Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Search Behavior | | Alyaauditors0 -
Long list or paginated pages
Hi peeps, I am just interested in this from a usability POV and to see what you would prefer to see when you are met with a page that has multiple options. Lets say that the page looks like a list of services, each clearly marked out in its own segment, but there are 50-60 options that match your requirements. Do you like to keep scrolling, or would you prefer to take what is there and then move on if you feel you want to dig deeper? Would you like to see a long list, of have the options loaded in as you get to them? -Andy
Search Behavior | | Andy.Drinkwater2 -
Search Analytics update in Google Webmasters Tools? Where can we find search queries bringing traffic to website?
I just got up and see Search Analytic's being updated today totally. Their is no option to see old reports. As Search Analytics only share 999 keywords.
Search Behavior | | csfarnsworth
Whats next now?
How can a webmaster finds all search queries bringing traffic to his website?
Any paid or free tool?
Google Analytic's > Acquisition > Search engine optimization > search queries will this area helps? Whole question revolves around. Any good tool that will help you find all the queries bringing traffic to my website?0 -
Is it better to find a page without the desired content, or not find the page?
Are there any studies that show which is best? If you find my page but not the specific thing you want on it, you may still find something of value. But, if you don't you may associate my site with poor results, which can be worse than finding what you want at a competitor site. IOW maybe it is best to have pages that ONLY and ALWAYS have the content desired. What do the studies suggest? I'm asking because I have content that maybe 1/3 of the time exists and 2/3 of the time doesn't...think 'out of stock' products. So, I'm wondering if I should look into removing the page from being indexed during the 2/3 or should keep it. If I remove it then my concern is whether I lose the history/age factor that I've read Google finds important for credibility. Your thoughts?
Search Behavior | | friendoffood0 -
Canonical url for eshop, to do or not to do?
Hello everyone, I'm having a headache right now in designing a url base for a eshop. I would be thankful for any suggestions. Just to be clear about my problem, I'll be using this product example:
Search Behavior | | donatasBart
Product name: Product
Categories: Sale, Women
Brand: Superbrand Basicly every name of product, category or brand will resolve as url, if I enter url: /product it will open Product page /superbrand it will open brand page /superbrand/product will open product page from superbrand page /superbrand/sale/product would open product page selected from superbrand, then category sales /superbrand/woman/product would open product page selected from superbrand, then category woman So I will have many variations how to reach the product page, and of course i should set canonical url for it. I could set it just to /product , but then I don't know if I won't loose in terms of seo for other more detailed urls. Will google still index my other urls for product if i will state the canonical url in each product page? I know, maybe it would be the best solution to create a link like this: /superbrand_sale_product , which I can, but however it will be a duplicate content issue, since there will me many url pointing to the same product, and the only difference between them will be category, brand or whatever else... Thanks for all your ideas!0 -
Google Webmaster Tools notice of detected unnatural links to our website
Hi, We have been using SEOmoz for a good few months now and have found it incredibly useful. Unfortunately however I think we may have slipped up a little bit as we have just received the following message in our Google Webmaster Tools: Google Webmaster Tools notice of detected unnatural links to http://www.refreshcartridges.co.uk/ I have a funny feeling I might know what the problem is but I'd like a confirmation before I potentially go off on a wild goose chase. We also own the domain name www.computerarticles.co.uk and recently started introducing the author at the bottom of the post along with both a link to the website homepage and a link to a deep, popular page on our website. For example, check out http://www.computerarticles.co.uk/twitter-time-saving-tools/ We genuinely didn't realise this was a bad thing and thought it would just provide Google with a way of deep linking straight in to popular areas of our site. I would really appreciate advice as to whether you think it might be these links that are causing the problem or whether there is something else that could be causing the problem. In the event it is these links that are causing the issue would you recommend removing the entire 'about the author' page (as we have published around 500 pages on that site) and simply put a link in the blog roll or simplify it to just link to the homepage. I appreciate in advance any help you could give. Regards Chris
Search Behavior | | ChrisHolgate0 -
New EU Laws governing cookies; will Google Analytics still be usable after May 25th?
Hi, first time I've posted a question, New EU Laws governing cookies; will Google Analytics still be usable after May 25th? - apologies in advance if its already been covered, but I couldn't find any answers when I searched - google search showed someone else ask the question already, but no straight answers were given:- From May 25th the Privacy and Electronic Communications Directive will come in to force which prohibits the use of cookies without informed, prior consent from web users. I've been trying to research to see whether or not this will affect Google Analytics.The Directive seems to be designed to prevent behavioural tracking, rather than web stats, but after reading the directive (with no law experience) I'm fairly confused by what will be prohibited. If anyone has any thoughts on the matter, I'd be very grateful! 🙂
Search Behavior | | bendyman1 -
Where can I find research into consumer behavior in URL input?
I have a hypothesis that the % of users that type URLs is decreasing. Instead I think users will be arriving at sites by clicking on links in emails, search and social. Where can I find data / research to back me up?
Search Behavior | | TomCritchlow0