Do the SEOmoz Campaign Reports follow Robots.txt?
-
Hello,
Do the SEOmoz Campaign Reports (that track errors and warnings for a website) follow rules I write in the robots.txt file?
I've done all that I can to fix the legitimate errors with my website, as reported by the fabulous SEOmoz tools. I want to clean up my pages indexed with the search engines so I've written a few rules to exclude content from Wordpress tag URLs for instance.
Will my campaign report errors and warnings also drop as a result of this?
-
Thanks Chris and Sam. The confirmation and additional resources helped.
-
Hi,
Rogerbot does adhere to your robots.txt file as mentioned here under the section heading How come rogerbot isn’t crawling all of my pages?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Campaign Keyword Overview?
This may be more of a developmental comment, however... Is there any way to pull an overview of keyword ranking over the week (or any period of time) for one of your campaigns? It looks like you can pull graphs on individual keyword performance, however not for the full set of keywords for a campaign. Anyone have suggestions on how to do this within Pro Moz... or is it best to compile the keyword data every week and track it in Numbers or Excel? Thanks everyone!
Moz Pro | | Treefrog_SEO0 -
OnPage report check
Is anyone else having issues with onpage report card on SEOmoz: I keep getting this message: The change you wanted was rejected. Maybe you tried to change something you didn't have access to.
Moz Pro | | deaddogdesign0 -
Video SERP and Seomoz ranking
It seems that my keywords that lead to videoresults in SERP, is not being ranked on Seomoz! How come when i rank #3 on a certain keyword with a videoresult Seomoz is displaying me as #15 (which is the second of my pages in SERP)? What is the reason for not counting the video-result in the ranking-tool?
Moz Pro | | alsvik0 -
Sharing/Transferring SEOMOZ campaigns
What happens when you are no longer working on a campaign, and your client needs the campaign history? I don't pay for my account, my employer does. If I ever have to move on what should I do with the account? I would want to keep my seomoz profile and Q&A history. But the campaigns belong to my employer so I would have to change all of the profile settings into his name… Is there a protocol for this kind of situation?
Moz Pro | | BeTheBoss0 -
SEOMoz Pro still hasn't crawled 10k pages for one campaign
I looked for a question in the forum already for this but couldn't find anything. Perhaps I am using the wrong keywords, so I apologize if this is a duplicate. I recently signed up with SEOMoz Pro and added two campaigns. For one campaign, 10,000 pages were crawled. For the other campaign, only about 300. It's been 2 weeks since I created the campaigns. Is there a way to force a crawl of the site associated with the second campaign?
Moz Pro | | SharieBags0 -
How would you set up campaigns?
Hi Guy's, I have a question about campaigns, We run a eCommerce website with several categories with sub cats/ i.e. natural hair care Natural Shampoo Natural Conditioner Natural Treatments natural Skin Care etc etc My question is this... do you use campaigns to separate the sites sections up? or do you run one campaign, trying to get my head around the best way to target my sections for performance/keywords etc... Thanks Daniel
Moz Pro | | LushDuck0 -
Why is Roger crawling pages that are disallowed in my robots.txt file?
I have specified the following in my robots.txt file: Disallow: /catalog/product_compare/ Yet Roger is crawling these pages = 1,357 errors. Is this a bug or am I missing something in my robots.txt file? Here's one of the URLs that Roger pulled: <colgroup><col width="312"></colgroup>
Moz Pro | | MeltButterySpread
| example.com/catalog/product_compare/add/product/19241/uenc/aHR0cDovL2ZyZXNocHJvZHVjZWNsb3RoZXMuY29tL3RvcHMvYWxsLXRvcHM_cD02/ Please let me know if my problem is in robots.txt or if Roger spaced this one. Thanks! |0 -
Trifecta Report (domain)
Recently i have found that the data in the trifecta report is becoming less complete. For the last few sites i found that the report returned about half of the metrics it was looking for. For instance, it mentioned that one of the domains did not have a dmoz or wikipedia link/page even though they had both? Also, it rarely returns the Yahoo Site Explorer metrics even though when clicking to see the source the data is there? Are you guys planning on phasing out this tool, if not it seems like some work needs to be done on cleaning it up. Thanks!
Moz Pro | | kchandler1