Why isn't seo moz properly crawling my site?
-
In my campaign results, only 2 pages have been crawled, when there are many more. Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have. It's as if SEO moz is having trouble crawling through my site.
Any ideas on this?
-
Do you mind posting your URL so we can have a loot at it?
-
Thanks for the replies, but it never got past 2 pages crawled. I have no idea why this is. I got a message saying it may have something to do with user-agent discrimination, but I googled that and there's actually no one talking about it on the internet.
Google isn't indexing my site either. It's not a robots.txt problem, I've had that looked at. The only thing that has changed is that I upgraded the site from cscart v3 to v4. Not sure how that could change anything.
-
Yeah i'd give it a week. It will tell you on your campaign exactly when the next full-crawl is scheduled for. Wait for this date if you haven't already.
Otherwise contact their support team. The Moz team is quick to respond and a helpful bunch. Just don't call them SEOMoz or Rand will track you down and give you a frowny-face.
-
Hi -
Is it the Initial Crawl or Full Crawl ?
If its initial crawl, may be you should wait for the final crawl report. However, just a query - have you checked like - Are your pages not getting blocked by meta noindex or through robots tag... What are the sort of errors you getting
For further info should read this article that why the pages do not get crawled https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages-
If you still feel an issue - may be can write directly to Moz staff on - [email protected]
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a way to export all your crawl errors for multiple Moz campaigns at once?
We're looking for a simple way to export all crawl errors for our Moz campaigns. More than likely we could use the API, but was wondering if there was any functionality already built into Moz for exporting all crawl errors.
Moz Bar | | ReunionMarketing0 -
My crawl report only shows 1 link
Hello, I've tried a crawl for the site www.doctify.co.uk and it's only returned 1 link in the report which is the homepage. Do you know what the issue could be? Thanks, Nina
Moz Bar | | Global_Blue0 -
Problem Downloading Crawl Error Report PDF's
I am trying to download the PDF reports for the various 'crawl errors' - now some of them are quite large but would that justify why I am unable to download - the error is a straightforward one, see attached. Any ideas? Andy aDlViIN
Moz Bar | | TomKing0 -
MOZ crawl test is not reporting on all the pages on my site.
I've run the crawl test one of the sites I've taken over SEO for, however its only picking all the pages. For instance it indexes all the pages under xxxxx/us but none under xxxxx/au or xxxxx/uk The pages are being indexed as they're ranking in Google. Thanks.
Moz Bar | | ahyde0 -
Crawling password protected sites such as dev or staging areas to look at sites b4 going live ?
Hi Ive instructed clients to password protect dev areas so dont get crawled and indexed but how do we set up Moz crawl software so we can crawl theses sites for final check of any issues before going live ? Is there an option i havnt seen to add logins/passwords for crawl software to access ? cheers dan
Moz Bar | | Dan-Lawrence0 -
Moz / more changes on the way?
I love Moz and the community and all the tools here. I admit I haven't rolled around in all the new things rolled out a few months ago. I thought there were more changes on the way but I wasn't sure if those already happened and I missed them or if I need to be patient? Affiliate program, client reporting? Thanks for any response. Have a great weekend! Matthew
Moz Bar | | Mrupp441 -
I already have a campaign registered in moz, but it does not appear when I open Moz Analytics, as I proceed?
I received an email suggesting you upgrade to Moz Analytics, however to do the procedure my existing campaign stopped appearing and I can not access it, how should I proceed?I need back to Pro?
Moz Bar | | IBacana0 -
What happened to moz Crawl Test? Is it moved in the redesign?
Love the new design of moz.com! And the mentions tool is terrific. However, I use the Crawl test a ton and cannot find where to access it now.
Moz Bar | | jessential0