Why isn't seo moz properly crawling my site?
-
In my campaign results, only 2 pages have been crawled, when there are many more. Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have. It's as if SEO moz is having trouble crawling through my site.
Any ideas on this?
-
Do you mind posting your URL so we can have a loot at it?
-
Thanks for the replies, but it never got past 2 pages crawled. I have no idea why this is. I got a message saying it may have something to do with user-agent discrimination, but I googled that and there's actually no one talking about it on the internet.
Google isn't indexing my site either. It's not a robots.txt problem, I've had that looked at. The only thing that has changed is that I upgraded the site from cscart v3 to v4. Not sure how that could change anything.
-
Yeah i'd give it a week. It will tell you on your campaign exactly when the next full-crawl is scheduled for. Wait for this date if you haven't already.
Otherwise contact their support team. The Moz team is quick to respond and a helpful bunch. Just don't call them SEOMoz or Rand will track you down and give you a frowny-face.
-
Hi -
Is it the Initial Crawl or Full Crawl ?
If its initial crawl, may be you should wait for the final crawl report. However, just a query - have you checked like - Are your pages not getting blocked by meta noindex or through robots tag... What are the sort of errors you getting
For further info should read this article that why the pages do not get crawled https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages-
If you still feel an issue - may be can write directly to Moz staff on - [email protected]
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How does Moz gather the Keyword for my campaign in Moz Pro?
Looking at my campaign on Moz Pro and I was wondering where the keywords are generated from as I did not put these in. Can someone please explain?
Moz Bar | | House-Doctors0 -
Any Moz staff out there with Magento experience?
Would be great to hook up with Moz staff that are Magento-integration savvy. Or maybe qualified users . . . Need to go through Magento Admin in order to correct errors found in Site Crawl. Thanks, Steve
Moz Bar | | spiderx.ing0 -
Lack of UK Keyword Volume Data In Moz
Is it just me or is there a considerable lack of keyword Volume data for UK Google search terms on Moz? I have 53 keywords and not a single one has any keyword volume data - these are not obscure terms and include the following as examples... leather satchel, leather laptop bag, satchels, leather bag, leather backpack, leather school satchel. Without this information aren't a lot of the services offered by Moz rather academic as it is impossible to know which terms are really worth targeting. What is the solution? I could use US data and hope it is similar but this seems close to a deal breaker for UK subscribers.
Moz Bar | | MrFrisbee0 -
Cannot crawl website with redirect intalled on subdomain url
Hi! I want to crawl this website : http://www.car-moderne.ch. I tried a got back the crawl just for that one url (not for all the pages of the website). This single line cvs says that the status of the http://www.car-moderne.ch is 200, but in fact it is a redirect 301 to http://www.car-moderne.ch/fr where the live home page is (actually the Moz bar sees the 301, not the 200 as the single-lined crawl does). How can I proceed in this case (a 301 redirect being installed on the subdomain url) to still be able to have a full-fledged juicy cvs with all the broken links, duplicate content, etc. Thank you for your help! Pascal Hämmerli
Moz Bar | | Ethos_Digital0 -
I got a 404 in the Crawl Test Tool Report
I, yesterday i ran an crawl on http://www.everlastinggarden.nl and i get an 404. Does anybody know why this happens? <colgroup><col width="1535"></colgroup>
Moz Bar | | IMforYou
| # ---------------------------------------- |
| Crawl Test Tool Report | Moz,http://pro.seomoz.org/tools/crawl-test |
| www.everlastinggarden.nl |
| Report created: 15 Jul 18:34 |
| # ---------------------------------------- |
| URL,Time Crawled,Title Tag,Meta Description,HTTP Status Code,Referrer,Link Count,Content-Type Header,4XX (Client Error),5XX (Server Error),Title Missing or Empty,Duplicate Page Content,URLs with Duplicate Page Content (up to 5),Duplicate Page Title,URLs with Duplicate Title Tags (up to 5),Long URL,Overly-Dynamic URL,301 (Permanent Redirect),302 (Temporary Redirect),301/302 Target,Meta Refresh,Meta Refresh Target,Title Element Too Short,Title Element Too Long,Too Many On-Page Links,Missing Meta Description Tag,Search Engine blocked by robots.txt,Meta-robots Nofollow,Blocked by X-robots,X-Robots-Tag Header,Blocked by meta-robots,Meta Robots Tag,Rel Canonical,Rel-Canonical Target,Blocking All User Agents,Blocking Google,Blocking Yahoo,Blocking Bing,Internal Links,Linking Root Domains,External Links,Page Authority |
| http://www.everlastinggarden.nl,2014,404 : Received 404 (Not Found) error response for page.,Error attempting to request page | Best regards, Jos0 -
Where to find one off crawl report
Hello, I don't know if I am being a bit daft but I don't seem to be able to find the area where I can request a one off crawl report anymore (rather than setting up a campaign). Can someone let me know where this is now? Thanks!
Moz Bar | | RikkiD220 -
Moz showing warnings for each dynamic link despite canonicalization?
As you can see in the attached image, Moz is showing a warning for each dynamic URL despite a rel=canonical tag. Is this by design? If so, it is frustrating seeing as it is really just the one page with many links . . . 9h5oDmr.png
Moz Bar | | BlueLinkERP0