MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Issue with MOZ Keyword Tracking: Missing Keywords in Report
Hello, I’m encountering an issue with MOZ’s keyword tracking tool. We have correctly set up our website: https://recomendacionpersonal.com/ to track multiple keywords, but the tool only seems to track a few of them. Some important keywords we’re targeting don’t appear in the report at all. We are in the trial phase and need to ensure the tool functions correctly for our SEO strategy before subscribing to a premium plan. Can someone please help us understand why this might be happening and how to fix it? Thank you!
Product Support | | gabo12120 -
How to del the account of moz
i dont wanna pay but know i take trail but i wanna del the account but dont know how to del
Product Support | | Nobody16068513179450 -
What do the Moz user levels mean?
I see that there are 3 other levels to a Moz Community Profile that users can have outside of the traditional 5 levels earned through points (Contributor-Oracle) and they are Pro, Associate and Staff. Obviously, Staff is someone who works at Moz but what do Pro and Associate mean and how do you get them?
Product Support | | authority-networks1 -
Still no invite to site crawl beta! Why bother?
Well, I was informed that I was en-queue to be invited to the Moz Site Crawl v2. I have several client sites making use of SNI b/c, well... CDN's. What is the point of telling me I may receive an invitation shortly, then hearing nothing back and not being able to crawl their sites... this makes this service 100% useless as I can simply use a couple of different tools (free) to perform the same tasks... don't get me wrong... I would rather use Moz and this is not intended to flame the service as I think it could be great... if only it worked. I cannot justify the lack of response, nor the lack of service (what we intended to use here) for the price. It seems like this is simply a waiting game wherein Moz expects me to pay for this service and THEN I will receive my invite? Is it at all possible that anyone can look into this and/or my invite status. If I cannot sample these features before long, you've lost a solid potential client. (Not my loss)
Product Support | | jmsdonline0 -
How to use moz to find spam backlinks
I am new to MOZ pro. I have lots of spam backlinks from a company that blackhatted me about 5 years ago. Can MOZ list these for me? I don't know how. Thanks
Product Support | | TomHW0 -
Moz Local support -- please address our dashboard issues.
We are experiencing issues with two client locations for Hillcrest. Hillcrest Home Care and Hillcrest Hospice Care. The Hospice Care location is displaying as Home Care, and one of the duplicate Home Cares is saying it is paused. This might be due to the fact that Google flagged Hospice Care as a duplicate of Home Care, because they are at the same address but have different suite numbers. Please help ASAP. Thanks.
Product Support | | LM360_Digital0 -
I'm tired of logging in to MOZ
I like this site, I really do, which is why I visit multiple times a day. But I grow weary of these premium sites that require me to log in multiple times a day. This morning I was simultaneously working at ordercup.com, strengthcoach.com, and moz.com, and all three log me out at every turn. Argh!!! What's worse is that some MOZ pages think I'm logged in and others don't. I don't fully understand the logic behind the curtain, so I wander from page to page trying to get the login in sync. Why can't these sites work like lynda.com where I can stay logged in for days and weeks? To top it off, LastPass rolled out a new release that broke auto-login. All this logging in is getting in the way of me getting anything done.
Product Support | | ChristopherGlaeser3 -
Are there tutorials to best learn how to use my Moz campaign?
I just recently created a Moz campaign and while some features are intuitive, there are many that I don't completely understand. Are there tutorials somewhere on Moz.com to help maximize my campaign efforts here?
Product Support | | leslieevarts0