MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why are so many subdomains detected in moz? even though I never made it.
I saw it in the Links -> Top Pages menu, here many sub domains were detected. even though I never made it, is that normal? multiple subdomains detected:
Product Support | | sem001234
w4bd5da.dummy.com
09x.dummy.com
7h5a.dummy.com
8d1y8ec.dummy.com
sfxpwzx.dummy.com
px0ke.dummy.com
uaj.dummy.com0 -
Unsolved How can I create a custom gift box using MOZ's products, and what are some creative ideas for designing the packaging?
Creating a custom gift box using MOZ's products can be a fun and thoughtful way to personalize a gift. Here's a step-by-step guide on how to do it, along with some creative packaging ideas: Step 1: Select the Products
Product Support | | MeltonMark8888
Browse MOZ's product catalog and select the items you want to include in the gift box. Consider the recipient's preferences, interests, and the occasion for which you're creating the gift box. Step 2: Choose the Box
Select a Galaxy Gift Box that will fit the products comfortably. It can be a plain cardboard box or a decorative one, depending on the overall aesthetic you're aiming for. Make sure the box is sturdy enough to protect the contents. Step 3: Gather Materials
Besides the products, gather materials for packaging, such as tissue paper, bubble wrap, or shredded paper for cushioning. You'll also need ribbon, twine, or other decorative elements for the finishing touches. Step 4: Arrange the Products
Arrange the chosen products inside the anniversary gifts for men . Place larger items at the back and smaller items at the front for visibility. Ensure that the arrangement looks aesthetically pleasing and well-balanced. Step 5: Add Filler
Add your chosen filler material to protect the products during shipping and to enhance the presentation. You can use colored tissue paper, shredded paper, or bubble wrap.
Gift Box Max0 -
Hi please help me process the refund. The money that was charge is for my mom's heart operation.
How do we process the refund for an account that has never been used. Please please help us.
Product Support | | Dugard-Property0 -
How to use moz to find spam backlinks
I am new to MOZ pro. I have lots of spam backlinks from a company that blackhatted me about 5 years ago. Can MOZ list these for me? I don't know how. Thanks
Product Support | | TomHW0 -
Moz pricing plans don't make sense
Hey. I posted a question about this on my other Moz account (one I use for moz local), but it appears to have been removed, so here goes again. Can someone from Moz please explain to me why that in your plans, as the price goes up and more campaigns are allowed, the amount of keywords tracked per campaign goes down? $149 plan - 5 campaigns - 450 keywords = 90 keywords per campaign. $249 plan - 25 campaigns - 1100 keywords = 44 keywords per campaign $599 plan - 100 campaigns - 3700 keywords = 37 keywords per campaign What confuses me here with your pricing plans is two fold Modern SEO requires a lot of quality content, interlinked together to rank well (in most cases). Your SEO guides even talk about this. Blogging is one of the most popular ways to do this. However, in any modest website these days, especially one that runs a blog, how does tracking only 37 keywords per campaign make sense? The fact is, that even your starter plan with only 90 per campaign doesn't make sense. My business website is tracking about 300 (that actually drive traffic). I provide my SEO clients with the same type of work I would do for my self, which again reinforces that 37 keywords is plainly pathetic. Every online pricing model I've ever seen follows one simple rule: When price goes up, you get more for your money, not less. At first glance you might think that is what you're getting when you step up a plan and get more campaigns, but then to have less keywords per campaign simply doesn't make sense at all. What does make sense is to have a more flexible pricing model. Instead of locking us into set tiers which don't really make sense, you should allow a more flexible pricing BEFORE we have to go up to enterprise. Why not have a per project price of 'x' price per month, then have a price per keyword or maybe per 100 keywords. This would allow all of us the flexibility to run campaign depths that make sense for us, not for your counterintuitive views of how we should be tracking them. Again, I'd really like a Moz staff person to respond to this as the last time I commented about this, it was removed.
Product Support | | Multiverse-Media-Group0 -
Moz Pro Free trial
Hi i got a coupon code from a hosting company for Moz seo 4 month free trial however after registering and entering my information i was charged 99$ even though it said todays charge = $ 0 i would like a refund as it doens't seem to a be a free trial
Product Support | | zemosdesign0 -
Why Moz Analytics says that my site had a 13% traffic increase and Moz Pro says that the same site had 3% decrease on traffic?
Every Tuesday The first thing I do in the morning is check my updates on my Moz Campaigns... Today the numbers just don't make sense... How come Moz Analytics and Moz Pro are showing different numbers? Does any one have the same problem? Which one should i trust?
Product Support | | Felip30 -
Moz Pro Account
How many campaigns can you have before you max out your Moz pro account?
Product Support | | alblaze200