403 Error on WMT but not on MOZ?
-
Hello,
2 days ago I found there are about 1200 of 403 errors by Google WMT when I tried to fetch my domain - Please see attached
HTTP/1.1 403 Access Forbidden Cache-Control: private Content-Type: text/html ETag: "" Server: Set-Cookie: ASPSESSIONIDSSBARTSD=BEHMJHJBKJOEJEALECNNIPFH; path=/; HttpOnly X-Powered-By: Date: Tue, 18 Feb 2014 13:54:10 GMT Content-Length: 1233
<title>403 - Forbidden: Access is denied.</title>
Server Error
<fieldset>
403 - Forbidden: Access is denied.
You do not have permission to view this directory or page using the credentials that you supplied.
</fieldset>
I ran a complete report using MOZ but I was shocked not see any 4xx , 5xx errors. Google: 246 of 404 errors
No Google, Yahoo or Bing blocking
HTTP status code: ALL 200
301 redirect: none? I have done about 2500 over 4 years.
The website is losing indexed pages. I'm not sure what's going and which numbers to trust.
Please help. Thank you.
Adam
-
Hi Adam!
Thanks for writing in to Q&A! Let's dive right into this nitty gritty!
There are a lot of reasons you could be seeing these data discrepancies. If you're seeing more GWT errors, it could be because they have 'discovered links' through different means. Moz starts with your home page and uses recursive crawling to find pages on your site. We keep crawling until we stop finding unique links, or until we hit your page crawl limit. Bottom line, when we crawl your site your homepage is the only seed. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way.
403 errors are agent specific. There's also a possibility that on a server level you're blocking WMT from crawling, but not rogerbot.
I looked into your account, and it looks like we're only crawling about 3,500 pages. Also, we generally limit our crawls to about 200 links per page. When I looked into your account, I saw that in most cases you had well beyond 200 internal links per page.
We have a few different options moving forward. To help you further I need examples of the following:
-specific URLs that show GWT errors, but don't show errors on Moz.
-a link hierarchy from that URL that goes back to your homepage.I want to respect your privacy, so if you'd like to take this conversation offline, please email us at [email protected]!
I hope this helps! Let me know if you have any other questions!
Have a great rest of your Thursday!
Erin
-
It's difficult to say exactly what is wrong in this situation, but here are a couple of questions that might help narrow it down.
Have you tried manually going to the pages that appear to have these errors?
Did you recently change any URLs on your site?
Is the sitemap you submitted in WMT still valid?
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why is my website Backlinks Lower on Moz than on SEMRush?
Hi, I'm new to Moz and I am trying to find out why my website Birmingham Roofers has 7 backlinks on Moz it has 21 on SEMRush. However, I read somewhere online in one of your blog post that it crawls in real time.
Moz Bar | | ajegunle1 -
Accuracy of Moz Keyword Tool
I understand that no search tool is entirely accurate, but I'm seriously beginning to doubt the accuracy of the Moz keyword tool search volumes for keywords. For example: I entered "largest police departments" and it says 0-10 per month in the US, despite the fact that that term is directly responsible for 200 hits per day. Many alterations of that keyword come up with 0-10 or not determined. This is not a small error -- and it repeats over and over for other search terms that I have already ranked for in the US. It's gigantically inaccurate in a massive scale.
Moz Bar | | Luke_Proctor0 -
Significant difference with DA scores on Moz Chrome app VS Website Tool
I saw a big difference between DA scores on Moz Chrome app VS Website Tool. Which DA score is the correct one? I personally believe the scores on Moz's site is most accurate. Do you happen to have issues syncing the scored to your Chrome app? Chrome App VS. Moz Research Tool (https://mza.bundledseo.com/researchtools/ose/)
Moz Bar | | iPrice_Marketing
Moz.com: 92 / 88 Here's a screenshot of the difference: https://ipricegroup-my.sharepoint.com/:i:/p/jeremy_chew/ESy9lzUTC3lOl8o93Sx6LsUB8mYXo8LmYuUj2aa0xLXi1A?e=A6OrXs This was evident in other websites too:
Priceza (priceza.com.my😞 38 / 24
Shopback (shopback.my😞 43 / 41
Cuponation (https://www.cuponation.com.my/😞 27 / 250 -
Moz Crawl only crawling the top level page (1 page)
For the past few mounts my weekly site crawl has been inconsistent. One week works fine, it crawls all of my 500 or so pages. The following week it only crawls 1 page (http://mydomain.com) and nothing else. A few weekly scan go by and the crawl is back up the the 500 or so pages.I went ahead and created several campaigns with duplicate settings and crawled the site. Most times but not all the new campaign's crawl works fine crawling all pages. But within a week or two the weekly crawl will fail again. (crawling 1 page). Currently i have four campaign's all with the same settings running weekly crawls. 2 campaign's crawled the 500 pages and two crawled only the single page. Any help will be greatly appreciated
Moz Bar | | dmaude0 -
URLS appearing twice in Moz crawl
I have asked this question before and got a Moz response to which i replied but no reply after that. Hi, We have noticed in our moz crawl that urls are appearing twice so urls like this - http://www.recyclingbins.co.uk/about/ www.recyclingbins.co.uk/about/ Thought it may be possible rel=canonical issue as can find URL's but no linking URL's to the pages. Does anyone have any ideas? Thank you Jon I did the crawl test and they were not there
Moz Bar | | imrubbish0 -
How to make sense of data for this keyword (Moz Keyword vs. Google KW Planner)
The keyword "auto immune disorder" has an avg monthly (local/US) search of 880 in Google KW Planner with "low" competition In Moz, the same keyword has an avg monthly (local/US) search of 5 with a KW difficulty of 71%. I realize that the competition in Google KWP is based on ads, but is there a discrepancy when the search volume is so different in Google vs. Moz/Bing? Based on the above data, it seems like it would make sense to do a Google Adword (high search volume, low competition) instead of trying to rank organically...am I on the right track here? Thanks!
Moz Bar | | lulu710 -
Duplicate content errors
Hi I am getting some errors for duplicate content errors in my crawl report for some of our products www.....com/brand/productname1.html www.....com/section/productname1.html www.....com/productname1.html we have canonical in the header for all three pages rel="canonical" href="www....com/productname1.html" />
Moz Bar | | phes0 -
New moz analytics...will it have reporting?
Loving the new Moz Analytics...very shiny. Just wondering if it will have reporting tied to it at some point? Thanks..Jeannie x.
Moz Bar | | Jeannie.0