How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can't see the link I earned from Moz in OSE
Hi Mozzers, A month ago I got the nofollow tag removed from the first custom link on my Moz profile but I can't see this in our links on OSE? SEO Spyglass shows it just fine. Is this related to the delays in the back end of Moz or have I set up my profile wrong? Cheers! Jamie
Link Explorer | | SanjidaKazi0 -
Why MoZ Bar gives different PA and DA to my homepage? Surly they should have the same metrics?
Hi guys, is it normal that when looking at my homepage with the mozbar i get the same DA and PA? It seems that it should provide the same results. Thankss
Link Explorer | | artdivision0 -
Just Discovered links - How long before they are counted toward the PA scores
I have a new website I put up in the last 90 days. I have been watching the DA, PA and Keyword rankings. Once I set up the campaign I got a report back a week later and some data showing some keyword rankings and some DA & PA scores and links showing from 2 domains. Since this time OSE has Just Discovered 16 more backlinking domains - however the DA and PA scores have not changed ? How long after the new Just Discovered backlinks before they affect the scores I am seeing for my DA & PA ? Thank you in advance for any insight on this matter, Happy Holidays - Joe
Link Explorer | | jlane90 -
OSE - Link Opportunities
I'm checking out this new Link Opportunities feature for one of our sites and what I'm seeing right now is pretty disappointing. For Reclaim Links, everything listed is an internal link on our site. It's got tons of URLs from our old Iciniti structure (replatformed to Magento mid-March). It's crawling tons of stuff that's blocked in robots. There are no links from external domains in the first 5 pages. For Unlinked Mentions, it's showing tons of mentions - 33,566 to be exact, a ridiculous number - mostly from news sites like Forbes, WSJ, Guardian, CNN, etc. These sites are not mentioning us. It's set up to look only for our brand name or domain name, so I don't know how it's thinking there are all these nonexistent mentions. What's going on with Link Opportunities?
Link Explorer | | Kingof50 -
Page Authority dropped to 1 for subdirectory in my site
Hey, one of my sites https://www.automationanywhere.com/testing has had all it's pages drop to a page authority of 1 in Moz and the campaign doesnt appear to be indexing any pages from this directory. We launched a new site in this directory on the 12th and havent been getting any moz love since. The pages are indexable and followable, and are being indexed by google and others. The site on the root domain has been unaffected. Please help me get my moz campaign back on track. Thanks!
Link Explorer | | aatethys0 -
External link numbers down year on year
Hi, Just wondering if anyone knows why a website that has definitely had some links acquired over the last year would now show less links and from fewer referring domains than they had this time last year? How is that possible - assume it is down to the way OSE / Moz crawl the web and collect data but need a definitive explanation for a client that has noticed the drop in link metrics and as a result authority. Many thanks,
Link Explorer | | lollowe0 -
How can I get a list of all the links going out from my website
How can I get a list of all the links going out from my website and from which pages of my site. can I get this list using Moz, I also have ahref.com account, can I use that if yes how or do I need to use some other tools. Thank you
Link Explorer | | SinaKashani0