How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Backlinks aren't shown
Hi, my site has 15 backlinks from sites with 50-90 da. and only 4 of them are shown on the moz's backlink checker, While on google console and on different platforms, I do see most of them. All of the links are dofollow. I even tried the link tracking list and all the domains are shown as not linking to my domain, while they are. Any idea what is happening? Thank you.
Link Explorer | | Yair1231230 -
What's the easiest way to see a list of domains ranking well for a keyword with its DA and traffic numbers?
Hi. I'm trying to figure out how to easily see, for a given keyword, the ranking domains, their domain authority, and their traffic. Is it possible to get this all on one screen?
Link Explorer | | scott.thomason.scott80350 -
Inbound links for https://www.example.com versus just example.com
Hi all, Wondering the difference between the Inbound Links stats for https://www.example.com versus only using example.com. When I type in the https:// version, I see 3 Spam Flags - for the example.com version, there are none. There are also spammy links pointing to the https version as opposed to the non-https version when I use this tool: https://mza.bundledseo.com/researchtools/ose/ Anyone know the difference and which should be regarded when fixing spam issues?
Link Explorer | | netamorphosis0 -
No backlinks reporting in MOZ OSE?
We have a bunch of links and none of them report in MOZ OSE. Does the MOZ OSE tool have a cache that takes a while to refresh? We have recently moved over to CloudFlare and since the move the numbers do not add up. Here is a link to a ahrefs screenshot. Any insights would be greatly appreciated. moz.png
Link Explorer | | seanallen0070 -
MOZ competitor analysis tool
Hi Guys Has anyone also noticed that the MOZ competitor analysis tool does not always pick up on all back-links? If I put two competitors into MOZ and Ahrefs I get so many more back-link info from Ahrefs. Has anyone else experienced the same issue? Thanks Jon
Link Explorer | | NaughtyChilli0 -
OSE Links CSV: Download Failed - Server Problem
I'm just trying to download our Links CSV from OSE and I keep getting "Failed - Server Problem" and I got a bad gateway page when I clicked the download link in the email. Is there a problem atm?
Link Explorer | | SanjidaKazi0 -
Hi guys. My site, www.x-mini.com attained more links and got better alexa ranking. However, my DA and PA dropped. How can I explain this?
My site, www.x-mini.com attained more links and got better alexa ranking. However, my DA and PA dropped. How can I explain this? Siz5lkp.png
Link Explorer | | Dineshr840 -
Open Site Explorer only showing 10 internal links, and 270 external links
Hi, I run the website www.abackpackerstale.com ,and for some reasons opensite explorer is only showing 10 internal links, and a 200 and something external links. How can I fix this as I am sure it is hurting my DA authority, and overall site score. Thanks! Stephen
Link Explorer | | backpackerstephen0