How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Link Explorer | | dlwnsh05100 -
Can I change the Link Explorer from check with Google US?
I'm trying to check the ranking keywords for a specific article with the Link Explorer, but when I hover over Ranking Keywords on the Overview it tells me that it's looking on Google US. We're a UK based company and the keywords we're trying to rank for are UK based - is there a way of changing this to match?
Link Explorer | | Kestra0 -
Moz showing +3M new inbound links. But nowhere to find them?
Hi there Moz is showing a +3M backlink rise in the dashboard for one of our domains. The site has always had around 350K backlinks and in Ahrefs and Majestic it still shows this number. But Moz shows a growth of +3M in the last two weeks. Is there a way to see where these backlinks come from in OSE? I can't seem to understand how it is possible to see this somehow. Can it be a mistake of Moz maybe?
Link Explorer | | snorkel1 -
Why is the company reference of "designed by" with a link back my web development site not being indexed as a link?
Using the Mozbar I am analyzing my links and my competitors links. I am noticing other web developer sites are getting credit/index links from all their client's websites with the "designed by...." link in the footer. However, for me I only see one "inbound link" in the link analysis report. Sometimes I notice a company getting several inbound links on one site they built. I have built many other sites and have my company link below on all the footers. Why are the other sites not showing up as "inbound links" on the link analysis report? Thanks for your help! Nikki
Link Explorer | | NikkiPatt0 -
Why moz is not showing My Website External Backlinks?
Google Webmaster showing my external links 41
Link Explorer | | djsamrock
Majestic showing my external links 28
Ahrefs showing my external links 13
&
Moz is showing my external links 0... Will anyone please explain Why moz is not showing My Website External Backlinks?0 -
OSE Inbound Link Report Exports Returning Blank
We're trying to download a larger OSE report of inbound links and the report only has headers and no actual data. I'm logged in, so is there a bug here?
Link Explorer | | Highland0 -
Page Authority = 1 of linking page?
I am trying to determine if any of our PR services or inbound links are hurting our SEO. To do this I am using the Open Site Explorer tool and checking some of the URL's that link to us. While doing this I found a page that has a Page authority of 1/100 most other links have a decent authority...does this score mean this page has been penalized by Google? If not what else could a 1/100 mean?
Link Explorer | | Bertrand131 -
Link Tracking
Is there a way to utilize MOZ to view all links pointing to a website? Any other ways to fine tune the link analyses process when it comes to quality SEO?
Link Explorer | | WebMarkets0