Discrepancies between google search console and OSE
-
Hi
google search console is showing root linking domains at 297 but OSE only shows 19
This was highlighted because OSE dropped from 50 to 19 since last scan
Regards Paul
-
Hi there Paul,
Sam from Moz's Help Team here! Sorry about the trouble - I know this can seem frustrating and confusing so let me try to explain. Overall, this is due to our method of indexing, which focuses on quality over quantity (if we're providing a summary of it).
When we collect this information for our link index it's actually expected that we won’t find every page and link because we aren’t looking for them all. When we collect this data, we’re looking specifically for the most valuable links and, rather than crawling your entire site or every site, we collect this by starting our crawler on a few highest ranking sites and letting it perform a breadth first search to see what it finds.
For each page that we crawl, we first collect each of it’s links before following these and collecting the details of each page that these link to and so on. There’s a set limit of links that we’ll crawl per page and pages that we’ll crawl per site so it’s expected that we may not follow every link on a site this way (so this means we may not always find all available backlinks/linking domains).
Open Site Explorer and the Link Analysis page of campaigns are both tied to our Mozscape index, which tends to update roughly once a month.
Just a few points on how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled ~130 billion URLs
The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available!
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories.
You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time.
Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.
It's also important to note that OSE is based on link freshness and diversity, so it's possible that older inbound links that were pointing to you have no longer been indexed. Our index only caches the link data it has for around 180 days - after that, unless the tool is prompted to re-crawl those sites, links will fall out of our index and no longer be included, which is why we always recommend consistent and continuous link building.
Generally, we recommend using a wide variety of backlink tools to get the most illustrative picture of how your site's backlink profile looks. OSE and Ahrefs index differently and have different purposes. Ahrefs is good for quantity while OSE is great for finding higher quality links. Domain Authority is our own proprietary metric that is closely correlated to Google rankings, so our customers often use OSE to research influential sites to build links.
I hope this helps - let me know if you have any further questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are Unlinked Mentions Coming Back in the New OSE?
Hi Mozzers, Just a quickie, with the unlinked mentions being retired, I was wondering if Moz have any plans to bring this feature back through the new link explorer? Many thanks! 🙂
Link Explorer | | Corbec8881 -
How many pages Google crawl in free version
I am using moz pro 30 days trial version.Can Anybody tell me how many pages moz crawl in a day or in a week.Because its two days and only 2 pages they crawled. Thanks
Link Explorer | | VarinderS0 -
No backlinks reporting in MOZ OSE?
We have a bunch of links and none of them report in MOZ OSE. Does the MOZ OSE tool have a cache that takes a while to refresh? We have recently moved over to CloudFlare and since the move the numbers do not add up. Here is a link to a ahrefs screenshot. Any insights would be greatly appreciated. moz.png
Link Explorer | | seanallen0070 -
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for sites - in a similar way you can compare sites using OSE
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for competitors sites - in a similar way to how you can compare sites stats - (DA, PA, Backlinks etc) using OSE's compare tool?
Link Explorer | | mike8780 -
OSE not picking up all internal links?
Hi! I've been checking a few pages in OSE. For example: https://www.holidayhypermarket.co.uk/holidays/last-minute This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
Link Explorer | | Blink-SEO0 -
OSE results vs. Google
Is OSE still a worthy analyzer of the factors breaking down Google rank of a page or website? More so over the past six months, I've seems to noticed how the page comparison in OSE seems to have less and less correspondence to Google rank. For instance, I'm analyzing sites where the top result has a Page Authority rank of 11, Subdomain MozRank of 3.53, outranking a page coming in in spot #14 with Page Authority of 36, Subdomain MozRank of 3.94. I see this frequently, that by the factors measured in OSE, a certain page with favorable scores is being outranked by a page with poor OSE scores. Of course, I realize how sophisticated Google's algorithm is and the OSE can't reverse engineer the whole thing. Also, there are lots of other factors, such as personalized search results, banklink velocity, and who's in my G+ circles, that isn't taken into account in OSE. Yet, I see this more-and-more, where websites kicking ass in OSE measurements rank poor, and poor websites ranked in OSE come out near the top in Google. So, given this, where OSE is apparently a less effective tool to help analyze the factors building Google rank as Google evolves and values brand, what should a chap do? I already know the predictable answers of do RCS, build your community, and so on. But, I want to know what's driving the juice behind these top ranking websites, and OSE doesn't seem to be cutting it anymore... Your thoughts?
Link Explorer | | ExploreConsulting0 -
Inbound links export report link redirect to OSE
Hi there, I have received email notification that my new inbound links CSV report is ready to export and download. I follow the OSE link but I am redirected straight back to the main page of OSE not the download. Is there a problem? Are the access problems due to the Moz.com and Research Tools Outage. reported on Moz Health? David
Link Explorer | | David-E-Carey0 -
OSE Export very slow
Anyone else having issues with Open Site Explorer? Been trying to export a backlink report for a website for the past 2 hours (the grey bar has been going that long). The site only has 1937 backlinks!!
Link Explorer | | Grumpy_Carl0