OPen Site Explorer listing criteria?
-
Checking link data for a potential client who has given me access to their websmaster tools account, I've noticed that Google list over 150,000 "Links to Your Site" but yet OSE only reports a tiny fraction of this number.
I have manually verified that there are in fact direct links from the sites that are listed in Webmaster Tools but not in OSE.Does OSE discard some links? Is there a reporting lag? Does anyone know why there would be such a large discrepancy?
-
Thanks anyway but no this client has never before done any structured SEO or link building. The site is a long established site with thousands of clients linking back to it and the checks I've done show that they are natural links.
I'll do a bit more digging but my previous observations had been that GWT underestimated the links versus OSE or previously Yahoo Site explorer. This is so far the other way around it is odd. -
That does seem a little odd. I tried finding info on how many links Google claims to have indexed, but couldn't find a reliable source. We indexed 38 billion domains and 387 billion links in our last Linkscape update.
That said, with how our crawlers work, if you're getting backlinks on domains with loads of other links on the page (which often happens if you're buying links), our crawlers will not grab every link on the page and that would definitely lower your backlinks profile with OSE.
-
Thanks Erica but in this case there are 19011.4% more links in GWT than OSE.
Would your diagnosis explain a gap of that magnitude or should I be looking for something else? -
OSE's data comes from our own crawlers. The simple fact is that our crawlers do not reach the same amount of data that Google's do. We're working on it and continually improving this. We use our own crawlers because we believe in the quality of getting the data for ourselves.
Hope this helps!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Complex Rankings Issue For A Law Firm Site
Be warned, this is a complex issue that I have and will require someone who has some advanced knowledge about 301s and link penalty’s. I have a law firm client whose site is having some issues. There are some very complex details here so I'm going to articulate them in bullet points in hopes of making the issues easy to understand. So here's my root problem: We have poor organic rankings (4th, 5th, 6th page for most terms) despite Domain Authority of 32 (avg. 1st page competitor is 28) and some very strong white hat link building the last 60 days or so. How's their backlink profile look, you ask? When you look at their backlink profile in OSE, their spam score is a 1/17 (not sure if that's credible in any way). Lot's of links that score 5's on the spam score make up about 10% of their OSE links. Here’s where it gets tricky; those links are not directed the client's New URL, they are links that go to some old URLs the client used to have, for which they had an SEO guy who built all those crappy links. Those URLs with the crappy links (we'll call them The Crappy URLs) were 301'd (can we all agree 301'd is a verb?) to the NEW URL for just a couple of months. Shortly after that, NEW URL dropped almost completely out of Google, so the client turned off the 301s. So despite those 301s being turned off, OSE still shows all the links going to The Crappy URLs but is giving The New URL credit for them. Keep in mind, the 301s were turned off about 6 months ago so it’s a little strange that OSE still shows those 301s. This has led me to the conclusion that the Domain Authority that OSE shows of 32, is not a “real” number since it is seemingly based off links inherited from 301s that no longer exist. So now I’m trying to create an action plan for this client that will hopefully help us start to make some real progress in our rankings. This client does not have the budget to wait another 6 months for some sign of hope so time is of the essence. Here’s my theoretical action plans I’m choosing from and would like the communities input on which, if any, they feel is best (Also, if I’m missing something or you have an idea, I’m all ears): **Potential Action Plans: ** Do nothing, keep building quality links, creating quality content, monitor crawl reports/gwt for issues. That strategy is going to win long term. #1 + Create one page sites on The Crappy URLs, setup GWT for them, submit sitemaps thus forcing Google, OSE and other web crawlers to index them, thus removing any potential residual penalties from the 301s. NOTE: Currently The Crappy URLS are just landing on GoDaddy’s default landing page which is of course not being indexed by Google or OSE. #2 + Disavow all the bad links going to The Crappy URLS. Then once the bad links no longer appear in the OSE profile for each of The Crappy Sites, 301 them again, thus inheriting the good links but not the bad. #1 + 301 the Crappy URLS back to the New URL, while also disavow any links going to The Crappy URLs. The logic here is that if the road back to recovery is going to be a few months away no matter what, when the 301 knocked them back 6 months ago no reputable link building was being done. I am cautiously optimistic the linkbuilding we are doing will eventually off set any penalty’s coming from the 301s. Plus now we’ll know the 32 Domain Authority OSE is giving us is real. This is the one I’m leaning towards quite frankly because I think it will reduce the recovery time and we’ll know somewhat quickly (30-60 days) if it’s actually working. 1-3 could each take 90 days before we know if it’s working. So please, if you have any expertise with any of this, your help or advice would be appreciated. I’d rather not share The New URL for obvious reasons but if you must know, simply message me and as long as you’re legit, I’ll share it with you.
Moz Pro | | BrianJGomez0 -
How reliable are the external link metrics found in the Open Site Explorer research tool?
I have noticed huge discrepancies with the external link metrics of one of the websites that I have been tracking since the launch of the website. Shortly after launch I captured a screenshot of the external link metrics to the website to track the progress. As I look at the same Open Site Explorer metrics now (2 months later) it has increased by 900% which is very inconsistent with the amount of link building done for the client. Thanks!
Moz Pro | | michaeleagar0 -
Open Site Explorer Social Media?
Open Site Explorer always reports only a few facebook likes. If I go to the business page of the site, it has 100+ likes. This seems to happen a lot. Is this a OSE issue or is there an issue with the site clearly being defined to google as a connected facebook account? If OSE doesn't see the likes, will google? How can I fix?
Moz Pro | | JML11790 -
Site Optimisation for ktichens!!
Hey Guys, I am about to begin to optimise this site www.stuartandersonkitchens.co.uk for some keywords such as edinburgh kitchens, quality kitchens edinburgh etc as he is based in edinburgh. I am also going to be doing some work behind the bones of the site optimisiing alt, meta data, micro data etc. Also I am thinking about creating a FB, Twitter, Youtube profile and possibly adding him to a few directories (DMOZ etc), some local & running a small adwords campaign using the freebie credits. I will be altering some of the content in order to have it more amicable to the engines. Is there any other advice anyone would like to give me, where I could improve in order to have him seen on the search engines. Be great to here your take on this. Thanks again, Craig
Moz Pro | | fenwaymedia0 -
Opensite explorer not showing facebook/twitter other sites
hello i have had my site live and indexing for 3 months however open site explorer doesn't show the facebook or twitter linkback from my corporate sites. any ideas why this would not show in opesite? it doesn't show in google WMT either. my site: http://cheap-airport-taxis.com/
Moz Pro | | smashseo0 -
OSE lists dead links
Going over the link profile of a competitor who gets 5x the traffic we do.... of course frustrated that the majority of their links are spam blogs (full of words but don't communicate anything) and forum profiles. Thanks Google for telling me what not to do, then rewarding my competitor for doing it shamelessly. Question regarding sites listed by Open Site Explorer as linking to said competitor, but that don't even load when I visit their url. Some go to a godaddy parked page, like the domain name expired long ago. Is this simply a limitation of OSE, and can I assume Google has indexed differently and therefore awarding no link juice from these urls?
Moz Pro | | jotham20 -
Where is the best place to add links on my site?
If I'd like to put links to other sites in my site, is it better to have a page named "Our Helpful Links" etc. instead of just adding them to the bottom of an existing page like I've seen on some sites? I'm asking because I'm wanting to make Google as happy as possible and still add them. Just in case it helps to look at the site yourself to give advise its; http://www.allstatetransmission.net If you see anything else there that I should work on feel free to be hard on it, I value any criticism. Thanks, Jeff
Moz Pro | | allstatetransmission0 -
Yahoo Site Explorer died. Does DA and PA Seomoz parameters have all it takes to replace YSE?
We're trying to simplify our link analysis job when acquiring a new external link. We're wondering to know if Domain Authority Seomoz parameter is all what we need to take a decision. Does DA Seomoz parameter takes into consideration 'domain age', 'alexa ranking', 'dmoz links', indexed pages on google', and 'inbound links vs outbound links'?
Moz Pro | | seoneogames1