Specific external links
-
So...we have an A+ rating with the BBB and have for some time. We have a link from their page. We also use sites like pricegrabber and reseller rankings and have links from those.
What I can't figure out is why links from the BBB and Pricegrabber don't even show up in open site explorer but the reseller ratings links are everywhere. The BBB one is easily the oldest and the other two are roughly the same age (i.e. at least a couple years old.)
-
The Open Site Explorer indexed is completely refreshed every few weeks, and currently consists of 105 billion links. While that's quite a large data set and mostly comparable with other indexes in the space, it's still only a fraction of the links on the web and only a portion of the links Google undoubtedly knows about.
The way OSE finds links is that it prioritizes pages with lots of inbound links and links it found during previous crawls. Because BBB pages are often found deep-deep-deep under layers of navigation and usually don't have a lot of external links pointing to them, they aren't easy pages for crawlers to find on a regular basis. BBB has an especially difficult site architecture, and sadly this issue comes up a lot with that particular site
We're working on including more historical data in the index, so that even if we didn't crawl the link in the past two weeks, we'll still include it if we are reasonably confident it still exist. This will help alleviate some of these concerns.
The good news (or bad depending on how you look at it) is that while OSE doesn't show every link, it tends to show the majority of the most valuable links.
Regardless, thanks for the feedback and best of luck with your SEO.
-
I share your frustration in wanting to be able to track links in OSE. Someone at Moz told me a while back that OSE only reaches 20-25% of links out there. I've just come to tell myself that if I know the link exists then I don't need to see it in OSE.
-
I wonder if Moz understands and follows the Robots.txt file? I know at one point they never, back in the day when I used Moz most of my errors came from URL's which were hidden by robots which would not of caused errors for Google.
& what your saying Oren makes perfect sense if it's correct. Why would they want to crawl aggregated content.
-
Perhaps a Mozzer can verify this, but I remember someone saying they Moz doesn't crawl some big sites that aggregate lots of data (twitter, BBB, yelp, domain listings, etc. etc.) because of the size of their servers, and the likelihood that the user put it there themselves. They have smaller servers than say, Google or Bing.
-
Hi,
Firstly it could be that Open Site Explorer has not had time to pick them up, if it's years old then let's not forget the OSE manually crawls the internet and is not Google's crawler meaning there will be sections of the web which won't be crawled by Moz.
If it's old then there may be no links pointing to these pages which would not give OSE a reason to crawl them, certainly if it's years. Don't worry about it, a missing link on OSE is one less your competitors can find I had a similar issue with a few links from BOTW but in time it updated and works fine but Open Site Explorer is not flawless.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Improving ranking for a more specific keyword - eg 1 word
Hi there Ive managed to get my site ranking in top5 of Organic search for a 2 word keyword "keywordname australia" for example or "buy keywordname" - however finding it a lot slower process improving rankings for just the actual 'keywordname' Any suggestions as to what might be the best thing to focus on to improve a more competitive term?
Moz Pro | | IsaCleanse0 -
If links have been disavowed, do they still show in crawl reports?
I have a new client who says they have disavowed all their bad links, but I still see a bunch of spammy backlinks in my external links report. I understand that disavow does not mean links are actually removed so will they continue to show in Google Webmaster Tools and in my Moz reports? If so, how do I know which ones have been disavowed and which have not? Regards, Dino
Moz Pro | | Dino640 -
How to exclude a specific subdomain from SEOMoz Campaign?
Forgive me if I've overlooked something obvious, but how can I exclude a subdomain from a campaign? I want to crawl/analyze mywebsite.com, but not subdomain.mywebsite.com Thanks in advance...
Moz Pro | | ahockley1 -
How can we efficiently use Fresh Web Explorer and Just Discovered Links?
Love the fresh data sources SEOmoz is building for us. However, I'm frustrated by the lack of scale the tools offer. Let's say I have 30 competitors I want to watch (which is pretty conservative - if we're targeting 100 keywords on a site, we could easily have 100's of top 20 ranked competitors). If I have to run individual reports for each using OSE and Fresh Web Explorer, that would be hours of work every day/week. Ideally, I'd like to see a campaign feature where you could add 2-200 competitors to view in one report. You could view recent links (from FWE and JDL) for all competitors on one handy report, and sort by various metrics. So for example, if you wanted to view the top 10 links your competitors have gotten in the past week, you could see that in 30 seconds of work, vs many hours of work. Any others who think this would be useful? Any ideas for how we can use the data in such a way without this feature?
Moz Pro | | AdamThompson1 -
Benefits of reducing on page links
This is more of a discussion point. What would be the measurable results of reducing the number of on page links, specifically on a home page, but let's assume by way of a large navigation menu most of the pages have a lot of links" For instance, would any of the stats on the MozBar be affected (let's start with the home page). Would the Page Authority or MozRank change at all, perhaps because there is less "juice" flowing out of the home page? Thanks! 🙂
Moz Pro | | ntcma0 -
Links don't add up
Sorry if this is obvious, but I'm new to seomoz. I've run an analysis for one of my pages and it's showing 624 total links - 118 internal and 6 external. Why doesn't the sum of the internal and external links equal the total links?
Moz Pro | | landmark10 -
In the middle of Link Building campaign! Do you think Dog Blogs are a good Idea?
Hello Again, Here's I thing, my main website is my Digital Web Agency www.FenwayMedia.co.uk but I also hold good affinity with dog lovers on Facebook over 2100 friends and have a website www.Sepperro.com dedicated to my kennel of 9 racing Siberian huskies. In return I would give them exposure to my dog mediums (articles, links etc.) My only slight concern was relevance. However my thinkning is that as a Digital Agency surely you would be expected to have links coming from all sorts of sources as you "may" have had some input into the development of their site/ marketing etc. What do you guys think? Thank you once again. Kind Regards, Craig
Moz Pro | | fenwaymedia0 -
External Followed Links History, number of links go down
I was reviewing Historical Domain Analysis and found that in last 2 month we lost almost 10000 external followed links. What this could be? is this real or just question seomoz crawling? 30voy1g.jpg
Moz Pro | | ctam0