Open Site Explorer
-
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. **
Thanks,
Julie
-
Hey Julie,
Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Ninja -
Hi Julie,
Rogerbot isn't as big as other bots so it takes him a little while to get about. did you make sure you gave him enough time?
Now if you really need to you can also try other sites like Majestic SEO & ahrefs to find links but again they will also need a bit of time (though i tend to find them a bit faster than OSE). Other things to remember is the more you links to a page the easier it is for it to be crawled so if you don't have any links on it it can take a bit longer too.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can MOZ keyword explorer output sentences instead keywords?
Can MOZ keyword explorer output sentences instead keywords? We need to optimize our website for the Knowledge Graph (OG). There was an old tool that does it, but I can't remember its name.
Link Explorer | | Elchanan1 -
My site links to my clients not showing in Moz
I've got a web design business with a site that's been out there for 17 years - www.biztoolsone.com. I've got links to my clients' sites in my portfolio page. The backlinks list for my clients, when I check them in Moz, don't show the links from this site. They always showed in the list until a few months ago. The site has a DA of 59 & PA (for home page) of 50. The spam score is 0/17. I'm having a tough time telling my clients that the Moz backlinks list is accurate when that site doesn't show in the list. The same is true for www.fayettevillenc.biz - this is one I created years ago to generate backlinks. It's got a spam score of 4/17, so I'm a little more understanding of that one. Thanks for any guidance!
Link Explorer | | wcksmith10 -
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer?
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer. What is the cause of this? We've checked the robots.txt and htaccess file, but so far we can't find anything that would be blocking Moz from crawling the internal links. We manage loads of other clients on this platform and this is the first time we've run into this issue. What else can I check?
Link Explorer | | OozleMedia0 -
I crawled my site, but an old crawl report still is visible
I crawled my site recently, but an old crawl report still is still all I can see
Link Explorer | | Bigjim0 -
Backlinks not showing on Open Site Explorer's Just-Discovered Links
Hi guys! My name is Edgar. I've recently been adding a bunch of backlinks to the site i work for, and most of them have a very high DA (DA > 80. Wohoo!). Nevertheless i'm often feel a bit frustrated when i check my site with the OSE, because just a few part of these links are showed in the just-discovered section, although i created them few days ago. So, i would like to know why is this happening, how long it take for my links to get crawled, and when can i stop getting frustrated on this? Than you very much! Edgar.
Link Explorer | | PCBU0 -
[No Title] for all Top Pages at Open Site Explorer
49 out of the top 50 pages of the domain www.parallels.com shows [No Title]. I find this to be a major concern. Pages have long been established, title tags haven't changed recently. Am seeing a fair amount of 301 and 404s showing up, but actual OK 200 pages still showing [No Title]. Also seeing some decreases in organic search traffic at Google. Might there be a correlation?
Link Explorer | | ChristianMKG0 -
Open site Explorer Facebook Shares
In open site explorer I have been trying to increase my Facebook Shares and likes. I recently posted my URL and got over 150 likes but none of that has been showing up in open site explorer. I noticed my profile was set to private so I went back and made sure it was public and the shared link was public but nothing. Can anybody explain to me what exactly the Facebook share is measuring? Because the explanation it gives me isn't working for some reason. Perhaps it takes a bit longer for Facebook measure than Twitter or Google Plus, but it has been a few days and I would expect it to have registered by now. Any help would be great. If it helps you can help check it out. My URL is http://www.baselinedental.com Thanks!
Link Explorer | | BDP19780 -
Is there an efficient way to use Open Site Explorer to find unnatural or harmful links
We have a new client with 8 sites that we would like to 301 to a new site. However, before doing so we want to make sure that the backlinks are not unnatural or harmful in any way. Using open site explorer (other than just looking at exact anchor text vs brand anchor text ratio) is there a way to determine low quality inbound sites linking in? or any type of links google will find manipulative?
Link Explorer | | Bryan_Loconto0