Open Site Explorer
-
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. **
Thanks,
Julie
-
Hey Julie,
Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Ninja -
Hi Julie,
Rogerbot isn't as big as other bots so it takes him a little while to get about. did you make sure you gave him enough time?
Now if you really need to you can also try other sites like Majestic SEO & ahrefs to find links but again they will also need a bit of time (though i tend to find them a bit faster than OSE). Other things to remember is the more you links to a page the easier it is for it to be crawled so if you don't have any links on it it can take a bit longer too.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why Moz Link Explorer is showing wrong data?
Hi everyone. I am using Moz Link Explorer to find relevant links from competitors and when I narrow it down to Link Type: Follow Status: Active I get the list. All good here... BUT ... Inspecting the actual link on the page there is a no=follow attached to it. Is this feature still working properly on the new Link Explorer or is a bug? Thanks!
Link Explorer | | Sorin_T0 -
Open Site Explorer Showing Blank Screen
Hi Moz Community, When I go to search for backlinks for any site, I am getting a blank screen after starting the search. This is happening to every search I perform for any URL or root domain. It's been happening for about a week now and I am not able to find any solutions. Any help would be greatly appreciated. Thanks! Ryan
Link Explorer | | RyanRhodesGW0 -
How can I get links indexed in Just Discovered Links, or Open site Explorer? (Because it aint Bit.ly or Feedly!)
Dear Moz & Forum, I've been on a bit of a merry-go-round with one of my clients. He knows enough about SEO to ask questions, and one thing he likes is to see the links that we are building inside Open Site Explorer. Now, of course we know that it takes a while for links to show, but that was ok, because we could just plug the links that we've built into a bit.ly link and then they'd show under Just Discovered Links in Open Site Explorer, and then boom, we're happy. It stopped working some time ago, and after the support team were a little unstuck I sent a hopeful tweet to @randfish. Here is the response: https://twitter.com/randfish/status/788412272129347584 The advice to use Bit.Ly was removed swiftly after this! Oops! The current Guidance is here: https://mza.seotoolninja.com/help/guides/research-tools/open-site-explorer/justdiscovered It says: Want to see your new link in the Just-Discovered Links tab? An easy way to start seeing your link in the Just-Discovered section is to have it shared on Twitter and available on Feedly link. Feedly stopped supporting their own link shortner a few years ago. Also, when you share a link from Feedly on twitter it is just the same as sharing a normal tweet, because it shares the standard URL for the site not a link to view on Feedly. Or, maybe these two statements are independant of one another and they should both be done separately? I've done that too! I've also added the feed to recommended feeds inside fresh web explorer and that didn't work either! So, Moz and Help team please help me! How can I get links I've built for clients into Just Discovered Links? Thank you!
Link Explorer | | stevestretton11 -
Inbound links that does not appear in open site explorer
There are several links to my website that are old, and are not indexed to locate in Open Site Explorer. Which may be the problem from appearing? This is shown in webmaster tools
Link Explorer | | hectordlux0 -
Campaign shows website links from Https. My site is not https but http:// HELP
When looking at my web campaign, I have inbound links pointing from every page located on my menu from https:// I do not have an https. website in any way. The weird part is that when I click on the link, it is a replica of my homepage, although in text only format. I have attached a picture for reference. Why and how could my top links be coming from this? I do not have any inbound links non https:// from my website Thank you! BNHHc5u
Link Explorer | | Morg56850 -
Repeated mysterious 404's from ancient site structure killing my rankings
Several years ago I changed my site structure to go from a flash based site to a blog based wordpress site. After doing so I went from page 1 to page 30 for my relevant search terms. I have employed people to help me track down the problem and I believe that they have narroed it to the existance of 404's being created from some unknown internal source. I have been for years getting links like this... <colgroup><col width="792"></colgroup>
Link Explorer | | dfphotographer.com
| http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/charisma-and-steve-301/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-04-2/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-12-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/feed/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-16-2/?share=email | ......regularly showing in webmaster tools, (this is from a top pages report from MOZ where there are hundreds also shown). When I do a moz crawl of the site, none of these links show up. Therefore I have no way of finding the source of these links (they also do not show me the source in WMT as they should). We have completely cleared the site and rebuilt it and although it is still only a couple of weeks in it still does not appear to have stopped them. Does anyone have any way of helping me find the source of these mysterious 404's?0 -
Removing the clutter of site-wide links
I have a multi-part question with regard to the moz link index and some presentation suggestions. Firstly I would be interested to know how the link index treats site-wide links with regard to metrics such as DA, and PA. We all know that it is highly likely that SE's are unlikely to pass full link value across from sitewide links, and therefore it would make sense for Moz values to account for this as well - if they do not already. One annoying thing that also relates to sitewides is that they tend to clutter the much of the information presentation in a few of the tools (you can't see wood for trees as it were). This is most prominent in the "Just Discovered" page - if you have a sitewides on a large site, you can often find that this screen is just totally filled with these links as they are found. It would be very useful to be able to filter these out, as they are of little interest - currently I can't see a way of filtering them out. A further value where they create to much noise is the 'Total Links' value. Where sitewides are included in this value, the value actually becomes pretty meaningless as you can find that the majority of that value is sitewides. It would therefore be useful if there was another value for 'Total Links - Excluding Sitewides' where maybe value of 1 was just added to the count for a site wide
Link Explorer | | James770 -
Links from no-indexed pages in Open Site Explorer
I just looked up a site in Open Site Explorer. After putting in the site, I get a list of domains, links etc which is very useful. At the bottom is a note which I have pasted below. It mentions "24 links from no-indexed pages" and says we can't get any info on these. Is there a way to see what the 24 links are so I can investigate further?"Why does my number of inbounds links listed not match my total links count? The listed number may be slightly different because we only show 25 links per domain (so that you see a variety). Additionally you have 24 links from no-indexed pages. Unfortunately, we can't get info for those links."
Link Explorer | | EdKim0