Crawling and Links - Showing Links
-
Hello
I have a campaign in Moz that shows a new site as having no domain authority and no links.
The site does have links to it, but they don't show up on OSE.
Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link.
What is the best way to see the links the site has?
Thanks!
-
Hey Radi,
The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
Just so you know, here's how we compile our index:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
- We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.
We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.
Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website Backlinks not getting Crawl by Moz?
Hi, I've the query related to backlinks of my website. Some of the high authority sites give backlinks to my website but these links are still not showing in Moz. My website is 6 months old and also continuously getting backlinks from high authority sites but still these are not showing on Moz and also not improving DA and PA of my website. I've also attached the screenshot of Moz link explorer results please check and guide me what to do with website so Moz will consider it and give some authority. And also guide me How much Moz takes time to crawl website backlinks and shown in their link explorer. Website URL: https://www.welderexpert.com Moz Expert Suggestions needed. Thanks, overview?site=welderexpert.com⌖=domain
Link Explorer | | KOidue0 -
Why I am seeing only 2 internal links in Site explorer?
Their are lot of links on my site but site explorer showing only 2 internal links. I don't know why. Can anyone help me please?
Link Explorer | | HSgr1000 -
How is Moz DA affected by spam links? Disavow file?
So it does not appear that moz let's you upload your disavow file. So when moz calculates your DA how do spammy links factor in? After digging through our GA it appears our site was hit with the 2016 penguin update and never recovered. Our weekly visitors were 2k, then dropped to 500 and have stayed close to that level for a while. We've used the disavow tool, without success over the past 3 years. During that time we have done link out reach and built around 10 legit good quality DA links since. But we have not recovered. At this point i'm thinking I should just remove the disavow file. Moz says our spam score for our domain is 5%.
Link Explorer | | jessicapremier0 -
Angular SPA & MOZ Crawl Issues
Website: https://www.exambazaar.com/ Issue: Domain Authority & Page Authority 1/100 I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this? List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff Adding dotbot to Express Server:
Link Explorer | | gparashar
prerender.crawlerUserAgents.push('dotbot');0 -
Why some of my strong backlinks don't show up in Site Explorer
Hello, Just was checking my backlinks and I see that few very strong backlinks are not showing up in my links list. I check with Moz bar in my browser and those are all dofollow links. Some of those sites link back to me a while ago. Thanks, Regards, Armands
Link Explorer | | A_Fotografy0 -
Are Just Discovered Links Reports Working?
I can't find my 4 month old site in Open Site Explorer. But as the site has had all of its posts tweeted I checked the Just Discovered Links reports to see if it was mentioned there. My domain is http://www.genesisclub.training but the problem is that if I target "this root domain" - I get a bunch of links that are nothing to do with my site. For example the root domain report includes sites linking to www.tinmagpie.training www.goahead.training powerquery.training http://videoproduction.training http://www.eti.training http://linkedinsales.training and more, as sites linking to my root domain. In which universe? The Just Discovered algorithm looks like it isn't coping with the .training TLD. It is treating my domain as if it were genesisclub.training.com so now anything.training is in my root domain.
Link Explorer | | diywm0 -
No back links showing in site explorer but..
I am quite surprise with this, normally site explorer show more and valid database for back links but this time its opposite. the site url is www.motortrader.com.pk webmaster shows me about 2000 where as site explorer is null. is there any particular reason for that?
Link Explorer | | Mustansar0 -
Moz crawler showing pages blocked by robots.txt
I've blocked a large number of pages which Moz were showing as duplicate or giving 404's in our robots.txt using /?key and /?p etc. However Moz crawler is still showing as being an issue. I assumed Roger picked up the robots.txt file, or is that not the case?
Link Explorer | | ahyde0