Best way to filter out the nofollowed links from WMT?
-
When I'm downloading links from WMT to audit them for my unnatural links clients I generally check each individual link. If it is a nofollowed link I make a note that it is nofollowed and move on. I'm thinking that there has to be a quicker way to find all of the nofollowed links so that I can filter them out from the beginning. How would I do that?
-
Yes, that's right. What you'd end up with is a small list of URLs that have nofollow anywhere/somewhere on the page. If it's a big list of 5000 links and this tool can trim it down to maybe 200 having nofollow somewhere or 500 or 2000. In either case, it's a small list. Definitely not a solution to what you are looking for.
-
Hmmm...interesting. I was just playing with screaming frog and thought I had it because you can upload a list of links and then when you export them there is a column for "nofollow", but that column means that the page is nofollowed. That means that a nofollowed link from a meta robots follow,index page would not be flagged.
I see what you're saying about searching for nofollow on the page, but I can't see it being specific enough. A lot of pages may have for example nofollowed comment links but my link in the article could still be followed.
-
Marie
What you could do is use Screaming Frog to crawl all the links (the combined list of ahref links and WMT and then use the custom filter to check if the domain is there, ie your link is there and then the 2nd filter to check if there is the word nofollow anywhere on the page. It's not going to be a perfect list, because you may end up seeing a page that is linking to you, but is nofollow'ing somebody else from the same page.
But then most of the times, the regular links, they are either nofollowed or they are not. "Mostly".
I hope this helps.
-
agreed and good point. (That is why we end up with soooo much SAS).
Thanks -
Thanks Robert. Yes, I usually do use ahrefs and the links from there are nicely marked as nofollowed and easy to filter out. I generally combine the links from ahrefs with the links from WMT and remove the duplicates.
I find that often there are links that are only on one list and not both. For small sites that's not a big deal, but for a large site there may be thousands of nofollowed links that only exist on the WMT list. I figured that if I could find a way to filter out the nofollowed links from the WMT list as well then this would save me a lot of time.
-
Marie,
Have you used ahrefs.com before?
If not I think it will be very useful to you given that I know what you do. I took a small site we handle and looked at what I have in WMT and then ran it on ahrefs. On WMT we are showing 68 distinct external links. On ahrefs we are showing 62. Worst case about a ten percent difference. (For finding those 6, download both csv files and sort and should be quick. Obviously with thousands you have more work.)
With ahrefs, you can simply sort them by nofollow, mark your GWMT data, then boom. You are real close to magic.If you want to see it, etc. I have a conference call with a bunch of Cannucks at 0930 CDT for about 45 min. After we can talk if you call me. Oh, sorry, forgot you were up North...
Hope it helps,
Robert
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
We're looking at providing SEO for a website that has the majority of its incoming links from websites created solely to provide links. Few have bad spam rankings. How worried should I be about those links?
The majority of incoming links to a prospect's website are from website pages apparently created solely to provide links to the website. Few have high spam scores. The sites linking to the main site have versions of blogs with linked text. They seem to be providing positive SEO value now, but I'm concerned they might get noticed and hurt the main site in the future.
Link Building | | PKI_Niles1 -
Should blogger award badges/links be nofollowed?
I'm pretty sure the answer to this will be a big yes. Obviously this is a tactic that can be gamed quite easily, but I wanted to know if there are any clear guidelines on this. We've done a post about the most influential food bloggers using our own tool, so there's proper data behind the top ten. We wanted to reach out and let them know, give them a badge to include that might drive a bit of traffic and raise some brand awareness. That's why the question has come up as we want to make sure we advise the bloggers properly if a nofollow is best practice.
Link Building | | joshuaboyd0 -
Linking out: Follow vs. Nofollow
When linking out to other sites, such as resources on .gov pages, should I use follow or nofollow links?
Link Building | | AHC_SEO0 -
Getting a sitewide links from one domain as oppsed to few links from certain pages, a good, bad or horrible idea?
Hello, I have a website that is performing really well in Google for country specific Real Estate Website. I have had this site for just about 2 years and I have 4600+ indexed pages, and about 50 of my main keywords appear in top 10 results on Google. I have now started a second site with a brand new domain, its only about 2 months old. This one is a Travel website and again its country specific (same country that real estate website is performing well in) and since its still building up the content and has barely a couple of backlinks, I am thinking of adding a linkback to it from my Real Estate Site. Is it a good idea to add a site wide link back from header section of the real estate website to my travel website? Both sites has same country and most of the keywords in both relate to this country. Or will I be better off adding a few text links from few pages with best Page Authority? Or - do you suggest that I do not link the two at all? Both sites are hosted on different servers, with different IP's and one is on windows server created in asp.net while another is a magento site. Any advidce / insight will be much appreciated and thank you in advance.
Link Building | | waituk_sanjeev0 -
What is the Best Tool to Identify Toxic Links?
I've been using Link Detox from linkresearchtools.com against the list of back links provided in my GWT account although it seems it is not enough. What tools are the best at identifying toxic links?
Link Building | | sbrault740 -
Link Campaign
I need to put together a link campaign, but am a new SEO in training. Any recommendations on how to start, even if it's just read certain articles or watch certain videos? Your help is appreciated!
Link Building | | cbeuoy0 -
Do No follow links from social media platforms transfer authority or value when they link to third party websites?
With social media playing a bigger role in SEO (since the Panda, Penguin updates etc) and how search engines rank sites now, does anybody know why Twitter for instance has 'no follow' when I check my client's websites under 'inbound links' on Open Site Explorer?
Link Building | | caroline19770 -
Where are all the sites that are linking to me?
I need to compile a list of all the siters linking to my site, but my open site explorer analysis shows very few links. I know for certain that there are many many more sites linking to it (it's an academic site and there are links to it from a lot of academic directories). What am I doing wrong?
Link Building | | michalseo0