Deny visitors by referrer in .htaccess to clean up spammy links?
-
I want to lead off by saying that I do not recommend trying this. My gut tells me that this is a bad idea, but I want to start a conversation about why.
Since penguin a few weeks ago, one of the most common topics of conversation in almost every SEO/Webmaster forum is "how to remove spammy links". As Ryan Kent pointed out, it is almost impossible to remove all of these links, as these webmasters and previous link builders rarely respond. This is particularly concerning given that he also points out that Google is very adamant that ALL of these links are removed.
After a handful of sleepless nights and some research, I found out that you can block traffic from specific referring sites using your.htaccess file. My thinking is that by blocking traffic from the domains with the spammy links, you could prevent Google from crawling from those sites to yours, thus indicating that you do not want to take credit for the link.
I think there are two parts to the conversation...
-
Would this work? Google would still see the link on the offending domain, but by blocking that domain are you preventing any strength or penalty associated with that domain from impacting your site?
-
If for whatever reason this would nto work, would a tweak in the algorithm by Google to allow this practice be beneficial to both Google and the SEO community? This would certainly save those of us tasked with cleaning up previous work by shoddy link builders a lot of time and allow us to focus on what Google wants in creating high quality sites.
Thoughts?
-
-
I've thought about this idea to get rid of bad links from specific referrers.
I agree with the comments Ian has made but when it is the homepage it's not always possible to follow those steps. Has anyone else had any experience/information?
-
Hi Ian,
Thanks for the response. I agree with you that this feels wrong and I don't recommend anyone try this (unless you have a site that you don't mind using as a guinea pig).
The problem is that, if this is your home page or a strong category page with many legitimate links, rankings, ect., it will be tough to abandon the page altogether.
To follow up about the original idea, I have done some additional research and found a few mentions, though none of them exceptionally credible, of the fact that the Googlebot does not pass referrer data to the server. Can anyone confirm?
-
Ooooh, that feels all wrong.
Seems to me .htaccess would block visitors that you may want. And while Google may obey the directive, they may also misinterpret a referrer-specific directive as cloaking.
If you want to get the same effect, here's what I'd do:
- Change the page to which the offending links point. Have it say "This page is gone, but you can get the information you want here" and make that a link to a new page.
- Set up your server to return a 410 code when folks visit that page.
- Set up a new page with the old page's content, so folks can click from the old to the new, but visiting bots and browsers get a 410 code and dump the page.
That will get Google to de-index the page in a hurry.
Another option: Simply add noindex, nofollow to the targeted page.
But I like the 410 option, because that should break the authority flow and has the best chance of giving Google what it wants, short of removing the link.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Tiered back links
Playing catch up with latest SEO techniques and wanted to ask the community what opinion is with generated tiered back links. For example, in one month having - 50 tier one links, 250 tier two links and 1000 tier three links generated within articles forums, social networks, guestbooks etc. In my view this is blackhat, my question is - is this still acceptable? or will it be damaging my domain? Thank you.
White Hat / Black Hat SEO | | w4rdy0 -
Why There is No link Data Available in my Webmaster Tools even the site has lots of links and webmastert tools account setup properly
i have few account in my webmaster tools that are not showing any link data even the has lots of links. i checked the setup and its everything is good. is some one tell me why there is no data coming through? Thanks
White Hat / Black Hat SEO | | OnlineAssetPartners1 -
How to deal with link echoes of former hacked websites?
Hi all, I'd know which is the best way to deal with link echoes of former hacked websites that Webmaster tool reports. to clarify: when you download the backlink report from Webmaster tool you'll have a list of backlinks discovered, but if you follow one of those links you will see that on that page there is no link to your website. the source code is also clean, no hidden links or other dodgy technique. Since that the topic is usually miles away from my industry I have to assume at some point that site has been hacked by a spammer who placed that backlink. In this case what should I do? Ignore it, disavow the domain or what? Moreover, which is the best procedure when you have to face a site which points a lot of backlinks from only its sub-domains? For example: this dodgy spammy website : http://px949z32.com/ is apparently a desert, but when you do site:http://px949z32.com/ you'll discover 55,200 results! Would be it be enough to just disavow the root domain http://px949z32.com/?
White Hat / Black Hat SEO | | madcow78
As I don't want to wait too long before taking any action, my plan is to disavow all those domains without any mercy, although I can't find a current backlink in one of their pages. I will do this, as at the minute my concern is they will be hacked again and I have to face the same issue again and again Thanks to all, P.0 -
Companies creating spammy links to charge money to delete them?
Hi all, Yesterday I was checking out ahrefs.com and realizing that one of our main competitors was getting new spammy links to its website from junk directories, rusian forums, porn sites etc. I found it to be weird but I thought that maybe they hired a black hat company without knowing it. Today I began finding the same type of spammy links pointing to our site. I'm completely sure we did not create them.I was checking out some of the new directory links and their listings consist of new pages including only our company's website and absolutely no descriptions. I did a little more research and find out that many of those new directories/listings belong to the same company ( seems to be located in Argentina, but I'm not sure). I also remembered paying that company long time ago to delete two links to our website that were included in their directories. I have to tell you, I'm completely out of my mind and I really don't know what to do. The two possibilities I can think about are: 1- A competitor has hired somebody to point spam to our site, to our other competitor, and may be some other competitors in the industry.(because as I tell you before our main competitor in the area is getting new spammy links too) 2- These black hat companies that own directories and other junk websites are pointing spam to us to get paid to remove links. Whether is #1 or #2 is getting out of control and I really don't know how to manage it (except from disvowing links as soon as I find them). I would appreciate suggestions/advise. Thanks. Ana
White Hat / Black Hat SEO | | anagentile0 -
Benefits of having outbound links
Are there any strengths (benefits) in having outbound links within the site regarding SEO? If linking to reputable sites, would that help increase our SEO strength or does that only work if they links back to us?
White Hat / Black Hat SEO | | WebRiverGroup1 -
Domain authority - Low quality links
I have a question I hope people can help me on. it is my intention for my next project to focus on domain authority, and a small number of high quality links. I have a couple of scenarios I would appreciate some advice on: 1. Can lower quality links lower domain authority? 2. Would you avoid links from low quality sites no matter what \ what domain authority levels should you avoid links from. 3. Should I be looking at link profiles of the sites I get links from. Does it matter if a site I get a link from has 1000's of spammy links (i.e. something to look out for when doing guest blogging). 4. Should I avoid directories no matter what, or is high pr \ domain authority directories ok to use, if I end up on a page of other relevant directory submissions related to my niche. Essentially, my aim is to have high quality links, but equally, there are some decent sites on the fringes that I will need to consider (based on a competitors link profile I researches).
White Hat / Black Hat SEO | | Jonathan19790 -
Can image links help improve my backlinking profile?
I recently spent some time looking at the backlink profile of a leading UK food & clothing retailer and noticed that a high number of their backlinks for very competitive search phrase's consisted entirely of image backlinks. 50% of the links contained no alt text and other 50% contained a mix of just the targeted keyword or a phase containig one mention of the targeted keyword. Has anyone had any experiance of this type of marketing producing any positive effect on SEO or search engine rankings?
White Hat / Black Hat SEO | | BigJonOne0 -
External links in a global footer
My company runs a real estate site (http://yochicago.com) that features editorial blog and video content. In our footer, we feature links to some of our client sites. That footer is global, i.e., on every page of the site, of which there are thousands. One of our clients has been hit by Google for unnatural links. While I am very aware of them using a network of junk sites (http://www.seomoz.org/q/can-our-white-hat-links-get-a-bad-rap-when-they-re-alongside-junk-links-busted-by-panda), could we be contributing to the problem? Our site has the most links into the troubled site.
White Hat / Black Hat SEO | | mikescotty0