Stripping Out Referral Spam From Past Reports
-
Hi,
I'm looking to confirm the best approach for retroactively stripping away referral spam (free buttons, SEMalt, etc.). Now to be clear, I already have filters in place to ignore them from current stats, so moving forward I'm fine. However, I'd love to go back and check untainted stats.
I've setup segments using a regex to strip the root words away and it seems to be working. I have a regex setup to strip out things like: social-buttons|seoanalyses|copyrightclaims|classifiedads|jobsense|free-share-buttons|e-buyeasy|acrobats.hol|cheap-online|amezon|search-help|qut-smoking and so forth.
I've been going through my referral data, noticing obvious spam, and adding their domains to my segment. Is this the optimal way for me to get a clear, untainted view of my past stats?
-
Sweet, glad to hear our filters will suffice. Thanks for the input, Daniel.
-
Hey, no worries and you're right that your filters should block them as well. Using .htaccess would be just an additional defense mechanism but may not be necessary.
-
Hi Daniel,
Thanks again for the response. What would be the difference in Analytics data between my filters and going straight to .htaccess? If the data is the same, is there an additional benefit to .htaccess?
For regular users, I'd suspect less bandwidth since they can't load my domain, but I don't think these bots actually load the page or visit.
-
I would use your .htaccess file to block them with the following code (this would for example block referrals from semalt.com and semalt.com subdomains):
RewriteEngine On
Options +FollowSymlinks
RewriteCond %{HTTP_REFERER} ^https?://([^.]+.)*semalt.com\ [NC,OR]
RewriteRule .* – [F]
You can also use .htaccess to block IP addresses associated with the spammy sources.
edit: just saw your edit but hope this helps nevertheless!
-
Hi Daniel,
Thanks for the additional tips. I do have the bot filtering feature enabled as another point of protection. I checked my referral exclusion list and apparently set this up about a year ago for the initial wave of referral bots I noticed. I didn't know it added them to direct.
The majority of my spam referral hosts have been added to regular filters. I think with the combination of my retroactive approach and new filters, I should have reliable data going forward.
-
Hi there,
You’re on the right track and the best way to retroactively remove spammy sources is through report filters and advanced segments.
A couple other notes:
- A good way to spot spammy referrers is to sort by bounce rate and eliminate any with 100% bounce and over 10 sessions.
- Avoid using the “referral exclusion list” since this will just count spam traffic as direct traffic instead.
- You should also enable the GA ‘bot filtering’ feature under ‘Reporting view settings’ as seen here
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the "UPDATE" indicate in the Google Search Console Query Reports?
We recently noticed an update note in the Google Search Console that happened on April 27th. Does this denote an algorithm update? Any feedback or article would really be helpful. Thanks! gfQ8FG9.jpg
Reporting & Analytics | | RosemaryB0 -
Drop in google.com / referral trafic
Hi, On one of our sites (after the release of a new version, including redirections), we've seen a drop in referral trafic from google.fr (france). I know that this trafic usually comes from Google Images but it doesnt seem to be the case this time. The referal path is "/" and not "imgres" as it usually is when it comes from google images. The search trafic hasnt dropped tough... The site is a job listing site. We also saw a drop from indeed.com, I guess their crawler got lost in our new site... Any idea on the possible google site it could come from? Thank you,
Reporting & Analytics | | AdrienLargus0 -
Why doesn't Google seem to care about referral spam?
In researching the issue of referral spam, there is no shortage if info, both on MOZ and beyond. But, neither the Google Analytics Blog or Help Forums seem to mention the issue at all. I'd think it is something that they would want to get rid of, yet it seems like they don't even acknowledge that it exists. Anyone have insights into this? Am I missing something, or is Google strangely silent on an issue that is becoming more and more annoying for anyone trying to use GA data?
Reporting & Analytics | | irapasternack1 -
Google Analytics Auto Report Config
Buonpormeriggio from 15 degrees C, very cloudy wetherby UK 🙂 In Google Analytics I love how you can eMail dashboard reports as illustrated here:
Reporting & Analytics | | Nightwing
http://i216.photobucket.com/albums/cc53/zymurgy_bucket/philpotts-tweak-auto-date-range-2_zps3e2b3e50.jpg But a client wants a weekly report but with a week range from Tues to Mon so my question is please:
How do you or can you tweak the date range so when you select weekly it doesnt spit out the standard Mon to sunday report (or Whatever it is). Thanks is advance,
David0 -
Google Direct Traffic Reporting for Mobile on Analytics
We noticed a significant drop in our direct traffic in Google Analytics for mobile on July 30th but all our other traffic remains the same. What is the possible cause of this?
Reporting & Analytics | | COEDMediaGroup0 -
Blog Analytics broke for two weeks. How do I account for these hits in my monthly report?
The Analytics on my blog broke for about two weeks before I realized it. I need to come up with some estimated numbers for total pageviews, referrals, direct hits, etc to add to my monthly SEM report. I took the average of the past four 2 week periods to come up with the number of hits. Should I just add this number to the total hits on my site? Or are these hits being counted twice if they went on to the main site? http://www.howlatthemoon.com
Reporting & Analytics | | howlusa0 -
Is the meta description available on the On Page Optimization Report even if its currently being optimized?
Currently, description is only available if the element is not being optimized (i.e. character count is off/keyword isn't included in the description)
Reporting & Analytics | | Jerome670 -
When i first add my url to seomoz then i had a general report of all the faults my website had in SEO and suggestions where can i find it now , i cant find it ?!
when i first add my url to seomoz then i had a general report of all the faults my website had in SEO and suggestions where can i find it now , i cant find it ?!
Reporting & Analytics | | fireproductsuk0