KW Explorer is Working to Disambiguate Keywords Google Merges Together
-
Hey gang,
Russ Jones from Moz has been doing a ton of heavy lifting work to try to get around the new problem posed by Google AdWords recent change to merged-keyword volume data. But, we're fighting back against this obfuscation in Keyword Explorer. I'm sharing two emails (slightly edited) from Russ about what we're doing here:
Introduction to the Problem:
Google Adwords Keyword Planner is the primary source for keyword search volume (how often a keyword is searched monthly on Google) for much of the search marketing industry. While Google has grouped together highly-similar terms for a while (especially misspellings), in June of 2016 they dramatically increased this keyword-grouping. This means similar phrases like "keyword rank", "keyword ranking" and "keyword rankings" would all be reported as having the same, combined search volume, rather than their individual search volumes. If you were to take Google's numbers at face value, you might think there are 3,000 searches per month for these 3 terms, when in reality there is only 1,000, divided amongst the 3 terms.
How we are addressing it:
Moz's Keyword Explorer uses a blend of data sources, not just Keyword Planner, to build our volume metrics. This gives us a distinct advantage in that we can adjust the volume of words that deviate dramatically in one data set verses another. Take for example the phrases "keyword rank", "keyword ranking", and "keyword rankings". While Google Keyword Planner might report all of these as having 1,000 searches per month, Moz Keyword Explorer can detect that these numbers are significantly higher than what our models would predict given our other data sets. We can then adjust the volume accordingly. Moreover, given our huge keyword data set, we can also identify grouped phrases (like these 3) and divide the volume proportionally to what we see in our other data sets. Thus, we address the grouping problem from multiple directions.
Here's email #2 from Russ, detailing more of how we're attacking this:
I have been working pretty much non-stop on this keyword volume disambiguation problem (finding the real search volume of individual keywords when Google clumps several together). I think I have settled on a pretty good solution and am working on getting it all in. For example...
Google Keyword Volume for the phrases "briefcase for women" and "briefcases for women" are both at 3600 because they have been lumped together. My disambiguation script says the singular (briefcase for women) should be 2731 and the plural should be 869. Google Trends roughly agrees with this, showing that the singular is searched more than 2x the plural: https://www.google.com/trends/explore#q=briefcase%20for%20women%2C%20briefcases%20for%20women&cmpt=q&tz=Etc%2FGMT%2B4
Basically, Keyword Explorer should already be providing some more accurate/segmented numbers than AdWords, and in the future, we'll get even better thanks to our clickstream data and our evolving models.
Any questions, let us know!
-
Thank you, Russ!
Google confirmed me that this change is due to an update, it won't be rolled back and there's no way to fetch data for each variant individually. Details are here.
Your tool will help us a lot.
-
Thanks for taking the time to come up with a 'solution' to the problem
-
The bug has been fixed but it will take 24 hours for the caches to clear! Thanks again!
-
That is a weird bug, because our database is showing 18k+ for that term! I will investigate!
-
Thank you, Rand and Russ!
I found a weird result. "bag" in US is reported to have 0-10, while "bags" in US is 11.5k-30.3k.
Considering KW planner and Google trend, "bag" in US seems to be outlier.
-
You're working in the right direction, guys. It seems a little scammy on the part of search engines to show these search volumes, as if they prompt you to bid on those keywords because they have a high search volume. While they do show the same SERP for this keyword, I believe a page optimized with "Buy a car in Orlando" will have a better score and a lower bid than a page optimized for "Buys a cars in Orlandos".
-
Thanks!
-
You're welcome for our efforts. I am really excited as we roll out this volume fix. I think it is going to offer a real improvement for SEOs everywhere.
-
Thanks Russ and Rand! I've used many tools for getting to the bottom of estimated volume and have high hopes for your evolving KW Explorer. It's definitely needed.
-
This has a HUGE HISTORICAL impact.
-
Thanks for touching upon this topic which is seriously impacting all marketers who rely on google data. Even the core definition of "Search Volume" is now NOT correct. It's THAT bad as pointed out here http://bit.ly/29MvvvK. Thanks for your efforts.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Accuracy of Moz Keyword Tool
I understand that no search tool is entirely accurate, but I'm seriously beginning to doubt the accuracy of the Moz keyword tool search volumes for keywords. For example: I entered "largest police departments" and it says 0-10 per month in the US, despite the fact that that term is directly responsible for 200 hits per day. Many alterations of that keyword come up with 0-10 or not determined. This is not a small error -- and it repeats over and over for other search terms that I have already ranked for in the US. It's gigantically inaccurate in a massive scale.
Moz Bar | | Luke_Proctor0 -
What is a Good Keyword Volume Score?
Hi All! Continuing my series of discussions about the various keyword scores we use here at Moz (previously: Keyword Difficulty & Keyword Opportunity)... Let's move on to Volume. Volume in Moz's tools is expressed in a range, e.g. Bartending Certification has volume of 201-500. These ranges correspond to data we have suggesting that in an average month, that keyword is searched for a minimum of X to a maximum of Y (where X-Y is the volume range). We use clickstream data as well as data from Google AdWords and then some PPC AdWords campaigns we run and have access to when we build the models for our volume data. As such, we've got very high confidence in these numbers -- 95%+ of the time, a given keyword's monthly search volume on Google will fall inside that range. If you want to see all the nitty gritty details, check out Russ Jones post on Moz's Keyword Volume and how we calculate it. As far as a "good" volume score -- higher is usually better, as it means more demand, but lots of keywords with low volume scores can also add up to strong traffic when combined, and they may be more relevant. Capturing exactly the audience you want that also wants you is what SEO is all about. p.s. When Keyword Explorer or Moz Pro gives you a "no data" or "unknown" volume number, it may just mean we haven't collected information from our clickstream providers or AdWords crawls, not that the keyword has no volume (though it sometimes means that, too, we just don't know yet). One way to verify - see if Google Suggest autofills it in when you type in the search box. If it does, that's usually a sign there's at least some volume (even if it's only a few searches a month).
Moz Bar | | randfish11 -
Learn How to Use Fresh Web Explorer to Build Links. Get your Daily SEO Fix.
Hi there, If you have unique data or a particularly excellent resource on your site, this content can be a great link magnet. Watch The Moz Daily SEO Fix: How to Use Fresh Web Explorer to Build Links to learn how to use Fresh Web Explorer to set up alerts and track mentions of relevant keyword phrases, find link opportunities, and build links to your content. This post wraps up The Moz Daily SEO Fix for this week. To view more Moz tool tips and tricks, check out The Moz Daily SEO Fix playlist on YouTube. Thanks!
Moz Bar | | kellyjcoop2 -
What does the green check mark mean in the KW Difficulty & SERP Analysis Report mean?
Hi, I just generated a Keyword Difficulty and SERP Analysis Report and I find that many of the metrics have a green checkmark besides them. What does that indicate? Similarly, there are many metrics which appear in green. However rest are in grey. Also help what does that indicate? Refer the attached link to the screenshot of the report. I tried looking at a couple of places for the answer but in vain.. Thanks.. DQSlssU
Moz Bar | | Shalin.TJ0 -
MOZ Onpage grade and Google ranking.
I have found for years that there is not necessarily any connection between the onpage given by Moz and the SEO ranking. "F" page can be #1 in Google for long periods of time, and "A" pages can be unranked. I do not see the consistency, so I am unsure how much time to spend optimizing as suggested. I know there are many factors in rankings, but I just wanted to point out that this lack of consistency makes me hesitate to make changes to well-ranking pages -- especially with algorithm changes happening all the time. It seems that everything is considered over-optimization of late, even if it is all natural language. It is hard to NOT use words or synonyms sometimes on pages, for example... Thank you for your great product. I just want to know how my time to spend on this matter or turn my attention to off-page factors where the inconsistency is hard to figure out.
Moz Bar | | gheh20130 -
Moz keyword search took
I don't understand how moz keyword search tool works and how to interpret serp analysis. Is there any tutorial on how to use it?
Moz Bar | | zsyed0 -
Issues adding keywords to MOZ analytics
Hi All 🙂 I've started a couple of campaigns in MOZ Analytics, one accepts keywords the other looks like it does but doesn't actually add them.. I'm pasting a group of keywords, about 30, all separated with comma's. Doing exactly the same to one account that congratulated me straight away and added them to the list below, yay! The other shows the spinning wheel for a few seconds and does nothing further, I've waited a good 24 hours and they keywords have not appeared. Any help appreciated! Thanks 🙂
Moz Bar | | spanda0