Google dropping pages from SERPS
-
The website for my London based plumbing company has thousands of specifically tailored pages for the various services we provide to all the areas in London. It equates to approximately 6000 pages in total.
When google has all these pages indexed, we tend to get a fair bit of traffic - as they cater pretty well for long tail searches. However, every once in a while Google will drop the vast majority of our indexed pages from SERPs for a few days or weeks at a time - for example at the moment Google is only indexing 613 whereas last week it was back at the normal ~6000.
Why does this happen? We of course lose a lot of organic traffic when these pages don't displayed - what are we doing wrong?
Website: www.pgs-plumbers.co.uk
-
I am fairly sure that Pagerank is now constantly updated, it may well be that they only adjust the visible pagerank every three months though.
I can only say this next bit speculatively because I don't have the data (I would love to see the periods and numbers for the site above), but the cap itself might be a somewhat fluid idea, pages may be retained in the index as they are discovered but get pared back to their "hard cap" periodically.
-
Yeah, good shout. I was thinking about that as well, and maybe something to do with switching or upgrading of data centers, but probably not the latter to this extent.
-
Seems unlikely he would drop 90% of indexed pages and regain them back soon after if it was a PR thing, don't you think? Aren't PR updates generally quarterly?
-
I think it could be down to an indexation cap. I know Pagerank is not the force it once was but it does play a role in the number of pages google retains in it's index (if they regularly cull sites back to their cap that might explain the fluctuation, or maybe you fluctuate between two thresholds).
Matt Cutts made some comments which Rand broke down into bitesize chunks in the SEOmoz blog to that effect:
http://www.seomoz.org/blog/an-illustrated-guide-to-matt-cutts-comments-on-crawling-indexation
Your Pagerank is low, and without trawling through your site I don't know about duplicate content, but this could well be it. The fix is the same as an awful lot of SEO problems, more, better links.
-
I also think it's very possible his previous experiences with rankings dropping and pages getting de-indexed could have been at key algo udpates as well. Mayday, etc...
-
Yup David's point above is the prime suspect for a lot of changes just now, however you say this has happened before?
Are you doing anything else at the times when you've noticed you get dropped for a few days/weeks? Roughly how often does it happen?
EDIT - Just quickly put your site into OSE and you don't have a hugely diverse link profile, plus the sort of sites you're getting links from may have been effected by the farmer update which is had a knock on effect to your site (and similar updates may have done in the past). Not conclusive but something to think about as well.
-
The answer could easily be the Google Farmer update. If you are not familiar with this, read the latest post by Rand: http://www.seomoz.org/blog/googles-farmer-update-analysis-of-winners-vs-losers
That will help you understand the latest algorithm update and how you can do something about it.
It sounds like you dropped off due to the algo update and that leads me to believe that Google thought your content was not high enough quality?
I would read Rand's post, evaluate your website, and then have the content analyzed and see if you need to hire a really good writer to build high quality content that is valuable to the users. If you were building mediocre content to target thousands of keywords, specifically long-tail, you need to revamp that strategy and focus on amazing content first!
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site:www.domainname.com - does not find homepage in Google (only inner pages - why?)
When I do a Google search on site:www.domainname.com, my clients homepage does not appear. Other inner pages do. The same thing happend a while ago and I did 'fetch by google' in Search Console. After that the homepage was indexed again when I did a site:www.domainname.com search. But now (2 weeks later), it's gone again. When I search on the brand name of the website in Google it does find the homepage. I don't know why it doesn't find the homepage when I do a site: search. Any ideas? [see images where you can see the problem] XTrDn 2doHF
Technical SEO | | robk1230 -
Is the Google results serp broken?
Hi everyone! We've been trying to decipher how many of our pages are indexed by google at the moment. If we do the usual "site:https://www.hobbydb.com" search term, the serp says that we have more than 740,000 pages indexed. However, when I do a deep dive and click through to the last page of results, I can only get to page 54, and then there are no more results. This would mean that I only have 540 pages indexed, not 740,000. We have also done other queries for other sub-sections of our website, and the results also truncate at 50 pages. Has anyone run into this problem? Any suggestions are appreciated! Best, Alex
Technical SEO | | mpchobbydb0 -
Will a Robots.txt 'disallow' of a directory, keep Google from seeing 301 redirects for pages/files within the directory?
Hi- I have a client that had thousands of dynamic php pages indexed by Google that shouldn't have been. He has since blocked these php pages via robots.txt disallow. Unfortunately, many of those php pages were linked to by high quality sites mulitiple times (instead of the static urls) before he put up the php 'disallow'. If we create 301 redirects for some of these php URLs that area still showing high value backlinks and send them to the correct static URLs, will Google even see these 301 redirects and pass link value to the proper static URLs? Or will the robots.txt keep Google away and we lose all these high quality backlinks? I guess the same question applies if we use the canonical tag instead of the 301. Will the robots.txt keep Google from seeing the canonical tags on the php pages? Thanks very much, V
Technical SEO | | Voodak0 -
Anything new if determining how many of a sites pages are in Google's supplemental index vs the main index?
Since site:mysite.com *** -sljktf stopped working to find pages in the supplemental index several years ago has anyone found another way to identify content that has been regulated to the supplemental index?
Technical SEO | | SEMPassion0 -
If content is at the bottom of the page but the code is at the top, does Google know that the content is at the bottom?
I'm working on creating content for top category pages for an ecommerce site. I can put them under the left hand navigation bar, and that content would be near the top in the code. I can also put the content at the bottom center, where it would look nicer but be at the bottom of the code. What's the better approach? Thanks for reading!
Technical SEO | | DA20130 -
Which carries more weight Google page rank or Alexa Rank?
And how come do I see websites with Google PR of Zero and Alexa Page Rank in the top Thousands rank?
Technical SEO | | sherohass0 -
Google picking up wrong page title
Hi, When searching for "Tottenham Forum" on google.co.uk (link below) http://www.google.co.uk/search?q=tottenham+forum&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-GB:official&client=firefox-a The site I manage (THFCTalk.com) is listed as 4th in the search results, but was hacked a few months ago and the search results lists the page title as "Free Shipping. Order Cialis Online. - Online Pharmacy" when the actual page title of THFCTalk is not actually set at that. Any idea how to fix this so Google updates this header on the search results? - as it is surely putting people off from clicking on our search result
Technical SEO | | WalesDragon0 -
Site drop in SERPS after domain down for three plus weeks
Have had a clients site that has been staple in the SERPS for the last four years that we have worked on it. However they had hosting issues a couple of months back which they didn't sort for two to three weeks. Since there the main keyword has bounced around between 24th and 44th in the google results. The drop ties in with the hosting issue but the client does seem to believe that this is the source of the issue. Can someone point me towards some online articles that would explain this for them. Some of the keywords have not suffered as badly but the one key term is still in the mid 20's. I am sure it is suffering a minus 20 for the keyword as it was normally 4th or 5th in the results. We don't host the site and the client had know idea were it was hosted. What is so annoying is that it is us who pointed out the site was down. Thanks in advance everyone 🙂
Technical SEO | | highwayfive0