De-indexed homepage in Google - very confusing.
-
A website I provide content for has just suffered a de-indexed homepage in Google (not in any of the other search engines) - all the other pages remained indexed as usual. Client asked me what might be the problem and I just couldn't figure it out - no linkbuilding has ever been carried out so clean backlink profile, etc. I just resubmitted it and it's back in its usual place, and has maintained the rankings (and PR) it had before it disappeared a few days ago. I checked WMT and no warnings or issues there. Any idea why this might've happened?
-
Having disappeared, the homepage appeared immediately when I resubmitted it, then fell back in SERPs a little and is now achieving better SERPs than when it disappeared. I can't see any probs with the code / sitemap or anything. All in all rather confusing but (thankfully) resolved in a couple of minutes. Thanks for your brilliant feedback Thomas and for your help as well Marcus. Thanks to you, I'm well prepared should this problem hit one of my clients again
-
Hi Marcus,
That is great news to have. Not that it's great that it happened but Great that other people have seen this happen and recovered. Considering all the things going on right now I would say at a glitch is entirely possible.
I know Google makes a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
Marcus very valuable contribution thank you.
a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
the 3rd link down just like Marcus explained has a very similar story. I think very valuable contribution thank you Marcus your comment inspired me to look for more data.
All the best I hope this is of help,
Thomas -
Hey, Thomas's response really nails most of the obvious causes here but as a simple n=1 oppinion this happened to one of my clients last week. Homepage disappeared for around 48 hours. No problems I could detect, but it was not indexed. Weird, but just as I was scratching my chin it popped back up.
Check the obvious things, make sure there are no problems and then leave it for 48 hours and see if it pops back up.
Not hugely scientific but after such a big update we often see little aberrations and this could be one of those if everything else is as it should be.
Hope that helps
Marcus -
I have heard a lot of people complain about page rank loss during the recent Penguin 2 update. Unfortunately that could be just Google's way of changing their own page rank. if the page itself is unaffected rank wise I would not be worried. The other thing I would what your client know is those page rank toolbars are notoriously wrong so you might want to check it through a more powerful or trustworthy source. I don't really put a lot of stock in Google's page rank because they frankly have told us not to and I would look more at the Moz rank
if there is a problem with the robots.txt it would be very possible Google is slow to reinstate it after what happened.
I would still check site with everything below however this is something I've heard of already from 2 other people. So it could just be a glitch or Google has made changes to its page rank algorithm.
It sounds to me as if there's either a problem with the robots.txt
or it's a simple matter of the plug-in or whatever's being used saying not to index or follow the homepage
if you could use this tool and simply type in the URL plus robots.txt
like this below
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
then post the results or send me a private message with them included.
In addition go on the homepage and search with either control F if you're a PC user or command F if you are Mac user for nofollow and noindex
if you find either one of these
they will look like this
http://www.robotstxt.org/meta.html
<title>...</title> you can use the
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
to change them to make sure they're not on the page. You do not need them there as Google default indexes and follows every page unless you tell it not to. The other thing you have to look for use of the X tag as well it can do the same thing as shown below
Example uses of the X-Robots-Tag
If you want to prevent search engines from showing files you’ve generated with PHP, add the following in the header file:
|
1
|header("X-Robots-Tag: noindex", true);
|This would not prevent search engines from following the links on those pages, if you want to do that, do the following:
|
1
|header("X-Robots-Tag: noindex, nofollow", true);
|But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following:
take a look at this to know if you are pages being affected by one or the other.
http://yoast.com/x-robots-tag-play/#examples
I hope this is of help,
let me know if I can be of more assistance.
Thomas
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Homepage alone dropped for one "keyword"
Hi Moz community, Our websites has dropped almost 50 positions for main keyword and Okay with other keywords. Other pages are doing consistent for other keywords. We haven't made any changes in website. What could be reason this ideal scenario of homepage dropping for main keyword. And recent unconfirmed algo update have anything do with this? Thnaks
Algorithm Updates | | vtmoz0 -
Google Algo Update
Hi I'm trying to look into how the update in Oct - Nov affected our site. It's positive with us ranking for more keywords, but I wondered if anyone knew what had changed. For example, one of our pages ranked for 291 keywords in October, now it ranks for 406 keywords. We've done nothing to this page in that time. I just want to try and understand what's happening with the algorithm a little more (although I'm sure everyone does :). Does anyone have any insights? Thanks!
Algorithm Updates | | BeckyKey0 -
Reduced traffic from google news
I have a question for my site. Can you advice me for situation? Last 1 months my site reduced traffic from google and google news.. And i dont know why? I need your advice. Thanks. Yunus Altindag Diyarbakir/Turkey
Algorithm Updates | | maxbilgisayar0 -
Homepage Index vs Home vs Default?
Should your home page be www.yoursite.com/index.htm or home.htm or default.htm on an apache server? Someone asked me this, and I have no idea. On our wordpress site, I have never even seen this come up, but according to my friend, every homepage HAS to be one of those three. So my question is which one is best for an apache server site AND does it actually have to be one of those three? Thanks, Ruben
Algorithm Updates | | KempRugeLawGroup0 -
My site dropped from 1st to 5th Pagna google br
My site dropped from 1st to 5th Pagna google br mented in the key word, how can I find out why at and what to do to get back? He fell after he put the google analytic code on all pages of the site, it may have acid? Meu site caiu da 1º para a 5º Pagna do google br em tadas as palavra chaves, como posso descobrir o motivo e oque fazer para voltar ? Ele caiu depois que coloquei o codigo do google analytic em todas as paginas do site, pode ter cido isso ?
Algorithm Updates | | Guedes0 -
New Google "Knowledge Graph"
So according to CNN an hour ago regarding new Google update: "With Knowledge Graph, which will begin rolling out to some users immediately, results will be arranged according to categories with which the search term has been associated" http://www.cnn.com/2012/05/16/tech/web/google-search-knowledge-graph/index.html?hpt=hp_t3 Does this mean we need to start optimizing for Categories as well as Keywords?
Algorithm Updates | | JFritton0 -
When Google crawls and indexes a new page does it show up immediately in Google search - "site;"?
We made changes to a site, including the addition of a new page and corresponding link/text changes to existing pages. The changes are not yet showing up in the Google index (“site:”/cache), but, approximately 24 hours after making the changes, The SERP's for this site jumped up. We obtained a new back link about a couple of weeks ago, but it is not yet showing up in OSE, Webmaster Tools, or other tools. Just wondering if you think the Google SERP changes run ahead of what they actually show us in site: or cache updates. Has Google made a significant SERP “adjustment” recently? Thanks.
Algorithm Updates | | richpalpine0 -
Website "penalized" 3 times by Google
I have a website that I'm working with that has had the misfortune of gaining rankings/traffic on Google, then having the rankings/traffic removed...3 times! (Very little was changed on the site to gain or lose "favor" with Google, either.) Notes: Site is a mixture of high quality original content and duplicate content (vacation rental listings) When traffic crashes, we lose nearly all rankings and traffic (90+%) When traffic crashes, we lose all rankings sitewide, including those gained by our high quality, unique pages None of the "crash" dates appear to coincide with any Panda update dates We are working on adding unique content to our pages with duplicate content, but it's a long process and so far doesn't seem to have made any difference I'm confounded why Google keeps "changing its mind" about our site We have an XML sitemap, and Google keeps our site indexed pretty well, even when we lose our rankings Due to the drastic and sitewide loss of rankings, I'm assuming we are dealing with some sort of algorithmic penalty Timeline: Traffic steadily grows starting in Jan 2011 Traffic crashes on Feb 19, 2011. We assumed it was due to a pre-panda anti-scraper update, but don't know. Google sends traffic to our site on March 1, then none the next day On June 16th, I block part of the site using robots.txt (most of the section wasn't indexed anyway) On June 17th, Google starts ranking our site again. I thought it might be due to the robots.txt change, but I had just made the change a few hours ago, and Google wasn't even indexing the part of the site I blocked Traffic/rankings crash again on July 6th. No theory why. Site URL: http://www.floridaisbest.com Traffic Stats: Attached I know that we need more backlinks and less duplicate content, but I can't explain why our Google rankings are "on again, off again". I have never seen a site gain and lose all of its rankings/traffic so drastically multiple times, for no apparent reason. Any thoughts or ideas would be welcome. Thanks! t8IqB
Algorithm Updates | | AdamThompson0