How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My exactly website name is not in google search
my web site tournet.co but when i search that in google , google can not find it in search result . i have to say my website is a new site and its age is 3 month .
On-Page Optimization | | p.farrhad12365410 -
Sudden disappearance from google organic ranking
I have been ranked in top 5 for all relevant search terms for years. I have been in business for 25 years and am modestly speaking the best in our field. The name of my company is "Alaska Yacht Charters" and suddenly I have disappeared from Google search. Google "alaska yacht charters" and I am nowhere to be found. This all occured within days of my suspending my adwords account which I felt I didn't need because of my great organic ranking. What has happened?Geoff Wilson www.alaskanyachtcharters.com
On-Page Optimization | | akstory0 -
To Many Links & Long Titles
One of our clients currently has a number of pages that "Too many on page links", Now her menu in itself has the majority. With it being an eComerce website it has quite a few categories. How harmfull is this to search rankings. The other side of thing's, Currently the client has a large number of pages where the title of the page is the product, However her products for example could be "The pink fluffy bear 2x4 with extendable arm and voice activation ( batteries not included )" Again, how Harmfull is having a large volume of pages named like this.
On-Page Optimization | | bmkdigital0 -
Infinite Scrolling Long Lists and SEO
Just curious if anyone else has tried this. I have pages with words that link to definitions. I have A LOT of them on a page and I am starting the process of trying to either do pagination (which I cant stand) or even cooler infinite scrolling where the page loads more words as the user scrolls. Good Bad for SEO?
On-Page Optimization | | cbielich0 -
How google handle with Title when is invisible on the page?
I would like to display H1 Title tag invisible on the homepage. I set up Title colour same colour as background colour. How google handle with this cloaking? What should I to set up in the style.css?
On-Page Optimization | | joeko0 -
Will Google re-index the page if content is changed/improved?
Hello,
On-Page Optimization | | wickedsunny1
i have a little question, it seems most of my posts which are 3 years old or even more, all have almost same type of 2-3 lines of text at post starting and then images roundups etc.
which recently stopped getting any traffic from google. Probably becuase of lack in text etc.
So if i now edit those old pages, will they be reindexed in google with this new content/data?
thanks in advance.
cheers0 -
Best Way to Add Google Map to Site
My site is built with WordPress. I want to add our business location in the contact page using Google Map. What is the best way to do this? There is many plugins out there for Word Press do I need to use one ? Hopw about Webmaster tools, does it need to be submit somewhere in there? When it is done properly, will Google show our store location with a map in Goolgle search results? I saw some store result showing the map & business hours, How to do this? Thank you for your help. BigBlaze
On-Page Optimization | | BigBlaze2050 -
Google Ranking Dropped
Hi We launched a new website on the12th Feb 2012, it appeared on google page one for the search term "compare travel insurance" . Last week it changed ranking to page 49 of google ranking. my site is www.1234compare1234travel1234insurance1234ireland1234.com Take out the 1234 for my site address, some people have mentioned that it was honeymooned to page 1 due to being a new site with new content. Can anyone tell me if it looks as if I've done something wrong and been penalised by google? If not are there any SEO advice I could use to improve ranking? All comments and advice appreciated. Regards Paul
On-Page Optimization | | CocoMagenta1