How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Taking more than a day to index after the content changed
Hi everyone, As i got stuck with the confusion that - one of our website pages for the business located in Sharjah contents has been moderated and inspected the URL to google for index with new tags and contents. This is the URL which made the changes: https://www.socprollect-mea.com/sharjah-free-zone-company-registration/ and As i came to know that our page reflecting an issue "Valid items with warnings" once after inspecting the URL in the search console. Something which seems interesting and never experienced before - which is showing: "Products"warning - something like that. I came to know that - Missing field "Brand" and showing no global identifier. Does anybody know what it is and can u able to rectify this concern and get me a solution to index our URL faster on Google search. please?
On-Page Optimization | | nazfazy0 -
Metadescription not being pulled by Google? Yoast v SmartCrawl?
Hey guys, For whatever reason, Google isn't pulling the metadescriptions I've provided for a wordpress site I'm working on. We had both Yoast and SmartCrawl installed, so I thought maybe they were confusing Google and deactivated Yoast. Unfortunately, that didn't fix the issue. Instead of using the text I've plugged into SmartCrawl, Google is just using snippets from the blog posts... And it's happening for every single post, leading to a huge uptick in metadata issues in moz. Any idea how to fix this?? Thank you!
On-Page Optimization | | laurendavidson0 -
Google is not taking the title I set
Hi Everyone, I have the following website I am trying to SEO www.forcor.com.ar. As usual, the client decided to SEO the website after it was made by a developer that is not specialized in SEO. I am having the following issue. Google is not picking up the title I defined for the homepage. I have changed it multiple times and Google continues to take the title that was defined when the website was launched which was about 6 months ago. I also tried to verify if the title is being defined by some other website and so far I do not find any evidence that supports this. This is the title seen in the SERP (GOOGLE) as of 6 months ago - Forcor S.A: Repuestos Ford - Concesionario Oficial de Ford This is the one that is programmed via Yoast - <title>Repuestos Ford - Concesionario Oficial de Ford - Forcor S.A</title> The funny thing is that Google is picking up the correct Meta Description. Any suggestions on how to get Google to pick up the programmed title??? Another interesting fact is that Yahoo is picking up the correct title as you can see here
On-Page Optimization | | Carla_Dawson0 -
Long Meta Titles on Dynamic Pages
What to do with long meta titles on press release pages. Unlike other pages on the site, press release pages have no physical value and are dynamically created picking data from the database. Such pages i notice are automatically picking the URL/H1 as meta title and meta description. How to shorten such meta titles and descriptions? Do such errors (related to dynamically created pages) matter? Tanveer
On-Page Optimization | | Sequelmed0 -
Duplicate meta and title in Google Webmaster Tools not updated?
Our canonical tags were removed by mistake for some time and our duplicate meta and title warnings in Google webmaster tools html improvements went up. We fixed the issue a week ago. I made sure the sitemap is picking up the canonical URL. Still the number went up after we fixed it (from around 5000 to around 7000 now) but when I click on details, it shows around 2000 in detail page. How long does it take for Google to update this? RB
On-Page Optimization | | rbai0 -
Any idea how Google is doing this? Is it schematic? http://techcrunch.com/2014/02/28/google-adds-full-restaurant-menus-to-its-search-results-pages/
Google is now showing menus on select searches. Any idea how they are getting this information? I would like to make sure my clients get visibility this way.
On-Page Optimization | | Ron_McCabe0 -
Should I Remove This Subdirectory From Google?
On my site, I have a subdirectory. It posts articles from a bunch of websites that my readers are interested in & links back to all of those sites. There is no original content in it. There are over 1700 indexed pages in this subdirectory. The rest of my site has about 500 (all original content). The search engine traffic for this subdirectory only accounts for 3.9% of my sites overall visits. Should I consider removing this subdirectory? Could all the duplicate content be hurting the rankings of my legit pages? What do you all think?
On-Page Optimization | | PedroAndJobu0 -
How long does it take for Google to see Changes to a site?
Hi, I have a low PR site (PR 1) that I am starting to work on. Ingeneral when you make changes to my site how long would it take Google to recognize and index those changes? The reason I am wondering is because the site I am working on had a lot of duplicate content (around 700 pages), I got rid of it all, but I wasn't sure how long it would take Google to spider all these pages and re-index them since the site is low PR. Thanks, Ken
On-Page Optimization | | Jason_3420