Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SPAMMY links to my search results page
Hi, I have a big problem, somehow someone has built THOUSANDS of SPAMMY links to my site's search result pages with keywords that does not even make sense or inline with the site. Links are dofollow and goes to /?s=TERM see the for yourself https://mz.seotoolninja.com/pro/link-explorer/inbound-links?site=https%3A%2F%2Fhealthtian.com See image https://imgur.com/a/fahetyZ Please is there a way to BLOCK all at once? i feel these links are impacting on my site. Thanks
Link Building | | Lordcharsty1 -
Diverse SEO On & Off page questions!
Hey everybody. I have been reading several resources on SEO, and wanted to know your opinion on these topics. I know they are diverse and should be on a different set of questions, but i wanted to give it a try. I run a Heavily Specialized Steel B2B eCommerce Site. So my question would be what is the importance of the following topics, taking into mind the nature of my site. The importance on how often the page is updated ? Recommendations on updating relatively static pages ? How important is to meet HTML and W3C Standards, also its validation. The NoFollow and Follow ratio of incoming links. Your opinion onthe inclusion of outbound links to other relevant pages. Is there a best practice? Any comment is welcome, and would be deeply appreciated. Regards,
Link Building | | JesusD1 -
How to make google index the page title has changed ?
Google has indexed all my websites, but I have to change some title in the website but when checking google does not update the change.
Link Building | | tuananh0688
Please help me .
My site : http://blog.addme.vn0 -
Merging 10 niche pages into 1 large page: how to go about it?
Good day,
Link Building | | rayvensoft
I am new to SEOmoz, so please allow me to take this opportunity to introduce myself before jumping into the questions. I have a small network of sites that focus on language education online. I have been working on them for about 3 years, and they were starting to do well. I am sure I made some mistakes along the way with regards to SEO (I paid for article distribution, and directory submission). I also did link exchanges - mainly with related sites, but some of them were kind of grey . I stayed away from blackhat entirely.
So, like many people I got affected by Google Penguin. Luckily it was not as bad as many of the people I have heard about. 7 out of my 10 sites, stayed on or near the top for the main keywords. They did however drop for some of the secondary keywords. 3 of the sites however got hit hard. Based on this, I have ventured to guess that google is telling me I was doing it about 70% right, and 30% wrong. Well, live and learn.
After April 24th I started to scower the web to find out what happened and to see what to do. In my readings I noticed that a lot of people were affected, but some where not. The one thing I found that most of the people who were affected had in commune was that they were on SEOmoz. So I decided to join. So now I am here to hopefully learn what I did wrong, and what I need to do right. I have no problem at all in starting from scratch and putting in the hard work. Now, as for my question. As I mentioned, not all of my sites were hit by Penguin. More of them survived than got killed. I was hoping to be able to leverage those sites to give the new larger site a kick-start. Just to give you some metric, all 10 sites have a quality rank of between 40-60 according opensiteexplorer. The linking is nothing extreme. The pages have anywhere from 200-1000 links. Nothing more than that. So here are the questions. 1) The SEO I did on all 10 sites were very similar. So I am afraid of just doing a 301 redirect from the 7 other sites in the future google may punish them as well, and as such my main page new page will suffer. What would you guys recommend. Instead of a 301, I could just ad a link to the sub pages on the new site. It would be less effective, but also less risky. What would you all suggest? 2) If I take the 301 option, what is the general recommendation on how to phase it in. I am assuming Google would not like it if all 7 pages got redirected on the same day. That would essentially make the page have 5000 or so links overnight. What is the general recommendation for these kinds of things. one 301 a week? one 301 a month? The 301's would not be to the homepage, they would each go to a relevant sub-section of the site. Sorry for the long first post. My wife tells me I don't know when enough is enough sometimes. 🙂 Thanks in advance for any assistance and I am excited to see what I can learn on SEOmoz.0 -
Redirect a 404 page
Hi We encountered a problem with our site during a migration to a new platform and we lost much of link juice. I have noticed on SEOmoz Open Site explorer that our old urls from the old site still exists and many have high page authority. The urls all redirected currently to a 404 page and it is not possible to retrieve the old information For example this page http://www.featuredeco.co.uk/mall/departmentpage.cfm/FeatureDeco/_71989/1 This has a page authority of 32. Is it possible to retrieve the link juice from these pages and channel it on the Kind regards Paul
Link Building | | prano0 -
Homepage vs specific page Backlink
Hello, I have a local business and have been working on getting backlinks for highly relevant keywords. I have keyword optimized pages (keyword in URL, title, H1, etc) but I have been sending backlinks to the homepage, as these keywords represent the core of what we offer. See example below: car repair car repair london auto repair auto repair london I have been sending backlinks (with the correct anchor text of course) to the homepage, am I better off sending them to the specific pages? One more thing: the SEOMOZ report talks about cannibalisation of keywords, where for example the page optimised for "car repair" links to "Car repair london". I have links to the optimised pages in a footer at the bottom of every single page on the website, is this bad practice? (considering SEOMOZ talks about cannibalisation? Should I do something else instead (or eliminate the footer links altogether?) I would appreciate your expert advice.
Link Building | | dpaq20110 -
Does focussing deep linking too much on one page have a negative impact elsewhere?
Hi, I'm just starting a backlinking campaign on a new website and am focussing on one deep page for client - focussing a lot of good quality backlinks on that one page. I'm aware that most of the other pages, including homepage, lack good backlinks. Can I go ahead and focus powerful backlinks on that one 'deep' page without a problem, or may that approach result in negative impacts on other pages' SERPs.
Link Building | | McTaggart0 -
Hubpages and Page authority
Hi, I've created a Hubpage awhile back and I see the url has a page authority over 50. How much does Domain authority influence page authority? The url has only 3 (registered) backlinks, so I cannot see an obvious explanation why. I understand that Hubpages was one of the sites that "took a hit" with the Panda update, but it has a domain authority of 84...
Link Building | | vibelingo0