Should I noindex, nofollow a lot of child pages?
-
Some category pages on my website have A LOT of product pages in them. Many of these pages do not receive any sort of organic traffic. Is there a reason for Google to be crawling these pages? Should I noindex, nofollow these pages to make Google's life a little easier? Could I possibly see some benefits from this or should I leave it the way it is?
-
it all comes down to the amount of content on the pages. hyper targeted pages like sizes usually don't get enough editor attention or have enough unique content written about them to make them valuable and in that case a main page listing the sizes will suffice because they will rank for those sizes if the content is on the page because it is so extremely long tail...and protects you from panda. I just went through this exercise with a pool company who had several brands and multiple sizes and we opted to not get so granular.
-
Having pages that no one goes to won't negatively affect the rankings of the rest of your site.
In your case if you're really concerned about those obscure pages and they're thin or duplicate content, you could choose one really popular product in each category (such as "6x6x4 red foil gift box") and add canonical tags on the other similar products in that category (i.e. all the other red box pages) pointing to the popular one.
-
I would say leave them in there as you want Google to see everything on your site that might be relevant to the user.
I think you are referring to what some call Crawl Optimization or Crawl Budget (great article here http://www.blindfiveyearold.com/crawl-optimization) and yes there is something to making sure that you do not waste Google's time in crawling pages that do not matter.
I would still think that product pages are worth Google's time if you have good content and also, these are the things that you sell. Seems that Google would not only want to see your category pages, but what items are in a category. One thing to note, all of those "red box" product pages all link up to the "red box" category page. That is part of what makes the "red box" category authoritative within your site as you are telling Google this with your internal link structure. You may find that if you noindex your product pages, your category pages may go down.
The use of the noindex/nofollow to help with Crawl Optimization is really more for pages like search pages, or pages that can be resorted 100 different ways with 100 different URLs. Those are all duplicates and waste Googles time. Your product pages are really different animals and so my vote would be to keep them in the crawl.
-
Thanks for the response. The thing is these small product pages are too obscure for anyone to find. Many are differentiated only by product size.
For example:
If someone types in "red boxes" into google, we will rank for “red boxes”. On this category page, we have 24 different red box products such as "6x6x4 Red Foil Gift Box" and "5 1/2 x 11 1/2 x 1 Red Glossy Box." Sure, if somebody searched for a "6x6x4 Red Foil Gift Box," our page would show. But nobody is going to search that. There are ways to eliminate some of these extra pages, but it would be less user friendly for a customer clicking through the site.
My question is, if Google sees that these pages consistently get no organic traffic, even if they might rank for some obscure keyword, can keeping these pages have a negative effect on my rankings?
-
I would think you would want Google to find your product pages and then get you traffic for them. I dont think the solution is to use noindex as that would take them out of the index for sure.
I am betting that either due to your site archtecture or how you have your sitemap setup or even possibly that you have thin content on all the product pages are more of the issue.
If you don't want to work on any of those things, sure you can noindex all of your product pages, but then it just seems like you are giving up and limiting your long term outlook for ranking pages in Google.
The only reason I would use the noindex in a case like yours would be to keep duplicate product or category pages out of the index. Additionally, I would use that also to keep Google out of any of your search result pages, shopping cart etc. Those are the pages that are wasting Google's time. That brings up another point, are you having Google crawl a bunch of duplicate content on your site and that is why it never gets to the "good" content pages?
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Home page keyword in url
I have been looking into SEO for a few weeks now trying to perfect a homepage. Going through various sources on MOZ, and other examples out there on the internet, I keep seeing that you should have your keyword in the URL of the page. The homepage is the page most people want to rank the highest in google searches, however, you cannot put the keyword in the URL as most home page URLs are simply /. Should I actually make the home like this: www.example.com/key-word-example? I would imagine this would not be the normal for many users and would seem like it's not the home page.
On-Page Optimization | | Matthew_smart0 -
Pyramid link structure - how to noindex, nofollow
I'm talking about this article: https://mza.seotoolninja.com/learn/seo/internal-link Take this sample: HOME --> Shirts --> Plain shirt --> shirt#1 Product page: noindex, follow all links except 1 from breadcrumbs to nearest category (plain shirts). SubCategory page (plain shirts): noindex, follow all links except 1 link from breadcrumbs to nearest category (shirts) and all products belonging to current subcategory. Category page (shirts): noindex, follow all links except 1 link from breadcrumbs to front page (site.com) and links to own subcategories. Front page: noindex, follow all links except 12 links to main categories (shirts, pants etc.) Is it correct? If I noindex some parts of website, will it be harmful?
On-Page Optimization | | SilverStar10 -
Is it better to create more pages of content or expand on current pages of content?
I am assuming that one way of improving the rankings of current pages will be to create more content on the keywords used... should this be an expansion of the content on current pages I am optimising for a keyword or is it better to keep creating new pages and if we are creating new pages is it best to use an extension of the keyword on the new page – for example if we are optimising one page for ‘does voltage optimisation work’ would it then be worth creating a page optimised for ‘does voltage optimisation work in hotels’ for example and so on? I am guessing maybe both might help, this is just a question I have had from one of my clients.
On-Page Optimization | | TWSI1 -
Homepage On-page Optimization
How do you all handle homepage optimization, if you (or a client) offers a variety of services? Our homepage has the strongest link profile of any of our pages, but it lists all the areas of law we cover. Therefore, it has too many keywords and none really rank well. Should we just pick our most profitable areas and optimize for that? www.kempruge.com in case anyone would benefit from looking at the actual page. Thanks, Ruben
On-Page Optimization | | KempRugeLawGroup0 -
Page 2 is ranking
Hey All, I'm working on a wordpress site project and in analytics the sites ranking url is page 2. is this a problem?
On-Page Optimization | | CobraJones950 -
Autogenerated pages
My main product is database conversion software. As it supports tons of databases, it's fairly easy to generate thousands of landing pages simply by variating source/target database names, connection information etc. In fact, I autogenerated almost 25k pages that way. As I didn't want to jeopardize my main site, I placed all that content to a new microsite (www.fullconvert.com) which had no history and no inbound links. Results were nice - site is live two months and in second month already had 1300 visitors. Now, my question is - should I create the same thing on my (old and rather authoritative) main site www.spectralcore.com? I could use a different template to avoid duplicate content. Of course, my main concern is being penalized by Google. In my opinion, this autogenerated content is fine because it provides (tons of) laser-focused landing pages, so visitors will instantly recognize they found what they're looking for. But Google might disagree! What do you think? Is there a danger in trying to leverage authority of my main site in adding 20k+ autogenerated pages with inbound no links to them?
On-Page Optimization | | metadata0 -
Pages not cached
Sorry for all the questions. I have dozens of article pages that are not cached by google. How can I get them cached?
On-Page Optimization | | azguy0 -
Should one page with markers or six separate pages?
Hi - I'm working on a site that was set up with 6 bios on one page, with markers jumping to each person's name. I was thinking about separating those into 6 different pages, but not sure if that's the right thing to do. Advice about keeping the bios on one page vs splitting them up? (Am I more likely to rank for those peoples' names if I have a unique page, or is the one page url with each different marker in it, just as good?) Ranking well for those names isn't a huge goal of the site, but it would be nice to make the choice that would help with that rank. Thanks for your input Emma
On-Page Optimization | | emmas0