Should I robots block this directory?

[CareerBliss]

There's about 43k pages indexed in  this directory, and while helpful to end users, I don't see it being a great source of unique content for search engines.

Would you robots block or meta noindex nofollow these pages in the /blissindex/ directory?

ie.

http://www.careerbliss.com/blissindex/petsmart-index-980481/

http://www.careerbliss.com/blissindex/att-index-1043730/

http://www.careerbliss.com/blissindex/facebook-index-996632/

[irvingw]

Totally agree with Ryan Kent. You should write a paragraph of content that is unique to the company featured. The chart is not unique enough and you will get flagged as having a high ratio of duplicate content. You should also look at all the other SEO elements on this page, understand what keyphrases you are targeting and modify the title, meta and H1 tags.

[RyanKent]

Should I robots block this directory?

I wouldn't.

Robots.txt in general should only be used when there is no other alternate means available to block content. An example is when your site is created by a CMS or e-commerce platform which does not offer the flexibility to noindex individual pages.

By blocking your site's content, you are preventing search engines not only from indexing the pages, but from following any links on those pages. You are restricting the way a crawler can travel on your site, which is generally a bad idea.

Additionally, I would suggest those pages offer value. "Petco salary comparison", "Target wages" and other search queries could generate results for those pages. Those pages contain helpful information which is otherwise not easily found on the internet. If that was my site, I would work to improve the optimization of those pages, not block them.