Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Correct robots.txt for WordPress
Hi. So I recently launched a website on WordPress (1 main page and 5 internal pages). The main page got indexed right off the bat, while other pages seem to be blocked by robots.txt. Would you please look at my robots file and tell me what‘s wrong? I wanted to block the contact page, plugin elements, users’ comments (I got a discussion space on every page of my website) and website search section (to prevent duplicate pages from appearing in google search results). Looks like one of the lines is blocking every page after ”/“ from indexing, even though everything seems right. Thank you so much. FzSQkqB.jpg
On-Page Optimization | | AslanBarselinov1 -
Combining adjacent image and text links
Hey, The pages on one of our sites has a lot of links on it, which I have read a couple of times can be bad for SEO, although many say don't worry too much about it. However, I was thinking to reduce links and also reduce code size combining adjacent image and text links. For example they current look like this:
On-Page Optimization | | mdeluk
"
Products page" I am thinking maybe I should change to the following:
"Products page" However, is this bad code and therefore could be bad for SEO? I have tried Googling this but couldn't seem to find anything on it.0 -
Need Some Quality Vs. Quantity SEO Advice
We have a gallery here with our main categories of patches. https://www.stadriemblems.com/gallery/ If you click on one, say Fire Patches, you'll be taken to a page of just fire patches. https://www.stadriemblems.com/fire-patches/ But here's the kicker: If you notice of the fire patch page, there are also sub-categories to that. So if you click on say, Fire Rescue, you get taken one level deeper. https://www.stadriemblems.com/fire-patches/fire-rescue-patches/ I'm redoing this entire site (a project over five years overdue), and I'm wondering if it's really worth it to keep these three-level deep sub pages. I originally created them with long tail SEO in mind, making us be the only ones who come up when people search for very specific patches. But it's a big undertaking to redo all of them, and are they really adding any value?
On-Page Optimization | | UnderRugSwept0 -
How to block index of link and content
Hi, We have pages where articles are shown and in the sides we have small snippets of Articles which shows the title and close to 25 words and a image. When i search for something in Google the snippet image and content is shown and in Google when clicked it redirects to a page which is not meant to be shown for the keyword the visitor is querying Is there a way i can block all the links and content shown in the right and left side of the page so Google does not get confused with the page content thats not related to that page? thanks
On-Page Optimization | | AlexisWithers0 -
URL Structure Suggestion
Hi
On-Page Optimization | | sandeep.clickdesk
My site url: http://goo.gl/AiOgu1
We are working on URL structure of our website. I have one query about URL structure.
Which one is good URL structure according to user and SEO prospective.
The targeted keyword for the particular page is "wordpress live chat". Is it worthful to rewrite the present url "https://www.abc.com/wordpress" to "https://www.abc.com/wordpress-live-chat" Please suggest.0 -
To use a fdqn or relative address in an internal link or not
Is it better to use my fdqn of http://1stclassdriving.co.uk/ or ~/ or ../ and then page name address for internal links or not? or does it just not matter for seo rankings?
On-Page Optimization | | brianw100 -
Too many links
My site index has recently showed up during crawl - with a warning of too many links (885). Should I be adding the no follow tag to this page? Wall Quotes, Vinyl Wall Quotes, Family Sayings, Baby Boy Quotes http://www.enchantingquotes.com/ind.html Thank you!
On-Page Optimization | | joziepaige0 -
The SEOmoz crawler is being blocked by robots.txt need help
SEO moz is showing me that the robot.txt is blocking content on my site
On-Page Optimization | | CGR-Creative0