Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How does the suggested website functionality work in Safari?
I don't seem to be able to find out much information on this one. Safari often shows a suggested website as you start typing a query into the browser. I've uploaded a screenshot to help show what I mean. safari-suggested-site.png
On-Page Optimization | | edwardlewis0 -
I need a fresh eye on this project, as I ran out of ideas
I know generally it's not a good idea posting project urls, however this time I'll break the rule as I could really use some genuine ideas: I just can't explain my rankings. So I created a small site, branded term, english language, I will use my British ranking data, you can use justproxy.co.uk to verify if you'd like. Site is 2 years old. My main keyword is Breast Actives, however my I describe the strangest phenomenon after the bullets. Site: http://buybreastactives.info So the point is: I did a little keyword stuffing back in the days, but removed it, took a safe middle density (analyzed the first rankers keyword usage). I've been looking at competitors backlink profiles comparing them to mine. The growth rates are similar. I have a little lower Domain and Page authority than the first few sites, but not that lower. Backlink quantity is somewhat similar to first 20, yet still I am ranking somewhere way beyond 200. I am not expecting a first place with a "somewhat similar" profile, but my bet is I should be at least in top 50. The only technique that worked was regular posting, I brought up the site into top 70, but as the site is really focused on a particular product, and the site's brewity suffered the price of posting semi-related articles, so I stopped. Rank out beyond 200. Another intresting aspect I cannot get my head around is that for "breast actives reviews" I have a dedicated page buybreastactives.info/real-customer-reviews, with some keyword usage, and another page buybreastactives.info/worldwide is ranking for it (around 80-90), but it does not use this keyword at all. So if you have some time to give it a glance I would be greatful for some thoughts. EDIT: Before penguin around 2012 dec site was in top 10 for nearly all terms targetted, with the stuffed keywords.
On-Page Optimization | | snetface0 -
Do javascript pseudo-links dilute link juice ?
Hi, On our ecommerce, we use multiple pseudo-links for the layered navigation (to filter by color, site, etc), so that google doesn't crawl every combination of filters. I know this kind of links don't pass link juice and don't get crawled (provided you hide the target urls in your javascript). But, as there is an "onclick" property, I'm afraid that google could understand that these are links, and treat them the same way as nofollowed links (not following them but diluting link juice anyway). Do you know if this is the case ? Thanks,
On-Page Optimization | | Strelok0 -
Link Structure
On my site I have a dropdown menu going across the page at the top to all of my categories on each page, I also have a similar structure going down the side going to the same categories, is this acceptable or would Google count this as double the internal links?
On-Page Optimization | | Palmbourne0 -
Should I have content on my home page or links to my articles
Hi, i have asked this question a couple of times without any luck so i am hoping third time lucky. My site www.in2town.co.uk has dropped in the rankings for two of my important keywords, lifestyle magazine and lifestyle news, so i am just wondering if i have to much content on the page for google to understand what the page is about. i am thinking to just have the links on my page instead of the intro to the articles, for example another online magazine does this, http://www.femalefirst.co.uk/ Can anyone please let me know if i should keep the intro to the articles or if i should go with the links idea like femalefirst does to help google understand that we are a lifestyle magazine any advice would be great
On-Page Optimization | | ClaireH-1848860 -
Spammy link for each keyword
Some people believe that having a link for each keyword and a page of content for each keyword (300+ words) can help ranking for those keywords. However, the old approach of having "restaurant New York", "restaurant Buffalo", "restaurant Newark" approach has become seen as a terrible SEO practice. I don't know whether this was because it's spammy or because people usually combined it with thin content that was 95% duplicate. Which brings us to; http://hungryhouse.co.uk/ Why does such a major company have the following on the site (see the footer); Aberdeen Takeaway Birmingham Takeaway Brighton Takeaway Bristol Takeaway Cambridge Takeaway Canterbury Takeaway Cardiff Takeaway Coventry Takeaway Edinburgh Takeaway Glasgow Takeaway Leeds Takeaway Leicester Takeaway Liverpool Takeaway London Takeaway Manchester Takeaway Newcastle Takeaway Nottingham Takeaway Sheffield Takeaway Southampton Takeaway York Takeaway Indian Takeaway Chinese Takeaway Thai Takeaway Italian Takeaway Cantonese Takeaway Pizza Delivery Sushi Takeaway Kebab Takeaway Fish and Chips Sandwiches Do they know something I don't? [unnecessary links removed by staff]
On-Page Optimization | | JamesFx0 -
Do external links drain PageRank?
Example: A page has 100 links, 90 internal links and 10 external links. The page has a Google internal PR of 1000. The question is: Is the pagerank that flows to the internal links being calculated taking into account all links on the page (internal + external) or only the 90 internal links? E.g. is the PR that flows to the internal links 1000/100 or 1000/90? Are links to external sites "votes" that do not affect the internal PR flow? Disclaimer: I understand that the maths behind the PR algo are more complex. This simplified example only serves to explain my question.
On-Page Optimization | | Florakel0