Duplicate Forum Content
-
HI everyone,
great to be here, absolutely loving everything, please go easy on me I'm quite a noob when it comes to seo, but hopefully my question isn't too basic.
After running the initial checks on my websites, I found there are 7,646 duplicate pages? Some are easy fixes but the majority are not, being forum pages, the edit, quote and new post links are coming up as duplicates of the main post?
Does anyone know how to fix this?
Best Lee
-
How delightful that you refer to Invisionpower as I recently took the software for a test drive and plan to purchase it in January
A question though that has been troubling me. I use a paid for hosting service, which forwards to one of my sub-domains. The problem is I have nearly 7k pages of duplicate content (all from the forum), I really want to add a no follow and then remove the forum pages from the search index and thus remove all of the duplicate content. Though I'm worried that adding no follow to the sub domain may impact on the main site.
I have a lot of page one search positions, many long tails which combined result in a lot of visits, but I also have a couple of short phrases that get 50% of the visits alone, so I can't risk making any changes, actually I'm pretty terrified to make any changes, just in case all of my website pages are removed from the index.
-
invisionpower forum is good choice, as i knew. Found duplicated content pages here, it happens with most of forums, but there is full provision that this can resolved by canonical or stop crawling one you don't want in robots.txt.
-
Hey
just found some valuable info which has solved a lot of my problems, modified .htaccess which has removed all of the non www links, so thats a part solve.
I think what I'm going to do is purchase the new forum software, setup a robot.txt to not crawl the new forums and then once I have all of the posts transfered to the new forum, remove the old forums from the index.
That should solve it, the new forum is very well established and if need be I can pay one of their developers to incorporate some seo feature that will stop the duplicate content issue. Once thats solved I can remove the robot.txt
Many thanks, Lee
-
Hi, still one more thing, because you sound loss, and that's not the meaning of this Q&A. Contact the forumservice and ask for the canonical, this is a very simple and common thing to do.
-
Ok thanks Leonie,
still no nearer to knowing what to do, I know theres a problem and generally what I need to do, but I'm still at a complete loss as to how to do it
But thank you for trying to help,
Best, Lee
-
Seo stuff is'nt that difficult, though it can be comlicated
Anyway I wish you luck with the forum and hope you'll manage to get it the way you wanted.
Grtz, Leonie
-
Mmmm this is becoming more problematic by the minute, will need to implement robot.txt before removing the urls.
And there was me thinking this seo stuff would be easy.
-
Lol, tha'ts also an option
under url's index, though they have to be removed first, otherwise google crawl them again. but there you can remove complete directories at once.
-
or go somewhere else lol, have been considering buying invisionpower forum for a while, this might be the final push I needed.
Is there a way of mass deleting pages from the index in webmaster tools, i.e. all links that contain edit, quote and new ect?
-
Ah okay, that will be difficult than.
Maybe you can ask them to implement the canonical url. It will be helpful for you to avoid duplicates
-
is a paid forum service, but they give you the ability to add code snippets in the head.
-
Hi Lee,
What kind of CMS are you using?
In wmt under parameters you can configure parameters. If the ur's contain the same parameter it is a posibility.
-
Hi Leonie,
thanks for taking the time to answer
Not sure if that will work, there is only one head (hope that makes sense). Forums work pretty much the same as content management systems. I have the ability to change what's contained in the head, but adding rel="canonical" will have the same effect on all pages, even the duplicate one (I think).
Is there a way of removing all pages from the index (in webmaster tools) that contain the word edit, or quote or new? Kind of like using a wild card?
-
Hi Lee,
I'm not very familiar with forums. but i think you can solve it by putting a canonical in the head.
If you have a main page, which is the post, put a canonical url in it:
the duplicate pages need to have the same canonical.
I hope this work for you.
Grtz, Leonie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Content Duplication Issue On Content Publishing Site
I am running Free Article Posting site but I discover people are posting their content which already has been published on different sites before. What should i need to do in order to save my site from Google penalty.3 waiting for your kind help in this regard Thanks in advance
Content Development | | Mustansar0 -
Need suggestion to place longer content on products category page
Hi All, I wanted to place longer content on products category page, Currenty I am showing product listing first and then small description at the end of listing.I don't want to add longer content either bottom or top. I want to make two tabs at the top of each category pages like Products | Informtion In Product section (after clicking on it) I want to display all products listing & in Information tab (after clicking on it) 2-3 paragraphs of webpage content but I'm afraid If I will place the content in this way Google won't index content and my purpose of adding webpage content to target long tail keywords won't fulfill. Please suggest me if you have any better idea & let me know what I am going to do would be good or not in SEO perspective. Thanks
Content Development | | Alick3000 -
Need advice on Paying for content?
Hi, We would like to attracting more readers onto our blog by accepting guest posting from external bloggers. Could anyone refer any good artricles on MOZ about the best practices on managing the activities and what would be the normal KPIs and ROI?
Content Development | | LauraHT0 -
Is there a way to set up a wordpress site so that the content is changed based on a location?
I have a site I am building that has information that shifts based on weather conditions and location. Is there a way to have information sort based on a users geographic location? I am trying to figure out the best way to do this.
Content Development | | Ron_McCabe0 -
Tools to created embedded content...
Wondering if anyone has done this before,, this so, would they mind sharing the best approach please. To cut a long story short, one of our seo client is a free UK internet safety resource, backed by (but independent from the UK Govt), the site is heavily talked about by sites such as BBC, Guardian and many more newspapers and as a result the domain authority is creeping up to 90 - Oh to be given the chance to monetise a site with DA 90!!! As you can imagine, with the quality of the links the site picks up, the ranking of content on the site can be fairly easy, but the one problem we are facing is that of sites 'borrowing' our content. These sites tend not to be small bedroom bloggers, but rather all kinds of sites. We have seen our content on UK University websites, Police websites and many more whom should know better. Obviously this is hurting the 'borrower' more than us with regard to duplicate content but it would still be good to get some credit for our work without having to keep hunting the sites down and emailing back and forth. We don't need the credit for backlink purposes but would be nice to have people know we read it incase they want to read more. A solution I have pondered is to create embed options, as per youtube et al. Instead of sites having to copy our content to list it, they can still include our content on their site and avoid any duplicate content issues. As I believe the embedded content will be called from our site (I think that's how a youtube video works) our site would also get the read stats on the content regardless of where is it located. We are hoping that this could become a great content distribution tool, we don't need people to come to our site as the site is non profit, has no advertising but we need to justify the resources we get by showing how many people are reading what we publish. We are never going to be able to stop sites using our content so, like the music industry and itunes, if we can find a legal way to do it then we can all benefit. My main question, yes, I do actually have one!!!, is two fold. Is it possible to create embed for whole articles and am i right in my thinking that if our content is on Jeff's Blog and loaded as an embed then the hit on the content is still reflected in our stats as the content is being pulled from our url? Sorry for the excessively long way of explaining this, any feedback is welcomed, even 'don't do it, it's stupid idea'!!
Content Development | | Grumpy_Carl0 -
Any freelance writers with viral content / linkbait experience?
Looking for a great freelance writer to assist in creating linkbait and viral content pieces. Please contact me if you are, or know of, such a person. 🙂
Content Development | | AdamThompson0 -
Duplicate Content - Video
I recently noticed a drop in rankings for my site shortly after the new algorithm update. I'm not sure exactly why rankings went down, but would like to know if it has to do with having videos on our site that do not belong to us. We have a few videos on product pages that the manufacturer of the product had created. I was wondering if Google maybe thinks we are maliciously stealing these videos or something and penalizing us for it. And if stuff like this has anything to do with the recent algorithm update. We make our own videos, but some of our manufacturer's videos are just better... and they work with us and are glad for us to have their videos listed. Thanks in advance
Content Development | | poolguy0 -
Is this Duplicate Content?
I searched a snippet of one of our Articles (in quotes) and got two results back in Google, one for the article on our site and one for our development/staging site. Does that mean that our development site is getting indexed by Google, even thought we "Disallow:/" in the robots.txt file? Is this a big duplicate content issue? Thanks
Content Development | | poolguy0