Duplicate Forum Content
-
HI everyone,
great to be here, absolutely loving everything, please go easy on me I'm quite a noob when it comes to seo, but hopefully my question isn't too basic.
After running the initial checks on my websites, I found there are 7,646 duplicate pages? Some are easy fixes but the majority are not, being forum pages, the edit, quote and new post links are coming up as duplicates of the main post?
Does anyone know how to fix this?
Best Lee
-
How delightful that you refer to Invisionpower as I recently took the software for a test drive and plan to purchase it in January
A question though that has been troubling me. I use a paid for hosting service, which forwards to one of my sub-domains. The problem is I have nearly 7k pages of duplicate content (all from the forum), I really want to add a no follow and then remove the forum pages from the search index and thus remove all of the duplicate content. Though I'm worried that adding no follow to the sub domain may impact on the main site.
I have a lot of page one search positions, many long tails which combined result in a lot of visits, but I also have a couple of short phrases that get 50% of the visits alone, so I can't risk making any changes, actually I'm pretty terrified to make any changes, just in case all of my website pages are removed from the index.
-
invisionpower forum is good choice, as i knew. Found duplicated content pages here, it happens with most of forums, but there is full provision that this can resolved by canonical or stop crawling one you don't want in robots.txt.
-
Hey
just found some valuable info which has solved a lot of my problems, modified .htaccess which has removed all of the non www links, so thats a part solve.
I think what I'm going to do is purchase the new forum software, setup a robot.txt to not crawl the new forums and then once I have all of the posts transfered to the new forum, remove the old forums from the index.
That should solve it, the new forum is very well established and if need be I can pay one of their developers to incorporate some seo feature that will stop the duplicate content issue. Once thats solved I can remove the robot.txt
Many thanks, Lee
-
Hi, still one more thing, because you sound loss, and that's not the meaning of this Q&A. Contact the forumservice and ask for the canonical, this is a very simple and common thing to do.
-
Ok thanks Leonie,
still no nearer to knowing what to do, I know theres a problem and generally what I need to do, but I'm still at a complete loss as to how to do it
But thank you for trying to help,
Best, Lee
-
Seo stuff is'nt that difficult, though it can be comlicated
Anyway I wish you luck with the forum and hope you'll manage to get it the way you wanted.
Grtz, Leonie
-
Mmmm this is becoming more problematic by the minute, will need to implement robot.txt before removing the urls.
And there was me thinking this seo stuff would be easy.
-
Lol, tha'ts also an option
under url's index, though they have to be removed first, otherwise google crawl them again. but there you can remove complete directories at once.
-
or go somewhere else lol, have been considering buying invisionpower forum for a while, this might be the final push I needed.
Is there a way of mass deleting pages from the index in webmaster tools, i.e. all links that contain edit, quote and new ect?
-
Ah okay, that will be difficult than.
Maybe you can ask them to implement the canonical url. It will be helpful for you to avoid duplicates
-
is a paid forum service, but they give you the ability to add code snippets in the head.
-
Hi Lee,
What kind of CMS are you using?
In wmt under parameters you can configure parameters. If the ur's contain the same parameter it is a posibility.
-
Hi Leonie,
thanks for taking the time to answer
Not sure if that will work, there is only one head (hope that makes sense). Forums work pretty much the same as content management systems. I have the ability to change what's contained in the head, but adding rel="canonical" will have the same effect on all pages, even the duplicate one (I think).
Is there a way of removing all pages from the index (in webmaster tools) that contain the word edit, or quote or new? Kind of like using a wild card?
-
Hi Lee,
I'm not very familiar with forums. but i think you can solve it by putting a canonical in the head.
If you have a main page, which is the post, put a canonical url in it:
the duplicate pages need to have the same canonical.
I hope this work for you.
Grtz, Leonie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are Duplicate Bio's Duplicate Content?
I'm wondering if I need to go through all the various bio's our firm has on all the various legal directory and client review sites to make sure they have unique bio's? I really, really don't want to do that, but if they are going to flagged as duplicate content, I will. I'm hoping sites like "findlaw," "avvo," etc, have some built in rel:cannonical or something that says these bio's aren't to be seen as unique content and therefore conflict with what's on our site. Anybody know? Just to clarify, any of the sties that have asked for unique content/bio/about us, I have complied with that. However, a lot don't specifically state it has to be unique, so I've just copy and pasted from our site in those cases. Thanks, Ruben
Content Development | | KempRugeLawGroup0 -
Content Writing Service Recommendations
I am looking to hire a content writer for our sites. Anyone familiar with a service where the manage the content on your site? Basically, come up with topics & content ideas, then writing the content. Please give me an idea of the pricing if possible. Greatly appreciate any help.
Content Development | | inhouseseo0 -
Duplicate Pages Different Content
Will duplicate pages different content hurt rankings/seo E-commerce Site is plugin style with WYSIWYG editor allowing for full customization, all pages are setup with basic default content. Ive created custom pages with content/keywords to begin seo on them I have two pages www.domain.com/sports/hockey and www.domain.com/nhl-tickets The first url is default, with a single H1tag, + Default Meta+Title tags, the second is the content rich page, and structured properly, both of which show up on the site, should I block the first url from displaying at all? The reason I am asking is because ive also setup breadcrumb links, which makes all of these category url's accessible on the site, I cannot edit breadcrumb links, we can either have them there or remove them. Thank you Very Much!!
Content Development | | TP_Marketing0 -
Someone wants to syndicate my content but I'm afraid
I GOT THE FOLLOWING EMAIL: Hi, I visited your site and would like to connect regarding nSphere syndicating your content into our search platform. We are interested in syndicating your content into our network. There’s no cost for this, we ask you to place a module on your site that reads your content and syndicates it into our network of millions of users. You only need to place a simple JavaScript code on your site. I have the code, but I would like to speak or email with you first. This module acts as search tool for your users as well. Can you email me or send me your number and a good day/time to connect? Thank you in advance.
Content Development | | UnderRugSwept
Matthew Mantyla | nSphere
Director of Media Integration I'M AFRAID OF DUPLICATE CONTENT. SHOULD I JUST IGNORE THIS; IS IT SPAM; OR COULD THIS BE AN OPPORTUNITY? I'M THINKING I SHOULD BE SUSPICIOUS OF THE FACT THAT HE DIDN'T EVEN PROVIDE A URL.0 -
What is the best practice for using the same content on two pages?
I have two websites in a very similar niche(s)...I have good unique content article that I would like to use on both sites because it adds value to the visitor experience.. Example: Science of Colors would be very useful for my seattle house painting paint colors page. I want to have content so they do not need to leave the site to navigate to second site. Would the identical content trigger a penalty or would it be crawled, ignored, and not indexed. Does having a rel=authorship on one site trump the site..Or is it a pile of BAD.
Content Development | | johnshearer0 -
Content being copied from our product page hurting our site overall?
On our product pages, he have short descriptions and some bulleted lists. Resellers of our products, and many other sites who are not resellers are copying this content, often verbatim. While I'm not as concerned for the product pages themselves as we're hoping the category pages will rank, does this duplication of our content hurt our site overall? FWIW, our brand name is in our domain and often also shown on these sites that copy the content.
Content Development | | minutiae0 -
Resolving duplicate text issues with a duplicate image?
We are a listing site for programs overseas. Many of our listings are inherently the same content, because in many cases the same exact information applies. We have resolved duplicate content issues to some extent by making some of the content in these listings unique. However, for the rest of the content which is going to be the same for about 100 pages, we were wondering if its better to have an image in place instead of duplicate text content (this would basically be an image of the text in question). We know this is a problem, because this is inherently duplicate content as well (only its a duplicate image instead of duplicate text). However, what's the best solution to this problem, and is a duplicate image just asking for trouble, or might this actually be a good idea?
Content Development | | dunklea0 -
Duplicate Content on WordPress Blogs?
We are getting ready to add a WordPress blog to our established website. Our plans are to place it in a subfolder on our website to maximize rank. My question is...Do we need to utilize a Meta Robots WordPress plugin by Yoast or similar so that noindex,follow robots meta tags will prevent search engine indexing of search result pages, subpages and category archives? We want to avoid the dreaded Duplicate Content Error and penalty. Any other great SEO WordPress plugins? Thank you for your time. Brian
Content Development | | gw3seo0