SEO impact on archives and mirror services?
-
Hi,
We're looking at setting up an email archive site for certain lists related to our niche. We've been considering using archives.ourdomain.com versus ourdomain.com/archives. Part of the problem is that while the archives won't initially have huge amounts of content, over time it'll outstrip the amount of content we produce and I was worried about whether or not this would cause a duplicate content penalty as the emails will also be archived elsewhere.
If the volume of mails over time combined with duplication penalties are going to penalise the site, I'd rather we used a subdomain or a separate domain. If not, then subdomains might be the way to go.
-
I meant include this robot in the subdomain not include the subdomain in the robot. Was answering an employee at the same time and crossed some wires.
-
You have a few choices here to avoid that.
If you want to avoid it completely, simply include this entire subdomain.domain.tld in the robots.txt as:
User-agent: *
Disallow: /
Disallow: *Then place it in the root of your subdomain folder, for example if you sub was at subdomain.domain.tld you would normally have a folder called subdomain within your normal root folder.
Do not place this robots.txt file in your main folder or the whole site will not be indexed.
Extra measure, you can place a:
in the head section of each page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blog or article length and SEO value
Why do different blog lengths affect SEO differently? Is it directly affected by Rankbrain or the Google Algorithm, or is it more because of user engagement?
Content Development | | CyrusDariusXerxes0 -
Project content marketing SEO value and Traffic
I'm creating a content marketing plan and need to project the visitor impact it could have on an exact-keyword domain name. The plan will produce at least 10 quality, original articles per day. Are there any common metrics or ways to guess what the visitor impact could be?
Content Development | | msantore821 -
Updating blogs - SEO best practice
Thinking of new blog content and one option obviously is to check out historical popular blogposts via Analytics and do fresh versions of those. So my question is what is best practice: 1. Copy and paste the old blogpost copy but edit it to be slightly different while still having the old blogpost live or 2. just update the old one and re-promote I assume it's better to have a new version of the blogpost?
Content Development | | digitalbua1 -
Advice on the layout on this page for user experience and seo
Hi, we are testing a new website using wordpress, we have never used wordpress before and normally use joomla so we would like some advice to make sure the page below is good user experience, good for seo and the layout of the page including text style and size and paragraph space is ok would love your feedback here is the page http://www.cheapflightsgatwick.com/david-cameron-economic-rescue-plans-fail-as-families-are-forced-to-give-up-holidays/
Content Development | | ClaireH-1848860 -
Blog for SEO
Hello, When setting up a blog for seo, are same rules applied as far as keyword density, exact, phrase & broad match etc? We are in the process of setting up a blog on our site, with wordpress and want to start off on the right foot. Thank you
Content Development | | TP_Marketing0 -
Clear examples of SEO success with content marketing needed.
I know SEOmoz is always going on about content marketing as the best SEO tactic, but I'm struggling to achieve search engine success with it for my site. Has anybody very successfully pursued a content marketing strategy for their site in a competitive niche? Can you give us the examples? (including the keywords you succeeded for). Any help greatly appreciated. Thanks
Content Development | | kevinmorley0 -
Blog Anchor Text SEO Query
Apologies if the following is a basic question but I am just starting out with SEO and I have seen this quite a lot recently on sites I have been on. My question is if you have a self hosted blog e.g. blog.site.com or site.com/blog and you use keyword anchor text in your blog post does that bring SEO benefits in itself or does the blog post have to be shared/commented by readers to have an effect? I have seen/heard of many sites spending a lot of money getting copy done or spending their own time and resources starting a blog but the blogs remain unshared or comment-less. I am starting my own blog to go with my social media and website so I wanted to establish the basics. Thanks in advance guys.
Content Development | | jannkuzel0 -
Displaying archive content articles in a writers bio page
My site has writers, and each has their own profile page (accessible when you click their name inside an article). We set up the code in a way that the bios, in addition to the actual writer photo/bio, would dynamically generate links to each article he/she produces. Figured that someone reading something by Bob Smith, might want to read other stuff by him. Which was fine, initially. Fast forward, and some of these writers have 3,4, even 15 pages of archives, as the archive system paginates every 10 articles (so www.example.com/bob-smith/archive-page3, etc) My thinking is that this is a bad thing. The articles are likely already found elsewhere in the site (under the content landing page it was written for, for example) and I visualize spiders getting sucked into these archive black holes, never to return. I also assume that it is just more internal mass linking (yech) and probably doesnt help the overall TOS/bounce/exit, etc. Thoughts?
Content Development | | EricPacifico0