What is the best way to block http://www.site.com/members/...
-
How do i block http://www.site.com/members/....name/activity/3202 and many more like this from getting spider
showing up as duplicate in moz
Regards Tai
-
Thanks for the answer and for endorsing the question.
Regards Tai
-
I would block those pages within the robots.txt file and with a Meta Noindex tag. Moz has a good article explaining the robots.txt file and how to block access to certain pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best site structure for us?
Hey guys, I have a somewhat silly question that I probably know the answer to - but would still like to hear your POV's. We're a WP theme making company but we also build other stuff. Context: 1. All demos for themes currently go under domain.com/Theme_A/ The demo is lorem ipsum so is marked noindex nofollow. That being said we get rocking analytics data usually (not sure if it's still valuable for G after the noindex). 2. Currently we need landing pages for themes and we're running them under domain.com/Theme_A/optimized-landing-page-title.php dofollow and indexed ofc. My question is...Would we be better off to include all landing pages under a domain.com/wordpress-themes/ category/tax and then go for the optimized-landing-page-title.php page? Does it make any difference either or? Right now we're not REALLY running them on subdomains (though the structure seems like it), they're just folders. We're thinking that more seo juice would flow through the different pages if we have them all under the same category, rather than basically starting from scratch each time under a new folder. Right? Thanks!!!
On-Page Optimization | | andy.bigbangthemes1 -
Random /feed 404 error from a wordpress site
My Moz Analytics report shows a 404 error on a page which I think should not exist at all. The URL is http://henryplumbingco.com/portfolio-item/butler-elementary/feed/. When I checked webmaster tools, it looks like there are a number of random /feed urls throwing 404 errors. I am using WordPress and the Enfold theme. Anyone know how to get rid of these errors? Thanks,
On-Page Optimization | | aj6130 -
Linking Out To External Sites
Hi, All If I have created a (website, logo, email campaign) for a client and written an article about it with screen shots on my website and link to them with a (do-follow) link how does Google see the (do-follow) link? Regards to the sites they have one link in the footer on the home page, which is a (do-follow) back to our site. Also, the websites are not in my Niche.
On-Page Optimization | | deskjet0 -
Best URL structure for my page
Hey everyone, I am wondering what is the best URL structure for my activity booking page in Bali. http://www.thingstodoinbali.com/bali/sports/water-sports/rafting/ or http://www.thingstodoinbali.com/bali/sports/water-sports/rafting-bali/ or would you recommend something else? Most people would google for "activity bali" in this case "rafting bali". Please advice. Thanks for your time and help in advance!
On-Page Optimization | | c.eiermann0 -
How do i block an entire category/directory with robots.txt?
Anyone has any idea how to block an entire product category, including all the products in that category using the robots.txt file? I'm using woocommerce in wordpress and i'd like to prevent bots from crawling every single one of products urls for now. The confusing part right now is that i have several different url structures linking to every single one of my products for example www.mystore.com/all-products, www.mystore.com/product-category, etc etc. I'm not really sure how i'd type it into the robots.txt file, or where to place the file. any help would be appreciated thanks
On-Page Optimization | | bricerhodes0 -
Long tail traffic - what is the best way to go back and add focus to repetitive long tail keywords?
Hey everybody, So, our niche doesn't have a million and a half searches per month, which makes a handle full of visitors look mighty enticing to a CMO Our price point is very high too, so to the question, is it worth taking the time to put a whole new content strategy in line for a few new visitors, the answer is yes. Now's the hard part. How on earth do I make 1,000 pages for similar topics? Is making new pages the best way to go about this? (probably so right? It's the only thing that I can see that would certainly increase likelihood of being more relevant, plus if I don't I will be missing out on the benefits of beefing up our site, AND the opportunity to more specifically answer a users query.) With phrases like "keyword" and "aftermarket keyword," the searcher is asking for two totally separate collections of results. I'm always reading about the importance of being there throughout the buyers complete purchasing /research process, which makes me think that considering doing anything other than creating unique pages is simply missing out.. Suggestions? Massive Content Strategy Help? Anybody? Thanks, TA
On-Page Optimization | | TylerAbernethy0 -
How to best use our blog posts for SEO?
My company recently created a WordPress hosted blog. It is hosted completely separate from our company site. The primary domain for the blog is blog.mydomainname.com, but we immediately created a folder within our company website for www.mydomainname.com/blog that has a reverse proxy to the blog itself. I'm curious though if we should consider taking the content from the blog posts and re-creating that within our company website as well? The blog posts are very good SEO rich content, and we always struggle to find new content to put on our company website as it is already. Would like to get some folks thoughts on this. Thanks!
On-Page Optimization | | KHCreative0 -
Why is our site dropping in Domain Authority
Hi all, I have a question. I have been working SEO on our site www.betxpert.com for the last 4-6 weeks and I have been looking forward to seeing the new DA and PA numbers. However today, our DA is now 30...where it was 31 or 33 a couple of days ago. How come the decrease? I have only improved the site i should say... Hope someone can shed a little light on the issue... -Rasmus
On-Page Optimization | | rasmusbang0