Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages Not Showing Up In Search After Being Indexed....
Hello, I'm trying optimize my google search for local business in Fort Myers, FL area. I've created specific keywords that people are searching and have made my page title and on-page experience reflect this relevency. However, the page isn't appearing anywhere on google search even though search console has stated that the page has been indexed. My question is, how do I trouble shoot this so that I can appear in local search for these search terms?
On-Page Optimization | | scottgray06200 -
My exactly website name is not in google search
my web site tournet.co but when i search that in google , google can not find it in search result . i have to say my website is a new site and its age is 3 month .
On-Page Optimization | | p.farrhad12365410 -
Putting review aggregation in product's navigation
Do you guys think it's a bad idea to put a review aggregation page in a product's navigation? Such as: "Which Brand of Men's Shampoo Is Best for You?" Rand suggests against it in this Whiteboard Friday as it interferes with a product's funnel, but I wonder if including it in navigation will give a domain and that page increased authority for a head keyword, such as "men's shampoo." What do you guys think?
On-Page Optimization | | Edward_Sturm0 -
Local searches
If a page is optimized for certain search terms that have "nyc" at the end of them, will that help the page appear when someone in NYC searches for the terms without the "nyc" part? Thank you!
On-Page Optimization | | nyc-seo0 -
Navigation causing too many links
If I add pages to my site to cover major cities/towns/counties in the UK where I offer wedding bands and link them from the navigation using drop down menus/categories ( I believe this is the best option to allow users to find what they are looking for) I get a'too many links on page' flag. How can I best get around this problem?
On-Page Optimization | | SamCUK0 -
Pages that show in Open Site Explorer that show as 404's in search
When I use Site Explorer to find our Top Pages there are a whole series of pages like this: http://www.nile-cruises-4u.co.uk/mybestbets/mybestbets-culture.html which I think were created when we had a Bulletin Board on the site. Although they are showing in the Top Pages results when you visit the page you get the following error message: HTTP Error 404.0 - Not Found The resource you are looking for has been removed, had its name changed, or is temporarily unavailable. What implications result from these pages still showing in results and what action should we take without messing up our search rankings? Any advice would be gratefully received.
On-Page Optimization | | NileCruises0 -
Search engine friendly URLs
I'm going to create some new content for my site, I'm trying to decide on the best search engine friendly format. Namely, is it ok to use a subdirectory or should I keep all content on root level? Is the SEO effect of either of these URLs superior to the other? domain.com/cooking/lasagna.php vs domain.com/lasagna.php
On-Page Optimization | | limens0 -
Should I include location in title tag to rank higher in local search
I'm working on a site for a small guest house (http://www.tommysonthebeach.com). I have created a Google Place page (Bing and Yahoo Local) as well and I have the address in the footer on every page. I have the location (Indian Rocks Beach) at the beginning of most titles tags because that is how people tend to search, e.g. "Indian Rocks Beach vacation rental." In theory I would think that I don't need location in the title tag because Google knows the location, and I could use the real estate for other keywords suchs as "pet friendly" or "beach hotel," etc. But when I look at the SERPS, those ranking highly all seem to have the location at the beginning of the title tag. Thanks. P.S. The site is currently not showing up in Google local search apparently because Google thinks it's a vacation rental agency, which are not allowed in local search. I'm trying to get that fixed.
On-Page Optimization | | bvalentine0