Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Frustrated by Google Search Result
We have a page on our website for our review of the "Voltage" shisha flavor by "Social Smoke" (Social Smoke is the brand). Voltage is one of their hookah tobacco flavors. https://www.hookah.org/social-smoke-voltage-flavored-hookh-tobacco/. When I search for "Social Smoke Voltage Review", our page is at the bottom of the first page result. We have a video, decent content on the page, and a review function. We've implemented correct Schema code too: https://goo.gl/iwCP7E. When I use the page grade tool on Moz. Our page ranks B for that keyword but the results number 1 and 2 and 3 on Google all rank C or D. Our video and review schemas don't show up on Google search result either. We have a good community online. Our social media pages are popular. We share the blog posts on the social media accounts fairly regularly too. We have an old and established website. From what I understand we are following all of Google's standards and rules too. What does a website owner gotta do?
On-Page Optimization | | Heydarian0 -
Do Search Engine Spiders Read Commented Out Content?
Do Search Engine Spiders Read Commented Out Content? Is commented out content detrimental?
On-Page Optimization | | lbohen0 -
Missing new pages in Search
Hi, We are on wordpress platform with category permalink structure site.com/category/categoryname. To pull in more SEO traffic, we created pages with structure site.com/categorynameand pulled in all the content from category pages to these new pages followed by applying no-follow on category pages within robots.txt. While it has been a week we applied these changes, we still see old category pages on google search with weird description ( A description for this result is not available because of this site's robots.txt... ) How could we make search results to replace old categories links with the new pages? thanks in advance
On-Page Optimization | | COEDMediaGroup0 -
Errors when checking W3C HTML after added Google Custom Search
hello, I have added google custome search to my website, and then check with W3C HTML, it report many error.
On-Page Optimization | | JohnHuynh
eg: there is no attribute "enableHistory" <gcse:searchbox-only enablehistory="true" autocompletemaxcompletions="5" au…<br="">or there is no attribute "resultsUrl" and so on ...</gcse:searchbox-only> Has anyone face with this problem, I don't know how to fix it. Please help!0 -
Do special characters ñ ã ô ä ö ü í à affect search results?
Dear Community, the google AdWords Keyword Tool shows e.g.: monthly global search for: "Satéré-Mawê Tribe" = 0
On-Page Optimization | | inlinear
but for "Satere-Mawe Tribe" = 320 (at least) But doing a search with or without using special characters,seems not to make a difference? as Google shows "the right" results even when people are making mistakes in spelling. On an english website I wantto use in the Title "Hunting, fishing and living with the Satéré-Mawê Tribe" using the correct Portuguese spelling. As Google Keyword tool tells me english speaking persons don't like using special characters... should I also leave them out in general or just don't mind? Thanks for any response
Holger0 -
Local search optimisation
One of the major keywords in our industry “fireplaces” is now viewed as a local search phrase & Google seems to be displaying website results that it views to be local businesses. We have 2 stores, and for some reason they do not appear high on the rankings despite us having a physical location near by... can anyone help? Also, we have a verified location on Google place, but even that doesn’t appear.
On-Page Optimization | | Ray_UK0 -
Accessibility search
Hello there, One of the sites we do work for is a chain of care homes. We are in the process of adding a page reader so any visitors they have who are visually impaired will find it easier to access the info they need. We're doing this from a usability point of view more than anything (given their target audience), but while looking to see if there were any accessibility news sites /directories we could leverage for some links I came across mentions of the old Google Accessibility search. It seems to have been before my time as an SEO, so I wondered: is this still relevant, or has it just been assimilated into the regular algorithm (the only mentions I could find were very dated) if relevant and separate from the main search, are there many who use it what other things should we take into account when trying to optimise for this (assuming it's still relevant, of course) Cheers guys!
On-Page Optimization | | themegroup0 -
How can I get a website to show up in local search in a major city when it is in the suburbs
We did a website for a local landscape company.they are in the outskirts of a major city of Dayton. Most people search landscape company Dayton area. I'm finding landscape companies coming up with lower moz trust and moz ranking. Some of them had no keywords or page titles. I am signing up on all of the local directories. the site is www.scarffs.com
On-Page Optimization | | MarkBolin0