Meta Robots Tag - What's it really mean?
-
I used on a handful of pages recently and noticed that they're still popping up in the Google search index. I'd like to keep these from appearing, so I figured I needed a directive statement with stronger semantic meaning.
From what I understand, is what I'm looking for. Using this will keep Google from not only crawling the page, but indexing the page, as well.
I decided to see what the official robotstxt.org website said about it, so I checked (link here):
the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.
So, is their explanation saying that the page itself will be indexed, but the content / links on it won't be followed / indexed? Let me hear your thoughts, mozzers.
-
You can find out your desired meta robots setting by asking yourself two questions:
noindex or index: do you want this particular page to show up as a listing in the Google results for a query? Yes: index, No: noindex.
nofollow or follow: do you want the links on this page to be crawled (followed) by the search engine robots, thereby allowing them access to the deeper pages it links to (even though that particular page might even be noindexed). Yes: follow, No: nofollow
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Newer iteration of Avinash Kaushik's Web 2.0
Greetings all! Does anyone know if there is a more recent, but comparable, book that covers the topic of analytics like Avinash Kaushik's Web Analytics 2.0: The Art of Online Accountability and Science of Customer Centricity or Brian Clifton's Advanced Web Metrics with Google Analytics, 2nd Edition? These were published in 2009 & 2010. I know the core concepts remain the same, but the technology has improved greatly.
Reporting & Analytics | | AfroSEO0 -
Why is this tag not firing in Google Analytics?
I setup Google Tag Manager on this site- http://germanhausbarn.com I am trying to setup event tracking for the donate, newsletter, and Contact Us button at the bottom of the page. The most recent version is published, and I ran debug and it shows that they fire, but nothing is coming up in analytics. Any thoughts?
Reporting & Analytics | | EcommerceSite0 -
How to detect where Google gets indexed URL's
Google index some kind of way some links that create duplicate content. We doesn't understand how these are created so we would like detect where Google robots find these links. We tried: Moz Crawl Diagnostics but it shows 0 as Internal Link Count for these kind of links. Find some information from Google Analytics, that maybe there is trace (site content - all content) from visitors side. There wan't. We tried to find some information in Webmaster Tools under Internal link and HTML Improvements but didn't find any trace. Tried some search commands. Is there maybe some good one to search. TO search URL's form code with https://search.nerdydata.com.
Reporting & Analytics | | raido0 -
Ok. I'm just going to cut loose with my stupid question. What is internal link equity? What distinguishes an internal link with equity from one without equity?
What distinguishes an internal link with equity from one without equity? Is there a limit to how many of these I want? What's the rule-of-thumb? Cheers, Wes
Reporting & Analytics | | wrconard0 -
Schema Rich Snippet Markup tool is validating the markup but it says it isn't in Webmaster Tools.
All my Schema Rich Snippets are being validated in the webmaster tools Rich Snippet tester tool here http://www.google.com/webmasters/tools/richsnippets But when I go take a peek at the new tab in Webmaster tools when I'm signed into my analytics account it shows there are no active Markups on my site. Has anyone else been having this issue? If it says it's working in the Google tool from the link above should I even be worried if its not showing up when I'm signed into my analytics account? Thanks.
Reporting & Analytics | | DCochrane0 -
How serious are the Duplicate page content and Tags error?
I have a travel booking website which reserves flights, cars, hotels, vacation packages and Cruises. I encounter a huge number of Duplicate Page Title and Content error. This is expected because of the nature of my website. Say if you look for flights between Washington DC and London Heathrow you will at least get 60 different options with same content and title tags. How can I go about reducing the harm if any of duplicate content and meta tags on my website? Knowing that invariably I will have multiple pages with same content and tags? Would appreciate your advice? S.H
Reporting & Analytics | | sherohass0 -
Analytics tagging parameters effect on site SEO
One of the effective tools used in analytics tagging is the use of analytics parameters that starts with '?' or '#'. Example on site tagging: Main link: www.domainname.com./category/sub-category/ www.domainname.com./category/sub-category/?lid=topnav www.domainname.com./category/sub-category/?lid=sidenav All three links link to the same landing page, with an extra parameter. Using email or campaign tagging: www.domainname.com./category/sub-category/ www.domainname.com./category/sub-category/?utm_source=launch&utm_medium=email&utm_term=html&utm_content=getscoop&utm_campaign=hwdyrwm2012 With that we create many tagged links based on the campaign internal strategy. How do these effect indexing, and link juice? How do thy effect SEO in general?
Reporting & Analytics | | RAPPLA0 -
How much direct traffic is really direct?
Does anyone else think that a large chunk of traffic labelled as "Direct" in your analytics isn't direct at all. When you analyse traffic trends it seems that a large percentage could just be browsers with their referring URL hidden so it only appears direct. Here's the evidence: When we've been affected by major search algorithm changes, we've seen big changes in direct traffic as well as organic, but not in referral traffic. If direct traffic is just bookmarks, typed-in URLs, and people clicking through from emails why is direct traffic 85% new visitors? We don't do any offline advertising, so you'd expect genuine direct traffic to be returning visitors -- either our brand loyalists or subscribers to our email newsletters. If you segment direct traffic into new and returning visitors and look at a major algo update as discussed in 1), you find all the drop in direct traffic is from New Direct visitors, with no drop at all in Returning Direct visitors. Can anyone explain who these New, Direct visitors are if not simply mislabelled new, search visitors. Cookie deletion can't be the problem (ie: they can't be Returning, Direct really) because the traffic doesn't behave like returning, direct (that is, it varies too much). I'd be really interest to hear theories, and whether anyone has any figures on the extent of HTTP referrer blocking.
Reporting & Analytics | | Dennis-529610