Google ignores Meta name="Robots"
-
Ciao from 24 degrees C wetherby UK,
On this page http://www.perspex.co.uk/products/palopaque-cladding/ this line was added to block indexing:
But it has not worked, when you google "Palopaque PVC Wall Cladding" the page appears in the SERPS.
I'm going to upload a robots txt file in a second attempt to block indexing but my question is please:
Why is it being indexed?Grazie,
David -
BJS1976 is correct. Take a look at Google's cached page and view the source:
The meta robots tag is not there, so Google hasn't re-crawled your site since this line of code was added.
-
Hi David,
When did you add the tag? Was it added after 9 Jul 2013 19:08:35 GMT ? (this is when Google cached this page last).
I would advise you not to add it to Robots.txt - This only prevents page from getting into the index, but it does not remove pages from the index.
I don't think the formatting matters - e.g, the space or no space - see this link: http://googlewebmastercentral.blogspot.co.uk/2007/03/using-robots-meta-tag.html
I would guess that Google has not re-crawled the page since you added the tag in.
If you want to get rid of it quickly, use Google Webmaster Tools > Remove URL.
-
Hi David,
I was checking your source and it says:
Is it possible that missing a space in code doesn't stop Google indexing it? (I think that's causing your issue)
Here's a documentation how to implement it correctly directly from Google
Hope it helps,
Istvan
Later edit: btw: it should be something like this:
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Robots.txt vs. meta noindex, follow
Hi guys, I wander what your opinion is concerning exclution via the robots.txt file.
Technical SEO | | AdenaSEO
Do you advise to keep using this? For example: User-agent: *
Disallow: /sale/*
Disallow: /cart/*
Disallow: /search/
Disallow: /account/
Disallow: /wishlist/* Or do you prefer using the meta tag 'noindex, follow' instead?
I keep hearing different suggestions.
I'm just curious what your opinion / suggestion is. Regards,
Tom Vledder0 -
Our rankings for "Tree Service" dropped last month
Hi, we've had a page www.savatree.com/tree-service.html which was ranking top 1-12 on the google rankings but has complete dropped out. We don't have any duplicate errors from that page on here. Do you have any suggestions? We do rank highly on Bing and Yahoo (1-2 pages). We can't figure whats going on.
Technical SEO | | SavATree0 -
Google is indexing blocked content in robots.txt
Hi,Google is indexing some URLs that i don't want to be indexed and also is indexing the same URLs with https. This URLs are blocked in the file robots.txt.I've tried to block this URLs through Google WebmasterTools but Google doesn't let me do it because this URL are httpsThe file robots.txt is correct so, what can i do to avoid this content to be indexed?
Technical SEO | | elisainteractive0 -
Meta-robots Nofollow on logins and admins
In my SEO MOZ reports I am getting over 400 errors as Meta-robots Nofollow. These are all leading to my admin login page which I do not want robots in. Should I put some code on these pages so the robots know this and don't attempt to and I do not get these errors in my reports?
Technical SEO | | Endora0 -
Does google "see through" php/asp redirects?
A lot of the time I see companies employing a technique like this: <a target="_blank" href="/external/wcpages/referral.aspx?URL=http%253a%252f%252fwww.xxxx.ca&ReferralType=W&ProfileID=22&ListingID=96&CategoryID=219">xxxxxa> Or similarly with php. In an attempt to log all the clicks that exit their site from certain locations. When google bot comes along and crawls this page, does it still understand that this page links to www.xxxx.ca?
Technical SEO | | adriandg0 -
Removing duplicate &var=1 etc var name urls from google
Hi I had a huge drop in traffic around the 11th of july over 50% down with no recovery as yet... ~5000 organic visits per day down to barley over 2500. I fixed up a problem that one script was introducing that had caused high bounce rates. Now i have identified that google has indexed the entire news section 4 times, same content but with var=0 var=1 2 3 etc around 40,000 urls in total. Now this would have to be causing problems. I have fixed the problem and those url's 404 now, no need for 301's as they are not linked to from anywhere. How can I get them out of the index? I cant do it one by one with the url removal request.. I cant remove a directory from url removal tool as the reuglar content is still there.. If I ban it in robots.txt those urls, wont it never try to index them again and thus not ever discover they are 404ing? These urls are no longer linked to from anywhere, so how can google ever reach them by crawling to find them 404ing?
Technical SEO | | Adsau0 -
"/" at the end of a URL
I just noticed that I have the exact same page showing up separately in my Google Analytics reports. One has a "/" at the end and the other does not. Otherwise, these are the exact same URL's. Is this something I need to be aware of from a duplicate content perspective? If so, how do I go about fixing this? I thought the SE's would automatically see that a URL with a "/" at the end is the same as one without, but if that is the case, why is it showing up in my reports as two separate pages?
Technical SEO | | Blockinc0 -
Correct 301 of domain inclusive "/"
Do I have to redirect "/" in the domain by default? My root domain is e.g. petra.at
Technical SEO | | petrakraft
--> I redirect via 301 to www.petra.at Do I have to do that with petra.at/ and www.petra.at/, too?0