How can I check if the FOLLOW,NOINDEX tag is working?
-
Hi everyone!
After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content.
You can find an example below:
http://www.inmonova.com/en/properties?page=2
I have been checking yahoo site explorer and result pages still get indexed. My question is:
Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect?
Thanks in advance.
-
Excactly what I was looking for. Thanks.
-
There are sites out there like http://www.noindexchecker.com/ that will help you double check your work
-
Thank you very much for your quick responses!
I will wait patiently to see those dulicates drop down
-
Daniel is correct. You just need to be more patient.
Websites are crawled in pieces. The crawler can grab 10% of your site each day. It depends upon the popularity of your site, the popularity of the content within your site, how well your site is linked, along with other factors.
You have done all you can for now. You will see your pages start disappearing from search results.
-
The code is correct and I see that there are 0 links to that results page - the only thing I can think of is the search engines indexed the page before you added the tag!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can anyone recommend an SEO workflow?
I've been seeing great results with my efforts in the last few months. But I think my workflow is a mess is non-existent! Does anyone have a specific workflow that I could use as a base?
Intermediate & Advanced SEO | | Madstrategist1 -
How Can A SubDomain Out Perform A Root Domain?
Hi guys! I have a rather strange SEO question. It may not be that strange at all actually. If a site has a subdomain or a shopping cart that is on a subdomain through a third-party shopping cart provider, can the third party shopping cart transfer value to the subdomain causing the subdomain to have greater domain authority than the main site or root domain? Another question, this subdomain, up until yesterday, blocked google from crawling it with robots txt, however it has a much higher domain authority than the root domain. The root domain has a really low domain authority, despite not blocking google from crawling it. How is this possible? I hope these questions make sense. I am a little stumped & trying to figure out why the subdomain is out-performing the main site despite being hidden from search, if that's even the case. Please let me know if I have it all wrong..
Intermediate & Advanced SEO | | Prae0 -
Sanity Check: NoIndexing a Boatload of URLs
Hi, I'm working with a Shopify site that has about 10x more URLs in Google's index than it really ought to. This equals thousands of urls bloating the index. Shopify makes it super easy to make endless new collections of products, where none of the new collections has any new content... just a new mix of products. Over time, this makes for a ton of duplicate content. My response, aside from making other new/unique content, is to select some choice collections with KW/topic opportunities in organic and add unique content to those pages. At the same time, noindexing the other 90% of excess collections pages. The thing is there's evidently no method that I could find of just uploading a list of urls to Shopify to tag noindex. And, it's too time consuming to do this one url at a time, so I wrote a little script to add a noindex tag (not nofollow) to pages that share various identical title tags, since many of them do. This saves some time, but I have to be careful to not inadvertently noindex a page I want to keep. Here are my questions: Is this what you would do? To me it seems a little crazy that I have to do this by title tag, although faster than one at a time. Would you follow it up with a deindex request (one url at a time) with Google or just let Google figure it out over time? Are there any potential negative side effects from noindexing 90% of what Google is already aware of? Any additional ideas? Thanks! Best... Mike
Intermediate & Advanced SEO | | 945010 -
Original Source Tag or Canonical Tag for News Publishers?
I have been sourcing content from a news publisher who is my partner for publishing content online. My website deals with sourcing content from a couple of websites. I did use a canonical tag pointing towards the respective syndicated source but I have not seen traffic for those articles. I did some research and found out that Google does have a tag for news publishers which is the "original-source" tag which helps news publishers to give proper credit for their work. Here's a link to the official word by Google" https://news.googleblog.com/2010/11/credit-where-credit-is-due.html Although Google has officially stated that the "syndication-source" tag has been replaced by the "canonical" tag. However, there is no mention about the "original-source" tag.
Intermediate & Advanced SEO | | Starcom_Search
Can I still use the "original-source" tag to syndicate content from my partner site instead of the "canonical" tag? P.S.: The reason why I am not convinced with the use of the canonical tag is because:
1. As per what Google says, duplicate content won't harm my website unless it is spam. (And since we are rightfully content from our partner'website and showcasing it to a larger audience by hosting it on our website as well, we are thereby not indulging in any unethical practices) 2. The canonical tag could possibly hamper my crawl bandwidth issues as it would essentially need the crawler to crawl the whole page to figure out that the canonical is present, post which any possible valuation that my site could have garnered gets lost.3. Moreover, since I am from the news, media and publication industry, content republication is a widely accepted practice and in such cases simply including a link to the original source of the article or using the original source tag should suffice, That being mentioned, I do not want to go ahead without taking a second opinion about this. Kindly help me to resolve this issue.0 -
Competitor Title, can I use the same???
there are some pages, my competitor is ranking well and also, we have done page optimization it is 100% for page title keywords as im going to use the same title of the competitor? Will this affect me? Pls suggest wht should I do..
Intermediate & Advanced SEO | | Rahim1190 -
Can the experts out here can review our site for improved performance and suggestions
Hi - we have started off with Auto Site based in India - 15 months back The site is - www.mycarhelpline.com - generating close to 2500 visits / daily basis. we aim to scale to new heights to touch atleast 10,000 visits / daily basis in coming 12 months Can we request your review to recommend for :- Link Building Site review Loading time Improvements / suggestion to take it up - (leaving aside dynamic url's) . Though may seem as SEO Audit and review - but any recommendations or suggestion will be highly appreciated.
Intermediate & Advanced SEO | | Modi0 -
Can this site be optimised?
I have been told that because of the technology this site was developed with it cannot be changed for example urls title and meta tags cannot be changed. why is that and what other types of sites also cannot be changed. http://www.alliedpickfords.com/Pages/Landing.aspx For example i have been told alot of online stores cannot be optimised because the urls change every time some one goes to the page therefor you cant lionk to a certain page is that true and what is the way around it if any.
Intermediate & Advanced SEO | | duncan2740 -
Nobody Can Answer This? What Can Google Tell About Videos?
I uploaded a video to youtube one time and then went to upload it again, but saved differently with different tags. Youtube rejected the second upload as being the same as the first. Really, it was the same... just a different file with different tags. Now, I was thinking about making and uploading some similar but not identical videos for embedding on some web pages. Was thinking I'd make the voice overs different, but the images mostly the same montage. Do you think Youtube/Google will see it as the same video? I kind of assume that it didn't fly when I first tried it some time ago because youtube was looking at the audio in the way it can make a transcription. Do you think if the audi,o, file name, tags were different, it wouldn't matter if the video was the same? Thanks!
Intermediate & Advanced SEO | | 945010