Accidental Noindex/Mis-Canonicalisation - Please help!
-
Hi everybody,
I was hoping somebody might be able to help as this is an issue my team and I have never come across before.
A client of ours recently migrated to a new site design. 301 redirects were properly implemented and the transition was fairly smooth.
However, we realised soon after that a sub-section of pages had either one or both of the following errors:
- They featured a canonical tag pointing to the wrong page
- They featured the 'meta noindex' tag
After realising this, both the canonicals and the noindex tags were immediately removed. However, Google crawled the site while these were in place and the pages subsequently dropped out of Google's index.
We re-submitted the affected pages to Google's index and used WMT to 'Fetch' the pages as Google. We have also since 'allowed' the pages in the robots.txt file as an extra measure.
We found that the pages which just had the noindex tag were immediately re-indexed, while the pages which featured the noindex tag and which were mis-canonicalised are still not being re-indexed.
Can anyone think of a reason why this might be the case? One of the pages which featured both tags was one of our most important organic landing pages, so we're eager to resolve this.
Any help or advice would be appreciated.
Thanks!
-
I'm not sure how helpful it is, in the sense of being good news, but I did something like this to one of my sites on purpose once, and wrote it up:
http://www.seomoz.org/blog/catastrophic-canonicalization
A couple of tips:
(1) I think what Oleg is saying, which I agree with is that if Page A had a canonical to Page B, instead of just removing the canonical tag, put in a canonical tag pointing from Page A to Page A. Sometimes, the self-referencing canonical will help over-ride the old/bad canonical.
(2) Fetch is a good bet, but I'd also re-submit an XML sitemap with just the "bad" URLs. It's not a cure-all, but it can help nudge Google.
Unfortunately, it really can take time to sort out. Make sure your internal links are correct as well. You could temporarily build new internal links (list a few resources on your home-page, for example) to push link-juice temporarily. You could also post the proper URLs on Twitter/FB, etc., to kick them a bit. Of course, that only works for a few pages, not for hundreds.
-
Yes it may just be a waiting game as Oleg mentioned. But perhaps to help speed up the process you could link to some of those pages from a higher level page (like the homepage or a department landing page).Don't spam tho, no more than 100 links on a page (including navigation/footer etc).
I'd also recommend having an XML sitemap with all the URLs of your website on it. You'll need to upload this to Google Webmaster Tools as well.
When they do get re-indexed keep an eye out for how they have been indexed; so look at what keywords bring up that page in SERPs (Raven Tools is an easy way to track keywords and see which URL comes up). If you find that 'odd' pages are being indexed for a certain keyword search you should do some link building specific to the keyword you want ranked pointing to the page/URL you want ranked.
Good luck!
Davinia
-
Hi Oleg,
Thanks for your response. Unfortunately the canonical URL was another of our main organic landing pages so a redirect wouldn't be appropriate in this situation.
I agree that it's just a matter of time but it's frustrating that Google has crawled the site since we updated the pages and still hasn't re-indexed the page in question.
-
Can you set a canonical/redirect on the page that was incorrect pointing back to the correct page?
i.e. page1.html had wrong canonical to pgae1.html -> change pgae1.html canonical to page1.html
Overall, I think it's just a matter of time before Google is able to recrawl and fix itself... it's odd that canonical + noindex is slower than just noindex. Do whatever you can to get G to recrawl the pages.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
NOINDEX,NOFOLLOW Mistake
One of our top organic landing page was set as "NOINDEX,NOFOLLOW" by "mistake". I took me about a week to realize this after I saw a drop of traffic on that page. I looked on Google to see if it was indexed and my fear were confirmed! After finding our that it was switched to "NOINDEX,NOFOLLOW" I switched it back to "INDEX,FOLLOW" and did an index request in our Google Search Console. Anyone else has run into a similar issue? Did you ever got the page inxed again?
Intermediate & Advanced SEO | | FrankViolette2 -
Help to identify that this SEO agency is doing a TERRIBLE job
Hi folks, I am working with a group for which I do SEO etc. for one part of the group. Another part of the group hired an SEO agency to carry out their SEO for them (before I joined). In short, they are doing a terrible job by building links in very dodgy directories (ones which get taken offline) and via machine generated 'articles' on horrendously bad 'blogs'. Please take a look at these 'articles' and leave your thoughts below so I can back up the point that these guys are not the kind of SEOs we should be working with. [List of links to articles removed by moderator] Many thanks in advance, Gill.
Intermediate & Advanced SEO | | Cannetastic0 -
2015/2016 Sitemaps Exclusions
Hello fellow mozrs!
Intermediate & Advanced SEO | | artdivision
Been working on a few Property (Real Estate for our American friends) websites recently and and two questions that constantly come up as we spec the site are: 1. What schema (schema.org) should the website use (throughout all pages as well as individual pages). Did anyone found that schema actually helped with their ranking/CTR?
2. Whilst setting up the sitemaps (usually Yaost is our preferred plugin for the job), what page would you EXCLUDE from the site map? Looking forward to some interesting comments.
Dan.0 -
Noindexing Thin News Content for Panda
We've been suffering under a Panda penalty since Oct 2014. We've completely revamped the site but with this new "slow roll out" nonsense it's incredibly hard to know at what point you have to accept that you haven't done enough yet. We have thousands of news stories going back to 2001, some of which are probably thin and some of which are probably close to other news stories on the internet being articles based on press releases. I'm considering noindexing everything older than a year just in case, however, that seems a bit of overkill. The question is, if I mine the logfiles and only deindex stuff that Google sends no further traffic to after a year could this be seen as trying to game the algo or similar? Also, if the articles are noindexed but still exist, is that enough to escape a Panda penalty or does the page need to be physically gone?
Intermediate & Advanced SEO | | AlfredPennyworth0 -
Googleon/off tag does it work
Hi I am currently working on a page where I have some of the content across all pages. Rewriting it to make it unique is not an option I am afraid. I came across a tag called Googleon/off that will tell google not to index a certain part of a give webpage but will this ensure that it is not seen as dupplicate content? https://developers.google.com/search-appliance/documentation/610/admin_crawl/Preparing
Intermediate & Advanced SEO | | AndersDK0 -
Not ranking as well in Yahoo/Bing as in Google. Why?
For my top 132 keywords, my target ranks an average of 7 positions lower in Bing and an average of 9 positions lower in Yahoo. Does anyone have some good resources to read, or any tips on why we would rank so much poorer in Bing/Yahoo than in google?
Intermediate & Advanced SEO | | adriandg0 -
1st Campaign - Advice please.
We have just run our first campaign for our site and have found over 5,335 errors! It would appear that the majority of which are where the crawl has duplicated the product page with the "write a review - Tell a friend page"...hence a large number of errors. In addition we also have over 5,000 302 warnings for the following URL: URL: http://www.collarandcuff.co.uk/index.php?_a=login&redir=/index.php?_a=viewCat&catId=105 Please bear in mind we are fairly new to this type of data....so go easy on us. In short, will these errors have a significant bearing on our rankings etc and if so how do we rectify? Many thanks. Tony
Intermediate & Advanced SEO | | collar640 -
Domain Authority / Page Authority
I manage a site that has home page authority of 69, and overall domain authority of 63. To improve domain authority, would it help to remove some of the pages that have 0 page authority? There are over 1,000 pages to this site, and I always thought that the more pages you have, the better (generally). But, does it actually hurt the site to have pages that Google perceives as having 0 page authority, or does this have no bearing? Any insight would be greatly appreciated.
Intermediate & Advanced SEO | | DiscoverBoating0