How long will Google take to stop crawling an old URL once it has been 301 redirected
-
I need to do a clean-up old urls that have been redirected in sitemap and was wondering about this.
-
I agree with Ryan. As long as the old URLs are out there in the web, Google will follow them.
At the same time, redirected URL list will be very lengthy if you are maintaining a big site and maintaining them will consume your resources.
Check link value of the old URLs as a first step. If they have no value then you will be fine to retire such old URLs.
-
Google's crawler will always attempt to crawl any links it finds. If somewhere on the internet there is a link to an old URL and Google sees that link, it will never stop trying to explore that link. Each time it attempts to crawl the link, it will see the 301 and follow the redirect, but if you ever remove that redirect then the original URL will be seen.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My Website stopped being in the Google Index
Hi there, So My website is two weeks old, and I published it and it was ranking at about page 10 or 11 for a week maybe a bit longer. The last few days it dropped off the rankings, which I assumed was the google algorithm doing its thing but when I checked Google Search Console it says my domain is not in the index. 'This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed.' I click request indexing, then after a bit, it goes green saying it was successfully indexed. Then when I refresh the website it gives me the same message 'This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed.' Not sure why it says this, any ideas or help is appreciated cheers.
Technical SEO | | sydneygardening0 -
Homepage Not Ranking in Google - How long do old (not current) bad SEO practices exert influence?
I'm trying to get to the bottom of a problem I have with the Google ranking for mauiactivities.com - it's far below what I would hope for. My research so far has uncovered the following, and any advice on where to go from here would be appreciated. _Edit:_No problems with Bing or Yahoo - the site is #1 for primary key word 'maui activities' 1. Running a site:http://www.mauiactivities.com search in Google reveals that the homepage doesn't rank. At all. I looked through the 17 pages of results and can't spot it. Edit: I have now, after fresh checks after submitting the homepage through Search Console, found it at #1 - still, the following applies ... 2. I've found that the domain (before it was purchased by my client in 2011) had some bad inbound links, specifically from scubamaui.com (no longer active). The links where white, on a white background. This web archive snapshot will reveal all. 3. Those bad links were 'cleaned up' (i.e. they don't show in the web archive) from 2014, and as mentioned above, the website is now 'down'. 4. Search Console doesn't have a manual penalty. 5. When I search for 'tropical divers maui' in Google I find www.mauiactivities.com is the 4th result. To me, this indicates a current relationship with the dead site (Tropical Divers Maui). No other term comes close to ranking to high for the homepage. So, to summarise - can the old, dead Tropical Divers Maui website still be affecting the Google ranking, and what would you suggest I do next?
Technical SEO | | jsherwin0 -
.aspx 301 redirects on Business Catalyst
Hi I am have moved my website from .aspx to business catalyst. I have found out (when the site already migrated!) that Business Catalyst does not support .aspx 301 redirects. On a previous post from 2012 (https://mza.seotoolninja.com/community/q/aspx-files-will-simply-not-work-as-redirects) , someone has recommended a java script re direct. I have tried this but google search console is classing this as a 404 resulting in no link juice and my website dropping pages on google. I have tried to do 301 redirects at my server level but wont work. Anyone know a solution? Thanks in advance Keith
Technical SEO | | EntertainmentIdeas0 -
URL Change, Old URLs Still In Index
Recently changed URLs on a website to remove dynamic parameters. We 301'd the old dynamic links (canonical version) to the cleaner parameter-free URLs. We then updated the canonical tags to reflect these changes. All pages dropped at least a few ranking positions and now Moz shows both the new page ranking slightly lower in results pages and the old page still in the index. I feel like I'm splitting value between the two page versions until the old one disappears... is there a way to consolidate this quickly?
Technical SEO | | ShawnW0 -
Best practice for eCommerce site migration, should I 301 redirect or match URLs on new site
Hi Guys, I have been struggling with this one for quite some time. I am no SEO expert like many of you, rather just a small business owner trying to do the right thing, so forgive me if I say something that makes no sense 🙂 I am moving our eCommerce store from one platform to another, in the process the store is getting a massive face lift. The part I am struggling with is whether I should keep my existing URL structure in place or use 301 redirects to create a cleaner looking URLs. Currently the URLs are a little long and I would love to move to a /category/product_name type format. Of course the goal is not to lose ranking in the process, I rank pretty well for several competitive phrases and do not want to create a negative impact. How would you guys handle this? Thanks, Dinesh
Technical SEO | | MyFairyTaleBooks0 -
301 redirects on Windows server
Hi, We are soon moving www.ourumbrellaorganisationwebsite.co.uk/oldsubsidiaryname/index.aspx AND www.differentolddomainname.co.uk to just www.ourumbrellaorganisationwebsite.co.uk (an existing site which will no longer have the old subsidiary name sub section). How do we do the 301 redirects on a Windows server? Helicon has been suggested but I don't know it. I know we need to 301 redirect 'old' pages to the equivalent new ones, but is it a problem to do all of the old pages (there are lots) or should we just just do a few? is there ever a downside to doing individual redirects for an entire old site? Also, once the 301 redirects are in place from the old domain, is it possible to let the old domain expire and if so, at what point? Thanks
Technical SEO | | Houses0 -
301 redirect or 302
A client of mine has an international company named www.taxglobalizers.com if you come from Holland they 302 redirect you to the www.taxglobalizers.com/en version of the site and if you come from Holland they redirect with a 302 to www.taxglobalizers.com/nl version. I think it is best to change this in a 301 redirect. Am i correct in this? Kind Regards, Ruud
Technical SEO | | RuudHeijnen0 -
301 Redirect NOT Working as Expected - HELP!
Hi! I just launched our newly coded site and just realized the installed 301 is NOT working. The URL string is the same EXCEPT for the removal of /shop/. Here is the code in .htaccess: ############################################ enable rewrites Options +FollowSymLinks RewriteEngine on #RedirectMatch 301 ^/shop?/$ http://hiphound.com/ RedirectMatch 301 ^/shop?/$ http://hiphound.com ########################################### When I go to Google and click on an old link I get a 404. No bueno!! Here is an example: http://hiphound.com/shop/rubit-dog-tag-clip I thought (and was told) that the installed 301 would send this page to: http://hiphound.com/rubit-dog-tag-clip It's not. Please HELP!! 🙂 What am I doing wrong??? Lynn
Technical SEO | | hiphound0