Dead links-urls
-
What is the quickest way to get Google to clean up dead
link? I have 74,000 dead links reported back, i have added a robot txt to
disallow and added on Google list remove from my webmaster tool 4 months ago.
The same dead links also show on the open site explores.Thanks
-
thank you 410 was what i needed.
-
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
Can you offer clarification as to what you view as a "dead link"?
If you mean a link to a page on your site which no longer exists, then your options are as follows:
-
take John's advice and 301 the link to the most relevant page on your site
-
allow the link to 404. 404 errors are a natural part of the internet. You should be sure to have the most helpful 404 page possible. Include your site's normal navigation, a search box, most popular articles, etc.
Blocking pages in robots.txt is usually a bad idea and is more likely to add to the problem rather then fix it. If you do not block the page in robots.txt, Google would then crawl the page, see the error and remove it from their index. Because you block the page they can no longer view the page so they will likely leave it in for longer.
Google normally promptly removes web pages submitted with the URL Removal Tool. The tool is designed to remove pages which can damage your site or others. For example, if confidential information was accidentally published. It is not designed to be used to remove 74k pages because you decided to remove them from your website.
If these dead links are simply pages you removed from your site, I advise you to remove the robots.txt block and then decide to 301 them or allow them to 404. Google should then clean up the links within 30-60 days.
If you want to speed up the process as much as possible, there is one other step you can take. Set a 410 (Gone) code for the pages. When Google receives a 404 response, they are unsure if the page is simply temporarily unavailable so they keep it in the index. If they receive a 410 response, you are telling Google the page is GONE and they can update their index faster.
-
-
Are the links 404 pages or just expired content?
-
The links are index, i need them really cleaned up, not a
redirect, and users/customers find it frustrating -
You could try setting up a 301 redirect in htaccess.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Strange "?offset" URL found with content crawl issues
I recently recieved a slew of content crawl issues via Moz for URL's that I have never seen before For example:
Moz Pro | | HannahPalamara
Standard URL: https://skilldirector.com/news,
Newly identified URL: https://skilldirector.com/news?offset=1469542207800&category=Competency+Management). Does anyone know where the URL comes from and how to fix it?0 -
Crawl Diagnostics saids a page is linking but I can't find the link on the page.
Hi I have just got my first Crawl Diagnostics report and I have a questions. It saids that this page: http://goo.gl/8py9wj links to http://goo.gl/Uc7qKq which is a 404. I can't recognize the URL on the page which is a 404 and when searching in the code I can't find the %7Blink%7D in the URL which gives the problems. I hope you can help me to understand what triggers it 🙂
Moz Pro | | SebastianThode0 -
Can I view inbound links to my Facebook business page?
I changed the title of my facebook page for my business Admiral Movers. I realized that all the listings that I manually entered over the years may be lost. Is there a way to view old page and new page inbound links to our facebook page?
Moz Pro | | Smcnelley0 -
Sitewide links causing problem
Hello, I've had a couple of people look at the backlink profile for nlpca(dot)com and tell me that there were a lot of sitewide links with non-branded anchor text. The spreadsheet is [here](http://thewealthymind.com/wp-content/uploads/2013/03/anchor-text.xls). Actually, because of our company name, all sitewide links have branded anchor text except for http://www.iepdoc.nl
Moz Pro | | BobGW
http://www.ionut-ciurea.com The term "NLP" is not ranking for us, we should be on page 1 or 2. Also, we used to be sitelinked for "NLP California" and aren't anymore. Notice that "nlpca" splits into "nlp" and "ca" for California. Could you look and see if it is just those 2 sites and if all we need to do is contact them to change to branded anchor text. Or if it's something else to get back our rankings for "NLP" and our sitelinks for "NLP California" Thank you0 -
Does linking to relevant high authority websites effect your MozTrust or Rank?
Basically what the title says. I am having a hard time understanding why a compeitor with less linking domains and none of any real quality, they're all membership sites or partnerships, nothing to relevant to the industry. While we have links and articles on us from multiple magazines in our industry. As well as to relevant directories with high domain ranks. The only thing I noticed is they're linking to their clients website, which are all high authority websites. So do external links count towards your MozTrust or Rank?
Moz Pro | | SeanConroy1 -
No follow link
Hi There, We pay for our site (www.residentialland.com) to appear on a popular property site: http://www.homesandproperty.co.uk/ When I use Open Site Explorer, it is our top link, but it has 'no follow' above it. So I had a look at the source code on the homesandproperty website and I cant see any nofollow code that would effect our link. I also used this tool which confirmed it isnt classed as a no follow link: http://www.seorankings.com/tools/nofollow-link-checker Can anyone else tell me if our paid for link on homesandproperty is a no follow, or if it is 'search engine friendly' so to speak? We pay for links across their site, so we want to get the full benefit. Any help would be appreciated, Thanks, Rob
Moz Pro | | op010 -
Use of the tilde in URLs
I just signed up for SEOMoz and sent my site through the first crawl. I use the tilde in my rewritten URLs. This threw my entire site into the Notice section 301 (permanent redirect) since each page redirects to the exact URL with the ~, not the %7e. I find conflicting information on the web - you can use the tilde in more recent coding guidelines where you couldn't in the old. It would be a huge thing to change every page in my site to use an underscore instead of a tilde int he URL. If Google is like SEOMoz and is 301 redirecting every page on the site, then I'll do it, but is it just an SEOMoz thing? I ran my site through Firebug and and all my pages show the 200 response header, not the 301 redirect. Thanks for any help you can provide.
Moz Pro | | fdb0 -
Why is the crawler following form action links?
I have an issue with one of my sites where the SEOMoz crawler is following some form action links. It is my understanding that the crawler will ignore these links. Why would it not be ignoring them in certain cases. If you need more detail, please ask. Thanks.
Moz Pro | | AmberHanson0