Dead links-urls
-
What is the quickest way to get Google to clean up dead
link? I have 74,000 dead links reported back, i have added a robot txt to
disallow and added on Google list remove from my webmaster tool 4 months ago.
The same dead links also show on the open site explores.Thanks
-
thank you 410 was what i needed.
-
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
Can you offer clarification as to what you view as a "dead link"?
If you mean a link to a page on your site which no longer exists, then your options are as follows:
-
take John's advice and 301 the link to the most relevant page on your site
-
allow the link to 404. 404 errors are a natural part of the internet. You should be sure to have the most helpful 404 page possible. Include your site's normal navigation, a search box, most popular articles, etc.
Blocking pages in robots.txt is usually a bad idea and is more likely to add to the problem rather then fix it. If you do not block the page in robots.txt, Google would then crawl the page, see the error and remove it from their index. Because you block the page they can no longer view the page so they will likely leave it in for longer.
Google normally promptly removes web pages submitted with the URL Removal Tool. The tool is designed to remove pages which can damage your site or others. For example, if confidential information was accidentally published. It is not designed to be used to remove 74k pages because you decided to remove them from your website.
If these dead links are simply pages you removed from your site, I advise you to remove the robots.txt block and then decide to 301 them or allow them to 404. Google should then clean up the links within 30-60 days.
If you want to speed up the process as much as possible, there is one other step you can take. Set a 410 (Gone) code for the pages. When Google receives a 404 response, they are unsure if the page is simply temporarily unavailable so they keep it in the index. If they receive a 410 response, you are telling Google the page is GONE and they can update their index faster.
-
-
Are the links 404 pages or just expired content?
-
The links are index, i need them really cleaned up, not a
redirect, and users/customers find it frustrating -
You could try setting up a 301 redirect in htaccess.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate pages coming from links from the login page - what should we do about them?
This is a follow on to an earlier question which was well answered by Dirk Ceuppens regarding abnormal crawl issues. We are seeing that the issues relating to Duplicate Pages are coming from links from the login page which shows information about where the user was redirected from. For example, if the visitor is not logged on and wishes to wish-list an item, they will be redirected to the login page, with the item code and intended action in the url; which can then continue on to the desired page once logged on. The MOZ crawler is seeing these pages as having Duplicated Content whilst they are all the same apart from a piece of information in the URL. Should we be blocking these duplications? Are they a risk to us? What should we be doing? Many thanks, Sarah
Moz Pro | | Mutatio_Digital0 -
How important are Internal Equity-Passing Links in rankings?
Hi,I ran opensite explorer of a customer site: www.enviosadomicilio.com and compared it with the most ranked competence sites. In almost all the factor enviosadomicilio.com has the best scores, except in Internal Equity-Passing Links. The competence has aprox 20K Equity links and another 2K meanwhile enviosadomicilio.com only have 296. Do you think that factor could be the reason that enviosadomicilio.com are in ranking 15th while the competence in 1st and 3rd?. How could we get Internal-Passing Links?, we don´t have a lot of products or categories in the site. Thanks a lot.
Moz Pro | | ramirez_salvador0 -
Tracking External Followed Inbound Links - Are We Getting Fooled?
This question is not about how to use SEOMOZ Link tools. It's about the numbers themselves and how their fluctuations are causing confidence issues.... My client wants to track inbound followed links over time. But as I understand it, this number will vary depending on the Linkscape crawling success (or even outages or partial crawls.) In the past few reports, we've had wild fluctuations which have made them very nervous. If my client wants to track inbound followed links over time, what SEOMOZ metric should we use for the most reliable progress checks?
Moz Pro | | scottclark0 -
Link Assistant SEO Tool - Any Others?
I have the most boring copier service website, clients cool, concept is really boring; Well I am looking to generate this client some link back juice, cause this guy is struggling for traffic, and I am am struggling to generate a buzz about copier services?? Fortunately, it's only local, so that helps me with testing my localization campaigning. 🙂 Any opinions on this software? http://www.link-assistant.com Do you know of some better "Back Linking Software? I was considering buying it. But once I go to purchase it, I second guess myself; "It just looks shady, and the perpetual up-sale, turns me off.". I really just value the MOZer communities opinions! and I want to see what the community thinks of the above company, and if ya heard anything good, or bad. The Demo seems legit as hell!
Moz Pro | | smstv0 -
Will SEOMoz offer URL data relating to Bot visits
Does SEOMoz in the future plan to report on Bot visits for each URL, when they are spidered and when they appear in for example Google's index ?
Moz Pro | | NeilTompkins0 -
No follow Internal Links
Hello, I am comparing my site with my competitors. According to Open Site Explorer, my site has 541 internal follow links, and a total of 1,286 total internal links, implying I have 745 no follow internal links. I tried to drill into these internal no follow links using the "Inbound Links" report in OSE. But I'm receiving an error stating that No Data is Available for this URL. Does anyone have any insight to this? I'd really like to understand where those no follow links are coming from. Thanks in advance. eh70
Moz Pro | | TheBOTWGuys0 -
Link Blocks
Sorry, perhaps a noob question. In relation to site explorer, have also searched and unable to find any information, wondered if anyone could advise as to what "Linking C Blocks" are? Found under the "Compare Link Metrics" tab. Thanks in advance. Lee
Moz Pro | | LeeMiller0 -
Open site explorer - Analysing competitors links
When using open site explorer to analyse my competitors links, when going through them, I would click them to have a look at them. Almost all of the ones I clicked on something started to download on my computer and would be a blank page or the tab would disappear when the download begun. What is this? Why have they done this? Is this bad practice? Thanks
Moz Pro | | CompleteOffice0