Best free tool to check internal broken links
-
Question says it all I guess. What would your recommend as the best free tool to check internal broken links?
-
[Spammy comment removed by forum moderator.]
-
How awesome is that Screaming Frog tool?
-
Hey Kevin,
If you download the CSV report, we should list the referring page in the CSV. I know it'd be better to have it on the on-screen report, and it is on our wish list, but you should be able to see the info in an export.
-
Hi Kevin
Thanks - yes, although I am a Moz Associate, out of full transparency I agree with that you are saying. It is not a tool I specifically use with Moz, and do prefer Screaming Frog for the exact functions you are referring to. Screaming Frog will tell you what pages the bad links are on.
You can definitely pass this on to the product team as a feature request on this page. Personally I love tools like their analytics, keyword difficulty, rank tracker, open site explorer, but I agree from this aspect the crawler is not the strongest, and I would suggest supplementing with Screaming Frog (as I do).
-Dan
-
Dan, although I love me some MOZ the crawl diagnostics kinda suck... all they do is report errors but they don't give any insight on where the bad link is originated... it merely shows the page which is 404ed, which is a BIG FAT WASTE OF TIME.
You guys should know that we need to know WHICH PAGE THE BAD LINK IS ON, and furthermore WHAT LINE OF CODE HAS THE BAD LINK. Who cares about the broken page!?!?!?!?!?
-
Yes when you set up a campaign with Moz Analytics, Moz will crawl your website and return a whole report of suggestions. It will start a sample crawl which gets returned to you pretty quickly, and a full crawl a little bit thereafter. It will report things to you like 400 errors etc.
You can also use the Moz Crawl Test (PRO only as well) which will return to you the HTTP status code of each URL crawled.
Optionally, you can also use Screaming Frog SEO Spider (free up to 500 pages to crawl, paid for bigger sites).
-Dan
-
Does anyone have any clue on how I can check my internal broken links using MOZ tools?
-
Hello,
If you have a full Sitemap, transform it to a .txt by putting only URL (Excel can do that easily) try Screaming Frog SEO on list mode, which is free regardless of the number of links.
Even if you search a free tool, I strongly recommand to invest 99£/year on this tool, it's worth it.
-
Ok, first, does the url with /errors/error_404 (without the query string) exist?
Also - are you using something to create your 404 pages for tracking purposes?
The query string on the url would appear to be stating the referring url anyway - hence ?q=-i3 basically equates to the page /i3
At a guess - it could be there is a script running to create logs on specific 404's, or create a new log each time one occurs - if this folder is visable to the crawlers, it would get spidered and subsequently the problem would arise.
-
Yeah I tried that but the URL in the URL coloumn shows for example:
/errors/error_404?q=-i3
and the Referrer shows:
/-i3
Neither page exists and so I do not know where the page which contains this broken link is...
-
It does, when you get the report, filter column D marked "4XX (Client Error)" and you will see your 404's there - further along in the report you will also be able to see referring url which will show you which page is linking to it.
-
Checked out the tool I just linked to on here and it doesn't include broken link data
-
Is the the custom crawl tool on here you are referring too? http://pro.seomoz.org/tools/crawl-test
-
Custom crawl right here on SEOmoz, or you could use Xenu
-
Hi Dan,
Thanks for that tool. It works great and especially like that it works in Chrome.
Do you however know of a tool which would do this site wide rather than per page?
-
This tool is a great extension for Chrome
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internal Linking issue
So i am working with a review company and I am having a hard time with something. We have created a category which lists and categorizes every one of our properties. For example a specific property in the category "restaurant" would be as seen below: /restaurant/mcdonalds /restaurant/panda-express And so on and so on. What I am noticing however is that our more obscure properties are not being linked to by any page. If I were to visit the page myurl.com/restaurant I would see 100+ pages of properties, however it seems like only the properties on the first few pages are being counted as having links. So far the only way I have been able to work around this issue is by creating a page and hiding it in our footer called "all restaurants". This page lists and links to every one of our properties. However it isn't exactly user friendly and I would prefer scrapers not to be able to scrape all properties at once! Anyway, any suggestions would be greatly appreciated.
Technical SEO | | HashtagHustler0 -
Broken canonical link errors
Hello, Several tools I'm using are returning errors due to "broken canonical links". However, I'm not too sure why is that. Eg.
Technical SEO | | GhillC
Page URL: domain.com/page.html?xxxx
Canonical link URL: domain.com/page.html
Returns an error. Any idea why? Am I doing it wrong? Thanks,
G1 -
Competitors link building surely link farming ? but no punishment?
Hi there added a competitors metrics to see what they were doing and to my amazement they seem to have 1000+ links surely this is link farming considering we stay in a very remote area. also why would he be rewarded for this not punished? imgur.com/18dUqNL 18dUqNL 18dUqNL
Technical SEO | | ShauniBROWN2 -
Webmaster tools not showing links but Moz OSE is showing links. Why can't I see them in the Google Search Console
Hi, Please see attached photos. I have a website that shows external follow links when performing a search on open site explorer. However, they are not recognised or visible in search console. This is the case for both internal and external links. The internal links are 'no follow' which I am getting developer to rectify. Any ideas why I cant see the 'follow' external links? Thanks in advance to those who help me out. Jesse T7dkL5s T7dkL5s OkQmPL4 3qILHqS
Technical SEO | | jessew0 -
Will Google Recrawl an Indexed URL Which is No Longer Internally Linked?
We accidentally introduced Google to our incomplete site. The end result: thousands of pages indexed which return nothing but a "Sorry, no results" page. I know there are many ways to go about this, but the sheer number of pages makes it frustrating. Ideally, in the interim, I'd love to 404 the offending pages and allow Google to recrawl them, realize they're dead, and begin removing them from the index. Unfortunately, we've removed the initial internal links that lead to this premature indexation from our site. So my question is, will Google revisit these pages based on their own records (as in, this page is indexed, let's go check it out again!), or will they only revisit them by following along a current site structure? We are signed up with WMT if that helps.
Technical SEO | | kirmeliux0 -
Best practice for multiple domain links
A site i'm working on has about 12 language domains - .es, it, .de etc. On each page of every domain the header has links to every homepage. At the moment these are all set to no-follow as an initial step to stop potential link profile issues spreading around. Moving forward i'm not totally sure how to handle these links. On one side I see and agree that no-follow is not necessary, but do-follow is just filtering out and weakening link juice. What is the best way to handle this scenario?
Technical SEO | | MickEdwards0 -
International Seo - Canada
Our organization is currently only operating in the USA but will soon be entering the Canadian market. We did a lot of research and decided that for our needs it would be best to use a subfolder for Canada. Initially we will be targeting the english speaking community but eventually we will want to expand to the french speaking Canadians as well. The question is - is there a preferred version in setting up the subfolders: www.website.org/ca/ -- default will be english www.website.org/ca/fr/ - french www.website.org/en-ca/ - english www.website.org/fr-ca/ - french www.website.org/ca/en/ -english www.website.org/ca/fr/ - french Thanks
Technical SEO | | Morris770 -
Amazon s3 links
Hello, Dose anyone has experience with Amazon s3 ? Hosting images, site elements and static files (pdf etc) on Amazon S3 bucket can influence the link structure / juice ? (by having external links to the amazon s3 bucket / account). If you host all the site images and site resources with Amazon S3 will all those "links" count as outgoing external links ? Is it worst then having everything linking internally ? Dose anyone knows if that can hurt you ? Personally I was not able to test it and I am sure I can't test it in the near future. Hope someone has and I can skip some steps with this. Thanks !
Technical SEO | | eyepaq1