Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Methods for estimating competitor website traffic from natural search
Hi all, I'm currently working on some competitor analysis and estimating website traffic based on rankings and estimated search volume for approximately 500 keywords. I'm then estimating based on click through rate from Webmaster tools. I think this will give me a relatively accurate estimation but was wondering how everyone else does this? Any other methods out there? Thanks, Elias
Competitive Research | | A_Q0 -
Why is my website not in the top 3 if our Moz statistics are better?
Hi, We've been using Moz, for our E-commerce sites, for some time now and are improving all of our statistics, be it on-page for specific keywords or general crawl errors, but I've not been seeing a lot of change in our rankings... (we've moved from place 7 to 6 on our main keyword). I'm thinking of looking at our backlinks, through Link Detox, after we finish our Moz optimisation to see if anything weird is going on with that. Are there any other areas I should be looking at? any other clues as to why we're not ranking higher than our competitors. Even if our Moz statistics are better and our Market Samurai values are similar? Thank you very much! Alexander
Competitive Research | | WebmasterAlex1 -
Finding competitors best keywords?
How do I learn my competitor's best keywords? I realize I can add more keywords to my campaign but the problem is - I am not sure I am thinking of the right keywords. I don't want to compare with the keywords I am targeting - I want to know what THEY are targeting.
Competitive Research | | dealblogger1 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
Where do we find a Keyword Discovery Tool in SEOmoz?
I've been looking for a way to compare keywords amongst my competition websites.
Competitive Research | | homesonthesound0 -
How do I find the best converting keywords
I rank decently on local search for some of my keywords but find that the traffic coming to my site is not from those keywords. I also find that they never convert to sales queries. Is someone able to help me out with that? Thanks My domain is www.hykano.com
Competitive Research | | Skwtayler0 -
Website analysis automation
I need a tool that will input a list of URLs and produce a spreadsheet with link metrics for all sites including PageRank, Domain Authority, Page Authority, Social data, etc..i know that OSE will do this for 5 sites at a time but I need to compare more. At lest 50 at a time... I bought Buzzstream thinking this would work, but it doesn't. does anybody have any good advice? Thanks!!
Competitive Research | | znotes0 -
50,000 Links From The Same Website
Hey Mozers, I was conducting competitive research for a client of mine and I discovered one of their competitors has over 50,000 backlinks! After removing my heart from my stomach I realized that 99.9% of the links came from a single website that doesn't have nearly that many pages. Has anyone experienced this in the past? And if so what exactly is going on? C
Competitive Research | | calindaniel0