Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Cant find any keyword for my site
I searched for keyword rank for shoreloop.com but couldn't find any. What could be the problem?
Competitive Research | | killerseo20200 -
Why my website's Alexa rank is dropping
My website Alexa rank has dramatically dropped in the past 3 months: Website: www.sastasundar.com End of July, 2012: 5217 Global, 265 Local(India) But Now: ** 29260** Global, 2274 Local(India) Definitely something big has affected my global ranking and I'm not able to figure it out. Please help.
Competitive Research | | foreseegame0 -
Pagerank and sitemap question :)
As most of us are, I am working on pushing my page rank up and in that I have been looking at some of the pages ahead of me to see what they may be doing. I noticed one of my main competitors has some different sitemaps than I am using. My sitemaps consist of:
Competitive Research | | allstatetransmission
Using Yoast WP PLugin:
Posts
Pages
QA/FAQs
Testimonials
Categories
and FAQ Categories Using Google Images Sitemap WP Plugin:
Images Sitemap http://1stimpressions.com/sitemap_index.xml Their sitemap has:
Posts
Pages
Attachment
Portfolio (Next Gen Gallery)
Category
Post Tags
Next Gen Gallery (NGG) Tags
Portfolio Type Sitemap
Author Sitemap http://smartwrap.com/sitemap_index.xml Could adding in some of these sitemaps help in page rank? I have looked at their links and on page optimization and we are just about par in comparison if not ahead of them, but they still are a whole page ahead of us in google searches for phoenix vehicle wraps, or car wraps phoenix and related searches. Thanks for your input, I really appreciate it. 🙂 Cheers! (edited spelling)0 -
Traffic estimates for any website?
Google's Display Network Ad Planner used to be the best for this (although was often still way out), but the data for the sites I used to check has disappeared. Does anyone know any other sites that provide half-decent estimates of traffic? trafficestimate.com, Compete and Alexa are way off. I'd be interested in paid services too. Thanks. 🙂
Competitive Research | | Alex-Harford0 -
Find competitors based on keywords
Are there any tools where I can enter say 5 keywords and it will look at the top 10 sites for each of those keywords then return which sites show up the most.
Competitive Research | | eyeflow0 -
Help with website
Hello, I've been trying to get our website on 1st place (or at least 1st page to start) on several keywords, on google in all English speaking countries. In most of them I managed, but in USA I'm on 5th page. By Domain Analysis we are better than competition. Keywords are glass nail files, crystals nail files (some long tail keywords are ok, we are somewhere on top). Website: http://www.czech-glass-nail-files.com/ We worked on code, design (notice issues is just recent, because of server migration), on-page, blog. Can someone help me out with an advise? The goal is to be #1. We definitely doing something wrong, but I can't figure out what. Thank you.
Competitive Research | | divan0 -
I would like suggestions for winery websites
Has anyone on here worked for, or simply know of a high authority winery website? I may have the opportunity to do some work for a vineyard/winery. Obviously there are certain universal seo tactics that I will use on the site, however my knowledge of wine is limited, so I would like some suggestions for, well deigned and seo optimized sites to study and learn from. Any suggestions?
Competitive Research | | NerdsOnCall0 -
Website analysis automation
I need a tool that will input a list of URLs and produce a spreadsheet with link metrics for all sites including PageRank, Domain Authority, Page Authority, Social data, etc..i know that OSE will do this for 5 sites at a time but I need to compare more. At lest 50 at a time... I bought Buzzstream thinking this would work, but it doesn't. does anybody have any good advice? Thanks!!
Competitive Research | | znotes0