301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are there tools to discover duplicate content issues with the other websites?
We have issues with users copy-pasting content from other sources into our site. The only way I know to find out, is to manually (!!) copy a snippet of their text into google, to see if I get results from other sites. I have been googling for tools to help automate this process, but without luck. Can you recommend any?
Moz Pro | | betternow0 -
Why is my MOZ report only crawling 1 page?
just got this weeks MOZ report and it states that it have only crawled: Pages Crawled: 1 | Limit: 10,000 it was over 1000 a couple of weeks ago, we have moved servers recently but is there anything i have done wrong here? indigocarhire.co.uk thanks
Moz Pro | | RGOnline0 -
Duplicate page report
We ran a CSV spreadsheet of our crawl diagnostics related to duplicate URLS' after waiting 5 days with no response to how Rogerbot can be made to filter. My IT lead tells me he thinks the label on the spreadsheet is showing “duplicate URLs”, and that is – literally – what the spreadsheet is showing. It thinks that a database ID number is the only valid part of a URL. To replicate: Just filter the spreadsheet for any number that you see on the page. For example, filtering for 1793 gives us the following result: | URL http://truthbook.com/faq/dsp_viewFAQ.cfm?faqID=1793 http://truthbook.com/index.cfm?linkID=1793 http://truthbook.com/index.cfm?linkID=1793&pf=true http://www.truthbook.com/blogs/dsp_viewBlogEntry.cfm?blogentryID=1793 http://www.truthbook.com/index.cfm?linkID=1793 | There are a couple of problems with the above: 1. It gives the www result, as well as the non-www result. 2. It is seeing the print version as a duplicate (&pf=true) but these are blocked from Google via the noindex header tag. 3. It thinks that different sections of the website with the same ID number the same thing (faq / blogs / pages) In short: this particular report tell us nothing at all. I am trying to get a perspective from someone at SEOMoz to determine if he is reading the result correctly or there is something he is missing? Please help. Jim
Moz Pro | | jimmyzig0 -
Universal results not in pdf or csv reports
Right now, the universal results show up when I look at tankings on the site, but do not show up at all in the weekly pdf reports. They also did not appear in the full rankings history .csv report. They only appear in the weekly csv report, and then, the information is not as detailed as it is on the website (it only shows whether a universal exists, but doesn't indicate at what position it shows up). This limits the usefulness of these reports to my customers. I need to be able to show them rankings histories, including universal results, in their monthly or weekly reports. Including the charts would be nice as well. Since I can individually download the .pdfs for these for each keywords, why can't we just include it in the monthly reports. Also, would like to be able to view rankings history for all three search engines at once for a keyword, or multiple keywords to reduce the number of pages in a report. Can you add this feature?
Moz Pro | | HMS0 -
Using this service
Hello, I have had this service for my free month. I had over 150 errors on my website which I fixed. My problem is that in doing this my traffic is actually worse and I have now fallen completely off google. From the start of my website I would slowly creep to within t he top 3 pages of google for the search term apron and aprons, then suddenly I fall to somewhere around page 20. No one, even people I hired has been able to explain this. I hear google changes, it takes time, etc, etc... Its been 5 years and other newer companies are on the top page right in their first year.. After working with this site for a month, I have looked to page 65 for apron and aprons and still cant find me. And I know some people say Alexa is a gimmick, but now instead of rising to 10 million and falling back down to 23 million, Alexa says there is no info regarding my website whatsoever. Any advice? I was excited to have this service but I cant get my partner to agree to keep it if my month long result is worse then I ever was before. And please dont say it takes time , 5 years is more than enough. Thank you in advance!
Moz Pro | | Gardengirl0 -
How Long Does a SERP Analysis Report Normally Take to Run?
I started running a SERP analysis report two days ago, and it still says it's "in progress." It is 5:40 PM Pacific on August 7 as I type this, and I started running the report on: August 05, 2012 10:03 (copied and pasted from the report). Is this normal? Thanks!
Moz Pro | | ScottShrum0 -
Sorting On-page Optimization Reports
I know there are several pre-set ways to sort the on-page optimization reports, but how can I custom sort them into my own order?
Moz Pro | | WillWatrous0