New folder structure
-
We are in the process of relaunching one of our website's that will use a totally need folder structure.
Previously we used mydomain.com/content/country/region/city/district/hotel_name/
Now we are changing to make the URL shorter, more precise - since we are using a new CMS, to be mydomain.com/gb_Hotel-Name/
My question is currently we've in the region of 10,000 pages indexed in Google. So we are going to have to create 301 permanent redirects from the old URLs to the new URLs.
From your previous experience, is this the correct way of approaching the task.
-
Hi Neil.
The sites we have done are all new but from experience dealing with moving to new urls the best thing to do is create a mapping document in excel. It'squite easy if you know that for example:
www.domain.com/berlin-hotel is moving to www.domain.com/de/berlin-hotel.
Then all you need to do is put in the 301s based on the mapping and monitor WMT for issues - you will always miss something.
From what you are saying however there is no logical structure to your site - which will make this harder. I have had to deal with this in the past too, you might just need to identify all of the more important pages and 301 these first and go via mechanical turk of get an intern in or something to just plough away and find all of your urls.
If you have an XML sitemap you should be able to get them all pretty quickly and map from here.
Hope this helps.
-
Hi ASR, can you advise more on how you moved to the new folder structure ? Did you leave old pages in place, launch new site, then go through all old URLs and 301 them to the new URL ?
The problem I have is the new folder structure is not a standard pattern, so any 301 will need to be done manually.
-
either way, it would not hurt to 301 all.
-
Ooops, should have said link juice.
As you can all see Alan and I have different views on this but at least you have a range of views Tommo!
Good luck - hope it all goes well.
-
"A 301 will pass 80% of the page authority over."
No a 301 will pass 85% of its incomming link juice, you are redireceting the inomming links not the page
A 301, passes 85% of its PR from the page to another page though a link from the page.
But if the page no longer exists it can not. Once you delete that page, it no longer has any page rank, but the pages that may link to the old page are still passing PR, so in that case you can redirect those links to the new page. But you cannot redirect the non existing page or any authority it had to the new page.
Read Google’s algorithm, I assure that is not how it works.
http://www.webworkshop.net/pagerank.html
By the way, all links pass 85% of link juice it has though its links, if the link hits a 301 redirect, it loses 15% again. This is so you don’t get infinite loops.
Imagine if you could move a page and somehow gets its PR by doing a 301 redirect. You could keep moving it and it would keep getting more PR.
If I could use an analogy
If you have a store and Bob has a store, and Bob closes down, but puts a sign on his door telling his customers to go to your store, you will get his customers, but you don’t get his stock. And if he had no customers you get nothing.
Anyhow if you read the link you will see that I am correct -
A 301 will pass 80% of the page authority over. You also don't leave any 404s.
I'm not sure why you are so against 301s? It's tidier, "best practice" and not hard to do. Why risk missing something out that might prove the difference?
-
They will reindex them, you dont need to 301 then to get them reindexed.
But they dont have any page rank if the no longer exist. you can only pass link juice though a link, if the page no longer exists then you can not link from it, and there is no link juce juice to pass.
If that were true, you could keep moving a page and its link juice would keep rising.
-
I would 301 all the pages; it's "best practice," IMO.. The old pages had juice just from the fact that they existed; ie. inbound links aren't the only value you want to preserve. And, as ASR points out, best to avoid the 404s. The redirects are not just for the PageRank, but to allow search engines to easily reindex the content.
-
"The pages will still have some authority even without links"
they would if they were still there, but they no longer are, its just a ref to them in the index,
sure if they have some like or links, I agree
If they are in another lingo, they maybe, I dont know, but if they are in the same lingo, I still say they will be duplicate content
-
The pages will still have some authority even without links, so I would definitely pass any little bit there. Social signals too if there are any that might not have been picked up. And I would also worry that while some tools say there are no links, I don't know one 100% reliable tool to tell you page X has no links.
If the local sites are in DE, FR, ES, or whatever, then they are not duplicate, they are local language. IBM, Apple to name a couple certainly do this route also.
Matt Cutts may say that, but we certainly do not suffer from this problem in the least. Another Cutts "we do this but really don't" comment maybe?!
-
I agree it would of worked, but if they had no incomming links, then it was un-necessary.
-
Why must you 301 it, if they have no in comming links. There is no link juice to keep.
As for theTLD's, if they are duplicate content websites, which I assume they are, then you will have duplicate content problems. How will you get around that?
If yopu listen to the Matt Cutts video again, he says at the beginging, if the are all on the same TLD you will be pinged for DC
-
Disagree with you on that one Alan. We have no issue with duplicate content and it is also what everyone (including those at MOZcon this year) recommend.
In fact I have an email from SEOMoz themselves recommending it.
TLD will get better over time but from experience running 7 sites (6 country sites) I would only ever use folders now.
I also disagree with your comments below about not 301ing all old content. You must do this when re-launching.
-
I have to disagree, using the TLD's you dont need to worry about duplicate content.
See Matt Cutts
-
You are having to link build to multiple sites, they are start from zero in a search engines eyes (no matter how strong your current site is), your marketing materials cannont just mention domain.com etc.
Our use of folders with our strong domain strength has seen them launch and a month later be at the top of local search engines for hard to rank for search terms.
I cannot recommend strongly enough that going down the folder route is much better for SEO.
-
Yes, the other .de site for example will be 100% in the local language. What pitfalls do you feel we will have if we went the route of many TLD sites ?
-
Yes that is what I am saying. Definitely head down the domain.com/country-folder ie domain.com/uk
This has a lot of advantages around marketing, all of the links to this one domain help strengthen the entire site instead of having to having to link building to a number of new sites (which are starting from scratch in Google's eyes).
And you can still target them in GWMT by country too - which will definitely work. I am presuming they will be in local language as well?
Hope this helps.
A
-
Currently our domain is domain.com.
But we were thinking about having domain.de, domain.com.cn, domain.es etc. Are you saying this isn't the way to go ? We were looking to host these sites in the TLD country e.g domain.de hosted in Germany.
Examples where this has worked very well is TripAdvisor.
-
Okay. That makes sense but I would stick to one TLD if you could as you can run with folders and all of the country country sites (in the folder) will inherit all of the your one TLD strenght, makes things like link building easier too.
I would strongly recommend this. We have 6 international sites now and three are TLD (before I got here) and three folders and all of the folder sites are doing so much better than the TLD - the difference is amazing.
Even if you go with the new TLD I would miss out the GD_ bit - you don't need that at all if you have a TLD and makes no sense to me. I would rather have domain.com/city-hotels/hotel-name and optimise around this. You can then have landing pages around city hotels ie berlin hotels and pull in traffic this way.
Just a thought!
-
For the new site we will be having international TLD like mydomain.de. Re the GB this is so we initially know what country the hotel is located in, and in some instances hotels have the same name, but in different countries.
-
I would 301 all of the pages - to relevant new pages otherwise you will end up with a heap of 404s too if the old content just disappears. Blogs etc will have linked to them etc, you want to make the US as good as possible.
Mapping out the 301s will take time but be worth it in the long run.
I have done a website with 500,000 pages and mapped it and it worked well.
A
-
i would only bother 301 redirecting those that had incomming links or you will have a mess on your hands.
If you take a short cut and try to 301 on mass to the one page, bing for one will just ignore them as far as link juice goes.
also up untill recenly Matt Cutts said that _ or - were a matter of choice, but now he has stated to use -, cant remember the reason.
After 301ing all pages with in-links, i would just go to google and and remove site (enter root domain). This way yopu get rid of all the old pages and aviod duplicate content.
Others will proabaly not agree. but this is how i do it. Block the site with robots.txt, then remove site in GWMT by entering the domain name in remove url.
Wait a day till its removed, then remove robots.txt block.dont woory, you need to leave a block in place for 90 days to really remove from index. doing this all the pages that still exist will be back in a few days, the rest that 404 will be removed from index.
-
Hi Tommo.
Sounds like the clean up is a great idea. I wonder if you still need the GB at all? Is this for language or country? If you are doing country/language I would have a folder for each ie
domain/en/us/title-of-hotel
You can then geo-target these to country specific areas in GWMT as well - which would be helpful.
And definitely 301 them all - this is a must.
A
-
Yes this is correct, the 301 redirect will forward all juice to the new structure and Google will find this change pretty fast.
If you have a sitemap you could also submit that map to google through webmaster tools, that would update the index faster. Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New Subdomain & Best Way To Index
We have an ecommerce site, we'll say at https://example.com. We have created a series of brand new landing pages, mainly for PPC and Social at https://sub.example.com, but would also like for these to get indexed. These are built on Unbounce so there is an easy option to simply uncheck the box that says "block page from search engines", however I am trying to speed up this process but also do this the best/correct way. I've read a lot about how we should build landing pages as a sub-directory, but one of the main issues we are dealing with is long page load time on https://example.com, so I wanted a kind of fresh start. I was thinking a potential solution to index these quickly/correctly was to make a redirect such as https://example.com/forward-1 -> https:sub.example.com/forward-1 then submit https://example.com/forward-1 to Search Console but I am not sure if that will even work. Another possible solution was to put some of the subdomain links accessed on the root domain say right on the pages or in the navigation. Also, will I definitely be hurt by 'starting over' with a new website? Even though my MozBar on my subdomain https://sub.example.com has the same domain authority (DA) as the root domain https://example.com? Recommendations and steps to be taken are welcome!
Intermediate & Advanced SEO | | Markbwc0 -
Ecommerce New & Refurbished with multiple versions of refurbished
I am working with a website that sells new and multiple grades of refurbished power tools New Refurbished Grade A (top quality refurbished) Refurbished Grade C (had a few more scuffs but in perfect working order) Refurbished Grade D (no warranty / as is conditions, typically for parts) How would you create the Products and URL structure? Since they are all technically different products they have their own sku in magento. Would you combine them into one URL with different product options? or would you give each product version its own url (New, Grade A, Grade C, Grade D) Thanks! -- Steven
Intermediate & Advanced SEO | | intown0 -
Multilingual SEO subdirectories structure
Hi, I have to optimize a domain for Google for 3 languages (.com with subdirectories)(Dutch, German and English) content is only served on domain.com/nl, .com/de and .com/en NO CONTENT is served on domain.com.
Intermediate & Advanced SEO | | bmcinternetmarketing
How do I exclude domain.com from getting in Google? Because there is no content on the top level only on subdirectories. Is there a rule we have to add to htaccess? Or Robots.txt by disallow all and next lines allow /nl, allow /de and allow /en? Thanks a lot! Kind regards, Alain Nijholt0 -
How soon should new links show up?
Hi I know that GWT's will not show all my links but is there a 3rd party (other than Moz of course!) tool that will? And how quickly should they show up? Thanks Ash
Intermediate & Advanced SEO | | AshShep10 -
E commerce canonical links: include category structure?
I have a client on shopify. All categories have correct canonical links. however, the links from all menus, category pages, etc. follow this structure: /collections/COLLECTION_NAME/products/PRODUCT_NAME but the canonical link on the above product url is: /products/PRODUCT_NAME I have a feeling this is hurting our product detail page's seo. Our collection pages are ranking fine, but for some reason the detail pages aren't. It could be that they are deeper, but I am trying to make sure nothing big is causing it first before I get into the smaller factors. Any best practices on this?
Intermediate & Advanced SEO | | no6thgear0 -
Search traffic decline after redesign and new URL
Howdy Mozzers I’ve been a Moz fan since 2005, and been doing SEO since. This is my first major question to the community! I just started working for a new company in-house, and we’ve uncovered a serious problem. This is a bit of a long one, so I’m hoping you’ll stick it out with me! ***Since the images aren't working, here's a link to the google doc with images. https://docs.google.com/document/d/1I-iLDjBXI4d59Kl3uRMwLvpihWWKF3bQFTTNRb1R3ZM/edit?usp=sharing Background The site has gone through a few changes in the past few years. Drupal 5 and 6 hosted at bcbusinessonline.ca and now on Drupal 7 hosted at bcbusiness.ca. The redesigned responsive design site launched on January 9th, 2013. This includes changing the structure of the URL’s, such as categories, tags, and articles. We submitted a change of address through GWT shortly after the change. Problem Organic site traffic is down 50% over the last three months. Below, Google analytics, and Google Webmaster Tools shows the decline. *They used the same UA number for Google analytics, so that’s why the data is continuous
Intermediate & Advanced SEO | | Canada_wide_mediaOrganic traffic to the site. January 2011 - Dips in January are because of the business crowd on holidays.
Google Webmaster Tools data exported for bcbusiness.ca starting as far back as I could get. Redirects During the switch, the site went from bcbusinessonline.ca to bcbusiness.ca. They were implemented as 302’s on January 9th, 2013 to test, then on January 15th, they were all made 301’s. Here is how they were set up: Original: http://www.bcbusinessonline.ca/bcb/bc-blogs/conference/2010/10/07/11-phrases-never-use-your-resume --301-- http://www.bcbusiness.ca/bcb/bc-blogs/conference/2010/10/07/11-phrases-never-use-your-resume --301-- http://www.bcbusiness.ca/careers/11-phrases-never-to-use-on-your-resume Canonical issue On bcbusiness.ca, there are article pages (example) that are paginated. All of the page 2 to page N were set to the first page of the article. We addressed this issue by removing the canonical tag completely from the site on April 16th, 2013. Then, by walking through the Ayima Pagination Guide we decided for immediate and least work choice was to noindex, follow all the pages that simply list articles (example). Google Algorithm Changes (Penguin or Panda) According to SEOmoz Google Algorithm Changes there is no releases that could have impacted our site at the February 20th ballpark. However - Sitemap We have a sitemap submitted to Google Webmaster Tools, and currently have 4,229 pages indexed of 4,312 submitted. But there are a few pages we looked at that there is an inconsistency between what GWT is reporting and what a “site:” search reports. Why would the submit to index button be showing, if it’s in the index?
That page is in the sitemap. Updated: 2012-11-28T22:08Z Change Frequency: Yearly Priority: 0.5
*GWT Index Stats from bcbusiness.ca What we looked at so far The redirects are all currently 301’s GWT is reporting good DNS, Server Connectivity, and Robots.txt Fetch We don’t have noindex or nofollow on pages where we haven’t intended them to be. Robots.txt isn’t blocking GoogleBot, or any pages we want to rank. We have added nofollow to all ‘Promoted Content’ or paid advertising / advertorials We had TextLinkAds on our site at one point but I removed them once I satarted working here (April 1). Sitemaps were linking to the old URL, but now updated (April)
1 -
What impact will new folder structure have?
I'm evaluating a request to restructure our existing folder structure for Ties.com and I would like some input. I typically recommend proper folder structure for ecommerce sites either when doing a new build or when doing an information architecture overhaul because of duplicate content or canonicalization issues. Ties.com doesn't have duplicate content or canonicalization issues so I'm really trying to get feedback about the SEO impact of a folder structure change versus the amount of time required on our side to do the work. Please share your experiences. Current URL structure example: http://www.ties.com/v/a/the-american-necktie-co-navy-and-gold-stripe-navy-blue-skinny-tie Potential New Structure: http://www.ties.com**/skinny-ties**/the-american-necktie-co-navy-and-gold-stripe-navy-blue-skinny-tie OR http://www.ties.com/skinny-ties/brand/product-title I'm well aware that as a BEST PRACTICE we should be using the category/subcategory folder structure, but since we aren't really suffering from any technical SEO issues then I don't know if this will be worth our time to remap all of these URL's via 301 and canonicalize everything. I anticipate it will be a lot of work and if the Return on Effort is low I can't prioritize this project. I need 2nd and 3rd opinions from experienced ecommerce retail SEO's. Thank you
Intermediate & Advanced SEO | | Ties.com0 -
Could Temporarily Linking New Directory Pages to my Homepage Help SEO?
Within my website we maintain a nationwide directory of auto repair shops. When we add or significantly update / modify a particular listing, would it help improve the individual search engine rankings, Google PageRank, and / or Page Authority of the new auto shop page if we linked these pages to an area on the home page for "Our Newest Featured Shops" or "Latest Member Additions" or something of the nature? Each new shop profile would then be linked directly from the homepage for a period of time. I assume that it might be crawled and added to the indexes quicker, but would there be other benefits? If so, would those benefits only be temporary if eventually the new shop no longer linked to the homepage? Would keeping all featured shops in rotational display on the homepage make any difference? Any input is appreciated. Thanks. Kelly Vaught
Intermediate & Advanced SEO | | kelly_vaught0