International Sites - Sitemaps, Robots & Geolocating in WMT
-
Hi Guys,
I have a site that has now been launched in the US having originally just been UK. In order to accommodate this, the website has been set-up using directories for each country. Example:
As the site was originally set-up for UK, the sitemap, robots file & Webmaster Tools account were added to the main domain. Example:
The question is does this now need changing to make it specific for each country. Example:
The sitemap and robots.txt for the UK would move to:
and the US would have its own separate sitemap and robots.txt. Example :
Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb?
Any help would be appreciated! Thanks!
-
Thanks for the insights. Very helpful. What about the robots.txt, though? Should it stay under http://www.example.com, where crawlers can find the file?
-
Yes, that's how I did it.
-
Thanks for the response, much appreciated.
Would this mean that the sitemap featured at www.domain.com would need to reference each directory version (UK & US etc etc), leaving the en-gb & en-us to reference just their own?
-
Hi, here's what Google officially has to say:
Webmaster Tools data and reporting work best on a site level. For example, if your site http://www.example.com has separate sections for different countries, we recommend adding each of those subsites or subfolders as a separate site. For example, if you have a travel site with specific subfolders covering Ireland, France, and Spain, you could add the following sites to your Webmaster Tools account:
- http://www.example.com
- http://www.example.com/france
- http://www.example.com/ireland
- http://www.example.com/spain
Following this I have solved the exactly the same problem you had for a client. And it works perfectly.
- _The question is does this ["sitemap"] now need changing to make it specific for each country. _What I have done is add the sitemaps for each subdirectory as well as the main domain. It works (tracking and all that) and is easy to do.
- _Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? _Yes, that is the way to go.
- _Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb? _Yes, it does. And so do every other subdirectory you add down the line. That allows precise international targeting per subdirectory via the hreflang and country targeting settings and setting the main GWT site for the root domain to be for global traffic.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
International Targeting: What Does Google Consider an Equivalent Page?
Hi All, We are working with an international brand that owns several domains across the EU and in North America. Our team is in the process of setting up international targeting using sitemaps to indicate alternate language pages. This is being done to prevent North American pages from being served in the UK, Spain pages from being served in Portugal, or any other combination of possibilities... Currently we are mapping duplicate or “equivalent” pages and defining them as rel="alternate" on their respective sitemaps. The problem is, it’s not always explicitly clear what Google considers “equivalent.” 1. In this instance, URL structures vary by domain,
International SEO | | MetaPaul
2. in most cases the content is similar (but unique),
3. the landing page templates vary is design and functionality,
4. and lastly, services often contain nuances that make them slightly different from one another (Professional Liability Insurance vs Professional Indemnity Insurance). All things considered, these pages are offering the same service, but are vastly different (see above). Q: Is it appropriate to use these attributes to serve the correct language / regional URL to searchers? Q: Is there a rule of thumb on what should be considered an "equivalent" page? Thanks All, Paul3 -
Lost local organic rankings and international issues
Hi Everyone, Hoping we can get some help from our fellow Mozzers (Mozee's? Mozites?) We have 3 TLD's .com.au .co.uk & .com We noticed an issue a couple of weeks ago where we suddenly lost a lot of our search rankings for keywords on the .com.au site that we'd been top with for a long time. A lot of our Australian visitors were coming through our US site. US & UK sites got increased ranking results. We fixed up what we thought were the issues (Potentially HREF Lang issues and old sitemap issues). Google Search Console is still telling us we have some HREF Lang Errors, (but this could be waiting an updated crawl as the number is decreasing) Our main domain example.com is now showing up as first result in google.com.au search and the example.com.au doesn't show up until page 4 (prior to 2 weeks ago it was number 1) Any input would be appreciated...
International SEO | | tinyme0 -
Web Site Migration - Time to Google indexing
Soon we will do a website migration .com.br to .com/pt-br. Wi will do this migration when we have with lower traffic. Trying to follow Google Guidelines, applying the 301 redirect, sitemap etc... I would like to know, how long time the Google generally will use to transfering the relevance of .com.br to .com/pt-br/ using redirect 301?
International SEO | | mobic0 -
Google Analytics - whats best way to set up to track users on geotargeted sub folders & tlds ?
Hi ive got a client site just about to launch into 2 new territories (German Germany & Turkish Turkey) The existing/main site is in English & targets English keyword usage globally via domain.com and is not geotargeted in anyway. Analytics is set up for this on domain.com and tracking accurately and GWT is set up too. Now we have added a Turkish language site via a subfolder (domain.com/tr/) & the German site (domsain.com/de/) BUT this German subfolder will be domain mapped to a TLD (domain.de) eventually.. So what's best way to configure/set up Google Analytics to track users so can view the international sub-sites as individual sites etc ? (& GWT for that matter) ? Also after doing this i will be setting up in Moz Anlytics as separate campaigns so how do you set up so only draws in the Analytics data specific to these sub-folders ? All Best Dan
International SEO | | Dan-Lawrence0 -
Site Ranking in all countries except USA
Hello, I have a site www.apdermatology.com in is ranking #1 for
International SEO | | element8design
"Dermatologist Chelsea Mi" "Dermatologist Chelsea Michigan" In Google in Canada, UK, Australia, Etc.. But in the USA it is on the 4th+ Page, it has been this way for weeks if not months. And does not seem to come up. I originally thought maybe that google was penalizing the site although, it comes up in all other counties. Does anyone have any recommendations how to resolve this, or what the problem may be? Thanks.0 -
Alexa Rank and Linking from Article sites.
We are creating unique content and submitting our articles to article sites. I have some questions about the best way to go about this. 1. We are being very careful to create unique content for each submission - so we are not submitting the same article to multiple sites. Each submission is unique, so 1 article per 1 article directory. 2. When I did my research about these article sites at Alexa.com, I noticed that a lot of the article sites are ranking very well globally, but that a lot of them are #1 in Alexa for India. They are still ranked for other countries with very top ranking, for example, they may 9,000 Alexa rank in India and then 18,000 in the U.S. which is still very high. 3. We are trying to reach U.S. customers mostly, so I am wondering if we are still getting value by linking to these sites who have global reach (even though they are ranked best for India). I would think that this is very beneficial still, but I didn't want to get the wrong kind of traffic by getting links from sites that are primarily getting their traffic from India, even though they are also getting tons of traffic from the U.S. - I am assuming this is OK because a 18,000 or 19,000 Alexa Rank in the U.S. is still excellent and I will benefit by this. But I wanted to be sure. Feedback?
International SEO | | applesofgold0 -
New web design targeting UK & France
Hi I have a couple of topics I would like to clarify. My existing website is on .ie & we are now expanding into France & UK We have decided to take the route of example.com with subfolders for example.com/ie example.com/uk & example.com/fr just like thishttp://app.wistia.com/stats/278112 provided by SEOmoz Should we 301 redirect our existing .ie site to the .com or the .com/ie? When building links should links be built to .com or each .com .com/fr etc Also are there any good resources out there about International SEO? Thank you 🙂
International SEO | | Socialdude1 -
Tips for optimizing sites for arabian countries?
I'm going to assist a customer with SEO and we will also have to optimize the project for arabian countries. I'm looking for any helpful tips (links, blog-posts, experiences) like relevant search engines, best practices with keyword translation/localization, impact of mobile search/usage, recommendation for partners/companies... Thank you!
International SEO | | kqkq0