What is the best way to generate an automatic sitemap for google, bing and yahoo?
-
Hi guys,
So far I recieved a Sitemap that was generated by an seo company to use and submit to google, for our co.nz domain, I have been told to submit this also to bing and yahoo. Can anyone tell me if I can submit the same sitemap for the com.au and com or would i need to generate a new sitemap for each domain?
I have been told, everytime we change content we have to keep submitting, is there a way to do this autmatically as we will be writting alot of content daily.
Any recommendations or suggestions?
-
With Screaming Frog you would need to crawl, generate, and submit the sitemap (or upload it to your server) whenever it changes (you add/remove a page).
-
Thanks Ray, I could chat to my developer about generating a automated one as that would help out alot. With the screaming frog, would I just need to do it once? and submit this to google and bing only once?
-
Hi Alec,
It looks like your website is a custom built website, correct? No CMS like WordPress or similar. In this instance, you would want your developers to create an XML sitemap that auto-includes the new pages created for your site. If this is not possible, then you need to update the sitemap with the new pages as you create them.
Once you submit the sitemap link to Google / Bing they remember the URL to your sitemap and crawl the sitemap at their leisure (more popular sites get their sitemap crawled more frequently). So, once you submit a sitemap, as long as the URL remains the same, the bots will auto-crawl your sitemap for updates.
If you cannot have a sitemap autogenerated and do not want to always manually add the links (or do not know how to maintain an XML feed) then I suggest using Screaming Frog SEO Spider's sitemap feature. The tool will crawl your website and you can generate a sitemap for your site. Then, you can submit that sitemap as it changes to the proper search engines.
Since your websites are setup as unique domains, you would need to submit a sitemap with the unique URLs for each domain. Your other question about your 3 web properties raises some concerns, which I will try to address there.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the best way to manage multiple international URLS
Hi All Our company is looking to expand into Europe (we are a UK based company) and we are planning to copy over our current .co.uk site to a .com one and create 301 redirects to maintain our SEO rankings. With the .com domain we were looking to use this as our main ecommerce site and then create sites for different countries in Europe. What we are unsure about is the best way to execute this in terms of the domain. Would it be best to have it setup as a domain structure such as: UK = www.example.com/gb/
International SEO | | MartinJC
Ireland = www.example.com/ie/
France – www.example.com/fr/ and so on. Or would we be better served creating sub domains for each country, example www.gb.example.com. Our main concerned is what is the best way to do this without hurting our SEO rankings. Thanks for the help.0 -
Does Google's algorithm work the same in every country?
I can't help but feel this is a silly question! but does Google algorithm work exactly the same throughout all countries? I run a few sites in the UK and a couple in Spain but can't help but feel that my Spanish sites are harder to rank for. The sites that rank the best are business directories in Spain... whereas here in the UK you'd be lucky to find one on page one..
International SEO | | david.smith.segarra0 -
What is the best way to rank well on both Google.co.uk & Google.com?
I am working on a website that is primarily a UK based software company but is now expanding into the US. The website is a .com site and is not geo-targeted to any specific location. Currently the site ranks well on Google.co.uk for a number of the focus keywords. We are now targeting Google.com as well to increase visibility in the USA. The site is ranking number 1 for one of the focus terms on Google.co.uk but no where to be seen on Google.com but on another term the site ranks 3rd in both Google.co.uk and .com. There are a number of other terms that rank on the first page in Google.co.uk and on the 3rd or 4th page in Google.com. The server is located in Germany and I do not want to geotarget the site to the US as I am concerned this would have a negative impact on the .co.uk ranking. The site currently has a mix of .com and .co.uk links pointing back to the site, in actual fact possibly more links actually come from US sites already. My original plan was to just focus on building links back to the target pages from US sites rather than creating a US folder on the site and geotargeting that section of the site in WMT and having to build page authority for a completely new page with no existing backlinks. But now that I have a number 1 ranking on .co.uk and the same term not ranking at all in .com as well as a postion 3 ranking for a term in both .co.uk and .com I am slightly confused as to the best options. Any help, advice, opinions would be greatly appreciated.
International SEO | | PaulSimms0 -
Mini Google Search box within organic sitelinks
I'm trying to find solid information on Google's criteria on showing a "mini Google search box" within sitelinks? Example: if you type-in "wikipedia" on Google.com, a mini search box appears within the site links. This is for organic listing not paid listing. The Google Support page on Sitelinks does not state any info on the mini google search box. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=47334
International SEO | | Mobies0 -
Best practice for WPML, Yoast and sitemap for google
Hi Mozzers, I have a wordpress installation and work on a hotel website in three different languages: English, German, Spanish. In order to manage each language as a regional or global website, I started to give the website the names like: de.hotelnamen.com, es.hotelname.com (Hotel is in Costa Rica, maybe cr.hotelname.com is even better???) and hotelname.com. The possibility of WPML to manage my multilingual blog is good and the Yoast plugin gives me the sitemaps I want for each language. Because it is a hotel I have to have a global page which should serve the world if they try to find the hotel, right? That's why i put hotelname.com as a global page in English and registered the sitemaps and page on my webmaster account in countries as "not listed". For de.hotelname.com I choose Germany on another webmaster account and for es.hotelname.com Costa Rica (the country in which the Hotel is located). Unfortunately, after three month I don't receive good results with that methode. The hotelname.com adress is always the page which comes up in all search engines. I my tactic wrong? Where is my mistake? I would like to have hotelname.com in the rankings of all search engines beside of google Germany because for the German market I have the German version. Same in Costa Rica. Thanks for some ideas...
International SEO | | reisefm0 -
International (foreign language) URL's best practices
I'm curious if there is a benefit or best practice with regards to using the localized language on international sites (with specific ccTLDs). For example, should my french site (site.fr) use the french language as keywords within the URLs or should they be in english? e.g. www.site.fr/nourriture vs. www.site.fr/food Is that considered best practice for SEO (or just for brand perception those markets?). Is there a tangible loss in SEO if we do not use the correct language for those URLs and just stick with English around the world? I recall seeing a Matt Cutts video on the topic and he said that google does support i18n URL's but other SE's might not support them as gracefully but he didn't come down with a hard recommendation to go with i18n URL's or just English. Would love a strong ruling in favor one direction based on best practices.
International SEO | | mongillo0 -
What’s the best way to convert ccTLD to global TLD?
We started out as a Canadian site targeting Canadian users. Now our site http://iCraft.ca has a lot of international buyers and sellers and .ca TLD doesn’t make sense anymore, as we are not performing well on Google.com We are doing a complete site redesign right now, which will address a lot of coding and content specific issues, but we suspect .ca domain will always hold us back in achieving good positions on Google.com. Since Google doesn’t allow ccTLDs to set geo-targeting, what are our options? a) Migrating to a brand new .com site and setting up 301 redirects for all links from iCraft.ca. Would we lose all rankings in this example and pretty much start building them from scratch? Or would PR be transferred page by page from one domain to another through 301 redirects? b) Setup a separate .com site with mirrored content to target global audience and keep .ca site to target Canada. Not sure if splitting PR for the same pages between 2 sites is a good idea. Also, how would you address duplicate content properly in our situation?
International SEO | | MarinaUX
In this video that I found here on forum http://www.youtube.com/watch?v=Ets7nHOV1Yo Matt Cutts says that it’s ok to have duplicate content on different ccTLDs, but he says - make sure you localize your content on those domains. What if you can’t? Most of the content on our site is meant for anyone, not just Canadian users. So, for the most part, we’d have exactly same content on .com site, as we have on .ca site. We could display prices in different currencies on product pages, but the rest of the content – blogs, forum etc. are not country-specific and can’t be localized easily. Also, it’s not clear from the video if all mirrored sites should sit on the same domain name for each country, like example.com and example.ca or is it ok to have example.com and icraft.ca? c) Is there a better option? Thanks for your help!0 -
How can I view Google.com SERPs from outside the US?
If I go to Google.com I get redirected back to Google.co.uk and search results have a UK bias. I'm trying to research the US market and have a hazy recolection of Rand demonstrating how you can add a few characters to the google.co.uk url to see US results - just can't remember what video I saw it in. Any ideas? Thanks a lot
International SEO | | trbaldwin0