How to Resolve Google Crawling Issues for My eCommerce Website?
-
I want to resolve Google crawling issues for my eCommerce website. My website is as follow.
http://www.vistastores.com/ Google have crawled only 97 webpages from my website. My website is quite old. (~More than 6 months) But, Google have indexed only 97 webpages.
I have created one campaign over SEOmoz tool and found some errors over there. So, I just assumed that due to it Google did not crawled my website.
But, I have created one another campaign for my competitor website to know actual status and reason behind it.
I found that, my competitor website have more error compare to me but, Google have crawled maximum pages compare to me.
So, What is reason behind it? How can I improve my crawling rate and index maximum webpages to Google?
[6133009604_af85d29730_b.jpg](img src=) 6133009604_af85d29730_b.jpg 6133009604_af85d29730_b.jpg 6139706697_4e252fdb82_b.jpg
-
I aware about it. But, I have confusion with omitted results. Google shows me 509 URLs in visible portion and remaining one in omitted results.
I have checked similar result for my competitor with table lamps keyword.
site:simplytablelamps.com
Google shows 2470 pages for my competitor and omitted result is very less compare to my website.
I really don't know more about it but it may cut out my impression with products which are included in omitted result. This is my assumption. What you think about it? If you can give me more idea so it will help me more.
-
When I do a site:vistastores.com, I see about 2300 results indexed in Google, which indicates Google is both indexing and crawling your site. How many pages do you have?
-
Hi, Liam
I come back on this question after long time. Because, I am still surviving with crawling issue. Google is not crawling my website after implement all checklists.
Today, I read one blog post about to increase Google crawl rate.
Blog suggesting to set custom crawl rate with help of Google webmaster tools. So, Does it really matter to improve crawling?
What is important and helpful ... natural crawling by Google or embarrassing crawling by Google?
-
I am going forward with multiple XML sitemap after long R & D.
-
I am still waiting for additional answers in same direction. Can any one help me? I need answer on urgent basis.
-
Yes, your suggestion is right. I have added XML sitemap to Google webmaster tools. But, I am still confuse with crawling.
-
Not sure if you've already done this, but if not - signup to Google Webmaster Tools and submit your sitemap. You can also check crawl errors etc.
With e-commerce websites it's always useful to use an automated XML sitemap so that each product page is added and can then be crawled and indexed.
Let me know if this answers your question??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google changing my Title
I noticed today that Google is showing a different Title in searches for the homepage. It is showing a title which I believe was active as of late last year or early January. The new title is in the title tag, in Google cache and in MOZ crawls as well. Not sure why it would still be showing a different title in the search and wanted to see if anyone can explain the reason. Thanks
On-Page Optimization | | campaigneast0 -
Page/Website Structure
Hello again Mozzers, We have a category, lets call it widgets. Within widgets are about a hundred or so products. For usability my predecessor made the following layout Widgets Main Cateogry - Links off homepage - (no content just links to the 3 sub-categories)
On-Page Optimization | | ATP
- Widgets by Resolution
---- About 20 subcategories
eg. 0.1 Resolution widgets
0.2 resolution widgets
- Widgets by Capacity
---- About 20 subcategories
eg. 1 capacity widgets
2 capacity widgets
- Widgets by Type
---- About 12 subcategories This was a major improvement from a userbility perspective as it made a very complex product range navigatable by the major features or basic type. However, as you can imaging we now have 60+ very similiar pages all displaying very similiar products a nightmare for SEO. It also isnt ideal for user navigation as it take too many clicks to get to the products. I propose the following fix, and i wanted your opinion. Widget Main Category - Link from homepage (Consolidated with Widgets by Type)
-300 Words of content
-Links to the 12 Sub-type Catoregies (These are pages i can fill with content + products. This would give me a more ordinary structure of which I can focus each page to a keyword) The tricky part comes with incorporating the capacity and resolution options. 1 Browse Capacity Page
(20 sub categories all the same except capacity quantity & products)
1 Browse by Resolution Page
(20 sub categories all the same except resolution value & products) The owner want them, I was going to link from the main widgets page to each of these to give the customer the option. What I can't decide is how to deal with them from an SEO point of view. Should they be no-followed? canonicaled? Can there be any advantage to having so many pages covering slightly different variations or as i suspect it is dangerous to the overall health of the site. To complicate things further, Canonical tags may not be an option due to an old magento version running that doesnt support them. Is there an alternative way around? As always many thanks.0 -
Strange error on my website
Hi Wondering if anyone could help out here please. I tried to crawl my website using screaming frog and got a 500 error warning (odd considering it worked yesterday). I tried google speed test and got the following message - PageSpeed Insights received a 500 response from the server. To analyze pages behind firewalls or that require authentication. However, it also crawled the site and gave me a score of 70/100. It showed the site thumbnail, as normal. This was updated this morning and it showed the latest one so must have crawled. I can access the site, as can my 'people', the site is getting hits from real users in Google Analytics so must be working. Am very puzzled how the site can be working and not be working at the same time! If possible i would rather not share the url. The site is a test of concept and is very messy looking. it is more a test to see what happens if i do x... Many thanks Carl
On-Page Optimization | | daedriccarl0 -
Getting Google to see major changes?
I am making some big changes to my site based on Moz's advice. How can I get google to see all of them? I submitted them to Google Webmasters. Is that the best thing to do? How long until Google updates all my pages?
On-Page Optimization | | dealblogger0 -
Replacing website, same URL, lose ranking
We had to do a rush job for a client and get a website up very quickly. We had to just replace the existing files on the server, but URL stayed the same. Now "teeth whitening glasgow" which they were number #1 for isn't coming up. Know there is still some on page work to be done - but the link profile should still remain the same? Just looking for some advice to get back to where they were - should we do a website change of address or just verify the site in Webmaster and get all the on page done? Thanks, Laura
On-Page Optimization | | lauratagdigital0 -
Branded keyword domain not appearing in Google
Hi, I have a site called www.emv-cards.com but the site has a very poor showing on Google for the search term 'emv cards' and this does not make sense to me. It has position #6 on Bing but is not in Google's top 50. Any assistance would be appreciated. regards, George.
On-Page Optimization | | sirgeorge0 -
Has anyone noticed a big delta between Google and Bing rankings? For example, we rank favorably in Google, but not so favorably in Bing. Are there different tactics I should use to rank better in Bing?
An example is in Google, we currently rank #1 & #2 for "yoga pants" for Athleta and Old Navy. In Bing, I'm on page 2. Any thoughts here?
On-Page Optimization | | kpr0