How to Resolve Google Crawling Issues for My eCommerce Website?
-
I want to resolve Google crawling issues for my eCommerce website. My website is as follow.
http://www.vistastores.com/ Google have crawled only 97 webpages from my website. My website is quite old. (~More than 6 months) But, Google have indexed only 97 webpages.
I have created one campaign over SEOmoz tool and found some errors over there. So, I just assumed that due to it Google did not crawled my website.
But, I have created one another campaign for my competitor website to know actual status and reason behind it.
I found that, my competitor website have more error compare to me but, Google have crawled maximum pages compare to me.
So, What is reason behind it? How can I improve my crawling rate and index maximum webpages to Google?
[6133009604_af85d29730_b.jpg](img src=) 6133009604_af85d29730_b.jpg 6133009604_af85d29730_b.jpg 6139706697_4e252fdb82_b.jpg
-
I aware about it. But, I have confusion with omitted results. Google shows me 509 URLs in visible portion and remaining one in omitted results.
I have checked similar result for my competitor with table lamps keyword.
site:simplytablelamps.com
Google shows 2470 pages for my competitor and omitted result is very less compare to my website.
I really don't know more about it but it may cut out my impression with products which are included in omitted result. This is my assumption. What you think about it? If you can give me more idea so it will help me more.
-
When I do a site:vistastores.com, I see about 2300 results indexed in Google, which indicates Google is both indexing and crawling your site. How many pages do you have?
-
Hi, Liam
I come back on this question after long time. Because, I am still surviving with crawling issue. Google is not crawling my website after implement all checklists.
Today, I read one blog post about to increase Google crawl rate.
Blog suggesting to set custom crawl rate with help of Google webmaster tools. So, Does it really matter to improve crawling?
What is important and helpful ... natural crawling by Google or embarrassing crawling by Google?
-
I am going forward with multiple XML sitemap after long R & D.
-
I am still waiting for additional answers in same direction. Can any one help me? I need answer on urgent basis.
-
Yes, your suggestion is right. I have added XML sitemap to Google webmaster tools. But, I am still confuse with crawling.
-
Not sure if you've already done this, but if not - signup to Google Webmaster Tools and submit your sitemap. You can also check crawl errors etc.
With e-commerce websites it's always useful to use an automated XML sitemap so that each product page is added and can then be crawled and indexed.
Let me know if this answers your question??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to optimize my website with new Google Feature snippet fuctionality?
Recently I have interacted with Google's new Feature Snippet Functionality. Please refer to the link shared. https://www.google.com/search?q=family+health+insurance&rlz=1C1CHBD_enIN893IN893&oq=family+health+insurance&aqs=chrome.0.35i39l2j0l3j69i60l3.4692j0j7&sourceid=chrome&ie=UTF-8 I'am looking for the way to optimize my website for the same? If anyone has any clue then please help me with this. search?q=family+health+insurance&rlz=1C1CHBD_enIN893IN893&oq=family+health+insurance&aqs=chrome.0.35i39l2j0l3j69i60l3.4692j0j7&sourceid=chrome&ie=UTF-8
On-Page Optimization | | adlift0 -
What to do to index all my links of my website?
Ok, i have a new website, with only 14.000 page indexed by google, but the potential is big, 1-2 million pages. What i have to do, to force somehow google to index my website faster? This is my website: https://vmag.ro/
On-Page Optimization | | TeodorMarin0 -
Ranking & Visibility suddenly Down for my website
Any google updates or, can anyone tell me what google running, web ranking down, majority keywords showing on 1st pages right now those are on 3rd page, so is there any specific reason, or any solutions plz.. this s my website www.iqlance.com can anyone help me to audit and what was the issues facing exactly..
On-Page Optimization | | harry5501 -
Redirect and Redirect Error in Moz Crawl
Hello, We have a wordpress blog attached to our magento website located at domain.co.uk/blog/ Moz was coming back showing we had multiple page versions on show (http and https) So i updated the htaccess file to what is below. This has fixed most of the errors, however the homepage is being a little tricky. Moz is now saying that the page is redirecting and redirecting again http://www.domain.co.uk/blog to
On-Page Optimization | | ATP
http://www.domain.co.uk/blog/ to
https://www.domain.co.uk/blog/ BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /blog/</ifmodule> RewriteCond %{HTTPS} !=on
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301] RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /blog/index.php [L] END WordPress Within wordpress settings the urls are set up as follows Wordpress Address URL: https://www.domain.co.uk/blog Site Address URL: https://www.domain.co.uk/blog i tried to add a trailing / to these but it gets automatically removed. So i am assuming that wordpress is serving up https://www.domain.co.uk/blog **RewriteBase /blog/ **is re-directing it to / then my https rewrite is re-directing it again I am not sure where exactly to fix this, could anybody advise? Many thanks,0 -
WMT Fetch as Google
Is there any benefits in using 'Fetch as Google' in WMT and then submitting for indexing? I have a page which I'm trying to get to rank so far with no luck is it likely to help or could it hinder? Please speak from experience not hearsay 🙂 Many Thanks
On-Page Optimization | | seoman100 -
Removing old URLs from Google
Hello, I am sure that this question has been asked many times, but I am still not sure what to do about the following: Our site's URL structure has changed a few times in the past few months. Recenty, we have changed our URLs to become more SEO friendly. However, Google has indexed the old URLs as well. To give an example: The following page in our website shows the following URLs in Google Webmaster Tools: Confúcio e Seus Ensinamentos /artigo/68_38/2/as_religioes_iv_confucio_e_seus_ensinamentos//aula/14_6132/vestibular/confucio_e_seus_ensinamentos//aula/1_14_6132/vestibular/confucio_e_seus_ensinamentos//aula/_14_6132/Vestibular/confucio_e_seus_ensinamentos//aula/ensino/confucio_e_seus_ensinamentos/ The correct URL is the last one. What should I do about the other ones? Almost all the pages in our website have this problem. We have redirected the old URLs to the new ones, but is there anything else we should do? We were asking Google to remove them, but Google has informed us that it has reached the limit. Please advise us on waht we should do. We have removed the old sitemap with the old URLs. What else must we do? Thank you very much.
On-Page Optimization | | Tev0 -
Duplicate Content - Potential Issue.
Hello, here we go again, If I write an article somewhere, lets say Squidoo for instance, then post it to my blog on my website will google see this as duplicate content and probably credit Squidoo for it or is there soemthing I can do to prevent this, maybe a linkk back to Squidoo from my website or a dontfollow on my website? Im not sure so any help here would be great, Also If I use other peoples material in my blog and link back to them, obviously I dont want the credit for the original material I am simply collating some of this on my blog for others to have a specific library if you like. Is this going to damage my websites reputation? Thanks again peeps. Craig Fenton IT
On-Page Optimization | | craigyboy0 -
Canonical issue
Hi, Very new to seomoz but very impressed. First report has shown me that I have duplicate pages. Some seem to be duplicate titles and some were duplicates of pages i found on the server. however the main problem is it seems to be picking up pages with www and without it which I have a vague idea is a canonical issue. so it throws up pages like this: http://web-writer-articles.co.uk and http://www.web-writer-articles.co.uk I want it just to pick up pages with www Firstly should it be picking up both and if not how can I make amendments so that it is only picking up pages which include www ? thank you for your help, louandel15
On-Page Optimization | | louandel150