How to Index Faster?
-
Hello,
I have a new website and updated fresh content regularly. My indexing status is very slow.
When I search how to improve my indexing rate by Google, I found most of the members of Moz community replied there is no certain technique to improve your indexing. Apart from this you should keep posting fresh content more and more and wait for Google Indexing.
Some of them asked for submitting sitemap and share posts on Twitter, Facebook and Google Plus.
Well the above comments are from the year of 2012.
I'm curious to know is there any new technique or methods are used to improve indexing rate?
Need your suggestions!
Thanks.
-
As mentioned earlier, you can create a comprehensive Sitemap.xml file and resubmit to Google. Give me your email address, I will create one for you and send it
Best regards,
Devanur Rafi
-
The site has about 140 articles as of now. So there are 140 post URLs. This apart, there are many category, tags, author pages. So the number should be 230 URLs as indicated by Google. However, Google may show only post pages no a priority. This is just my hunch. Thanks,
-
Nevermind, there are about 497 pages on your website. So, I would ask you to use a comprehensive sitemap.xml file and submit it to Google. You can use a tool like GSite crawler to generate one.
-
Thanks for your help, Kavit
the website's URL is www.getyourtips.com
As per the results shown by PageSpeed test on Google, the website scores 69 out of 100 on mobile devices and 79 out of 100 on desktop PCs.
https://www.dropbox.com/s/xmfw6zci8hih3sn/Screenshot 2014-06-10 14.48.09.png
While there's still room for improvement, I think the scores aren't that bad at the moment? Please, take a look at the site and let me know if I could change some properties to make it load even faster.
This is a brand new website (just 2 month old) and it might take a while to establish authority or get some PageRank. Considering these, what should be the best foot forward?
Thanks,
-
Thanks for the info Susanta. After a quick check, I see the sitemap.xml that you submitted has only 130 URLs in it and there are 230 pages (omitted after 182) indexed in Google from your website. So, can you tell me how many pages are there in total in your website?
-
Hi Devanur,
Thanks for the help! Here's the URL of my website www.getyourtips.com
Here's a screenshot of the index status of the website on GWT: https://www.dropbox.com/s/nyrwjvvmt0novu7/Screenshot 2014-06-10 14.32.12.png
Here's a screenshot of the search queries page: https://www.dropbox.com/s/2js1oqtrtseg56g/Screenshot 2014-06-10 14.38.30.png
The website is a little over 2 months old.
We have submitted the Sitemap already.
We used to post 4 posts per day during the launch of the website but we have reduced the posting to just one per day since last week.
Would like to know if there is anything more we should do apart from submitting sites to different blog feeds to get the index more frequently.
Thanks,
-
Hi Susanta,
If I was you, I would focus on site performance. Having a fast responsive site means you can expose more of your site & contents to Google during each crawl.
If you have all this great content, it might be a matter of making the site faster so that Google can index more each time.
Crawl rates and indexation are largely affected by your PageRank and Authority with Google so this does get better with time as your site improves in these areas.
-
Hi Susanta,
If you can share the URL of your domain, we will be able to answer better as the rate of indexing differs from site to site and also depends on lot of things like the website internal linking structure, website architecture, your backlinks and the list goes on..
Sitemap.xml is definitely a good way to give the indexing rate of your website a boost. But the story does not end there as there are lot of things that come in to play.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do uncrawled but indexed pages affect seo?
It's a well known fact that too much thin content can hurt your SEO, but what about when you disallow google to crawl some places and it indexes some of them anyways (No title, no description, just the link) I am building a shopify store and it's imposible to change the robots.txt using shopify, and they disallow for example, the cart. Disallow: /cart But all my pages are linking there, so google has the uncrawled cart in it's index, along with many other uncrawled urls, can this hurt my SEO or trying to remove that from their index is just a waste of time? -I can't change anything from the robots.txt -I could try to nofollow those internal links What do you think?
Intermediate & Advanced SEO | | cuarto7150 -
Robots.txt, Disallow & Indexed-Pages..
Hi guys, hope you're well. I have a problem with my new website. I have 3 pages with the same content: http://example.examples.com/brand/brand1 (good page) http://example.examples.com/brand/brand1?show=false http://example.examples.com/brand/brand1?show=true The good page has rel=canonical & it is the only page should be appear in Search results but Google has indexed 3 pages... I don't know how should do now, but, i am thinking 2 posibilites: Remove filters (true, false) and leave only the good page and show 404 page for others pages. Update robots.txt with disallow for these parameters & remove those URL's manually Thank you so much!
Intermediate & Advanced SEO | | thekiller990 -
Problems in indexing a website built with Magento
Hi all My name is Riccardo and i work for a web marketing agency. Recently we're having some problem in indexing this website www.farmaermann.it which is based on Magento. In particular considering google web master tools the website sitemap is ok (without any error) and correctly uploaded. However only 72 of 1.772 URL have been indexed; we sent the sitemap on google webmaster tools 8 days ago. We checked the structure of the robots.txt consulting several Magento guides and it looks well structured also.
Intermediate & Advanced SEO | | advmedialab
In addition to this we noticed that some pages in google researches have different titles and they do not match the page title defined in Magento backend. To conclude we can not understand if this indexing problems are related to the website sitemap, robots.txt or something else.
Has anybody had the same kind of problems? Thank you all for your time and consideration Riccardo0 -
Links from non-indexed pages
Whilst looking for link opportunities, I have noticed that the website has a few profiles from suppliers or accredited organisations. However, a search form is required to access these pages and when I type cache:"webpage.com" the page is showing up as non-indexed. These are good websites, not spammy directory sites, but is it worth trying to get Google to index the pages? If so, what is the best method to use?
Intermediate & Advanced SEO | | maxweb0 -
Google Indexed my Site then De-indexed a Week After
Hi there, I'm working on getting a large e-commerce website indexed and I am having a lot of trouble.
Intermediate & Advanced SEO | | Travis-W
The site is www.consumerbase.com. We have about 130,000 pages and only 25,000 are getting indexed. I use multiple sitemaps so I can tell which product pages are indexed, and we need our "Mailing List" pages the most - http://www.consumerbase.com/mailing-lists/cigar-smoking-enthusiasts-mailing-list.html I submitted a sitemap a few weeks ago of a particular type of product page and about 40k/43k of the pages were indexed - GREAT! A week ago Google de-indexed almost all of those new pages. Check out this image, it kind of boggles my mind and makes me sad. http://screencast.com/t/GivYGYRrOV While these pages were indexed, we immediately received a ton of traffic to them - making me think Google liked them. I think our breadcrumbs, site structure, and "customers who viewed this product also viewed" links would make the site extremely crawl-able. What gives?
Does it come down to our site not having enough Domain Authority?
My client really needs an answer about how we are going to get these pages indexed.0 -
Why Is Google Indexing These Product Pages On Shopify?
How can we communicate to Google the exact product pages we'd like indexed on our site? We're an apparel company that uses Shopify as our ecommerce platform. Website is sportiqe.com. Currently, Google is indexing all types of different pages on our site. **Example of a product page we want indexed: ** Product Page: sportiqe.com/products/PRODUCT-TITLE (Like This) **Examples of product pages being indexed: ** sportiqe.myshopify.com/products/PRODUCT-TITLE sportiqe.com/collections/COLLECTION-NAME/products/PRODUCT-TITLE See attached for an example of how two different "Boston Celtics Grateful Dead" shirts are being indexed. Any suggestions? We've used both Shopify and Google Webmaster tools to set our preferred domain (sportiqe.com). We've also added this snippet of code to our site three months ago thinking that would do the trick... {% if template == 'product' %}{% if collection %} {% endif %}{% endif %} sKwNZOl
Intermediate & Advanced SEO | | farmiloe0 -
To remove from index or not and stop words
Each product is an item of jewellery based on a letter of the alphabet. At present all 26 are indexed but as you guess they all share the same description, title and URL (apart from change in letter). What I was going to do was set all but one to no-index, recreate new descriptions and revert back to index. But then that got me thinking - through stop words will the titles be seen as duplicates: letter bracelet letter a bracelet letter i bracelet
Intermediate & Advanced SEO | | MickEdwards0 -
Should pages of old news articles be indexed?
My website published about 3 news articles a day and is set up so that old news articles can be accessed through a "back" button with articles going to page 2 then page 3 then page 4, etc... as new articles push them down. The pages include a link to the article and a short snippet. I was thinking I would want Google to index the first 3 pages of articles, but after that the pages are not worthwhile. Could these pages harm me and should they be noindexed and/or added as a canonical URL to the main news page - or is leaving them as is fine because they are so deep into the site that Google won't see them, but I also won't be penalized for having week content? Thanks for the help!
Intermediate & Advanced SEO | | theLotter0