What is the best method for indexing blog pages?
-
I have a client whose blog has hundreds if not thousands of entries. My question is does it help his site if each unique blog entry becomes indexed on Google? Can we do this dynamically? And role does the canonical tag play in blog entries if at all?
Thanks,
Chris
-
is there a way to insert the title tag dynamically on each blog post via the cms?
CMS is software, and every software package is different. I will share there should be a way to do it, but you would need to search your CMS provider's site to get the details.
For your titles, I am not clear what you are asking. I would recommend the title tag for your blog matching your blog's title. You may want to add your site name or category name depending on the situation. For example if your site is "Chevyworld.com" and you have a blog entry titled "1982 Stingray, the end of an era" then the post title could be:
1982 Stingray, the end of an era
1982 Stingray, the end of an era | Chevyworld
1982 Stingray, the end of an era | Corvettes | Chevyworld
In the first example, your CMS would be adjusted to use the blog title for the title tag. In the second, the blog title plus your site name would be used for the title tag. The last example uses the blog title, the blog's main category tag and the site title.
Will google treat each entry as a unique page?
You need to ensure each page can only be accessed by one URL. For example, take a look at the following blog article's URL:
http://www.huffingtonpost.com/2011/06/25/rachel-weisz-daniel-craig-married_n_884653.html
Now try to access that same article with various other URLs such as without the www or with adding a trailing slash character:
http://huffingtonpost.com/2011/06/25/rachel-weisz-daniel-craig-married_n_884653.html
http://www.huffingtonpost.com/2011/06/25/rachel-weisz-daniel-craig-married_n_884653.html/
Notice that when you try to remove the "www' the same article appears but the site's redirect works and adjusts the URL by adding the "www'. Does your blog article redirect itself in this manner? Or does it display for both the www and non-www url?
Another example is the trailing slash. In this case the URL is adjusted and a question mark is added. If you View Page Source you will see there is a canonical meta tag which ensures the correct version of the page is consistently used by search engines.
-
Thanks for the reply. Follow up to your response, I am familiar with sitemaps, but what I meant by dynamically was is there a way to insert the title tag dynamically on each blog post via the cms? Also should each title tag for the blog follow a formula like: Client Blog: article a Client Blog: article b Client Blog: article c (and so on) Also thanks for the info on the canonical tags. So for a typical blog, will google treat each entry as a unique page? I want to make sure we don't get dinged for having duplicate pages.
-
**My question is does it help his site if each unique blog entry becomes indexed on Google? **
I am assuming that since each entry is unique content and is offered on your site that you desire people to read it. If that is the case then yes, it would be a tremendous help to be indexed by Google. If the pages are not indexed by Google, then how will people find these pages? It will only happen if they are either already on your site, or are told about the pages or linked to the pages.
Having a page indexed by Google allows people to find it through a normal search, which is how most pages on the web are discovered.
Can we do this dynamically?
Yes. You can submit a simple sitemap to Google, and they will try to crawl your site's pages if they have not already done so. It is important you do not block their efforts in your robots.txt file nor with any "noindex" meta tags.
** And role does the canonical tag play in blog entries if at all?**
Canonical tags help ensure the correct version of your blog entry, or any web page is indexed. If your page can be accessed through multiple URLs, then it should be canonicalized so the proper version of the page is indexed.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blogs Not Getting Indexed Intermittently - Why?
Over the past 5 months many of our clients are having indexing issues for their blog posts.
Technical SEO | | JohnBracamontes
A blog from 5 months ago could be indexed, and a blog from 1 month ago could be indexed but blogs from 4, 3 and 2 months ago aren't indexed. It isn't consistent and there is not commonality across all of these clients that would point to why this is happening. We've checked sitemap, robots, canonical issues, internal linking, combed through Search Console, run Moz reports, run SEM Rush reports (sorry Moz), but can't find anything. We are now manually submitting URLs to be indexed to try and ensure they get into the index. Search console reports for many of the URLs will show that the blog has been fetched and crawled, but not indexed (with no errors). In some cases we find that the blog paginated pages (i.e. blog/page/2 , blog/page/3 , etc.) are getting indexed but not the blogs themselves. There aren't any nofollow tags on the links going to the blogs either. Any ideas? *I've added a screenshot of one of the URL inspection reports from Search Console alt text0 -
Drop in Indexed Page + Organic Traffic
Hey Moz Community, I've been seeing a steady decrease in search console of pages being indexed by Google for our eCommerce site. This is corresponding to lower impressions and traffic in general this year. We started with around a million pages being indexed in Nov of 2015 down to 18,000 pages this Nov. I realized that since we don't have around 3,000 or so products year round this is mostly likely a good thing. I've checked to make sure our main landing pages are being indexed which they are and our sitemap was updated several times this year, although we're in the process of updating it again to resubmit. I also checked our robots.txt and there's nothing out of the ordinary. In the last month we've recently gotten rid of some duplicate content issues caused by pagination by using canonical tags but that's all we've done to reduce the number of pages crawled. We have seen some soft 404's and some server errors coming up in our crawl error report that we've either fixed or are trying to fix. Not really sure where to start looking to find a solution to the problem or if it's even a huge issue, but the drop in traffic is also not great. The drop in traffic corresponded to lose in rankings as well so there could be correlation or none. Any ideas here?
Technical SEO | | znotes0 -
Home Pages of Several Websites are disappearing / reappearing in Google Index
Hi, I periodically use the Google site command to confirm that our client's websites are fully indexed. Over the past few months I have noticed a very strange phenomenon which is happening for a small subset of our client's websites... basically the home page keeps disappearing and reappearing in the Google index every few days. This is isolated to a few of our client's websites and I have also noticed that it is happening for some of our client's competitor's websites (over which we have absolutely no control). In the past I have been led to believe that the absence of the home page in the index could imply a penalty of some sort. This does not seem to be the case since these sites continue to rank the same in various Google searches regardless of whether or not the home page is listed in the index. Below are some examples of sites of our clients where the home page is currently not indexed - although they may be indexed by the time you read this and try it yourself. Note that most of our clients are in Canada. My questions are: 1. has anyone else experienced/noticed this? 2. any thoughts on whether this could imply some sort of penalty? or could it just be a bug in Google? 3. does Google offer a way to report stuff like this? Note that we have been building websites for over 10 years so we have long been aware of issues like www vs. non-www, canonicalization, and meta content="noindex" (been there done that in 2005). I could be wrong but I do not believe that the site would keep disappearing and reappearing if something like this was the issue. Please feel free to scrutinize the home pages to see if I have overlooked something obvious - I AM getting old. site:dietrichlaw.ca - this site has continually ranked in the top 3 for [kitchener personal injury lawyers] for many years. site:burntucker.com - since we took over this site last year it has moved up to page 1 for [ottawa personal injury lawyers] site:bolandhowe.com - #1 for [aurora personal injury lawyers] site:imranlaw.ca - continually ranked in the top 3 for [mississauga immigration lawyers]. site:canadaenergy.ca - ranks #3 for [ontario hydro plans] Thanks in advance! Jim Donovan, President www.wethinksolutions.com
Technical SEO | | wethink0 -
Is site: a reliable method for getting full list of indexed pages?
The site:domain.com search seems to show less pages than it used to (Google and Bing). It doesn't relate to a specific site but all sites. For example, I will get "page 1 of about 3,000 results" but by the time I've paged through the results it will end and change to "page 24 of 201 results". In that example If I look in GSC it shows 1,932 indexed. Should I now accept the "pages" listed in site: is an unreliable metric?
Technical SEO | | bjalc20112 -
Google dropping pages from SERPs even though indexed and cached. (Shift over to https suspected.)
Anybody know why pages that have previously been indexed - and that are still present in Google's cache - are now not appearing in Google SERPs? All the usual suspects - noindex, robots, duplication filter, 301s - have been ruled out. We shifted our site over from http to https last week and it appears to have started then, although we have also been playing around with our navigation structure a bit too. Here are a few examples... Example 1: Live URL: https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place SERP (1): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place SERP (2): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place+site%3Awww.normanrecords.com Example 2: SERP: https://www.google.co.uk/search?q=deaf+center+recount+site%3Awww.normanrecords.com Live URL: https://www.normanrecords.com/records/149001-deaf-center-recount- Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149001-deaf-center-recount- These are pages that have been linked to from our homepage (Moz PA of 68) prominently for days, are present and correct in our sitemap (https://www.normanrecords.com/catalogue_sitemap.xml), have unique content, have decent on-page optimisation, etc. etc. We moved over to https on 11 Aug. There were some initial wobbles (e.g. 301s from normanrecords.com to www.normanrecords.com got caught up in a nasty loop due to the conflicting 301 from http to https) but these were quickly sorted (i.e. spotted and resolved within minutes). There have been some other changes made to the structure of the site (e.g. a reduction in the navigation options) but nothing I know of that would cause pages to drop like this. For the first example (Memory Drawings) we were ranking on the first page right up until this morning and have been receiving Google traffic for it ever since it was added to the site on 4 Aug. Any help very much appreciated! At the very end of my tether / understanding here... Cheers, Nathon
Technical SEO | | nathonraine0 -
Is the Authority of Individual Pages Diluted When You Add New Pages?
I was wondering if the authority of individual pages is diluted when you add new pages (in Google's view). Suppose your site had 100 pages and you added 100 new pages (without getting any new links). Would the average authority of the original pages significantly decrease and result in a drop in search traffic to the original pages? Do you worry that adding more pages will hurt pages that were previously published?
Technical SEO | | Charlessipe0 -
Best practice for Landing page in Wordpress
Hi Mozers, has anyone experience in setting up landing pages with Wordpress? The problem I want to solve is the following: I work with a membership area like SEOmoz in which I have some bigger plugins running. If i make a landing page in the same installation like a custom post type/template or via another plugin like "Premise" all plugins will automatically load as well. That will harm my page loading time. Do you think, I should work maybe with Wordpress Multisites? Landing pages as a separate blog and the membership area as another blog? Appreciate any good idea! Thanks
Technical SEO | | reisefm0 -
Off-page SEO and on-page SEO improvements
I would like to know what off-page SEO and on-page SEO improvements can be made to one of our client websites http://www.nd-center.com Best regards,
Technical SEO | | fkdpl2420