Use "If-Modified-Since HTTP header"
-
I´m working on a online brazilian marketplace ( looks like etsy in US) and we have a huge amount of pages... I´ve been studing a lot about that and I was wondering to use If-Modified-Since so Googlebot could check if the pages have been updated, and if it is not, there is no reason to get a new copy of them since it already has a current copy in the index. It uses a 304 status code, "and If a search engine crawler sees a web page status code of 304 it knows that web page has not been updated and does not need to be accessed again." Someone quoted before me**Since Google spiders billions of pages, there is no real need to use their resources or mine to look at a webpage that has not changed. For very large websites, the crawling process of search engine spiders can consume lots of bandwidth and result in extra cost and Googlebot could spend more time in pages actually changed or new stuff!**However, I´ve checked Amazon, Rakuten, Etsy and few others competitors and no one use it! I´d love to know what you folks think about it
-
Hi,
It's a tricky one, I've looked in to this also a while ago for a site I was working on. I don't have a definitive answer but we went for another solution. Creating sitemaps and using the last_modified date element in there so hopefully Google would get when we last updated the specific pages.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to compete against search terms that use geo-modifiers?
I should start by saying we are new to SEO. We are introducing new “cycling tours” in new destinations and we are looking for a strategy to combat geo-modified keyword searches. When people search for “cycling tours” they will anchor their search with a geo-modifier such as “cycling tours France” or “cycling tours Italy”. Based in Australia we are keen to communicate to Australians searching for international cycling tours there are new Australian options that they may wish to consider. The geo-modifiers required to find our tours (“eyre peninsula” and “carnarvon gorge”) are currently not on the cycling communities radar. For example to find one of our new tours you need to use “cycling tours eyre peninsula” or “cycling tours carnarvon gorge”. Currently the only solution we have found to let people know about our new tours is by word of mouth. Is there an SEO solution?
Intermediate & Advanced SEO | | Chook10 -
HTTP to HTTPS Question
Hello, I have a question regarding SSL Certificates I think I know the answer to but wanted to make sure. One of our clients’ site uses http for their pages but when they started creating Registration forms they created a full duplicate site on https (so now there are two versions of all of the pages). I know due to duplicate concerns this could be an issue and needs to resolved (as well as the pros and cons of both) but if they are already set up with https does it make sense to just move everything there or in some instances would it pay to keep some pages http (using canonical tags, redirects, htccess…etc)? – Most of the information I found related to making the decision prior to having both or describing the process but I couldn’t find anything that specifically related to if both are already present. I thought that the best approach because everything’s already set up is to just move everything over to the more secure one but was curious if anybody had any insight? Thank you in advance.
Intermediate & Advanced SEO | | Ben-R0 -
LinkedIn 999 HTTP Errors
I am working on a website, https://linkedinforbusiness.net and a ton of 999 HTTP errors have only now surfaced. I would venture from reading the "Request denied" error in the log, LinkedIn means to block BLCs attempts to check those links. It might be because the site has a lot of LinkedIn links; maybe they find it suspicious that the server is sending a lot of requests for their links. How do you see this? Any fixes? What level of harm do you think it brings to the site? I have removed all similar links to LinkedIn from my site to avoid this (https://www.hillwebcreations.com). However, this isn't so easily done for LinkedIn For Business, as her work in all about helping businesses and individuals optimize their use of LinkedIn.
Intermediate & Advanced SEO | | jessential0 -
WordPress – parent category "blog" instead of regular "post page"?
In WordPress you normally show you blog posts on: Your home page. Your "posts page" (configurable in the Reading Settings) I want to do neither and have a third option instead: Assign a parent category called "blog" for all posts, and show the latest posts on that category's archive page. For the readers, the experience will be 100% the same as a regular "posts page". The UI, permalinks, and breadcrumbs will be 100% the same. But, I have heard that the "posts page" is important for Google for indexing and understanding your blog. So is is smarter SEO-wise to use a "posts page" instead of a parent category named "blog"? What negative effects might there be, if I have no "posts page" and just use the parent category "blog" instead?
Intermediate & Advanced SEO | | NikolasB0 -
What is best practice for "Sorting" URLs to prevent indexing and for best link juice ?
We are now introducing 5 links in all our category pages for different sorting options of category listings.
Intermediate & Advanced SEO | | lcourse
The site has about 100.000 pages and with this change the number of URLs may go up to over 350.000 pages.
Until now google is indexing well our site but I would like to prevent the "sorting URLS" leading to less complete crawling of our core pages, especially since we are planning further huge expansion of pages soon. Apart from blocking the paramter in the search console (which did not really work well for me in the past to prevent indexing) what do you suggest to minimize indexing of these URLs also taking into consideration link juice optimization? On a technical level the sorting is implemented in a way that the whole page is reloaded, for which may be better options as well.0 -
Ranking of Moz "A" grade page.
Hello, I built a site in Weebly recently and it was indexed by Google and the one page in fact ranked #1 for one keyword. I used absolutely no SEO optimization techniques for this. It then rapidly dropped out of sight (not surprising ). I have now optimized the site in general and specifically the page www.insolvencylifeline.co.za/voluntary-sequestration-process as recommended by Moz. All the optimization was on-page, except that I also used the SEOProfiler tool to submit the site to their list of search engines recommended and I manually linked to a number of reputable directories. I did this on 09/03. If I search for www.insolvencylifeline.co.za/voluntary-sequestration-process I can see the page has been cached on 10/3. However,if I search for any of my 3 search terms for example "voluntary sequestration" and then do an advanced search for "insolvencylifeline", I only get search results for pages cached before 9/3. My page www.insolvencylifeline.co.za/voluntary-sequestration-process which I know is fully optimized (“A” Moz grade) for the search term, does not rank at all. Also if I search for www.insolvencylifeline.co.za, I can see that the page also was cached on 10/3. However, it does not show www.insolvencylifeline.co.za/voluntary-sequestration-process at all and the other pages shown were all cached before 9/3. Does this mean that the page www.insolvencylifeline.co.za/voluntary-sequestration-process does not rank at all even though it is indexed? If so, any thoughts on why? Regards, Gerhard.
Intermediate & Advanced SEO | | Gerrhard0 -
Experience with 307 HTTP status code
Hello, is there anybody how has got some experience with 307 HTTP status code? We would like to use 307 HTTP status code (temp redirect) for disabling temporary some of our shop-categories where all products are out of stock. Generally a few days or hours later products are back in stock and category page is also back. Is it a good idea to use 307 beccause link sould be disabled temorary or should we use 301 instead? Best regards Steffen
Intermediate & Advanced SEO | | steffen_0 -
Google ranking for the term "locum tenens"
Hello- My company is having a very difficult time performing well for the term "locum tenens". This term literally defines our industry and target market (temporary physician staffing, essentially) and is by far the most searched term in our industry (30k / month, give or take). For us, “locum tenens” is like “ice cream” is to Ben & Jerry’s. Of course, there are other keywords we're concerned with, but this is by far the most important single term. We've moved up to page 3 a few times since launching our redesigned site in April, but seem to continuously settle on page 5 (we've been on page 5 for many weeks now). While I didn’t expect us to be on page 1 at this point, I having a hard time understanding why we’re not on at least 2 or 3, in light of the sites ahead of us. We have a ton of decent, optimized content and we’ve tried not to be too spammy (every page does have locum tenens on it many times, but it describes our service – it’s hard not to use it many times). We are working on developing backlinks and are avoiding any spammy backlink schemes (I get calls every day from companies saying they can give me 400 backlinks a month, which I have a hard time believing is a good long term strategy). It just sort of seems like our site is cursed for some reason that I can't understand. We are working with a competent SEO firm, and still have not made much progress for this term. So, I’m hoping maybe the community here might have some helpful advice. Our site is www.bartonassociates.com. Any insight you guys may have would be GREATLY appreciated. Thanks in advance and have a great day. Jason
Intermediate & Advanced SEO | | ba_seomoz0