Removing hundreds of old product pages - Best process
-
Hi guys,
I've got a site about discounts/specials etc. A few months ago we decided it might be useful to have shop specials in PDF documents "pulled" and put on the site individually so that people could find the specials easily. This resulted in over 2000 new pages being added to the site over a few weeks (there are lots of specials).
However, 2 things have happened:1 - we have decided to go in another direction with the site and are no longer doing this
2 - the specials that were uploaded have now ended but the pages are still liveGoogle has indexed these pages already. What would be the best way to "deal" with these pages? Do I just delete them, do I 301 them to the home page? PS the site is build on wordpress.
Any ideas as I am at a complete loss.
Thanks,
Marc -
I am not aware of any benefit to removing the pages slowly over time as opposed to all at once.
-
Hi Ryan,
Thanks, I'll go through now and start deleting them.
Will not deleting almost 2000 pages from the site, make Google a little nervous about the "structure" or "trustworthiness" of my site?
Should I do it a few each week, or just all at once? -
In that case the general advise would be to delete the pages and allow them to 404.
The wordpress information is offered in case you happen to have a WP site. If your site is not built in WP, then a similar process would ideally be used.
-
Hi Ryan,
Thanks.
Yes there would be no other pages that would help the user.
So do I just go through wordpress and mass delete all of those posts? -
When deleting a web page ask yourself the following question:
If I was a user who was looking for this web page and it was not available, is there another page on my site which is very closely related which is likely to satisfy the user's query?
For example, if you have a page on May 2012 Deals of the Month, then I would forward that page to the current "Deals of the Month" page.
If you do not have a closely related page, then I would suggest allowing the URL to go to your 404 page. You should have a solid 404 process in place. Specifically:
-
your 404 page should be helpful. It should contain your site's navigation, a search option, a basic "I am sorry the page you are looking for cannot be found" message, etc.
-
you should track 404 errors so you can understand the popularity of any URLs which generate a 404. If you see a single URL generating multiple 404 errors on a daily basis, then you can take that as a strong indicator of a need to create new content related to that subject.
I recommend Yoast Google Analytics for WP plugin: http://yoast.com/wordpress/google-analytics/. It helps track and resolve 404 errors on WP sites.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is it ok to repeat a (focus) keyword used on a previous page, on a new page?
I am cataloguing the pages on our website in terms of which focus keyword has been used with the page. I've noticed that some pages repeated the same keyword / term. I've heard that it's not really good practice, as it's like telling google conflicting information, as the pages with the same keywords will be competing against each other. Is this correct information? If so, is the alternative to use various long-winded keywords instead? If not, meaning it's ok to repeat the keyword on different pages, is there a maximum recommended number of times that we want to repeat the word? Still new-ish to SEO, so any help is much appreciated! V.
Intermediate & Advanced SEO | | Vitzz1 -
Magento: Should we disable old URL's or delete the page altogether
Our developer tells us that we have a lot of 404 pages that are being included in our sitemap and the reason for this is because we have put 301 redirects on the old pages to new pages. We're using Magento and our current process is to simply disable, which then makes it a a 404. We then redirect this page using a 301 redirect to a new relevant page. The reason for redirecting these pages is because the old pages are still being indexed in Google. I understand 404 pages will eventually drop out of Google's index, but was wondering if we were somehow preventing them dropping out of the index by redirecting the URL's, causing the 404 pages to be added to the sitemap. My questions are: 1. Could we simply delete the entire unwanted page, so that it returns a 404 and drops out of Google's index altogether? 2. Because the 404 pages are in the sitemap, does this mean they will continue to be indexed by Google?
Intermediate & Advanced SEO | | andyheath0 -
Old pages STILL indexed...
Our new website has been live for around 3 months and the URL structure has completely changed. We weren't able to dynamically create 301 redirects for over 5,000 of our products because of how different the URL's were so we've been redirecting them as and when. 3 months on and we're still getting hundreds of 404 errors daily in our Webmaster Tools account. I've checked the server logs and it looks like Bing Bot still seems to want to crawl our old /product/ URL's. Also, if I perform a "site:example.co.uk/product" on Google or Bing - lots of results are still returned, indicating the both still haven't dropped them from their index. Should I ignore the 404 errors and continue to wait for them to drop off or should I just block /product/ in my robots.txt? After 3 months I'd have thought they'd have naturally dropped off by now! I'm half-debating this: User-agent: *
Intermediate & Advanced SEO | | LiamMcArthur
Disallow: /some-directory-for-all/* User-agent: Bingbot
User-agent: MSNBot
Disallow: /product/ Sitemap: http://www.example.co.uk/sitemap.xml0 -
Our client's web property recently switched over to secure pages (https) however there non secure pages (http) are still being indexed in Google. Should we request in GWMT to have the non secure pages deindexed?
Our client recently switched over to https via new SSL. They have also implemented rel canonicals for most of their internal webpages (that point to the https). However many of their non secure webpages are still being indexed by Google. We have access to their GWMT for both the secure and non secure pages.
Intermediate & Advanced SEO | | RosemaryB
Should we just let Google figure out what to do with the non secure pages? We would like to setup 301 redirects from the old non secure pages to the new secure pages, but were not sure if this is going to happen. We thought about requesting in GWMT for Google to remove the non secure pages. However we felt this was pretty drastic. Any recommendations would be much appreciated.0 -
Will Using Attributes For Landing Pages In Magento Dilute Page Rank?
Hello Mozzers! We have an ecommerce site built on Magento. We would like to use attribute filters in our layered navigation for landing page purposes. Each page will have a unique URL, Meta Title and Meta Description. For example: URL: domain.com/art/abstract (category is Art, attribute is Abstract) Title: Abstract Art For Sale Meta: Blah Blah Blah Currently these attribute pages are not being indexed by google as they are set in google parameters. We would like to edit google parameters to start indexing some of the attribute filters that users search for, so they can be used as landing pages. Does anyone have experience with this? Is this a good idea? What are the consequences? Will this dilute Page Rank? Could this destroy the world? Cheers! MozAddict
Intermediate & Advanced SEO | | MozAddict0 -
To list or not to list? Products that contain basic info only, yet show off product depth...
Some of our products on our site only have 40 characters of description... each item/category is it's own unique web page with basic info like Brand, Model, What it is, Price, & Quantity in stock. For searchers knowing what they want, they can quickly find us via the basic info & see that we have it in stock. But for someone surfing our site, it's not all that attractive or informative as you are scrolling down the category list. Collecting the picture & info can be a slow and time consuming process, but something we'd love to be all caught up on one day. Would it be wiser to take these pages off, or keep them on until they are fully updated with pic & more detail? (My thought is that even though they don't contain a lot of individual detail depth, they still add a substantial quantity of basic related content to the category page that they reside in. This basic info on these items are also given a chance to burn into the web search engines over a longer period of time. As time goes by and their content is improved, they will get re-crawled/re-indexed with their new information depth. Also, even though they don't look all that pretty, it shows off our product depth... if we only listed the items that looked spectacular, then a lot of our categories would only contain a wimpy 3 out of 30 items that we actually have for sale. That feels like a huge misrepresentation of how much selection we actually have to offer. But perhaps this is wrong thinking?) Thanks, Kevin
Intermediate & Advanced SEO | | Kevin_McLeish0 -
When removing a product page from an ecommerce site?
What is the best practice for removing a product page from an Ecommerce site? If a 301 is not available and the page is already crawled by the search engine A. block it out in the robot.txt B. let it 404
Intermediate & Advanced SEO | | Bryan_Loconto0 -
What is the best canonical url to use for a product page?
I just helped a client redesign and launch a new website for their organic skin care company (www.hylunia.com). The site is built in Magento which by default creates MANY urls for each product. Which of these two do you think would be the best to use as the canonical version? http://www.hylunia.com/pure-hyaluronic-acid-solution
Intermediate & Advanced SEO | | danielmoss
or http://www.hylunia.com/products/face-care/facial-moisturizers/pure-hyaluronic-acid-solution ? I'm leaning on the latter, because it makes sense to me to have the breadcrumbs match the url string, and also it seems having more keywords in the url would help. However, it's obviously a very long url, and there might be some benefits to using the shorter version that I'm not aware of. Thanks in advance for sharing your thoughts. Best, Daniel0