How to get a page re-crawed quickly
-
Does anyone know a way to get Google to re-crawl a webpage that does not belong to me.
There are a bunch of pages that I have had links removed on and I want Google to re-crawl those pages to see the links have been removed. (current wait time is way way too long)
Can anyone suggest some ways to get the page re-crawled. (I am unable to get the website owners to use WMT to do anything).
Suggestions like good ping services and various other techniques would be very much appreciated.
Thanks
-
Thanks Anthony, I have heard this recently. My problem is I want to find a solution and repeat it 20,000 times LOL.
-
Posting links on Google+ has been a really good way to get new pages crawled and indexed. Even if these pages are not new, I think if you could get a few G+ profiles to submit it, it would increase the likelihood that Googlebot would crawl the page.
-
Hi Gary,
Webmaster Tools would have been the way to do this quickly and easily. What I would recommend is to share the URL on Twitter if you can with a couple of people. They crawl Twitter of course and will crawl your page probably sooner.
-
Hey Gary,
Back in the day when when I wanted Google to notice links I had built I used to ping them and it seemed to work.
Matt Cutts also touches on pinging services such as PubSubHubbub in this video where he is talking about getting Google to notice pages faster: http://www.youtube.com/watch?v=4LsB19wTt0Q#t=77 I used to use https://pingler.com/ and http://pingomatic.com/.
Also in that vid Matt talks about links on places such as Twitter. You could perhaps build links to these pages elsewhere, but weather they would get crawled any faster depends on the site I guess.
You could also submit the URL to Google. I don't know weather it would speed crawling up, worth a go though.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages blocked by robots
**yazılım sürecinde yapılan bir yanlışlıktı.** Sorunu hızlı bir şekilde nasıl çözebilirim? bana yardım et. ```[XTRjH](https://imgur.com/a/XTRjH)
Intermediate & Advanced SEO | | mihoreis0 -
What to do when your home page an index for a series of pages.
I have created an index stack. My home page is http://www.southernwhitewater.com The home page is the index itself and the 1st page http://www.southernwhitewater.com/nz-adventure-tours-whitewater-river-rafting-hunting-fishing My home page (if your look at it through moz bat for chrome bar} incorporates all the pages in the index. Is this Bad? I would prefer to index each page separately. As per my site index in the footer What is the best way to optimize all these pages individually and still have the customers arrive at the top to a picture. rel= canonical? Any help would be great!! http://www.southernwhitewater.com
Intermediate & Advanced SEO | | VelocityWebsites0 -
Should i redirect this page?
Hi I have the following 2 pages: http://www.over50choices.co.uk/Funeral-Planning.aspx http://www.over50choices.co.uk/Funeral-Planning/Funeral-Plans.aspx My dilema is that google sees the words "funeral planning" & "funeral plans" as the same thing, which might explain why the "funeral plan" page is not ranked v well. My issue is that the "funeral planning" page is at category level and introduces the wider subject of funeral planning, which isnt just funeral plans, so if i 301 my "funeral plan" page i will have no where to talk about funeral plans. My question is, Is the "funeral plan" page not ranked v well because of this or do i just need better optimisation of the funeral plan page so google is clear which is the key focus for each page? Thanks Ash
Intermediate & Advanced SEO | | AshShep10 -
De-indexing product "quick view" pages
Hi there, The e-commerce website I am working on seems to index all of the "quick view" pages (which normally occur as iframes on the category page) as their own unique pages, creating thousands of duplicate pages / overly-dynamic URLs. Each indexed "quick view" page has the following URL structure: www.mydomain.com/catalog/includes/inc_productquickview.jsp?prodId=89514&catgId=cat140142&KeepThis=true&TB_iframe=true&height=475&width=700 where the only thing that changes is the product ID and category number. Would using "disallow" in Robots.txt be the best way to de-indexing all of these URLs? If so, could someone help me identify how to best structure this disallow statement? Would it be: Disallow: /catalog/includes/inc_productquickview.jsp?prodID=* Thanks for your help.
Intermediate & Advanced SEO | | FPD_NYC0 -
Orphan My Home Page
I want to orphan a home page on a site that I own so that the start page becomes site.com/home (or whatever) as opposed to site.com/. I need to accomplish this without associating the former with the latter...meaning no 301. Since this will not be a temporary move, 302 does not seem to work either. And even if I could use it, I don't want to credit / with anything from /home. Is there any way to default the Apache handler to /home without rewriting the URL? Or is there any other solution? The bottom line is, at the end of the day, I need Google to forget about / and anything associated with it, without interrupting the user experience when they request /. Thanks in advance.
Intermediate & Advanced SEO | | NTGproducts0 -
Redirecting thin content city pages to the state page, 404s or 301s?
I have a large number of thin content city-level pages (possibly 20,000+) that I recently removed from a site. Currently, I have it set up to send a 404 header when any of these removed city-level pages are accessed. But I'm not sending the visitor (or search engine) to a site-wide 404 page. Instead, I'm using PHP to redirect the visitor to the corresponding state-level page for that removed city-level page. Something like: if (this city page should be removed) { header("HTTP/1.0 404 Not Found");
Intermediate & Advanced SEO | | rriot
header("Location:http://example.com/state-level-page")
exit();
} Is it problematic to send a 404 header and still redirect to a category-level page like this? By doing this, I'm sending any visitors to removed pages to the next most relevant page. Does it make more sense to 301 all the removed city-level pages to the state-level page? Also, these removed city-level pages collectively have very little to none inbound links from other sites. I suspect that any inbound links to these removed pages are from low quality scraper-type sites anyway. Thanks in advance!2 -
Re-platform effects on Page Rank
We are performing a major replatform for an ecommerce client who has many top listings on page 1 in Google SERPs for very competitive terms. We are implementing a 301 redirect for all existing URLs that they have now to the appropriate new URLs, but the client is concerned with how deploying a new site with 100% new URLs and site structure will impact their Page Rank. From our experience, the 301 redirects should cover it but wanted to see if there is a way to predictively forecast page rank effects as a result of re-platforming.
Intermediate & Advanced SEO | | Bucktown0 -
Quick ranking boost
Hi, What is hte quickest way to get up the rankings for a particular not hugley competitive keyword ? Thanks,
Intermediate & Advanced SEO | | Prongo0