Crawling issues in google
-
Hi everyone,
I think i have crawling issues with one of my sites.
It has vanished form Google rankings it used to rank for all services i offered now it doesn't anymore ever since September 29th.
I have resubmitted to Google 2 times and they came back with the same answer:
"
We reviewed your site and found no manual actions by the web spam team that might affect your site's ranking in Google. There's no need to file a reconsideration request for your site, because any ranking issues you may be experiencing are not related to a manual action taken by the webspam team.
Of course, there may be other issues with your site that affect your site's ranking. Google's computers determine the order of our search results using a series of formulas known as algorithms. We make hundreds of changes to our search algorithms each year, and we employ more than 200 different signals when ranking pages. As our algorithms change and as the web (including your site) changes, some fluctuation in ranking can happen as we make updates to present the best results to our users.
If you've experienced a change in ranking which you suspect may be more than a simple algorithm change, there are other things you may want to investigate as possible causes, such as a major change to your site's content, content management system, or server architecture. For example, a site may not rank well if your server stops serving pages to Googlebot, or if you've changed the URLs for a large portion of your site's pages. This article has a list of other potential reasons your site may not be doing well in search.
"
How i detected that it may be a crawling issue is that 2 weeks ago i changed metas - metas are very slow in getting updated and for some of my pages never did update
Do you know any good tools to check for bad code that could slow down the crawling. I really don't know where to look other than issues for crawling. I validated the website with w3c validator and ran xenu and cleaned these up but my website is still down.
Any ideas are appreciated.
-
i ran another one
Date: Saturday, November 10, 2012 4:52:04 PM PST
Googlebot Type: Web
Download Time (in milliseconds): 94
<code>HTTP/1.1 200 OK Date: Sun, 11 Nov 2012 00:52:04 GMT</code>
-
Hi,
I already did do that a while ago...i still think i have a javascript issue.
I already did do the GWMT, w3c validation - but none of that helped
Date: Monday, October 22, 2012 5:00:59 PM PDT
Googlebot Type: Web
Download Time (in milliseconds): 115
<code>HTTP/1.1 200 OK Date: Tue, 23 Oct 2012 00:00:59 GMT</code>
-
Hey Cary,
The first thing I would do is to go into Google Webmaster tools -> Health -> Fetch as Googlebot.
Now under Fetch status you should have "Success" if Google managed to fetch the information. Click on it, and check the first few rows, you should see something like:
<code>HTTP/1.1 200 OK Date: Fri, 10 Nov 2012 00:26:17 GMT</code>
If you do see an other response then leave it as a response to this question so we can have investigate further with you.
Gr.,
Istvan
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirect and ranking issue
Hi there - was wondering whether someone might be able to help. For a period of a day and a half, all the traffic to our website's blog articles were mistakenly being redirected to our homepage. A number of these articles ranked in the top 5 in Google worldwide for their targeted keywords, so this was a considerable amount of organic traffic that was instantly being redirected. It was a strange site glitch and our web team rectified the error, but now all these articles have disappeared from Google rankings (not visible anywhere in the first five pages). I'm presuming this must be linked to this redirect issue - we've been advised to wait and see whether Google restores these rankings, but I'm still concerned as to whether this represents a more serious problem? We have re-indexed the pages we are most concerned about, but am not sure whether there is anything else obvious we should think to do. If anyone has any thoughts, I'd be happy to hear them!
Technical SEO | | rwat0 -
Crawl depth and www
I've run a crawl on a popular amphibian based tool, just wanted to confirm... should http://www.homepage be at crawl depth 0 or 1? The audit shows http://homepage at level 0 and http://www.homepage at level 1 through a redirect. Thanks
Technical SEO | | Focus-Online-Management0 -
Structure Data Issue
HiI found few errors in Google webmaster tools under structure data. The error shows "Missing: name' but when I click 'Test Live Data' it shows 'All good'. Currently we are using Drupal CMS and please find attached error screenshot.Please advice on this issue.Thanks,SatlaqlGEyp7
Technical SEO | | TrulyTravel0 -
Google stopped crawling my site. Everybody is stumped.
This has stumped the Wordpress staff and people in the Google Webmasters forum. We are in Google News (have been for years), and so new posts are crawled immediately. On Feb 17-18 Crawl Stats dropped 85%, and new posts were no longer indexed (not appearing on News or search). Data highlighter attempts return "This URL could not be found in Google's index." No manual actions by Google. No changes to the website; no custom CSS. No Site Errors or new URL errors. No sitemap problems (resubmitting didn't help). We're on wordpress.com, so no odd code. We can see the robot.txt file. Other search engines can see us, as can social media websites. Older posts still index, but loss of News is a big hit. Also, I think overall Google referrals are dropping. We can Fetch the URL for a new post, and many hours later it appears on Google and News, and we can then use Data Highlighter. It's now 6 days and no recovery. Everybody is stumped. Any ideas? I just joined, so this might be the wrong venue. If so, apologies.
Technical SEO | | Editor-FabiusMaximus_Website0 -
Google showing wrong title
Hi, Can anyone assist a newbie please? My keyword 'Security Systems' is giving me position 1 on page 1, but the title it is using is not the page title. I am assuming for some reason it has made it up, please see below. The actual title tag says - <colgroup><col width="420"></colgroup>
Technical SEO | | DaddySmurf
| Security systems | wireless | battery powered | Police Approved | CSS | Google is showing - Compound Security Systems: Wireless Security Systems | Battery ... <cite>www.compoundsecurity.co.uk/</cite>Manufacturers & suppliers of The Mosquito Device & Professional industry compliant and Police recommended battery powered wireless security systems.Contact us - Mosquito Anti-Loitering Devices - Security Equipment - Installers<iframe class="SEOmoz-iframe" src="chrome-extension://eakacpaijcpapndcfffdgphdiccmpknp/html/serpbar.html#{" settings":{"dmr":false,"dmt":false,"mr":true,"mt":true,"serp-overlay":true,"toolbar-enabled":true,"subdomain-metrics":false,"serp-panel-open":true,"toolbar-position":"bottom"},"lsdata":{"feid":1245,"fipl":315,"fmrp":4.717881718426137,"fmrr":3.169235978744307e-9,"ftrp":5.245402699173709,"ftrr":8.283399271183101e-8,"fuid":15756,"pda":47.20670031521297,"peid":1266,"pid":315,"pmrp":4.634793943915049,"pmrr":1.137485303730264e-7,"ptrp":4.949510322693934,"ptrr":1.6938187788875737e-7,"puid":15777,"ueid":510,"uemrp":4.693787066897207,"uemrr":2.520503065617982e-10,"uid":1060,"uipl":191,"ujid":1038,"umrp":4.96103855611017,"umrr":5.477715129904515e-10,"upa":55.929113684261466,"utrp":6.066855084050327,"utrr":2.1655670926371268e-10},"user":{"level":"pro","options":{},"proenabled":true,"aclurl":"http:="" moz.com="" users="" level?src="mozbar","loginURL":"https://mza.bundledseo.com/login","logoutURL":"https://mza.bundledseo.com/logout","apiRequest":"url-metrics","cols":"133146078688","expired":false,"accessId":"pro-RGFkZHlTbXVyZg%3D%3D","expires":1374249469,"signature":"M%2Bh%2FXh4OS%2BAMtT2j6kuntWSTvNI%3D","displayName":"DaddySmurf"},"serp":1,"host":"www.compoundsecurity.co.uk"}"" scrolling="no"></iframe> If anyone can tell me how to correct this, i would very much appreciate it. Regards, Si0 -
Can anyone help me understand why google is "Not Selecting" a large number of my webpages to include when crawling my site.
When looking through my google webmaster tools, I clicked into the advanced settings under index status and was surprised to see that google has marked around 90% of my pages on my site as "Not Selected" when crawling. Please take a look and offer any suggestions. www.luxuryhomehunt.com
Technical SEO | | Jdubin0 -
Google.com
Hi We are managing a .com site for a client working on getting the site ranking. The site is hosted in the US. The content is rich, deep and unique. The site is in a competitive market but had begun ranking top 50 for a selection of keywords and we could see many more in the top 100. The site is now going backwards and only has a few keywords ranking top 50 and all the others have disappeared from the rankings all together. Any thought as to what could cause this. The site is managed from the Uk but as mentioned is hosted in the US. No penguin issues as all content unique, rich, relevant and fresh. SEO is also managed from the UK. Thoughts
Technical SEO | | SEOwins0 -
Why Google did not index our domain?
Hi, We launched tmart 60 days ago and submitted to google, bing, yahoo 20 days later. But google had never indexed our website still when yahoo indexed it in one week. What we have checked or tried: 1. We got 20~50 inlinks in one month and now 81 inlinks via yahoo site explorer. 2. This domain has registered for 13 years and we purchased it from sedo last year. We
Technical SEO | | zt673
did not find any problems from domain archive pages. 3. Page similar: the homepage is 50% similar to one of our competitors when we just launched.
So we adjusted the page structure and modified the content one month later and decreased the similarity to 30% (by tools from webconfs.com) 4. Google Robots: googlebot crawled our website every day after we submitted for indexing.
We opened GWT account for it and added the xml sitemap last week. GWT said nothing
was wrong except the time of page loading. Our questions: Why google did not indexed our website? What should we do? Thanks, wu0