Googlebot Visit Time & Date Stamps
-
I know that in Google Webmaster Central, we can see general Googlebot crawl stats based on dates. Our site is crawled daily.
We're trying to find out the time of day Googlebot visits our site - know of any ways to do this or tools out there?
-
You can use ApacheLogViewer(freeware) to view your web-server logs and filter where UserAgent="Googlebot". This will give you the raw statistics including time of day when Google crawled your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
International SEO Domains & Avg Session Duration
I have a couple questions 1) Is there any SEO value to forwarding multiple domains to the same domain? For instance, we own dozens of of the same domain name but with International extensions. I haven't seen much on this topic and assume that Google ignores such domain names (they don't really have much of any links to them). 2) Is there any research on whether time on site is declining across the web? I've noticed a trend over the years but I want to make sure this is a standard user behavior as people jump around quicker and search hop for information.
Reporting & Analytics | | ScottOlson0 -
Google Analytics Not Tracking 100% of Visits?
Hi all, We're having an issue with Analytics where we are getting different figures from what Silver Pop are saying. For example email campaign A sent via Silver Pop, with Google Analytics tracking code show's 50 unique clicks in Silver Pop. Looking at Google Analytics there are only 10 visits from that campaign. So I thought it could be something with the tracking, but there wasn't a significant rise in web visits = either Google Analytics is not recording visits properly or Silver Pop figures are wrong. I'm more inclined to think that it's something to do with Google Analytics. Has anyone come across something similar? Where one system is showing you X amount of visits but the figures on Google Analytics don't add up? A few quick things already covered: Double checked the links have been tracked properly, but this doesn't explain the low increase in web visits generally We've double checked that Google Analytics tracking code is properly installed (and it is / was at the time of send). Any help would be much appreciated! Thanks guys.
Reporting & Analytics | | RKHStaff1 -
Differences in organic search visits and non-paid keyword visits
Hi folks, I was just wondering at the disparity between the "Organic Search Visits" total in the Traffic Data tab and the total visits from "Non Paid Keywords Sending Search Visits". Once you add up all the traffic generated from the individual keywords (including the not provided numbers) shouldn't the total match the number of organic search results? Or is there something I'm missing? At the moment the total visits from non-paid keywords is about 2,000 short of the total organic search visits.
Reporting & Analytics | | BrettCollins0 -
Has anyone experienced Google Analytics track the page visit to a "thank you" page, but not the goal conversion?
Has anyone experienced where Google Analytics would track the page visit to a "thank you" page, but not the goal conversion that should result? The goal had worked for a long time as it is as just a goal url with head match. No funnel. Not case sensitive. For about four days now, no conversions have been recorded, but Google Analytics shows hundreds of people visited the page that should trigger the goal. Additionally, we have received the hundreds of leads. A Screaming Frog search shows the code is embedded throughout the site. For the interested, the GA code looks like (and the 8 Xs are the correct number on the site): Am I missing something?
Reporting & Analytics | | 352inc0 -
Images Getting Indexed Making for Low Engagements Times in GA
I have quite a few images that are being indexed for popular search terms and are getting clicks. This site has a 0-10 second engagement of 69%. I would like to eliminate these images from the equation because I tend to think they are hurting my "quality score" in organic Google rankings. How do you keep these images from ranking? I suppose I could rename them. Should I disallow the images folder? I hate to do that, because some of my images turn up in local searches, which is good. I would rather keep those. But what is best practice? A little background info, this is a local service site. So the images that are ranking are coming up for a broad national type search. This has 0 value for the site. Any advice or suggestions would be appreciated, Thanks! Kathy
Reporting & Analytics | | MSWD0 -
Has anyone noticed a dramatic drop in direct visits year over year in GA across multiple sites?
I monitor about 10 websites in GA. Many of these sites are in a stable phase of their lifecycle. I've noticed this year that direct visits on all my sites and even friends sites have dropped by 20-60%. Has anyone seen any explanation for this or noticed this when compared to previous year? In every instance I have no penalties, notices, anything and the drop is made up completely of "direct visits".
Reporting & Analytics | | bradwayland0 -
Googlebot encountered extremely large numbers of links on your site??? How Do I resolve this?
I am working on a site with over 30 million pages. Every time I get about One Million indexed I get a Message in the Google Webmasters Tools saying "Googlebot encountered extremely large numbers of links on your site" The indexing then starts dropping like a Rock. I need to get the site indexed. Please Help!
Reporting & Analytics | | GlobalFlex0