Google Cache Time of Day

Do you pay attention to this?

[kamikaze Optimizer]

The index page of my site gets re-indexed (fresh cache) just about everyday.

For the past few years I have noticed that the Google Bot came to my site at about 0400 GMT, so this was about 11:00PM for me on the east coast.

This was nice because it allowed me to upload news articles to the site in the evening and they were in the index the following night.

Lately I have been noticing that the Google bot is coming much earlier in the day, about noon time my time.

I was wondering if anyone had any insight on this?

Are there factors involved that make the bot come at different times of the day? Could it be higher or lower PR?

[g1smd]

I see the same time every day for months, and then it changes again for a few months more.

[JayDogs]

I have noticed since March 27th that Googlebot stopped visiting alot of sites.

Are you sure the "Indexing/Cache Update" GoogleBot is even coming to your logs lately?

In my experience:

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -> Checks For Changes

Googlebot/2.1 (+http://www.google.com/bot.html) -> Actually indexes new pages and updates Cache.

Trust me, when you look at your logs you should see what I mean. I use SpyderTrax to see the Robots as well as their IP Adresses.

Let me know if you need help understanding the above.

Jay

[kamikaze Optimizer]

Not only do I see it in the logs, I see it live in the Googe cache.

This will change in about 6 hours with yesterdays date:
This is G o o g l e's cache of [my-site.com...] as retrieved on Apr 4, 2006 16:52:46 GMT.

[AlexK]

JayDogs:

In my experience:
.
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) -> Checks For Changes
Googlebot/2.1 (+http://www.google.com/bot.html) -> Actually indexes new pages and updates Cache.

Welcome to WebmasterWorld, JayDogs!

That is certainly what it used to do (it also took pages out of the main G-index, making them URL-only and/or Supplemental), although I suspect that it has had added functions (?) since inception a few years ago.

As just one item of certainty, I've recently spotted a page indexed by the M_bot, rather than the "standard" G_bot. (It is possible to spot, on my pages, whether the UA supports compression or not; the M_bot does support compression, the G_bot does not, hence being able to discriminate between them on the G-cached pages).

Monsieur Cutts (Q#2 [mattcutts.com]) mentioned it recently, although some of the info that he gives is misleading/wrong (it is hardly "new", although it is "newer").

My apologies, BTW. I am obsessed by this bot [webmasterworld.com], and you inadvertently rang my bell.