The Googlebots are such amusing and strange girls.

They need to talk to each other more.

[rfgdxm1]

Just spotted a weird coincidence in my logs. Googlebot grabbed the exact same page from my site twice within 4 minutes. Checking closer, the first was the 216.* deep crawler, and then the 64.* freshbot had to make absolutely sure that I hadn't changed that page within the last 4 minutes. ;) My guess is the reason is that the deep crawler and freshbot both do their own things independently without coordinating with each other. From this I'll have to conclude that Google has got disk space up the wazoo that they can do this. And don't bother wasting my bandwidth to grab and store the same page twice in 4 minutes either. ;)

[nutsandbolts]

It probably loves your pages so much it wants to go back and re-read them ;)

[rfgdxm1]

The real irony is about an hour after the 2 Googlebots grabbed the page in question, after reading an e-mail from someone I changed some of the text on that page and uploaded to the server. So now Google no longer has the current version. ;) Won't last for long. That page is in the root directory, and usually gets grabbed by the freshbot on average every 2 days. I dunno what it is about Googlebot, but there is no other search engine that is anywhere near as agressive with grabbing the same page over and over. Not that it is a major problem. It isn't like I have a 10 MB monthly transfer limit with my host. And, the server returns 304s to Googlebot if the page hasn't been changed since it last got it, so that keeps bandwidth very low. However, this kind of nosiness by a search engine just seems weird.