Is Googlebot weird?

Or, perhaps does Google somehow not trust me?

[rfgdxm1]

According to my site logs, Googlebot grabbed the index.htm page of my main site *three* times today so far, along with one other page on the site. Not that this is any particular problem for me, but why one earth would any search engine crawler grab the same page of my site three times in one day?

[fiestagirl]

I've seen this happen month after month to our sites. Google asks for the "home" or index page 2 or 3 times right before PLOWING throught the whole thing. I take it as a signal that the crawl is about to begin for us. :)

[bobriggs]

?? Who knows?

To find out if you are waiting for it to be indexed and then change it afterwards so it can put a little red flag in its database?

I'm sure there's a reason. I've seen it pick up the same page from my sites before.

Are there any server redirects to the site? If its's pulling pages, what I've noticed is that immediately after a 301 or 302, it will fetch the Location: url.

The bots are running on a distributed system from what I understand, and they might not talk to each other. Therefore another possibility is that they might be following links, but they're different programs or processes running.

[rfgdxm1]

After having my main site dropped from Google for a month because of what I believe to have been a glitch by my website host's server, I definitely don't mind seeing Googlebot around. ;) However, just strange that it would grab the index.htm page thrice in one day. I've noticed in the past Googlebot tended to be "nosy" in that it would typically grab the index.htm page from my site every other day. However, 3 times in a day is something I've never seen before. There are no server redirects on this site. It might be that the bots don't talk to each other well that would cause this to happen.

[bobriggs]

I definitely don't mind seeing Googlebot around

Neither do I. Good sign for my PR0 of over a year because it usually waited til the last minute; my conclusion: 'we don't allow your kind in here'. If it had any extra time at the end or mid/month, then it would pick up some pages from my site.

[diddlydazz]

for a period of 2 days (about 3 days ago) googlebot crawled one site continuosly and I mean continuosly.

It just kept grabbing each page one after the other then when it had finished it just started all over again.

these were crawl10, crawl11 and crawl12 so the theory on not talking to each other seems to bear true.

I was thinking of emailing google and telling them, but then I got paranoid that perhaps it would stop coming all together ;)

Dazz