Google bot tracking

How do you know when the google spider has visited?

[premier teague]

Does anyone know how to track the google bot when it visits your site? Does it have an ip address that we could pick up on?

I have heard mention of the robots.txt file, although we don't have one at the moment, could that be a way to tell that it has visited?

[bufferzone]

Googlebot is not one IP address, but rather 18 (or more) IP addresses. How you se the visit depends on the software your web hotel (or your self) uses. The stat from my Hotel calls it Browser Tag and I find it under Browsers. The googlebot is simply identified as Googlebot and a version number

[GeorgeGG]

IP address list probably out of date:
www.webmasterworld.com/forum39/1502.htm

GeorgeGG

[edited by: rogerd at 3:31 am (utc) on June 24, 2004]
[edit reason] No URLs please... [/edit]

[GeorgeGG]

Sticky me if needed:

Url to current/realtime
'crawl0 through crawl255'
'crawler0 through crawler255'
host/ip address and ip address's allocated to Google.

Georgegg

[cgchris99]

Can you check the agent to see if googlebot is crawling?

if(eregi("googlebot",$HTTP_USER_AGENT)) {}

I have this on one of my sites and it does report googlebot is visiting every day at almost the same time.

Will a deep crawler be a different agent name?

[robotsdobetter]

No, the "deep crawler" and Googlebot are the same.

[Leosghost]

Recent lists of most bots are at [robotstxt.org...]