How to track down google bot?

[Shaman]

People, i dont know how to use the stats/counters and i want to know when googlebot visits my site. Could anyone please post a detailed step-by step about installing some stats system to track google bot?

I have webalizer stats but cant find much info about googlebot there.

thanks.

[Dreamquick]

I don't know much about Webalizer but the easiest way to see when and where googlebot has been is to look in the text logfiles for "GoogleBot" which is what the google crawler calls itself.

There was a similar discussion a short while ago;

[webmasterworld.com...]

The only decent way to tracking GoogleBot is via the logfiles due to the fact that most tracking programs are designed to track people rather than crawlers and so they either use a method which can't detect them (3rd party scripts) or they group them with the normal users.

- Tony

[taxpod]

If you have access to your logfiles, I suggest giving Analog or AWStats a try: (www.analog.cx) (awstats.sourceforge.net)

Installation is pretty intuitive and you should be able to sort it out by yourself.

[Yidaki]

this might be a good place to read:

WebmasterWorld forum Tracking and Logging [webmasterworld.com]

[galaga]

Go into your webalizer stats for this month. Scroll down to the section called "Top 10 of X Total Sites By KBytes" and look for an entry like "crawler10.googlebot.com". That's the footprint of the little blighter!