Googlebot or bots in general logging

[billg51]

I would like an easy way to see that Googlebot has visited my site and all pages it saw.

Currently I am using Urchin, and it shows Googlebot visited, but not all the pages it indexed.

I know I can download my logs and view to see, but my log files are very large.

Is there any stats programs that breakdown your log to show all the pages Googlebot or other bots hit (without having to put tracking code on each page)?

Thanks.

[mnorton]

You could just Grep out all the lines containing googlebot

grep "Googlebot" logfile

should show you all the pages that the googlebot visited

Mike

[WebRankInfo]

Try GoogleStats, this free application tracks the robots and gives you statistics (tables, graphs).
Sticky mail me for more information.

[anallawalla]

I use spydertrax a free Perl script.

- Ash