Tracking JUST spiders

Any good tools for this?

[stuntdubl]

I also posted this is the spiders forum, but thought I might get answers here as well.

I have great tools to parse log files and track visitors, but does anyone have a favorite to watch JUST spider behavior? What would provide the most in depth analysis for this?

[claus]

If logfiles does not cut it, you'll have to roll your own script to call from all your pages and store bot requests in a database, i think. I haven't seen any tracking packages that did not monitor users.

/claus

[d_fused]

There is an easy to install php script available that lets you log spider behavior and monitor visits. It uses MySql database to store visits and delivers what it is meant for.

As far as a standalone application is concerned, give WhosOn a try... it basically does a similar job.

my 2 cents.