Log/Spider Analyzer

Recommendations?

[jschmeez32]

I currently use web analytics to report on all user activity on my website. The only problem is that it does not report on Spider activity because spiders don't actually render a page.

Can anyone recommend software that will report on spider activity to my site?

Otherwise i am stuck reviewing them manually - NOT FUN.

[fazer600]

AW Stats

[edited by: webdiversity at 10:32 pm (utc) on May 21, 2004]
[edit reason] URL removed [/edit]

[karmov]

I'll second awstats. It's not terribly detailed but gives me a nice overview and then if I want more detail I go use my Unix friends (grep, gawk, sort, etc...) to parse the log by hand.