What is the best way to track the progress of search engine spiders on one's site? I've tried analyzers like WebAlizer but they just don't seem to give enough detail.
Does anyone have any tips for tracking the spiders? I'm considering setting up Pphlogger to try to track them.
[edited by: Receptional at 6:03 pm (utc) on June 24, 2005] [edit reason] No URLS please [/edit]
