Does Tracking Software display the amount of times spiders hit your site and how deep they crawled? If so, which ones?
sugarkane
8:04 am on Mar 31, 2003 (gmt 0)
Almost all tracking software will have some sort of 'User Agent' or browser report that will list pageview figures for each spider. Mostly, you just get a total figure - eg Googlebot grabbed 10,000 pages over the period.
If you want to see which particular pages a spider has visited, my own preference would be to get right down into the raw log files, but I'm sure there must be packages that provide a nice detailed report.