Forum Moderators: DixonJones
Had statcrawler go through my site today. Seems to obey robots.txt but there appears to be scant info here or elsewhere on the web.
Doing a whois on the IP address doesn't appear to offer much either.
This is an extract from my logs:
66.92.186.101 - - [03/Oct/2004:09:17:53 -0500] "GET /#*$!x.html HTTP/1.0" 200 5587 "-" "stat statcrawler@gmail.com"