Forum Moderators: open
The same crawler with a different user agent but the same IP Address visited my sites this past week:
Mozilla/2.0 (compatible; DC9FE0029G; FreeBSD 5.4-RELEASE; i386; en_US)
65.110.21.171
Both of them read robots.txt twice and then left.
They all trace back to a project run by someone named Marty Anstey. According to his website this Helix project used to be known as Reaper, another ua I've had banned for a long time.