keyplyr - 10:21 am on May 25, 2012 (gmt 0)
@ SteveWh - 80 legs is a distributed bot, running on many machines. It can be config'd differently by different people.
As wilderness said, only some bots will follow robots.txt directives. There are many discussions here at WW attesting that 80 legs (008) does not obey robots.txt.
For a while I also thought it obeyed robots.txt until the day it ignored it and ran my entire site.