InfociousBot (+http://corp.infocious.com/tech_crawler.php)

and another bad bot

[DoppyNL]

Just found this guy in my logs and didn't find anything on webmasterworld about them via google. Never seen him before.

InfociousBot (+http://corp.infocious.com/tech_crawler.php)

First requested the robots.txt from a site wich was on a subdomain. This site has been offline for quite some time and has been returning 404's eversince.
The robots.txt has a complete exclude using:

User-agent: *
Disallow: /

yet, they happily continued requesting pages. About 50 of them, wich ofcourse all resulted in a 404.
All happened in about 2 minutes time.

Have fun banning them :)
I know I did :)

[DoppyNL]

woops, forgot the ip.

All from one ip: 67.101.86.203

[GaryK]

Thanks for the alert. I'm going to try a robots.txt disallow first and when the bot fails that test (;)) I'll probably ban it too.