DiamondBot - asked for obligatory robots.txt

and went right after deep level pages

[idoc]

On the first visit logged to the site. Must have had some directory structure to follow because it didn't take index or follow links. the arin lookup is interesting.

64.152.73.15 - - [20/Oct/2004:07:32:16 -0400] "GET /*/*-*.html HTTP/1.1" 200 12757 "-" "DiamondBot"

I added the following entry to the apache config to make sure they get the warm and fuzzy welcome of a 403 next time they show up. Deny from 64.152.73.0/24

[jimbeetle]

Also see [webmasterworld.com...]