More Bad Bots?

[BlueSky]

Had three unknown bots hit today one right after the other sucking up part of my site. They started and stayed in a subdirectory which oddly has no outside links but has been indexed by the SE's. Never touched the homepage or other upper level pages.

62.177.137.205 -- 459 pages in 4 minutes
192.116.85.25 -- 438 pages in 6 minutes
194.242.43.6 -- 481 pages in 7 minutes

Only the last one showed a user agent and looked at robots.txt.

194.242.43.6 - - [04/Sep/2003:14:05:59 -0500] "GET /robots.txt HTTP/1.0" 200 306 "-" "Art-Online.com 0.9(Beta)"

I looked up AO's domain in the contact email address in RIPE, the site says they are a French collator and distributor of judicial, legal, and economic databases. The other two lead off into just the ISPs.

inetnum: 62.177.128.0 - 62.177.151.255
netname: BBNET
descr: BBNET NV.
descr: ACCESS company
country: NL

inetnum: 192.116.85.0 - 192.116.85.255
netname: GILAT-SATCOM-BLOCK-16
descr: SKY2Net ltd
country: GB

inetnum: 194.242.43.0 - 194.242.43.255
netname: FR-GROUPE-SERVEUR
descr: GROUPE-SERVEUR
country: FR

[marcs]

62.177.137.205 -- 459 pages in 4 minutes

Noticed this one in logs too. Only 22 requests over 3-4 days.

[jomaxx]

The Art-Online robot is really from Art-Online.com and is legit, though it's not the smartest robot out there (I get a lot of 404's due to it misinterpreting relative links). So far it has always obeyed my robots.txt.

I've also been recently hit by the Sky2net robot from that IP as from quite a few other IP addresses/ISP's. I started a hread about it here:
[webmasterworld.com...]