BUbiNG

law-abiding Italian robot

[lucy24]

... well, law-abiding so far at least.

UA:
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)

IP:
159.149.133.253
All of 159.149 is the university of Milan, formally "Università degli Studi di Milano". (As opposed to what? Università della Birra e Musica? Maybe not; it's Milan.)

"law" does not mean law school, it means "Laboratory for Web Algorithmics". (What that means is anyone's guess.) Information in English and Italian on the same page.

Entered via the page in my WebmasterWorld profile, which is always an interesting start, and is currently working outward from there. Links from this page include a roboted-out directory, which they have not asked for yet. Two visits about 6 hours apart, with separate robots.txt request each time.

[Pfui]

Misc. bits:

1.) Over the weekend, I saw hits from:

s1.law.di.unimi.it (159.149.133.251)
s3.law.di.unimi.it (159.149.133.253)

Both asked for and respected robots.txt. But --

2.) Today, all of a sudden it's my New Best Friend:

04:49:22 /robots.txt
06:03:45 /robots.txt
07:07:58 /robots.txt
09:06:47 /robots.txt
09:18:53 /robots.txt
11:20:14 /robots.txt

(All but the 09:18 were .253)

robots.txt or no, that kind of wasteful, undesired activity will quickly find 'em dropped via iptables.

3.) Others' experiences are unhappy. See Project Honey Pot (PHP) comments here: [projecthoneypot.org...]

Also, PHP shows BUbiNG and more hailing from .251, .233, .234, etc.:

UbiCrawler/v0.5beta (http://law.di.unimi.it/)
Jakarta Commons-HttpClient/3.0-rc4

(Overeager CS department? Anyway...)

4.) Last but not least, apparently most IPs from 159.149.133.230 - .253 are BUbiNG'ing.

[keyplyr]

My "bing" IP filter blocked it

[lucy24]

all of a sudden it's my New Best Friend

Insert witticism about "bing" and robots.txt here.

[dstiles]

I blocked the whole /24 back in October 2013 for that robot and (probably) other open-port scanners or bots.

[keyplyr]

I blocked the whole /24 back in October 2013 for that robot and (probably) other open-port scanners or bots.

I block all (known) University CS ranges. Let those future Sergey's test their projects on someone else's files.