spider.ilab.sztaki.hu

Seems well behaved

[WitchLars]

UA: "[e-mail] (Computer_and_Automation_Research_Institute_Crawler)"
IP: 195.111.1.94 (crawler.ilab.sztaki.hu)

It fetched robots.txt, root index and all pages linked to the index (html only - no images, css or js), and it seems to have obeyed my robots.txt.

Their server returns the default Apache test page, and google doesn't show much beyond log hits.

FYI
-Lars

[claus]

It seems to be a research project, details here: [ilab.sztaki.hu...]

/claus