gutsy

Ubuntu/7.10

[keyplyr]

UA: Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.8.1.8) Gecko/20071008 Ubuntu/7.10 (gutsy) Firefox/2.0.0.8
Protocol: HTTP/1.1
Robots.txt: Yes
Host: hetzner.de
144.76.0.0 - 144.76.255.255
144.76.0.0/16

A.K.A "Gutsy Gibbon." Ubuntu is an open source Linux operating system for personal computers, tablets and smartphones but can effectively be run from a web server.

[lucy24]

Robots.txt: Yes
Host: hetzner.de

And that's not something you see every day. [^^] *

The IP looked familiar, but it's just because the range is also used by assorted distributed crawlers, including MJ12bot, BLEXBot, SISTRIX ... at which point I got tired of fine-tuning the RegEx.


* I'm going to use this. Sure, it says it means "all characters other than literal carets", but it looks as if it means extreme surprise.

[keyplyr]

I would think the robots.txt support is native to the app itself, but true... hetzner has shown itself to be a basket of deplorables :)