Checks robots.txt once...

...and once only.

[pendanticist]

80.252.***.** - - [26/Feb/2004:07:55:49 -0800] "GET /robots.txt HTTP/1.1" 200 1565 "-" "CCGCrawl/1.1-dev (CCGCrawl 1.1; http://www.examplifiedmyworkbase.com; robot'at'examplifiedmyworkbase.com)"

I'm a bit unfamiliar with some of the terminologies used to describe what the intention of this bot is.

Me thinks the Internet has gone bot happy.

[Staffa]

Just went to the URL to read their description but the site seems to be down.

Never mind, new bots/SEs seem to be popping up like snowdrops - a bit early in the season though ;o), one I had today :

213.232.xx.****----Vakes/0.01 (Vakes; http_:_//www.vakes.com/; search/at/vakes.com)

not worth bothering with

[coyote]

I tried searching on vakes and got a 404 each time I clicked the search button.

They're sure to be the next big thing... lol.