Forum Moderators: open

Message Too Old, No Replies

Eurobot

         

keyplyr

9:25 am on Aug 18, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Old UA:
eurobot/Nutch-1.0-dev (1.0)

New UA:
Eurobot/1.1 (http://eurobot.ayell.eu)

Coming from Hetzner Online AG Datacenter Nuernberg 78.46.64.0 - 78.46.95.255

Robots.txt: yes

GaryK

4:25 pm on Aug 20, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I guess they're all starting to realize having Nutch in the UA is guaranteed to get them banned. Too bad this one wasn't smart enough to change the name of the bot as well.

Translated from their bot page:

Eurobot is the web-indexing robot for Ayell of Euronet. The Eurobot searches the Internet for documents found by Euronet Ayell. It obeys the robots.txt standard. Eurobot's algorithm attempts to avoid requesting pages too quickly. Should you want Eurobot to not visit your site again just add the following entry in the robots.txt file:

User-agent: Eurobot
Disallow: /