Forum Moderators: open

Message Too Old, No Replies

My list is outdated

         

rainborick

2:34 am on Aug 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've written my own little Perl script to watch spiders, but my list of bot names and their owners is out of date and probably just plain wrong in at least one case. I originally culled the list over at robots.org, but its list is worse off than mine. I would appreciate any corrections:

@robots = ("googlebot\tGoogle",
"Slurp\tInktomi/MSN/Lycos/HotBot",
"Atomz\tAtomz",
"WISENutbot\tLooksmart",
"Fast-Webcrawler\tFast/Overture",
"Scooter\tAltaVista",
"ArchitextSpider\tExcite",
"InfoSeek\tInfoseek Robot",
"Sidewinder\tInfoseek Sidewinder",
"ia_archiver\tAlexa/Amazon.com",
"Lycos\tLycos",
"Ask Jeeves/Teoma\tAsk Jeeves/Teoma",
"Gulliver/1.1\tNorthernLight",
"MSNBOT\tMSN Search",
"wired-digital-newsbot/1.5\tWired Digital");

I trust everyone can parse my botName\ownerName pairs. Thanks!

volatilegx

2:21 pm on Aug 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Here's some good info: [jafsoft.com...] and here: [joseluis.pellicer.org...]