List of search engine robots?

[Jesse_Smith]

Is there a list some where of all the major search engine robot user agents? For example Google being googlebot. I want to change this to log all the major search engines.

if ($ENV{'HTTP_USER_AGENT'} =~ /googlebot/) {
open (DATABASE,">>$database");
print DATABASE "$ENV{'REMOTE_ADDR'} - $ENV{'HTTP_USER_AGENT'} - $ENV{'SCRIPT_URL'} - $shortdate\n";
close(DATABASE);
}

[Kandevil]

[robotstxt.org ]

Probably more than you wanted there, they're not all search engines but they are all those recognised as robots/crawlers/spiders.

Sure you can pick out the ones you want to use.