User-Agent list

[joker197cinque]

I manage w2kserver and iis box.

I have to create a database of user-agent of spider that I want always crawl my pages.

Where can I find the last, the more recent list of user-agent used by search engine?

I would like to allow:

- Google
- Yahoo
- MSN
- Altavista
- Alltheweb
- Arianna
- Virgilio

...I cannot use robots.tx because I'm developing a tool againts malicious spiders.

What do you think about it?

Any help appreciated.

Regards.

--
Fabri

[goodroi]

The best user agents list is maintained by people who cloak, I mean do IP delivery :). You should search for cloaking or ip delivery software. These providers generally also offer very good ua lists that are updated regularly.

[Easy_Coder]

g for "Spider List"... take a look at the first result.