Mod_Rewrite? User_Agent - Allow Vs. Deny

Related to bots/spiders and user agents

[decdim]

Is it possible to "allow" only certain requests (ie IE, Netscape, etc., etc.) and block the rest vs. "blocking" ones and allowing the rest?

[jdMorgan]

decdim,

Sure, but the problem is that new user-agents appear all the time, and by default, you have them blocked, since they're not yet allowed... So this approach can keep you on your toes, especially when new search engines appear -- MSNBOT (now called msnbot) comes to mind.

But you can do it either way you like.

Jim