Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- How to ban (compatible ; type requests


Pfui - 11:14 pm on Jun 23, 2006 (gmt 0)


I'm getting a little confused:) But Larry, re the Java thing, lop off that /1 because you want to block ALL Java-only UAs [webmasterworld.com]. And seeing as how you're already using mod_rewrite, just add this:

RewriteCond %{HTTP_USER_AGENT} ^Java [NC,OR]

If you add it at the end of your list, be sure to remove the OR:

RewriteCond %{HTTP_USER_AGENT} ^Java [NC]


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3309.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com