Forum Moderators: open

Message Too Old, No Replies

Zibie Spider 0.1 Java/1.4.2

no robots.

         

bull

9:57 am on Aug 1, 2003 (gmt 0)

10+ Year Member



66.240.130.105 - - [01/Aug/2003:10:55:45 +0200] "GET /odplistedone HTTP/1.1" 301 252 www.-net "-" "Zibie Spider 0.1 Java/1.4.2" "-"
66.240.130.105 - - [01/Aug/2003:10:55:45 +0200] "GET /odplistedone/ HTTP/1.1" 200 2302 www.-.net "-" "Zibie Spider 0.1 Java/1.4.2" "-"

nslookup returns some obviously porn page (no, I did not visit it)

RewriteCond %{HTTP_USER_AGENT} Java [NC,OR] 
will fix it.

jdMorgan

5:38 pm on Aug 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Careful... Google uses Java and Python for some of their "tools" and beta fetures:

# Block Java and Python URLlib except from Google
RewriteCond %{HTTP_USER_AGENT} ^(Python\.urllib¦Java/?[1-9]\.) [NC]
RewriteCond %{REMOTE_ADDR}!^216\.239\.(3[2-9]¦[45][0-9]¦6[0-3])\.
RewriteRule .* - [F]
Jim