Forum Moderators: open

Message Too Old, No Replies

What to do with libwww-perl/5.79?

Netscape or NetScrape?

         

blend27

12:27 pm on Apr 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



207.200.81.1XX came along as libwww-perl/5.79

no robots.txt first time 3 days ago, got a 403 based on UA 6 times

and today again 8 times, no robots.txt

Am I missing something?

bobothecat

9:10 pm on Apr 21, 2007 (gmt 0)



Place the following in your .htaccess:

RewriteCond %{HTTP_USER_AGENT} libwww [NC,OR]

That should fix your problem... outside of that... just let them eat 403's.