Forum Moderators: buckworks

Message Too Old, No Replies

"Libwww-perl" spider agents better banned?

Keeping trouble away

         

Morgenhund

11:23 am on Feb 7, 2008 (gmt 0)

10+ Year Member



Sometimes I notice spiders, that have "Libwww-perl" as their user agent string, browsing our site.

I far as I know, this is a standard Perl library HTTP agent, and most likely to be used by novice/lazy programmers, learning network programming, or checking for security holes, or stealing your content.

So I am considering to ban out any spider that does not care about being identified by something better that "Libwww-perl".

What do you thing about this?

SteveWh

12:37 am on Feb 8, 2008 (gmt 0)

10+ Year Member



I ban libwww-perl. It is the most often used user-agent of hackers. I don't recall seeing a single legitimate use of it in my access logs.

Jack_Hughes

2:08 pm on Feb 8, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah, I've banned it as well. I can't see what would be a legitimate use for it.