Welcome to WebmasterWorld Guest from 23.22.220.37

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Squider crawling from many IPs, may be a botnet

major hitter over the past ten days

     
8:42 pm on Apr 23, 2014 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3091
votes: 2


Over 400 hits since April 10th, all (I think) blocked. There may be some from server farms but those are not specifically logged here, just rejected. The appearance is of a botnet running with the UA below. It hits several times in a row with different IPs. Blocked on empty header fields.

UA:
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.110 Safari/537.36 Squider/0.01

Almost all IPs were France or Brazil with a couple of US and Belgium. Very unusual pattern (I'm in UK).
9:24 pm on May 18, 2014 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14622
votes: 86


Yup, when I looked after you mentioned it there's a huge mix of IPs. It made 5K attempted hits on one site, I didn't check the others.

That's the beauty of automated bot blocking, I never knew it existed until you mentioned it. ;)