Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Squider crawling from many IPs, may be a botnet

major hitter over the past ten days



8:42 pm on Apr 23, 2014 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member

Over 400 hits since April 10th, all (I think) blocked. There may be some from server farms but those are not specifically logged here, just rejected. The appearance is of a botnet running with the UA below. It hits several times in a row with different IPs. Blocked on empty header fields.

Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.110 Safari/537.36 Squider/0.01

Almost all IPs were France or Brazil with a couple of US and Belgium. Very unusual pattern (I'm in UK).


9:24 pm on May 18, 2014 (gmt 0)

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Yup, when I looked after you mentioned it there's a huge mix of IPs. It made 5K attempted hits on one site, I didn't check the others.

That's the beauty of automated bot blocking, I never knew it existed until you mentioned it. ;)

Featured Threads

Hot Threads This Week

Hot Threads This Month