Forum Moderators: open
Info page says crawling to add sites for new directory (new, no PR.) Nice way to start out... by log SPAMMING?
91.124.228.2** - - [17/Jul/2008:14:08:58 -0400] "HEAD / HTTP/1.0" 200 0 "http://extrabot.com/bot/132769.htm" "Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.3) Gecko/20070309 Firefox/2.0.0.3"
91.124.228.2** - - [17/Jul/2008:14:10:59 -0400] "HEAD / HTTP/1.0" 200 0 "http://extrabot.com/bot/132769.htm" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20051128 Netscape/8.0.4"
91.124.228.2** - - [17/Jul/2008:14:11:00 -0400] "HEAD / HTTP/1.0" 301 0 "http://extrabot.com/bot/132769.htm" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)"
Wonder if the UA that gets the snap-shot identifies itself correctly or pretends to be something else?
Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; SpamBlockerUtility 4.8.4)
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; IEMB3; .NET CLR 2.0.50727; IEMB3)
but the refferer has a different number in /132769.htm
Banned on the spot.