Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies


5:51 pm on Sep 22, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
votes: 64

Robots.txt: no
UA: Mozilla/5.0 (compatible; Nesotebot/2.1; +http://www.inoutscripts.com/bot.html)
UA: spider
(alternated between these two UAs using same IP address)

Despite being 403'd, it continued to crawl my entire site 3 times!

Singlehop -