Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies




5:51 pm on Sep 22, 2012 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Robots.txt: no
UA: Mozilla/5.0 (compatible; Nesotebot/2.1; +http://www.inoutscripts.com/bot.html)
UA: spider
(alternated between these two UAs using same IP address)

Despite being 403'd, it continued to crawl my entire site 3 times!

Singlehop -

Featured Threads

Hot Threads This Week

Hot Threads This Month