Msg#: 2771 posted 10:52 am on Oct 26, 2004 (gmt 0)
Hello all: In the amazing space of 130 seconds, my site (around 130 html pages) was completely and methodically spidered from this DNS 60.34.138.*.
The only ID was "Arachno" which appears to simply be a Japanese User Agent of some sort. The 'spider' (spiders are "arachnids" BTW) never called robots.txt. It found my home page on another site I know, and just dived in like there is no tomorrow.
A Whois search identified the DNS as within the range held by one NTT Communications in Tokyo. Was anyone else hit by this recently? Any clues who or what is behind this? If it means Japanese search engine listings, its OK with me.