rDNS: 84-75-179-***.dclient.hispeed.ch [verified] robots.txt: no Swiss ISP
Acted like bot, no image or flat files.
keyplyr
6:31 am on Oct 13, 2009 (gmt 0)
May be a "broken link checker." Some checkers do not request robots.txt, some do.
This is a fine line. IMO if something is crawling my web site, it's a spider/crawler and should request/follow robots.txt. May be another example of Swiss neutrality.
