Welcome to WebmasterWorld Guest from 18.104.22.168
I do have pages that require authorization on this site. The funny thing is, it never got robots.txt, but it stays away from the directory that requires authorization. It "acts" like it has seen the robots.txt file, because it gets everything else on the site.
he.net is Hurricane Electric in Fremont, CA.
Anybody else seen this one?