Page is a not externally linkable
Receptional - 7:31 pm on Nov 10, 2003 (gmt 0)
It happens. Of course, robots.txt is a voluntary protocol. I note they are no.1 on Yahoo for "Whitehouse" - just above a sex site at whitehouse.com.
We've had clients who want to NOT get found on search engines.