Page is a not externally linkable
Brett_Tabke - 3:15 am on Jul 5, 2001 (gmt 0)
On another note, it is interesting to block a nonexistent directory with a robots.txt and watch some spiders try to spider it. You can really spot who isn't playing fair that way.
We were meaning pages excluded by Robots.txt 2_much. (not banned really, just blocked from indexing).