keyplyr - 9:23 pm on Oct 28, 2003 (gmt 0)

Why would you want to hide it?

Some sites fall prey to constant file pilfering, leeching and unwanted mass downloads. On several occasions, I have seen a user get the robots.txt, view the directory hierarchy and which directories are off-limits, then go after them.

Since the robots.txt is, after all, intended for respectful robots, I feel it serves no constructive purpose for general accessibility.