I can think of a number of successful web site break ins where the cracker started off by using information that a clueless webmaster stored in robots.txt
Have a read of this...
a security site-based in Estonia, has uncovered the elementary mistake in RIAA's robots.txt files which gave the crackers their back door.
The firewall protects against all possible network hacks. If robots.txt wasn't necessary for your situation, then it should have been disabled.
[edited by: ThomasB at 1:32 pm (utc) on May 4, 2005]
[edit reason] linked to original article [/edit]