mrMister - 8:56 am on May 4, 2005 (gmt 0)

a robots.txt isnt quite an exploit

I can think of a number of successful web site break ins where the cracker started off by using information that a clueless webmaster stored in robots.txt

Have a read of this...

a security site-based in Estonia, has uncovered the elementary mistake in RIAA's robots.txt files which gave the crackers their back door.

[theregister.co.uk...]

The firewall protects against all possible network hacks. If robots.txt wasn't necessary for your situation, then it should have been disabled.

[edited by: ThomasB at 1:32 pm (utc) on May 4, 2005]
[edit reason] linked to original article [/edit]