ytswy - 10:58 pm on Mar 18, 2007 (gmt 0)

A better analogy is just because you don't have a sign on your front door (robots.txt), doesn't mean that coming inside and stealing your property and giving it away is ok.

Coming inside your property without permission would be trespassing. You can hardly make that claim about making requests to your publicly accessible webserver.

It's more like you open your property to the public, and then try to sue me because I took photos of something. Maybe you'd have the right to enforce a no photographs policy (no idea about that to be honest), but I am sure you would have to tell me about this policy first.