lucy24 - 11:55 pm on May 16, 2013 (gmt 0)
You can put anything you like in a script-- but the 403 isn't intrinsic to robots.txt. That's the difference.
just asking for robots.txt and being denied
Do you mean, being denied in their request for robots.txt? Heck, even Ukrainian robots can have my robots.txt if they ask for it. Not that they ever do* (Chinese search engines sometimes do-- for all the good it does them). But if they did ask, I'd give it to them.
* I once met a well-behaved Ukrainian robot. It was memorable :)