Page is a not externally linkable
wilderness - 4:28 pm on Sep 18, 2009 (gmt 0)
Just for the sake of newbies that may read this thread? Robots.txt does not "ban" or "deny" access to any robot, rather it makes a "request" to conforming bots to comply with your wishes.
I just tried banning it in my robots.txt, gonna check if its actually obeying.