Page is a not externally linkable
Nick_W - 5:20 pm on Nov 5, 2003 (gmt 0)
The file should look like this: That'll stop all bots. Nick
Sure, just add a robots.txt [webmasterworld.com] file to your http document root (where you keep your pages).
User-agent: *
Dissallow /