Page is a not externally linkable
rj87uk - 3:20 pm on Nov 29, 2004 (gmt 0)
I disagree. There will be a lot of webmasters & designers that dont know much about meta tags never mind Robots.txt Im sure thats one way to cut googles index by 1/3. I think this the best way is to keep it. If someone wants to get out of the index they should say so. After all a search engine will try and bring back the best results it can. Rj
I wholeheartedly agree with Visi. Default bot behavior should be that it will *not* cache unless the website operator specifically gives it permission to do so.