Page is a not externally linkable
- Google
-- Google News Archive
---- Website Publisher Sues Google over Caching


rj87uk - 3:20 pm on Nov 29, 2004 (gmt 0)


I wholeheartedly agree with Visi. Default bot behavior should be that it will *not* cache unless the website operator specifically gives it permission to do so.

I disagree. There will be a lot of webmasters & designers that dont know much about meta tags never mind Robots.txt

Im sure thats one way to cut googles index by 1/3. I think this the best way is to keep it. If someone wants to get out of the index they should say so. After all a search engine will try and bring back the best results it can.

Rj


Thread source:: http://www.webmasterworld.com/google_archive/26844.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com