jimbeetle - 7:44 pm on Jun 5, 2003 (gmt 0)

rintrah,

One thing I overlooked in my earlier post is that -- as JDMorgan put me straight on a couple of weeks ago -- if you do not want Google to index the page you have to allow G to see the page (pull the disallow entry out of your robots.tx) and use the robots meta tag (meta name="robots" content="noindex,nofollow" or as appropriate).

This is also needed for Teoma and ?ATW? that will insist on listing any page that they know is there whether robots.txt tells them they are allowed to index it or not.