Page is a not externally linkable
wiseapple - 2:38 pm on Jun 2, 2006 (gmt 0)
Thanks.
Dealing with the same thing... Have used the Robots meta-tag to block Googlebot. I thought this would work. However, we now have a bunch of stuff in the index that was not desired. Mostly stuff for our cgi area. In the past, we used "robots" in the meta-tag. We now specifically call out "Googlebot". Hopefully this will get some of the stuff removed. The one thing I have learned - it is difficult to get something completely out of the index once it is in. The only thing I have not yet tried is the "410".