Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Pages are ranking, in spite of robots.txt or robots meta tags


wiseapple - 2:38 pm on Jun 2, 2006 (gmt 0)


Dealing with the same thing... Have used the Robots meta-tag to block Googlebot. I thought this would work. However, we now have a bunch of stuff in the index that was not desired. Mostly stuff for our cgi area. In the past, we used "robots" in the meta-tag. We now specifically call out "Googlebot". Hopefully this will get some of the stuff removed. The one thing I have learned - it is difficult to get something completely out of the index once it is in. The only thing I have not yet tried is the "410".

Thanks.


Thread source:: http://www.webmasterworld.com/google/34402.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com