Trying to remove a few domains from Inktomi without robots.txt
patrick
9:18 pm on Feb 11, 2003 (gmt 0)
A site i work with currently has multiple domains pointing to the same site/ip, and I am looking to drop all but one. We have been brainstorming some ideas, and one is to have certain domain names resolve with the tag:
<meta name="robots" content="noindex,nofollow">
WIll that alone stop the indexing of a site in Inktomi, or would we need to have robots.txt as well? Any info would be appreciated.
lazerzubb
12:22 pm on Feb 12, 2003 (gmt 0)
Looks like do follow noindex. Nofollow only works for internal pages if i am not wrong. This page will probably help.