Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Sitemap and Robots File


tomda - 1:26 pm on Jan 13, 2009 (gmt 0)


Good bots wil ignore it, even if it is in sitemap.

For not indexing the URL, just add it the robots.txt file. You can also change the HTML meta data of your HTML page to none, but not necessary

Google reference here - [googlewebmastercentral.blogspot.com...]

If you use both a robots.txt file and robots meta tags
If the robots.txt and meta tag instructions for a page conflict, Googlebot follows the most restrictive. More specifically:
If you block a page with robots.txt, Googlebot will never crawl the page and will never read any meta tags on the page.
If you allow a page with robots.txt but block it from being indexed using a meta tag, Googlebot will access the page, read the meta tag, and subsequently not index it.


Thread source:: http://www.webmasterworld.com/robots_txt/3825261.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com