Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Preventing a page from being indexed but wanting links to be followed


g1smd - 5:24 pm on Oct 21, 2008 (gmt 0)


The robots.txt file stops listed files from being accessed so the links will never be found.

You need the meta tag. That allows the page to be fetched, links followed, but the content will not be indexed.


Thread source:: http://www.webmasterworld.com/robots_txt/3737889.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com