Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt vs Nofollow.


phranque - 12:57 am on Sep 8, 2010 (gmt 0)


welcome to WebmasterWorld [webmasterworld.com], slasher20!

in your situation i would generally suggest meta robots noindex.
otherwise the urls may be indexed even though the pages are excluded by robots.txt, in which case the SE may choose something outside of your control to show for a snippet.


Thread source:: http://www.webmasterworld.com/robots_txt/4197813.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com