Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
Marcia - 11:23 am on Jan 24, 2001 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/155.htm
mivox, how about excluding from an entire site? And, will adding robots.txt disallowing all spiders result in a site being removed from the index?
Brought to you by WebmasterWorld: http://www.webmasterworld.com