Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google - robots.txt - indexing
Brett_Tabke - 9:24 am on Jun 24, 2002 (gmt 0)
It still perplexes me that a robots.txt would be indexed. hmmm Anyone else got a robots.txt index?
Thread source:: http://www.webmasterworld.com/robots_txt/34.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com