Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt returning "test"

tschild - 10:13 am on Jan 28, 2004 (gmt 0)


Do you have in fact a robots.txt file (http://www.example.com/robots.txt) on the site? If not, does the reponse to the URL change when you upload an empty robots.txt file?

Thread source:: http://www.webmasterworld.com/robots_txt/256.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com