Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- What is Robot.txt?

Rsssingh - 9:55 am on Aug 20, 2008 (gmt 0)


The robots.txt file must reside in the root of the domain and must be named "robots.txt". Bots only check for this file in the root of the domain. For instance, http://www.example.com/robots.txt is a valid location.

Thread source:: http://www.webmasterworld.com/robots_txt/3726894.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com