Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- robots.txt file
ktd121 - 2:16 am on Jul 4, 2003 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/65.htm
After looking at my site root I did not see a robots.txt file. What exactly does this file do and how do you make one? What do you need to put into one and do you need to have one?
Brought to you by WebmasterWorld: http://www.webmasterworld.com