Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- What is Robot.txt?
Rsssingh - 9:56 am on Aug 20, 2008 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/3726894.htm
You need a robots.txt file only if your site includes content that you don't want search engines to index. If you want search engines to index everything in your site, you don't need a robots.txt file.
Brought to you by WebmasterWorld: http://www.webmasterworld.com