Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Do I need a robots.txt file for Googlebot to read?
SmallTime - 2:02 am on Jun 17, 2002 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/113.htm
Much better to put it there, but make sure that you have the syntax right.
Brought to you by WebmasterWorld: http://www.webmasterworld.com