Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Do I need a robots.txt file for Googlebot to read?

wangdy - 6:13 pm on Jun 17, 2002 (gmt 0)


Hey everyone...
along the same lines of this thread... where does the robots.txt need to reside?

Does that mean that one .txt is recommended for each URL/server, etc?

Thread source:: http://www.webmasterworld.com/robots_txt/113.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com