Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Do I need a robots.txt file for Googlebot to read?


Mardi_Gras - 8:41 pm on Jun 18, 2002 (gmt 0)


johnd - with all due respect to agerhart, I don't think it matters if it is blank :) But Brett has an article that will tell you everything you need to know about preparing a properly-functioning robots.txt at:

[searchengineworld.com...]


Thread source:: http://www.webmasterworld.com/robots_txt/113.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com