Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- faulty robots.txt?


ncw164x - 9:03 pm on Jan 2, 2004 (gmt 0)


Your robots.txt file should be

[nameofyoursite...]

as in the root of your site, you should not be getting a 404 error via the browser if the file is in this directory
are you seeing a 404 error when googlebot and slurp requests the file

The file must be FTP'd in ASCII not Binary

hope this helps

ncw164x


Thread source:: http://www.webmasterworld.com/robots_txt/222.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com