Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt returning "test"


ncw164x - 10:35 am on Jan 28, 2004 (gmt 0)


When I checked your site it is showing test so you must have a file called robots.txt. if you don't have a robots.txt file then it will return a 404 error (The page cannot be found)

See if you can FTP to your web space and view what is on your robots.txt file hopefully it says test so replace this with your file or even upload a blank robots.txt file in ASCII mode.

You dont have to have a robots.txt file it is only used to block spiders not to invite them, the only down side not having one is it fills your log file with 404 errors when it is requested by search engine spiders

ncw164x


Thread source:: http://www.webmasterworld.com/robots_txt/256.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com