Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe to WebmasterWorld
Robots.txt triggers 404 error Robots.txt triggers 404 error Nout msg:1528672 10:26 am on May 29, 2004 (gmt 0) I created a robots.txt file and placed it in my root folder. When i try to validate it i get many errors. Also when i look at in in my browser i get a message 404 file not found but the file is there. Is it maybe the CHMOD? I CHMODed it to 777 but i still cannot read it.
What could be wrong?
Robert Thivierge msg:1528673 11:10 am on May 29, 2004 (gmt 0)
Maybe your not using all-lowercase letters for "robots.txt". "Robots.txt" will not work on UNIX/Linux boxes.
Also, what error messages are you getting in the validator? A common source of errors is if line-endings are messed up (UNIX vs. Windows), but I have no idea without knowing what messages you got.
best of luck