Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt triggers 404 error

Robots.txt triggers 404 error

10:26 am on May 29, 2004 (gmt 0)

New User

10+ Year Member

joined:May 29, 2004
votes: 0

I created a robots.txt file and placed it in my root folder. When i try to validate it i get many errors.
Also when i look at in in my browser i get a message 404 file not found but the file is there.
Is it maybe the CHMOD? I CHMODed it to 777 but i still cannot read it.

What could be wrong?

11:10 am on May 29, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 5, 2003
votes: 0

Maybe your not using all-lowercase letters for "robots.txt". "Robots.txt" will not work on UNIX/Linux boxes.

Also, what error messages are you getting in the validator? A common source of errors is if line-endings are messed up (UNIX vs. Windows), but I have no idea without knowing what messages you got.

best of luck