| Logs keeping showing 404 error
I have a robots file and it looks ok |
eesnard
msg:1529401 | 12:04 am on Jan 29, 2004 (gmt 0) |
My logs keep showing that I am getting a 404 error for my robots file. I have checked the file and it looks good. Sticky mail me and I will provide the url if you think you can help.
|
canuck
msg:1529402 | 1:28 pm on Jan 29, 2004 (gmt 0) |
Is your file in the correct directory on your hosting account? If you type in: www.widgets.com/robots.txt does it show the file?
|
eesnard
msg:1529403 | 12:03 am on Jan 30, 2004 (gmt 0) |
Yes, What makes it even stranger some bots get a 200 and others like Google get a 404.
|
|
|
