My logs keep showing that I am getting a 404 error for my robots file. I have checked the file and it looks good. Sticky mail me and I will provide the url if you think you can help.
canuck
1:28 pm on Jan 29, 2004 (gmt 0)
Is your file in the correct directory on your hosting account? If you type in:
www.widgets.com/robots.txt does it show the file?
eesnard
12:03 am on Jan 30, 2004 (gmt 0)
Yes, What makes it even stranger some bots get a 200 and others like Google get a 404.
