What does this mean?

spider question

[textex]

robots.txt HTTP/1.0" 404 303

I have not robots.txt.
Should I?

If yes, should I add error 404 and 303 redirects?

If yes, can someone give me the proper code?

Thanks!

[wilderness]

404 is the error code.
303 is the files size of the page.

[Reid]

404 - file not found - because you have no robots.txt
303 - number of bytes delivered for the request (size of your 404 page)

to avoid getting 404's from robots requesting your robots.txt file you can

1. put an empty file called robots.txt in your root directory

2. put a robots.txt file (use notepad or similar) in your root directory with this exactly

user-agent: *
disallow:

Either of these examples will allow ALL robots to crawl the entire site and you won't get 404's.