Forum Moderators: open
Google does not list sites in SafeSearch which employ a robots.txt file.
This isn't true, Killroy. SafeSearch is a filter for adult content etc. and has nothing to do with robots exclusion, which is a method of preventing (polite) spiders from indexing certain files.
Am I better off havign NO robots.txt and bear all th e"file not founds" in my logs?
"file not founds" in your log are 404 errors when a visitor or spider requests a page that is missing. Robots.txt has nothing to do with this either. The only way to get rid of the 404s is to set up some kind of redirect from the missing pages, or add the missing pages themselves.
[edit reason = spelling]
[edited by: pixel_juice at 7:46 pm (utc) on April 12, 2003]
Jim