korkus2000 - 3:09 pm on Nov 18, 2002 (gmt 0)

Andrew_Thomas it will stop all of your 404 requests. Also googleguy has said that a custom 404 page with no robots.txt file can confuse the spider and cause your site to not be spidered correctly.

syntax to allow all:
User-agent: *
Disallow:

jamesf4218 sorry I don't know about htaccess. I am a NT developer.