Busynut - 4:30 pm on Oct 30, 2002 (gmt 0)

I've been following the recent .htaccess thread with great interest:
[webmasterworld.com ]

..as well as several related threads concerning robots, spam-proofing, etc. in several forums here at webmasterworld. I've been using robots files and .htaccess on my sites, but it appears I haven't used them as effectively as I can. I'm confused about whether the two files need to be coordinated - in terms of having the same list of "bad robots."

At present, my robots files basically just list the directories that are off-limits plus disallow a few specific image search engines.

So, should my robots.txt file include the same list of banned bots that I include in my mod_rewrite conditions within the .htaccess file? Or perhaps that doesn't make sense because the .htaccess file is being used to handle bots which are ignoring the robots file in the first place?