lucy24 - 4:38 am on Oct 4, 2012 (gmt 0)
is adding Options -Indexes to .htaccess the best way to deal with these URLs
Yes. Assuming you don't want humans pawing through the files either. Most people in most circumstances turn off auto-indexing.
these URLs now redirect to my 404 error page
Fortunately you are wrong about this. They don't redirect-- which would be calamitous-- they simply get served the same page as a 404. Or, in the case of robots, they don't. As soon as they see the 403, they slink away unsatisfied.
The rest of the question really does belong in a g### forum.