Forum Moderators: open
no robots.txt first time 3 days ago, got a 403 based on UA 6 times
and today again 8 times, no robots.txt
Am I missing something?
RewriteCond %{HTTP_USER_AGENT} libwww [NC,OR]
That should fix your problem... outside of that... just let them eat 403's.