Forum Moderators: open
[webmasterworld.com...]
From my log:
210.173.179.26 - - [07/Nov/2004:00:09:09 -0500] "GET /mysite/page.htm HTTP/1.1" 200 6229 "-" "gazz/5.0 (gazz@nttr.co.jp)"
I'm changing my .htaccess file from
RewriteCond %{HTTP_USER_AGENT} ^gazz/2.1
to
RewriteCond %{HTTP_USER_AGENT} ^gazz.*
Is ^gazz.* right?
^gazz
covers most bases and catches "anything that begins with gazz" regardless of what may come after those characters.
The same rule (modified to web) works for the multiple bots whose name begins with web to harvest pages.