Forum Moderators: open
This is still not working to block these agents. See my other post on the topic. Is there something I am doing wrong in my .htaccess file.
What other post? - Please provide a link.
You have both a start anchor "^" and an end anchor "$" on your pattern. Therefore, it will match only a user-agent which is exactly "DTS\ Agent" and contains no other characters.
If you wish to block "Beijing Email DTS Agent", then specify that complete pattern. Alternatively, you can leave the start anchor off, and use
RewriteCond %{HTTP_USER_AGENT} DTS\ Agent$ [NC,OR]
For more information on pattern anchors, see the regular expressions tutorial linked from this Introduction to mod_rewrite [webmasterworld.com] post.
HTH,
Jim
Is the other link. Okay I don't have an option as I've already had four seperate attacks this morning.
Sometimes, I wish I could block those... Unfortunately, I do get valid traffic from those areas, as well as other IP ranges that are "trouble spots" with regard to site scraping. :(
Each Webmaster must make these decisions for his/her own site(s) - And what is wrong for one site may very well be right for the next. Your choices for your site(s) cannot be argued with. Besides, I'd say that at least a third the entries in my bad-bot/bad-IP lists came from your posts... Thanks!
Jim
Yup... :)
I'll bet your notes rival those of many professional internet security firms. Three times out of four, I do a search here for some "new" misbehaving user-agent, and find a thread where you've already nailed it. Raw skill and as a bad-bot hunter is not the most important thing; Many corporations have a lot more resources that we have as individual Webmasters. But it's the willingness to share the information tht counts. You do, and I for one appreciate it.
Jim
www.tair.freeservers.com/cpp/chttpcli.html
You might click on the "Download dts.zip" link at the bottom of the page. If you speak C/C++, you find that this CHTTPSocket class uses "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent;)" as UA string. Is this the basic origin of the Beijing Email DTS Agent?
jan