Forum Moderators: open
213.244.195.162 - - [28/Sep/2003:22:10:57 -0500] "GET /removed_dir/ HTTP/1.0" 410 373 "d:/Google Search php pagging/Google Search php paging _DRW.htm" "Teleport Pro/1.29"
213.244.195.162 - - [28/Sep/2003:22:10:59 -0500] "GET /robots.txt HTTP/1.0" 200 342 "-" "-"
I'm kinda surprised he checked robots.txt at all but more surprised he got a 410 and 200. He should have gotten a 403. I have a long list of banned bots in my .htaccess. This is what I have for him:
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
Could one of you rewrite gurus tell me where I'm off in this directive and how it should be rewritten to pick him up? I really don't need someone letting this thing loose on my site.
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
Most folks use the NC. I do not. It's just a personal preferecne and I recall having some problems with my htaccess which may have been related to my host.
On long and mutliple word UA's, I rarely use the entire name.
Web Anything is an example.
The "^Web" handles most of them with a single line.
In your instance, I would suggest:
RewriteCond %{HTTP_USER_AGENT} ^Tele [OR]
Again, it's persoanl preference, If this visitor is playing around on your site (s,) I would deny the IP range as well.
Once we have accumulated an unusually large htaccess file, it becomes very easy to MISS typo's which can cause some really wierd 403's or even other errors which were not how we intended the file to function.
Personally, it took me a very long while to determine some wierd 403's being applied to ranges, which I did not desire.
Don
This one hasn't played around. He just showed up and then left...luckily. This tool looks far more powerful than the others which have come by. So, I need him on ban right away. lol