Forum Moderators: open

Message Too Old, No Replies

Help in Banning Teleport Pro

         

BlueSky

7:41 am on Sep 29, 2003 (gmt 0)

10+ Year Member



I took down part of my site until I can add something to put a short leash on non-SE non-UA bots that keeping going over there. Today, Teleport Pro visited the removed section. After getting a 410, the visitor then checked robots.txt, which shows it's disallowed right now, then left.

213.244.195.162 - - [28/Sep/2003:22:10:57 -0500] "GET /removed_dir/ HTTP/1.0" 410 373 "d:/Google Search php pagging/Google Search php paging _DRW.htm" "Teleport Pro/1.29"
213.244.195.162 - - [28/Sep/2003:22:10:59 -0500] "GET /robots.txt HTTP/1.0" 200 342 "-" "-"

I'm kinda surprised he checked robots.txt at all but more surprised he got a 410 and 200. He should have gotten a 403. I have a long list of banned bots in my .htaccess. This is what I have for him:

RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]

Could one of you rewrite gurus tell me where I'm off in this directive and how it should be rewritten to pick him up? I really don't need someone letting this thing loose on my site.

wilderness

12:52 pm on Sep 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]

Most folks use the NC. I do not. It's just a personal preferecne and I recall having some problems with my htaccess which may have been related to my host.

On long and mutliple word UA's, I rarely use the entire name.
Web Anything is an example.
The "^Web" handles most of them with a single line.

In your instance, I would suggest:

RewriteCond %{HTTP_USER_AGENT} ^Tele [OR]

Again, it's persoanl preference, If this visitor is playing around on your site (s,) I would deny the IP range as well.

Once we have accumulated an unusually large htaccess file, it becomes very easy to MISS typo's which can cause some really wierd 403's or even other errors which were not how we intended the file to function.
Personally, it took me a very long while to determine some wierd 403's being applied to ranges, which I did not desire.

Don

BlueSky

5:42 pm on Sep 29, 2003 (gmt 0)

10+ Year Member



Aaah okay, thanks. The single word ones work fine all the time, but the multiple word UA's don't. I've tried with and without escaping the space and neither one seems to pick them up. I'll try your suggestion on doing partial matches for those instead.

This one hasn't played around. He just showed up and then left...luckily. This tool looks far more powerful than the others which have come by. So, I need him on ban right away. lol