Bad Bot List

[pageoneresults]

I'm looking to see if there is an updated (as of 2008) Bad Bot List around. I'm aware of the "Close to perfect htaccess ban" that resides on WebmasterWorld but that hasn't been updated in quite some time. Is there a new rendition of that somewhere here? Or do we need one?

[youfoundjake]

I think that would be a great idea, I have the bad bot list myself. Unfortunately, I think its going to be a copy and paste session from hell. Much like what g1smd did with the various google datacenter IP ranges.
I'd almost take it a step further, and maybe include in the thread of how to set up a bad bot trap, as well as including the reverse dns lookup abilitys to catch bots using spoofed user-agents. Maybe end up being a stick at the top of the various subfourms.

[pageoneresults]

Since I started this topic, I've come to find out there are products on the market that may fulfill our requirements. Some are only for Linux at the moment, others are in beta and getting ready to hit the market. There's a new cottage industry in the mix and it all has to do with locking down your servers from rogue visitors. Instead of battling this in the trenches, we're going to move up to the firewall level and work there. We're on a .NET platform so we have our work cut out for us. It's in process. :)

[youfoundjake]

Ouch, .NET hurts. I wouldn't touch that with a 10 foot pole. I wish you all the luck in that endeavor.

[Asia_Expat]

I'm getting hit hard with a range of IP's from Sweden just now. Can you point me in the direction of some webmasterworld tutorials with dealing with this. It's making my forum look like there are many hundreds more visitors online than there actually are in reality, not to mention the added load on the server.