homepage Welcome to WebmasterWorld Guest from 54.166.255.168
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Hardware and OS Related Technologies / Website Technology Issues
Forum Library, Charter, Moderators: phranque

Website Technology Issues Forum

    
Bad Bot List
pageoneresults

WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3582855 posted 3:35 pm on Feb 23, 2008 (gmt 0)

I'm looking to see if there is an updated (as of 2008) Bad Bot List around. I'm aware of the "Close to perfect htaccess ban" that resides on WebmasterWorld but that hasn't been updated in quite some time. Is there a new rendition of that somewhere here? Or do we need one?

 

youfoundjake

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3582855 posted 4:48 pm on Feb 26, 2008 (gmt 0)

I think that would be a great idea, I have the bad bot list myself. Unfortunately, I think its going to be a copy and paste session from hell. Much like what g1smd did with the various google datacenter IP ranges.
I'd almost take it a step further, and maybe include in the thread of how to set up a bad bot trap, as well as including the reverse dns lookup abilitys to catch bots using spoofed user-agents. Maybe end up being a stick at the top of the various subfourms.

pageoneresults

WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3582855 posted 5:02 pm on Feb 26, 2008 (gmt 0)

Since I started this topic, I've come to find out there are products on the market that may fulfill our requirements. Some are only for Linux at the moment, others are in beta and getting ready to hit the market. There's a new cottage industry in the mix and it all has to do with locking down your servers from rogue visitors. Instead of battling this in the trenches, we're going to move up to the firewall level and work there. We're on a .NET platform so we have our work cut out for us. It's in process. :)

youfoundjake

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3582855 posted 5:09 pm on Feb 26, 2008 (gmt 0)

Ouch, .NET hurts. I wouldn't touch that with a 10 foot pole. I wish you all the luck in that endeavor.

Asia_Expat

5+ Year Member



 
Msg#: 3582855 posted 12:22 pm on Mar 31, 2008 (gmt 0)

I'm getting hit hard with a range of IP's from Sweden just now. Can you point me in the direction of some webmasterworld tutorials with dealing with this. It's making my forum look like there are many hundreds more visitors online than there actually are in reality, not to mention the added load on the server.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Hardware and OS Related Technologies / Website Technology Issues
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved