Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

List of bad bot/spiders

Requesting a list of known bad bots

12:29 am on Sep 7, 2005 (gmt 0)

New User

10+ Year Member

joined:June 23, 2005
votes: 0

Does anyone have a current list of bad bots to block. I am seeing more and more bots which I have no idea whether should be blocked. For example:


I tried looking around the forums and googled them, but can't decide which ones should be blocked.

Any help would be appreciated (either on the specific ones listed above, or someones current list of bad bots).


2:59 am on Sept 7, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 27, 2001
votes: 0

Check out A Close to Perfect .htaccess Ban List [webmasterworld.com] and the children of that thread.
11:19 am on Sept 7, 2005 (gmt 0)

New User

10+ Year Member

joined:June 23, 2005
votes: 0

Thank you for the reference. I actually did see that thread before but thought it may be a little out of date (it ranges from 2000 to 2003). Does it still apply or is there a newer list available?
8:35 pm on Sept 8, 2005 (gmt 0)


WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:July 24, 2001
votes: 0

the child threads go all the way up to 2004 and, for the most part, those threads are pretty inclusive and current.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members