| Bot blocking
best way to accomplish |
IONWeb
msg:1529234 | 1:51 am on Apr 8, 2004 (gmt 0) |
Aside from protecting folders from access (rephrase - protecting folders from bots that follow the rules) I have not really looked into blocking unwanted bots. I guess I have 2 choices - either start a disallow list and watch my .txt file grow and grow -- or -- find a bad bots script to catch those that do not follow the rules. Any thoughts or suggestions on how best to accomplish this? Thanks all ;)
|
|
