Aside from protecting folders from access (rephrase - protecting folders from bots that follow the rules) I have not really looked into blocking unwanted bots. I guess I have 2 choices - either start a disallow list and watch my .txt file grow and grow -- or -- find a bad bots script to catch those that do not follow the rules. Any thoughts or suggestions on how best to accomplish this?
Thanks all ;)
