Msg#: 3696941 posted 2:22 am on Aug 14, 2008 (gmt 0)
I've been so worn out guessing the exact right user agents to ban I've just gone to whitelisting, any more. Besides, most of the oddball and/or new bots don't give a rip about robots.txt, or behave like uncaged baboons, so it's just easier to say no, no, and NO to them. They do nothing for me other than suck bandwidth and fill up my log files with whacked requests. So, it's adios to them. No kiss on the cheek, no Christmas cards.