-- Search Engine Spider and User Agent Identification
---- Digsby IM Enables Web Crawlers Control of Your PC & Bandwidth
dstiles - 10:16 pm on Sep 8, 2009 (gmt 0)
IanKelly - stuff the users - what about the web site owners? It's their bandwidth being abused as much as anyone's. We also have paid-for bandwidth limits and distributed bots can make singnificant dents in that.