Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Digsby IM Enables Web Crawlers Control of Your PC & Bandwidth
dstiles - 10:16 pm on Sep 8, 2009 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3986022.htm
IanKelly - stuff the users - what about the web site owners? It's their bandwidth being abused as much as anyone's. We also have paid-for bandwidth limits and distributed bots can make singnificant dents in that.
Brought to you by WebmasterWorld: http://www.webmasterworld.com