Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Digsby IM Enables Web Crawlers Control of Your PC & Bandwidth
shiondev - 5:55 pm on Sep 8, 2009 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3986022.htm
We use very, very little (far below 50%) of each computer's bandwidth, which is why we are fairly sure we haven't gone over any caps. I agree that we can't say with 100% certainty, but we are very conservative with our usage.
Brought to you by WebmasterWorld: http://www.webmasterworld.com