Spider has been picking up +/- 30 pages a day. What is its purpose?
Brett_Tabke
9:04 am on Apr 19, 2000 (gmt 0)
The good old proxy cache spider. Grabs pages for aol users and then serves them out of the AOL cache. It runs with many different user agents for that many different AOL users.
