Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies




12:53 pm on Apr 18, 2000 (gmt 0)

10+ Year Member

Spider has been picking up +/- 30 pages a day. What is its purpose?


9:04 am on Apr 19, 2000 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

The good old proxy cache spider. Grabs pages for aol users and then serves them out of the AOL cache. It runs with many different user agents for that many different AOL users.

Featured Threads

Hot Threads This Week

Hot Threads This Month