Welcome to WebmasterWorld Guest from 184.108.40.206
Moderators: Ocean10000 & incrediBILL
Just doubled my visitors on one site in one day?
Google (1st return PDF says something about being an African spider): [google.com...]
There's also an old thread from 2003 [webmasterworld.com...] which links to this older thread [webmasterworld.com...] which links to a dead page.
UbiCrawler is a scalable, fault-tolerant and fully distributed web crawler...
Become a Pro Member