Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor
Major spidering by INK today? INK drbill msg:24375 3:49 pm on Oct 11, 2000 (gmt 0) Hi,
Anybody seeing some major spidering by INK today. Have had Slurp/si Slurp/cat and Slurp/Boobook
grabbing up everything in its path.. Anyone else seeing activity?
rpking msg:24376 4:12 pm on Oct 11, 2000 (gmt 0)
I had lots of attention 3/4 days ago. The whole Slurp family was requesting pages like mad. Hopefully Inktomi will do something with the data :)
Kamikaze msg:24377 4:37 pm on Oct 11, 2000 (gmt 0)
Got slurped, but see no results. It's been like this often.
Gorufu msg:24378 12:46 pm on Oct 14, 2000 (gmt 0)
Inktomi's been spidering my site at least 10-15 days per month since July but nothing has been indexed. Also Japan's Ink based SE, Goo, has been doing a lot of spidering during the same period and I am continually being dropped and re-indexed in Goo's database.
Goo has been spidering with UA's Slurp/si and moget/1.0
moget/1.0 (email@example.com) - 311 Slurp/si - 191 Slurp.so/1.0 - 187
moget/1.0 (firstname.lastname@example.org) - 358 Slurp/2.0-Boobook - 292 Slurp.so/1.0 - 243 Slurp/si - 186
moget/1.0 (email@example.com) - 353 Slurp.so/1.0 - 271 Slurp/cat - 189 Slurp/2.0-Boobook - 182 Slurp/si - 168
Slurp.so/1.0 - 114 moget/1.0 (firstname.lastname@example.org) - 113 Slurp/2.0-Boobook - 89 Slurp/si - 65