Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
Major spidering by INK today? INK drbill
Anybody seeing some major spidering by INK today. Have had Slurp/si Slurp/cat and Slurp/Boobook
grabbing up everything in its path.. Anyone else seeing activity?
I had lots of attention 3/4 days ago. The whole Slurp family was requesting pages like mad. Hopefully Inktomi will do something with the data :)
Got slurped, but see no results. It's been like this often.
Inktomi's been spidering my site at least 10-15 days per month since July but nothing has been indexed. Also Japan's Ink based SE, Goo, has been doing a lot of spidering during the same period and I am continually being dropped and re-indexed in Goo's database.
Goo has been spidering with UA's Slurp/si and moget/1.0
moget/1.0 (firstname.lastname@example.org) - 311 Slurp/si - 191 Slurp.so/1.0 - 187
moget/1.0 (email@example.com) - 358 Slurp/2.0-Boobook - 292 Slurp.so/1.0 - 243 Slurp/si - 186
moget/1.0 (firstname.lastname@example.org) - 353 Slurp.so/1.0 - 271 Slurp/cat - 189 Slurp/2.0-Boobook - 182 Slurp/si - 168
Slurp.so/1.0 - 114 moget/1.0 (email@example.com) - 113 Slurp/2.0-Boobook - 89 Slurp/si - 65