Forum Moderators: open
just had a visit from this one:
209.131.48.101 Slurp.so/1.0+ brimstone-u1.inktomi.com
asks for robots.txt, then index.htm and leaves
209.185.141.185 Slurp/3.0-AU resolves to j6000.inktomi.com
216.35.103.69 Slurp.so /1.0 j108.inktomi.com 216.35.103.43 Slurp.so /1.0 j4003.inktomisearch.com - deep crawl 216.35.103.45 Slurp.so /1.0 j4005.inktomisearch.com - deep crawl
spottet 99.10.26
Had a visit from same cluster:
202.212.5.30 Slurp.so/1.0+ goo212.goo.ne.jp