homepage Welcome to WebmasterWorld Guest from 54.198.46.115
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
New Inktomi IP
ulstrup




msg:403804
 12:58 pm on Oct 13, 1999 (gmt 0)

Hi

just had a visit from this one:

209.131.48.101 Slurp.so/1.0+ brimstone-u1.inktomi.com

asks for robots.txt, then index.htm and leaves

 

ulstrup




msg:403805
 8:03 am on Oct 26, 1999 (gmt 0)

One more...

209.185.141.185 Slurp/3.0-AU resolves to j6000.inktomi.com

ulstrup




msg:403806
 9:27 am on Oct 27, 1999 (gmt 0)

Very interesting new IPs

216.35.103.69 Slurp.so /1.0 j108.inktomi.com
216.35.103.43 Slurp.so /1.0 j4003.inktomisearch.com - deep crawl
216.35.103.45 Slurp.so /1.0 j4005.inktomisearch.com - deep crawl

spottet 99.10.26

Brett_Tabke




msg:403807
 12:23 pm on Nov 5, 1999 (gmt 0)

goo315.goo.ne.jp
202.212.5.36
Slurp.so/1.0 (slurp@inktomi.com; [inktomi.com...]

ulstrup




msg:403808
 8:36 pm on Nov 5, 1999 (gmt 0)

Hi Brett

Had a visit from same cluster:

202.212.5.30 Slurp.so/1.0+ goo212.goo.ne.jp

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved