Forum Moderators: open

Message Too Old, No Replies

ec009.inktomi.com

Who/what is this?

         

mayor

10:27 am on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Found ec009.inktomi.com in my log files on a new site. Looks like a humnan but doesn't behave a lot like one. Doesn't behave like a spinder at all, either.

Anyone know who/what this is?

eddier

11:24 am on Jan 5, 2003 (gmt 0)

10+ Year Member



Inktomi is a spider. A very big one in fact.

It spiders for a lot of search engines. Amongst other msn.com. So that's definitively a good guy :)

sem4u

11:27 am on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



And you can bet that Ink's spiders are getting hungrier every day now. :)

sem4u

11:28 am on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



From this Google search it looks like its been around since July 2000 at least:

[google.com...]

eddier

11:39 am on Jan 5, 2003 (gmt 0)

10+ Year Member



This is the list of customers:

about bluewin.ch blueyonder.co.uk espotting.com www.fi goo.ne.jp
hotbot.lycos.com hotbot.co.uk looksmart.com search.msn.com overture.com
soneraplaza.fi terra.cl tocc.co.jp

Actually it's a paid engine. So it will only spider you if you subscribed to either inktomi or one of the customers.

Hint: Inktomi used to be a LOT cheaper then msn ;) and you will get listed in msn as well...

topr8

11:47 am on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



could be a human - reference here

ec009.inktomi.com at WebmasterWorld [webmasterworld.com]

Birdman

11:57 am on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've been noticing "Slurp" deepcrawling some of my sites like crazy. Gotta like that. Is this the spider we are discussing in this thread?

eddier

12:08 pm on Jan 5, 2003 (gmt 0)

10+ Year Member



Yes. Inktomi gives results like this:

A visitor from j3146.inktomisearch.com (66.196.72.56)
arrived without a refering URL,
and visited mysite.com/mypage
at 0:52:02 PM on Sunday, January 5, 2003.
This visitor used Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; [inktomi.com...]

However the person above already discovered that the ec009 is indeed a human verifying the results

Birdman

12:13 pm on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Interesting, I'll have to chec l;ogs for that one.

sem4u

12:16 pm on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Could be a human possibly matching up Ink results with the Yahoo database?

Just a thought. :)

mayor

3:02 pm on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It not the regular Inktomi spider, if a spider at all. It read the robots.txt file but ingnored it, then went on grab things that spiders don't normally grab, like .gif and .js files. It read the robots.txt file and the HTML of two pages all within a few seconds, but then got real lazy and waited several hours to grab the .gif files and some .js files needed to finish the loading of those two pages.

Session started Jan 03 at about 1400 hrs, ended at about 2000 hrs. There were some big time lags between this visitor's activities after starting with that spider-like speed debut.