ec009.inktomi.com

Who/what is this?

[mayor]

Found ec009.inktomi.com in my log files on a new site. Looks like a humnan but doesn't behave a lot like one. Doesn't behave like a spinder at all, either.

Anyone know who/what this is?

[eddier]

Inktomi is a spider. A very big one in fact.

It spiders for a lot of search engines. Amongst other msn.com. So that's definitively a good guy :)

[sem4u]

And you can bet that Ink's spiders are getting hungrier every day now. :)

[sem4u]

From this Google search it looks like its been around since July 2000 at least:

[google.com...]

[eddier]

This is the list of customers:

about bluewin.ch blueyonder.co.uk espotting.com www.fi goo.ne.jp
hotbot.lycos.com hotbot.co.uk looksmart.com search.msn.com overture.com
soneraplaza.fi terra.cl tocc.co.jp

Actually it's a paid engine. So it will only spider you if you subscribed to either inktomi or one of the customers.

Hint: Inktomi used to be a LOT cheaper then msn ;) and you will get listed in msn as well...

[topr8]

could be a human - reference here

ec009.inktomi.com at WebmasterWorld [webmasterworld.com]

[Birdman]

I've been noticing "Slurp" deepcrawling some of my sites like crazy. Gotta like that. Is this the spider we are discussing in this thread?

[eddier]

Yes. Inktomi gives results like this:

A visitor from j3146.inktomisearch.com (66.196.72.56)
arrived without a refering URL,
and visited mysite.com/mypage
at 0:52:02 PM on Sunday, January 5, 2003.
This visitor used Mozilla/5.0 (Slurp/cat; [e-mail]; [inktomi.com...]

However the person above already discovered that the ec009 is indeed a human verifying the results

[Birdman]

Interesting, I'll have to chec l;ogs for that one.

[sem4u]

Could be a human possibly matching up Ink results with the Yahoo database?

Just a thought. :)

[mayor]

It not the regular Inktomi spider, if a spider at all. It read the robots.txt file but ingnored it, then went on grab things that spiders don't normally grab, like .gif and .js files. It read the robots.txt file and the HTML of two pages all within a few seconds, but then got real lazy and waited several hours to grab the .gif files and some .js files needed to finish the loading of those two pages.

Session started Jan 03 at about 1400 hrs, ended at about 2000 hrs. There were some big time lags between this visitor's activities after starting with that spider-like speed debut.