Welcome to WebmasterWorld Guest from 54.146.221.231

Forum Moderators: open

Message Too Old, No Replies

Inktomi on MSN bot, and Yahoo/Ink future...

...from an unspecified Inktomi marketing exec

     
2:55 am on Jun 19, 2003 (gmt 0)

Moderator from US 

WebmasterWorld Administrator robert_charlton is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2000
posts:11317
votes: 169


Not sure how new this information is, but there seems to be some talk in this forum about the MSN bot, at any rate....

I had a conversation with an unspecified Inktomi marketing exec at AdTech San Francisco today, and asked him about the MSN spider and about when we'll see Inktomi results on Yahoo. He knew I was going to be posting this. I hope I haven't misrepresented what he said...

- About Yahoo, he said that Inktomi would be going "live on Yahoo in the unspecified future," but wouldn't get more exact than that, except to say that "Inktomi is already live on Yahoo in some countries now."

- About the MSN spider, he felt that anybody could send out a spider, but building a full-scale engine is harder than that, and that it would be "18 months at least before MSN could go live with their own crawler based engine."

So, I'm guessing, there's going to be a chunk of time when Inktomi is powering two big portals and Inktomi results are going to be very significant.

I've posted some additional comments about Inktomi paid and free crawl in the Supporters Forum.... Join now. ;)

3:12 am on June 19, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 16, 2002
posts:2133
votes: 1


Thank you for the update Robert_Charlton.

-Jon

3:14 am on June 19, 2003 (gmt 0)

Moderator from US 

WebmasterWorld Administrator martinibuster is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 13, 2002
posts:13973
votes: 123


18 months at least before MSN could go live with their own crawler based engine

Good sleuthing. I didn't even think to talk up the Ink folks.

5:16 pm on June 19, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 12, 2000
posts:395
votes: 0


Thanks for the info Robert, very good to know.
2:08 am on June 20, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Aug 26, 2001
posts:277
votes: 0


MSN had a spider that added SERP content several years ago, my guess is they are reworking that spider. If that were the case they could become live whenever they like what they see. If only to produce the first page, then hit inktomi for the fill in.

Maybe looksmart's days are numbered?

If i recall correctly (anybody who wrote down anything please come in and correct me) it liked keywords to be shown in the title / description (meta) and looked at on page link text (rating only, must have keywords in title / description). Based on the depth of the spidering i got i think they may be looking for off page content on the linked to page ... I tried a micro spider like that once, worked good, in tests of a few sites. Bandwidth becomes a problem if you want to index a billion pages and read all the pages of those billion pages link too! (honest for me it becomes a problem when indexing a single 20MB site); even if the pages only have 20 links.

2:38 am on June 20, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jimbeetle is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 26, 2002
posts:3292
votes: 6


18 months at least

Though MS has been known to market not-quite-finished goods in the past the 18 months seems to be at least a very realistic number, depending on how much past work they already have on the shelf.

a chunk of time when Inktomi is powering two big portals and Inktomi results are going to be very significant

Let the games begin, we're in for an interesting year and a half.

4:49 pm on June 20, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 16, 2003
posts:633
votes: 0


Does this mean that MSN is going to be dumping Inktomi, or is it going to have its own results category (like LookSmart), or what?

-panic