Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
joined:Nov 11, 2000
I had a conversation with an unspecified Inktomi marketing exec at AdTech San Francisco today, and asked him about the MSN spider and about when we'll see Inktomi results on Yahoo. He knew I was going to be posting this. I hope I haven't misrepresented what he said...
- About Yahoo, he said that Inktomi would be going "live on Yahoo in the unspecified future," but wouldn't get more exact than that, except to say that "Inktomi is already live on Yahoo in some countries now."
- About the MSN spider, he felt that anybody could send out a spider, but building a full-scale engine is harder than that, and that it would be "18 months at least before MSN could go live with their own crawler based engine."
So, I'm guessing, there's going to be a chunk of time when Inktomi is powering two big portals and Inktomi results are going to be very significant.
I've posted some additional comments about Inktomi paid and free crawl in the Supporters Forum.... Join now. ;)
Maybe looksmart's days are numbered?
If i recall correctly (anybody who wrote down anything please come in and correct me) it liked keywords to be shown in the title / description (meta) and looked at on page link text (rating only, must have keywords in title / description). Based on the depth of the spidering i got i think they may be looking for off page content on the linked to page ... I tried a micro spider like that once, worked good, in tests of a few sites. Bandwidth becomes a problem if you want to index a billion pages and read all the pages of those billion pages link too! (honest for me it becomes a problem when indexing a single 20MB site); even if the pages only have 20 links.
18 months at least
Though MS has been known to market not-quite-finished goods in the past the 18 months seems to be at least a very realistic number, depending on how much past work they already have on the shelf.
a chunk of time when Inktomi is powering two big portals and Inktomi results are going to be very significant
Let the games begin, we're in for an interesting year and a half.