Welcome to WebmasterWorld Guest from 23.20.147.6

Forum Moderators: open

Message Too Old, No Replies

Is Inktomi STRICTLY PFI?

Slurp's been visiting & I sure haven't paid!

     
5:52 pm on Dec 23, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Mar 3, 2003
posts:306
votes: 0


Is there a way into Inktomi's results w/o paying? Slurp's been to my new site a few times ... though it hasn't crawled much of the site yet.
6:28 pm on Dec 23, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 16, 2003
posts:633
votes: 0


If your site has good content, it will be crawled by Ink for free. :)
10:14 pm on Dec 23, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 14, 2002
posts:1192
votes: 0


Ink now (since August 2002, I believe) has a two pronged approach to indexing the web.

They will crawl anyone who pays.

They selectively (but widely) crawl the net for free.

The criteria for the free crawl are not totally clear. They obviously crawl "important" sites (I suspect that links play a part in that definition), but also crawl fairly obscure sites.

My main site, which has a fair number of links pointing to it, was crawled as soon as they started their new approach. A new site I started this past spring, with very few links, had its index page indexed almost immediately, but the interior pages only started being indexed a month or so ago.

10:32 pm on Dec 23, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 16, 2003
posts:633
votes: 0


The criteria for the free crawl are not totally clear. They obviously crawl "important" sites (I suspect that links play a part in that definition), but also crawl fairly obscure sites.

My new site that I started with 0 incoming links got indexed in Inktomi about two weeks after I submitted.

12:41 pm on Dec 25, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 27, 2003
posts:122
votes: 0


My site is indexed for Free and I am on top no.1 position for my 3 most important KWs.
8:28 pm on Dec 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


There is no way any serious general search engine could be PFI only. The only sites that would pay are e-commerce ones, and the vast majority of searches people do are not looking for things to buy. Only a pure e-commerce search engine could be strictly PFI.
8:41 pm on Dec 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 21, 1999
posts:2141
votes: 0


Ink has always spidered and indexed sites at no cost. They've been doing this since before PFI existed. It seems they've become more active/aggressive in their spidering in the past few months.

There are three routes into Ink:
1. PFI
2. Use a free submit link
3. Wait for an Ink spider to find a link to your site

4:46 pm on Dec 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 12, 2002
posts:696
votes: 0


But will submitting numerous url's through PFI etc speed up or increase the likelihood of a major Slurp trawl?
8:17 pm on Dec 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 14, 2002
posts:1192
votes: 0


The conventional wisdom is that it will decrease the likelihood of a free crawl. Why crawl your site for free when you have shown your willingness to pay? I am not sure how much evidence there is to back this up, as I have never even contemplated paying.
1:17 am on Dec 30, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 21, 1999
posts:2141
votes: 0


My experience is that PFI pages are crawled promptly and often while the remainder of the site enjoys the usual crawls.
1:20 am on Dec 30, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Jan 1, 2003
posts:490
votes: 0


I was spidered by Slurp long before I paid up, but now things are much more regular and reliable so paying is worth it in that sense.