|Getting Large Numbers of Pages Included|
I am looking for a way to have over 300 pages included in the inktomi index. Is there a service available for this.
I don't know - but we just got a new site rampaged by Inktomi Slurp bot last night - and we never even submitted it yet.
Looks like it got about 75 pages out of 300 so far.
Apparently Slurp is getting much more aggressive lately in spidering. We have seen some pages from the new site show up in searching, and the site is not even live yet - only about half finished.
Trusted Feed through PT could work. Depending on the market you'll pay around $0.25/click, or if you are lucky Ink will come around and include the site for free.
For ages, inktomi just regularly visited my site, checked the index page and that was it.
However, on the 3rd or 4th March it went mad and finally crawled around all my sub pages.
Does this mean they are going to include these pages too, even though I only paid for the index page?
Does anyone know how long it might take for the pages to start showing up in the SERPs?
For my site, until recently, only a few really old pages were listed. Now I checked again (that's why I am in this forum now), and they indexed about 30% of my 500 pages. I never paid, but we've got a dmoz-listing since last november, and since then, inktomi has been a constant visitor, though they needed until now to include the pages in the index.
It seems since they were aquired by Yahoo, they really stepped up their non-PFI-spidering. I wouldn't pay anything now, get a dmoz-listing and wait, at least in some months you will know what they are really up to (I think they will couple PFI and Yahoo-Entry somehow, would be a natural thing to do).