Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Getting Large Numbers of Pages Included

11:30 am on Mar 4, 2003 (gmt 0)

New User

10+ Year Member

joined:Dec 5, 2002
votes: 0


I am looking for a way to have over 300 pages included in the inktomi index. Is there a service available for this.

12:29 pm on Mar 4, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 8, 2002
votes: 0

I don't know - but we just got a new site rampaged by Inktomi Slurp bot last night - and we never even submitted it yet.

Looks like it got about 75 pages out of 300 so far.

Apparently Slurp is getting much more aggressive lately in spidering. We have seen some pages from the new site show up in searching, and the site is not even live yet - only about half finished.

6:18 am on Mar 10, 2003 (gmt 0)


WebmasterWorld Administrator skibum is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Sept 20, 2000
votes: 1

Trusted Feed through PT could work. Depending on the market you'll pay around $0.25/click, or if you are lucky Ink will come around and include the site for free.
3:22 pm on Mar 11, 2003 (gmt 0)

New User

10+ Year Member

joined:Dec 12, 2002
votes: 0


For ages, inktomi just regularly visited my site, checked the index page and that was it.
However, on the 3rd or 4th March it went mad and finally crawled around all my sub pages.

Does this mean they are going to include these pages too, even though I only paid for the index page?
Does anyone know how long it might take for the pages to start showing up in the SERPs?


6:43 pm on Mar 11, 2003 (gmt 0)

New User

10+ Year Member

joined:July 18, 2002
votes: 0

For my site, until recently, only a few really old pages were listed. Now I checked again (that's why I am in this forum now), and they indexed about 30% of my 500 pages. I never paid, but we've got a dmoz-listing since last november, and since then, inktomi has been a constant visitor, though they needed until now to include the pages in the index.
It seems since they were aquired by Yahoo, they really stepped up their non-PFI-spidering. I wouldn't pay anything now, get a dmoz-listing and wait, at least in some months you will know what they are really up to (I think they will couple PFI and Yahoo-Entry somehow, would be a natural thing to do).