Is this who i think it is?

[Dpeper]

inktomi1-ren.server.ntl.com
62.252.128.4

So does this mean if i did get spidered that i will get in without paying?

-Donny

[NFFC]

Hi Donny, that is just an NTL dial-up/cable modem user looking at your site, NTL use Inktomi's caching software. The "ren" bit means they are from Scotland if that helps.

[Dpeper]

well i had my hopes up guess ill go pay my $25 like every one else ehh?

[Bluestreak]

Inktomi indexed me and I didnt pay a dime :D

I dont even know how that happened though, but I aint complaining. That's gotten my curiousity going though, so Ill see if I can find out how I ended up being indexed. Might help you out....

[Bluestreak]

After some research, I was probably indexed using the free submit here:

[submitit.bcentral.com...]

This allows you to be considered for indexing of Inktomi via MSN.

I should note that you're probably better off paying for inclusion, because that also guarantees that they will regularly spider your site. I dont see the Inktomi bot frequently, but then again I havent been paying too much attention to the logs except for checking on the Googlebot. I dont think they deep crawled my site either. It might be a matter of time, but it could also be because I'm not a paid inclusion. Who knows....

[Key_Master]

I have a site that has been spidered every single day for the last two years by Inktomi and I never paid them a dime. When I first started that site I submitted to every free search engine that used the Inktomi database. That's how I would advise getting into Inktomi. It takes longer to be include and regularly updated but it is worth the wait in the long run. Besides, it's free.

[Bluestreak]

Key,

Thats basically the approach i took. Its only been a month, so Im betting the Intktomi bot is going to deep crawl sooner or later. Google didnt deep crawl the first time they came either, until last week, when they when nuts :D I think there was a month or two month period before I saw Google deep crawl my site instead of a token "just checking in to see if you still exist" visit.

My impression is that the search engines allow some idle time to past after their initial index before they deep crawl the site. It makes sense because it will ensure your site isnt a fly by night operation that will lead to too many 404 errors, poisoning the SE's database.