Inktomi Bot: busy at the moment

Its going mental!

[Krapulator]

I have only recently implemented some bot tracking on my server and Inktomi is constantly spidering my site. My tracking has been in place for a week and slurp is showing up pretty much all day every day. Is this usual behavior? Im quite familiar with Googlebots idiosyncrasies but slurps activities seem a little excessive. Any comments or advice would be greatly appreciated.

[quotations]

Are you doing PFI?

You are paying to be re-visited every 48 hours, right?

[mack]

I dont pay ink but slurp still shows up about twice a week and takes quite a lot of pages.

could be viral marketing :)

you see it so you try it.

[coconutz]

Slurp has visited my site almost every day last month. It grabs the index page up to 3 times a day and one or two other pages, grabbed most of our pages twice during the month.

66.196.72.73 Mozilla/5.0+(Slurp/cat;[e-mail];+http://www.inktomi.com/slurp.html)

Site is not PFI. Wonder what Yahoo is planning.

[skipfactor]

I tend to agree that Yahoo/Ink must have something up their sleeve. On one of my sites, I only paid for the index page, and the whole site is now being slurped, but none of the crawled pages are showing up in the SERPs, only the submitted index.

On another newer site, I submitted 10 pages, and only those pages are getting slurped for now.

I think they're warehousing & testing for an eventual go at Google, but I guess that's pretty obvious.

[EliteWeb]

None of my sites on a particular server are paid inclusion in anyway and slurpy is all over them. Shows with enough links you can be included without paying :P

[engine]

There's nothing unusual with Slurp constantly visiting the robots and index page.
What is more unusual is the deep spidering. A good thing too, their db will eventiually be more up-to-date and thereby more attractive to use.

[coffeelover]

I have not paid anything, have only had my site up for a week, and have been spidered already several times by inktomi, and I assume as a result already show up in msn and hotbot/inktomi searches. (my url, not with keywords)

It has only grabbed the index page so far, but maybe it will come back for the other ones later since they have absolute URLS.

How to tell how far down I am in the rankings, I don't know however. Anyone know what kind of algorithm they use at msn or inktomi?
Thanks
Theodore

[Alternative Future]

Hi all,

Same thing here Ink is going mental in my site hitting anywhere between 400 & 500 pages a day, when it leaves it does not come back for at least a week or so later...

Doe's anyone have any idea as to when we might start seeing the results?

-gs

[otnot]

I have a PFI and Slurp hasn't been by for a week now.

[jdancing]

Inktomin only hits the specific pages I paid for inclution every day at the same time. I sure wish it would go mental on my site and spider more pages.

Through my Pay for Inclution provider, I have edited the URL of the pages I want spidered and have noticed the original page has been sticking around in the MSN SERPs. I wonder how long before it drops off? If it takes a while, I'll rotate my 5 paid for inclution URLs to every page on my site over the course of a month.