Slurp/si - Slurp/cat

[skirril]

Hello,

I have regular visits from the inktomi robot slurp.

I usually get the UA "Slurp/si", but today, a "slurp/cat" visited me.

Ideas?

Skirril

[msgraph]

I noticed Slurp/cat spidering many of my sites pretty heavily for the past few days. This is the same spider version that appears for Inktomi's paid inclusion program. I presume that this version of slurp is for pages that will be included into their index. So hopefully whatever pages they are nailing now will be included in the next update or at least in the main database. Keeping an eye out.

[skirril]

Strangely enough, I didnt submit anything to inkomi, and all
I submitted to yahoo was the main page.

The page gotten was a page somewhere deep down, of little to
no interest as an entry page.

[nube]

i did a paid submission to inktomi last week just one domain index, today checking the logs slurp is hitting everything linked to the index page.

[Marcia]

Wondering if this is still the distinction between Slurp/si and Slurp/cat since all of a sudden Slurp/cat is hitting all pages on a site and hasn't been seen for a long time until noiw.

[wilderness]

Inktomi
spiders for so many different sites.
That I leave them alone.

[inktomi.com...]

The spidering has remained constant and daily for over two years. I don't recall making a submission to them.
It has resulted in many bots picking up my pages and digging 6-7 pages deep in my structure of some 300 pages.

[Marcia]

>constant and daily for over two years

wilderness, you were probably picked up through a link then, if you didn't submit, which is logical. OK - you've been spidered steadily, but have new pages from the site been added to the index regularly, and have yau seen updates in the actual listings?

I'm trying to figure the difference between spidering when there are or aren't paid pages on a site.

[wilderness]

Hey Marica,
I've never made a submission to MSN.
Inktomi spiders for MSN.
My MSN referrals have many many listings and outnumber my Google referrals for some months now.

I actually as said previously, don't pay any attention to the results of Inktomi itself as they are the spider.
I don't believe Inktomi has their own SE?
Perhaps I'm wrong?

I do get spidered by different versions of Slurp.
Just don't pay attention to it :-(

I have way to many pages to check their individual listings.
These days when I make an addition it usually is contained deep in the sites structure.
My main pages and some others which were designed to DRAW traffic upon creation are listed with most every search engine.
I do add some NEW page links on my main pages occasionally and these are picked up very fast by most SE's. I just don't make it a point to go out searching for how my pages are listed these days.

The only real searching I do on the net that is extensive (these days) is when I happen to notice a unique referral search in my logs which in most cases provides new URL's which I previously wasn't aware of.

My efforts (when not working on the pile of pending articles, pictures and pages to add) are concentrated on malicious visitors via my logs.

Rarely do I run across a SE which I desire to enhance my listings at.
Although recently I did stumble across one.

www.openhere.com
has some really strict compliance however if you follow that compliance you get listings within SECONDS. :-)
Although openhere not a major SE. I like their site and method.