Inktomi Still Crawling "FREE" Submissions?

Haven't seen Slurp in 5 days..... :(

[redzone]

Though we have reduced our submission schedule through Anzwers/Canada, we have not seen any new submissions crawled over the last five days.

Anyone else verify, new crawls recently through the "FREE" (Inktomi's version of you get what you paid for) avenues?

[drbill]

RedZone,

Not seeing anything. Surlp is still visiting very strongly BUT nothing listed better than 70 in the DB

Quit submitting daily to them about 3 weeks back.. Taking a step back to relook at the situation again :(

[jilly]

We saw slurp once on our paid submission but the info in the database is what it was all along, nothing updated. I'm still trying to figure out what I paid for... :(

Am I wrong or is the page you submit supposed to be "updated" every 48 hours? I must've misread the fine print.

<edit>

Well hush my mouth! I just checked ink listings again and they did indeed update our description today, at least in some of the partners databases. Unfortunately we're still at the same position.

</edit>

Jill

Edited by: jilly

[littleman]

I have a couple of urls that ranked abut 6-8 months ago that somehow made it back on top. I haven't seen anything new and free in the primary database.

[DaveAtIFG]

Paid to Play on Saturday (11/11) for a formerly listed site. Today it's prominent on both HotBot and MSN. All I paid for was the index page but half a dozen pages are listed well. Unfortunately, routine free submissions were in progress at the same time so I'm not sure what triggered what but at least I'm back in... It's not a competitive term... I think I'll just grab a beer and forget about it for a week or so...

[2_much]

Slurp is still spidering sites submitted through the Free Add URL...It hit a few of our sites today...Some of our sites were added this month... Not all of them are buried, many have top 30 rankings...The question is, how long are they going to remain this way...On another note, some of the keywords are competitive, others aren't...
In all honesty, I haven't studied Ink very closely so I don't know why this is happening...I've only been at this (SEO) for a couple of months and have only applied basic optimization techniques to our sites...
So I have no idea what's working, but bottom line, IT'S WORKING!
So, thanks everyone!!! I learned everything I know here...Thanks!

2M

[pete]

Slurps been hitting some of the submitted pages on a new site. Keeps coming back for the default page though.

Came in six times this morning + hit the default page.

[Moby1]

Is anyone still getting spidered by 209.185.141.185? If so, where are you submitting to?

[WebRookie]

Pretty consistent crawls still from our free Ink submissions weekly, no changes yet. Page I submitted in October is showing in Ink results.

[Moby1]

Where are you submitting to weekly? Are you getting visited from 209.185.141.185?

[WebRookie]

I usually submit once, check back in 4-8 weeks and if listed leave it alone. If not I re-submit, don't do weekly submits. Rarely re-submit if a page is still in listings.

Submitting to HotBot, Canada.com, Answers. When I do international submits, submit to GOO. Don't have access to raw logs to check 209.185.141.185, using WebTrends. I get visits from Slurp and Slurp.so.

[Machiavelli]

I haven't done any paid placement, and my spidering seems to be increasing quite a bit without submitting a thing. Rankings are improving a little too.

[mayor]

Seems my Ink traffic is creeping up across the board too, Machievelli, and I gave up on the resubmissions a while ago. Hopefully a bit of a holiday present for all the hard working SEO folks.

[skibum]

With no paid submissions whatsoever, Ink is hitting my index pages CONSTANTLY, as in 5-7 times a day w/o submitting them, not every day, but several times a week. It sometimes goes a little deeper, but does not spider much past the index page. I can't remember the last time the pages were even submitted for free.

[stcrim]

skibum,

Welcome to WmW and the INK forum. Ink continues to spider the web - no question about it. There is a filtering system for the free submits that put those pages off the radar. However, if during regular spidering INK picks up your pages, they are as solid as the paid version. We no longer submit anything to INK. We have set up our links from other sites (sites we own) to provide a direct route into each subdirectory. As a result, some of our pages are surfacing in INK without being submitted or paid for...

[redzone]

The "free" submission crawler is NOT a "Slurp" user agent, and hasn't been for some time... Littleman, you are familiar with the "Mozilla Netbsd" UA that crawls submissions of URLs that have never been submitted to Inktomi. Have you seen that crawler over the last couple of weeks? I have not...

[pete]

Moby1, sorry for the delay.

New sites being hit by:
1) Agent: Slurp.so/1.0 ([e-mail]; [inktomi.com...]
IP's 209.1.13.232 and around there. Only hitting the default page and not indexing it I think

2)Agent: Slurp/cat ([e-mail]; [inktomi.com...]
IP's: 209.185.141.200
Hitting lower tier pages and indexing them (again, I think!)

Quite a big crawl yesterday on one of our older sites (250+ sessions). Havent checked the log files yet!

[drbill]

I have slurp crawling my server hard daily and still not seeing anything.. RedZone I had the new submission spider come round and visit and I had not submitted that site in 6 months or more. Still not sure what they are up to over there but I guess we will all know one day.

I am not holding my breath about it either.. That would kill me.

[Moby1]

pete,
Thanks for the info. I think the reason I'm not seeing these spiders has to do with a problem Inktomi is having with my DNS. I didn't really know until I subscribed to PositionTech and they have been unable to get my pages spidered. It's strange all the elements that go into get spidered, many of which you have no control over and no knowledge of. Anyway, thanks again for the info.

[redzone]

dr bill:
Couldn't have been the "new submission" crawler, if you had previously submitted the URL's... Everyone seems to be getting confused here, and it's easy with the multiple Ink crawlers that are around.

I'm referring to submitting a URL that has never been submitted to Ink, never been crawled by Ink... In May, 2000 Inktomi changed the UA of this crawler to a Mozilla user agent, very distinct from the "Slurp" UA's..

I have not seen this crawler for a few weeks now. Seems to parallel the start of the "pay for submission" program...

[msgraph]

Recevied this reply from Inktomi tech support.

I wrote:

I notice that this version of Slurp...

Slurp/si ([e-mail]; [inktomi.com...]

...visits my site more often then...

Slurp.so/1.0 ([e-mail]; [inktomi.com...]

Is one of these for checking updates and the other for sites that are recently submitted?

The Reply:

Hello,

Thank you for writing.

What you're observing is pretty much correct. The Slurp crawlers have
slightly different tasks. One checks briefly for updates and the other
checks less frequently but goes deeper.

Inktomi Tech Support