In and Out of Inktomi

Dropped then back then dropped

[SeventiesMartin]

Last Thursday all my sites that are on my dedicated server were dropped from Inktomi.

I don't spam or go in for heavy interlinking etc.

Some sites had a few pages that are added by PFI, most were just crawled and added to Inktomi, some have been there for over a year.

Then, last Thursday, every single site was dropped. The PFI pages then started coming back, presumably as they would have been updated anyway.

Yesterday about half the sites suddenly appeared again, including all the pages just that are on Inktomo for free. Phew, what a relief.

Then this morning they are all dropped again, except for a very few PFI pages.

Has anyone else experienced this or have a clue what could be going on. Some of the PFI pages came up for renewal and I didn't renew but thought I would leave then to just get indexed for free. Some I did renew.

The server is very stable with no downtimes, so can't see it being Inktomi being unable to crawl.

One of the sites that was out, then in, then out again has no pages via PFI, they are all free, and it doesn't link to or from any of the other sites.

Does Inktomi ban on a server basis. But if it was a ban then surely the PFI pages would not get listed again.

I'm confused as to what the probelm might be.

Is this happeneing to anyone else.

Any ideas anyone?

[SeventiesMartin]

And Inktomi is still crawling, well, the PFI pages anyway.

[Imaster]

I don't know about PFI, but I have noticed that many sites which have thousands and thousands of pages indexed on google simply have only a few hundreds crawled in inktomi.

If this is the case with ink, then I seriously doubt how useful it will be, in comparision with google.

[SeventiesMartin]

Until last Thursday I had hundreds of pages on Inktomi and was receiving a lot of traffic from MSN.

Not any more.

It seems strange that yesterday it put back several hundred if these pages, then today they are gone again.

Ink. hasn't crawled any non PFI pages since last week on this server. But sites on another server it has.

Just wish I knew that it was a blip and all would be well again eventually.

One of the sites that has gone missing has a different IP address (it has a secure area) and that's gone missing, so it can't be an IP address ban.

[Robber]

Looking at the stats for yesterday and today for one of our sites shows that it has been dropped completely.

There were a couple of thousand pages in Ink but now none - cant even find it searching on the domain name.

We haven't done any PFI and we haven't done any spam.

Strange!

[Imaster]

I don't understand whats going on with ink, but one of my site dropped low on the page count. With a database as small as this, I don't think it can be counted amongst google's competitors.

[SeventiesMartin]

Robber, your site disappeared on Thursday this week, all my sites dispappeared Thursday last week. Hope this isn't going to be a trend.

The pages I have included in PFI are being crawled and reindexed, but Slurp hasn't been around any site picking up any of the hundreds of pages that were indexed for free.

Every day I check the stats hoping that Slurp will be back, but not yet. Given that all the sites were on a dedicated server worries me, I did not spam, go in for heavy interlinking etc. Also there are 2 IP addresses, one is used for a site that has SSL, sites using both IP addresses are gone.

I don't like it one bit and can't figure what's going on.

[mogwai]

I've also had a couple of sites dropped from ink recently. Both sites are on different IPs, have a couple of links to each other, use no spam techniques and were receiving a decent amount of traffic from msn/ink up until the end of July. The sites have both since been dropped completely, a search for the domain names returns other pages that mention the sites and results pages from other engines!

Ink is still spidering these sites so I hope that they will return soon. I'd hate to lose the yahoo traffic for these sites when they make the switch.

[zeus]

I just cant find the reason for Yahoo to use inktomi it is one of the looser SE out there, there results are unstable and not very good.

Why dont they use Alltheweb or make a new deal with wisenut/looksmart they got better results.

zeus

[LateNight]

All my PFI pages - except index - have gone AWOL today. I was noticing my traffic had fallen from MSN/Ink and then I searched my site only to find it decimated. This better be a blip.