Slurp out on full crawl?

[Brett_Tabke]

Every site I've looked at this morning has been spidered hard by Inktomi the last few hours.

Is this the start of the first big Yahoo db build?

[creative craig]

I am seeing this to on a few of my sites.

Craig

[lazerzubb]

saw it to

[Tor]

I see it here in Norway also.

[why_nigel]

I haven't seen this on my sites yet but maybe it just hasn't gotten to them yet. Probably will soon.

[lawman]

They've hit both of my sites. Sorta keeps you on pins and needles about any potential change to Y! results.

lawman

[ritch_b]

And here - just to add my voice to the crowd.

R.

[edit_g]

Same here. It's like a "did you see the UFO over London the other day?" post. ;)

[troels nybo nielsen]

Yep, slurp has certainly increased its activities here too. Isn't this what we've all expected to see?

[stcrim]

Same Here

-s-

[rick whittington]

What's the IP address of this bot?

[glengara]

I've got this one inktomi4-not.server.ntl.com
but it's a few days old.....

[zeus]

I got a notice a few days ago that I could not see which site has been crawled, but I don think they have spidered any more then the index page, but then spider the whole web now.

zeus

[Orange_XL]

Haven't seen them yet. How do the spider anyway? Do they start at low IP-addresses and then go up?

[RussellC]

Slurp came and got my main site yesterday. Crawled the deepest it has in the past couple of months.

[HenryUK]

Substantial slurp traffic over the weekend. By far the biggest since 7/8 December.
Got individual pages listed for the first time two days before that...

[mayor]

Anyone seeing slup spider the unpaid pages on a site that has some PFI pages on it?

[RussellC]

mayor, Yes.

[johnser]

When are we likely to see a refresh of the database?
Any clues?
J

[FrenchGuy]

Same here. I have PFI but now they are spidering the whole site, including pages for which I donīt PFI... and they spider all the stuff under another domain as the one on PFI...

[Namaste]

whopee...how does that Inktomi algo go? :)

[troels nybo nielsen]

Methinks we are a few on this board who are gonna try and learn about inking. ;)

[alex_cross]

Where can I submit to Inktomi?

[peterdaly]

Inktomi has requested 3070 pages on my main site this month.

It seems to have been crawling me since sometime in December almost constantly. Very slow going compared with googlebot, which "slurped" ;) over 50,000 pages in the January crawl, stopping on the 11th.

-Pete

[korkus2000]

Ink submit
http://www.hotbot.lycos.co.uk/submit.html

[mayor]

Whoohooo ... can't get my logs until around 3AM. U betcha I'll have a fresh pot of coffee ready.

[Robert Charlton]

korkus - I tried the hotbot.lycos.co.uk submission form a few days ago. It now submits to Fast, not Inktomi.

For Inktomi submit, this still works:

[submitit.bcentral.com...]

To be considered for inclusion in the Inktomi Search Index, powering the MSN Web Pages section

Note also, though, on the MSN site:

...only one url allowed per site allowed per day.

They really seem to keep track.

[powerstar]

You guys think we will see free traffic from Inktomi after Yahoo paid 235M or so....I am not that sure....

Yahoo wants Inktomi PFI or even better PPC.

Get ready to pay in order to play.

[turk182]

1300 pages crawled out a total of 2500 in our site requested from December, 1st.

Seems that Inktomi crawls at a very low pace, 15 pages/hour in the "fast moments" ;) and 1 in the low.

[esset2002]

As I wrote in another post I also saw a big increase in traffic from Ink the biggest I ever seen. It was some new domains which had got in for free. 5 days later (sunday) the domains were nowere to be found on Ink. Maybe they are doing this to sell more inclusion...You know show webmasters how much traffic you could get from MSN and etc then turn it off...

/esset