Is Slurp more powerful than Googlebot?

Is mothra going to overtake godzilla?

[stuntdubl]

I have noticed significantly more hits (almost double) the hits from Slurp on a couple month old site as I have from Googlebot. Has anyone else experienced much higher volume spidering from Inktomi than from Gbot?

I'm curious if their has been lots of improvements in slurp since the acquisition, and if it has made their crawler more effective.

[troels nybo nielsen]

Slurp has become very active, but googlebot is still easily #1 on all my websites.

[stuntdubl]

My site still has much more referral traffic from G, but I'm just wondering about hits from the actual spiders.

Has anyone else had Slurp hit their site harder than Gbot?

[korkus2000]

Usually for me slurp slowly creeps across the site. It goes just as deep just slower. GBot accosts my site in short bursts. Don't get me started on scooter the web server abuser.

[WebGuerrilla]

Slurp has become much more active.

I think the biggest lesson G has taught all the other engines is that to be successful, you need to aggressively crawl the web and you must also be consistent about it.

Conducting a massive crawl every 6 months just doesn't cut it. I think Ink understands that. So I would expect to start seeing Slurp on a regular basis in the upcoming months.

[jomaxx]

INK has been steady, but probably not #1 for me. In the past month I have been heavily spidered by a new IP block assigned to DEC. Several very deep crawls. The spider is "Mercator-2.0".

I forget who ended up owning Alta Vista, but I assume that's where this spider is from.

[brakthepoet]

I don't know about more powerful, but I'm finding that my site's new pages are entering into the Ink index faster than into Google's. Googlebot has the regular, dependable cycle, but Slurp seems to be stopping by more often, but with no real predictability.

[JudgeJeffries]

I've seen much more activity from Slurp over the last month or so. I just assumed it must be part of Yahoo's grand plan and indicative of their future intent. No doubt someone with experience could give a reasonable analsis of the possible reasons for the increased activity which presumably is being orchestrated by Yahoo? Maybe I'm just a little too suspicious.

[stuntdubl]

Is slurp supposed to be pay for inclusion?

I didn't pay for that spidering, and I haven't noticed it on my other sites.

Is Yahoo changing the model making it no longer pay for inclusion?

[troels nybo nielsen]

stuntdubl,
you may want to read this thread if you haven't already.

[webmasterworld.com...]

I find it quite natural to expect Yahoo to make much more use of Inktomi, which might very well include creating a much larger and much more up to date database.