Encouraging Deep Crawls from Slurp

What Encourages Slurp to Crawl Deeper Into a Site?

[Lothar]

I've noticed that Slurp doesn't seem to have close to the same crawling depth of Googlebot and I'm wondering if any members here have had any luck in getting Slurp to index thousands of pages.

It seems Google uses Pagerank to a degree to determine how many pages or how deep a site will get indexed but Yahoo seems to be an enigma to me. We have sites that are very well linked from decent sources yet we are lucky to get Yahoo to index over 300 pages of a site whereas Google will pick up thousands.

Is Yahoo using their WebRank metric to determine the depth of a crawl? Is it simply putting all your pages on the homepage or sitemap to get a full crawl? Sometimes that is not always feasible for a site that has many categories so does anyone have any good ideas?

[hbirnbaum]

I also would like to know the answer to this. Anyone?

[cleanup]

How do yo recognise Slurp in your logs.

My access logs show quite basic info, I see plenty of Googlebot action but none from Y! - even though I have a number 1 site in yahoo! and Y! picks up changes fast.

?

[webzilla]

Inbound links to internal pages.