steveb - 7:31 pm on Jul 30, 2006 (gmt 0)
I hope they use 10 times as much bandwidth as they have. I hardly think "crawling too much" has been a problem for .0001% of the sites out there. Yahoo needs to crawl much harder and efficiently than they have. Years after they launched their search engine, I don't know of any 1000 page site that is fully indexed correctly.