aristotle - 2:09 am on Feb 24, 2010 (gmt 0)
Thanks Mad Scientist. I think your explanation is probably right -- Google wants to collect and use more data, yet at the same time could still restrict the number of pages they include in the SERPs. That would explain why they felt a need to improve their data handling capacity. Another reason would be the expected continuing growth of the internet. So I probably jumped to the wrong conclusion when I thought that the index would be expanded.