Swanson - 8:21 pm on May 3, 2006 (gmt 0)

Phil_Payne, what you said there is another signal of the problems they are facing "update cycle slowing".

When faced with these sort of storage problems you need to keep a check on the refresh rate of your data - especially if your algo has a "time" factor i.e. link rate, domain history etc. because then your data storage requirement explodes.