Andylew - 7:45 pm on May 3, 2010 (gmt 0)
I have a new theory!
Im still convinced by my earlier post where i pointed out the drop in sitemap reported listed urls to 0 then the build up again is an indication of things moving to caffine.
My thinking after that as was pointed out was fundermentaly flawed. However, as stated previously google is taking down datacentres to update them to caffine. So what if the datacentre that has been taken down is the authority for a particular site? Im obviously well aware of the redundancy in google but fundermentaly somewhere must be an authority and Im guessing some sites, amazon etc would have a higher redundancy priority than others and be distributed and duplicated across multiple datacentres? For other long tail sites perhaps it is actually faster to have all their data stored in a single location with redundancy in that datacentre being viewed as enough, they may not have enough authority to demand multi location redundancy? Take that datacentre down and there is little redundancy for that particular site in other datacentres so it slips in the listings until other datacentres can pick up the slack?