trakkerguy - 5:37 pm on May 12, 2010 (gmt 0)

discounting backlinks values etc while re-spidering them from scratch

This seems to be a popular theory. But I wonder what is really NEW here. I mean, Matt C has talked about how the caffeine infrastructure allows them to do more.

So what is new about throwing out the link index and recrawling?

How about if the re-indexing is "different"? Like maybe not counting links that don't bring any traffic, or more weight to those that bring real traffic?

Or some other tweak to the juice passed by a backlink that wasn't possible with the old infrastructure.