europeforvisitors - 5:23 pm on Jan 16, 2005 (gmt 0)

Google can't run the algo all of the time, my guess is that a dupe check is performed periodically.

Couldn't they just flag the top 20 or 50 or 100 results from certain types of searches (i.e., "money" keyphrases) for more detailed analysis by a duplicate-content filter at their convenience? In the real world, most users aren't going to notice if there are 500 boilerplate pages for the Hotel Whatsis or Elbonian home mortgages in the bottom 5,000,000 rankings for a competitive search phrase.