jimbeetle - 11:12 pm on Feb 10, 2007 (gmt 0)

Whereas LSI essentially talks about synomyns of words, this almost lends itself to "synomyns of phrases"

I think "synonyms of phrases" gets a bit too far away from the idea. We might be able to get away with saying "related phrases" (because in a way they are), but even that is not quite illustrative of the presence of Phrase A predicts the probability of the presence of Phrase B.

Therefore the associated phrases need not be on the same page, but in the cluster of pages and the overall density and frequency valued over the whole cluster.

This and other points MHes raised are very interesting. Using all the usual possible/maybe/it feels like caveats, this can possibly explain folks comments in other threads of taking hits on pages in one directory. Assuming pages in a single directory are somewhat related and maybe interlinked, that would -- or can -- fit MHes's definition of a "cluster of pages".