Yep, the Quality Score does not 'belong' to a keyword. Instead, it is a measure of the quality of the keyword in the context of the ad it shows.
Excerpting from the AdWords Help Center:
Quality Score = keyword's CTR + relevance of your ad text + historical keyword performance + other relevancy factors
Quoted from:
How is the Quality Score calculated?
[adwords.google.com...]
AWA