Sgt_Kickaxe - 4:44 am on Apr 17, 2012 (gmt 0)
Shallow, Google will only speed test 1% of your total impressions according to their literature and this is predominantly done via their Chrome browser for obvious reasons. It also tends to happen for your busiest pages regardless of country of origin of your visitors. It's not an accurate way of measuring speed.
A CDN might be your biggest help if your visitors come from around the world. Having a server smack in the middle of where your visitors are is always ideal.
No Google isn't god and they likely aren't penalizing you. I believe you'll even see they tell you how accurate the sampling was by telling you if it was a small, medium or large sampling. Less than 2,000 visitors a day = small to medium sampling at best which happens to include most sites.