I am totally out of my league here, and this question is probably simple, but I've noticed something that confuses me. My pages have been steadily moving up the results for about 6 months, and I'm #1 or #2 for my preferred search terms in Google. But even though I moved up significantly in the new results at the end of September, the cache of the page is from sometime in early August. Doesn't the robot cache the most recent version? For instance, if the Googlebot visits me on October 24, does it take a snapshot of the page then too? Does it do this every dance? How long does it take for this new snapshot to show up as the cached version? Am i right in guessing that Google may have missed my pages in September, but I still moved up?
And finally, how DO you find out what the bot has been doing on your site? I am hosted on a server run by a huge telecommunications giant. Do i need my own server in order to be able to observe Google's visits to my pages?
If you watch closely, you'll find that new and recent page versions change quite a lot in the cache as Google goes about its rolling updates. Today I watched the cache of one of my pages change several times.
Google doesn't seem to finalise its calculations for new pages during one dance. It often takes 2 dances.