Page is a not externally linkable
snowfox121 - 4:33 pm on Oct 24, 2002 (gmt 0)
And finally, how DO you find out what the bot has been doing on your site? I am hosted on a server run by a huge telecommunications giant. Do i need my own server in order to be able to observe Google's visits to my pages?
I am totally out of my league here, and this question is probably simple, but I've noticed something that confuses me. My pages have been steadily moving up the results for about 6 months, and I'm #1 or #2 for my preferred search terms in Google. But even though I moved up significantly in the new results at the end of September, the cache of the page is from sometime in early August. Doesn't the robot cache the most recent version? For instance, if the Googlebot visits me on October 24, does it take a snapshot of the page then too? Does it do this every dance? How long does it take for this new snapshot to show up as the cached version? Am i right in guessing that Google may have missed my pages in September, but I still moved up?