Forum Moderators: Robert Charlton & goodroi
I have a site_map.htm page on my site which contains links to all of the pages on my site. Google has indexed the page successfully but when I look at the cached page it is months out of date. Google states that the page is a snapshot from a crawl on December 27th 2005 but this cannot be the case as the version shown is months old. i.e. I have updated the site map with several new pages but they aren't appearing on the cached version.
Any ideas on what the problem is?
[edited by: tedster at 4:07 pm (utc) on Jan. 11, 2006]
However this is fixed in Big Daddy. So hopefully that will carry over soon.
The sitemap was downloaded within minutes. The pages were crawled within a day. All were indexed sometime this morning.
Here's the good bit. None of the cached versions I've seen so far reflect the newest version of the last changed page. But all searches do.
So as far as I can tell - a unique keyword in that last page crawled three days ago is live in search on all DCs I've tried. Bigdaddy's cache has returned the six-day-old version of all three pages, and a version of the last changed page that I think was current in November. All this morning.
I've decided to turn caching off in a robots metatag. It's more trouble and more exposure than it's worth.