Forum Moderators: Robert Charlton & goodroi
When I searched on the phrase "X-Google-Crawl-Date:" there were over 6 million results! They were all old - from November and December 2004. Most were dead sites but some were still active. One of the pages was news of the wierds FAQ page with a PR of 6, and other PR4 pages were there too!
I can't understand 3 things:
How does the Googlebot end up seeing a page that way; and
Why haven't they been recrawled and re-indexed (some of them are valid index pages of websites) or dropped; and
Why the hell are these pages in the index?
Is this a serious problem for Google? It is for the webmasters.