For instance, if you search 'slashdot' there are cached copies from Feb 20 and from Feb 21.
And, at [search.cometsystems.com...] you can watch the date of the cached copy of each page. How do they perform this?
aspdesigner
5:32 am on Feb 23, 2003 (gmt 0)
Sometimes when Freshbot makes it's rounds, it will overlap a date change while it is spidering. In such cases, the date it will display will depend on which side of midnight the clock was on when it spidered that particular site and page.
salson
8:17 am on Feb 23, 2003 (gmt 0)
Does Freshbot follow a specified path? I mean, can I know which the last spidered website is?
Amras
7:06 pm on Feb 23, 2003 (gmt 0)
Wow- 216... deepcrawled my site again for the 3rd night in a row and 11 different 64... freshbots in about 3 hours time. Doesn't show the date on google though.