Crawling and sampling - what's happening?

[mrdch]

Hi,

The log files of a site shows that the Google spider is visiting it quite often. However, the spider is using URLs with a parameter that is no longer in use on the site itself. It is also very unlikely to be found anywhere else.

For example, the URL Google uses looks like:
[site.com...]

but the CUURENT URL for that page is simply
[site.com...]

I am assuming that it has accumulated a list of URLs, which are then used to get information from the site. In a sense - this is not 'true' crawling - more like 'sampling'.

My question is: When does Google refresh that list of URLs? Is that on a monthly basis or what?

THANKS!

MC

[ciml]

Hello MC, for the main Google index you need to wait either one or two google updates [webmasterworld.com]. Some URLs get 'Fresh' listings quicker than that though.