joined:Nov 15, 2001
I am working on a series of sites that for a long time had absolutely no new content. As a result googlebot only seems to visit once a month.
If gbot visits at the start of a month and finds new links to new content it notes the new links (visible in the cache) but does not follow them until it's next visit a further month down the road.
So effectively if I want to monitor the effect of a particular change, I have to wait more than two months. This is proving very frustrating - I am used to sites that are crawled at least weekly.
Is there any way to increase the frequency of gbot's visits?