Ok all googlers...
As noted in another thread, I have the theory that part of the disappearing-index page problem so many are seeing (including myself) has to do with lack of freshbot visits.
Specifcally, I have a PR6 site that, despite almost daily deep-crawling by various googlebot's, frechbot has not hit my front page in months, or if it has, has failed to give me a fresh tag in over 6 months.
Now, this particular site WAS receiving upwards of 3000+ total unique visitors per day (about 70% from google) with over half hitting the front page first.
However, since this mysterious glitch (disappearing index) has popped up, traffic is cut in half, with most visitors finding the site via an internal content page rather than via the front page (which has not made my advertisers very happy).
In watching this phenom occur over the last 3 weeks or so, and most recently ab out a week ago, it appears to me that those sites that, for whatever reason, are failing to attract freshbot to their front pages are slipping from the serps for the primary targeted keyword/phrase.
The big question is, how do I get frechbot to strat coming back around on daily basis, and giving me a minty-fresh date?
In my efforts to do just that, here's what I've been doing for the past week or so:
1. New content is added to site daily (this was occuring anyway, with over 7000+ pages currently indexed)
2. Small changes to note new content are added to index page daily, including an "Last updated on..." reference near the top of the page.
What else should I be trying?
What prevents/influences frechbot to stop visiting a site (that continually adds content) on a daily basis?
Why does freshbot continue to visit small (spammy) 9-10 page sites that rarely (if ever) change their content, yet it fails to hit our front page?
Why are there 3-4 googlebot crawlers hitting our site almost everyday (including right now), but none of them seem to want to grab the PR6 index page?