Here is the situation. I run a site for a large tech magazine. We have a large very active forum. Google will not currently spider the forums because of the URL variables. I could easily change it to spider safe url's, however we are doing well over 500gb of transfer a month as it is and I am scared of the Googlebot coming in every other day and gang spidering the site. An index ago I would not have worried as much, but now that the fresh bot is so much more active I don't really want it to visit every day. I would really like to get the forums indexed, as they contain probably the most relevant data in the entire industry.
So that said is there a way to tell google not to stop by as often, say once a week or every other week?
