My Google mini search appliance is hammering my shopping cart giving me excessive order ID's. I am in the 5 million + order id range, but actual orders are severely far less. Everytime a guest adds something to my shopping cart a new order ID is given so order ID's should skip around, but not to this degree.
I have tried to train google mini to not spider cgi-bin files, and also added cgi-bin to robots.txt. I have also reduced the frequency to scan once a week, but that only slows the problem a little.
What else can I do?