Huge traffic Towards Google

Googleboot takes 10GB/day from my server

[barbos]

We faced the following problem. Our outgoing traffic jumped recently to about 10GB/day which is TOO much.

Sniffer analysis shows the abnormal traffic is going towards Google IP addresses.

We are using IIS-5 and our log files show more than 1,000 less outgoing traffic.

Restarting the server doesn't help but shutting down the sites on the server does.

I suspected dynamic pages with session ID and set robots to NONE as well as banned Googlebot-Image – no effect.

Limiting the traffic from the server to 40KB/sec brings the traffic down but browsing the sites becomes very, very slow.

It looks like Google cannot leave the server (don’t know why IIS logs don't show it though).

Appreciate any ideas how to solve this problem.

[DaveAtIFG]

If you've inadvertantly "trapped" Googlebot, email Google at [e-mail]