Forum Moderators: phranque
before the limit's reached, i've noticed a suspicious increase of bandwith usage. the CPanel interface says we have used over than 5 gigs just for this month! then i check the out stats to look for a suspect, and end up finding out that for the past few days there have been a heavy activity from googlebot. about 300mb per visits!
this site is a phpbb forum. i know about the trouble that the bot can run when crawling forums, but is this normal? does anyone have similar experience?
well, if so. where can i complain about this? the hosting company? any enlightment will be very appreciated.
geez man, getting out of bandwith this early really suxx!
5000MB/300MB means Google can wipe you out in 16 or 17 crawls.
They must be deep crawling, something a lot of people here would welcome.
I would just pay the extra pennies for higher bandwidth service. -Larry
but we're already planning on moving though. the service sucks. and yes, the next hosting company will have a lot bigger bandwith.
anyway, on an average, how much bandwith does googlebot takes when crawling forums anyway?
thx again.
this site is a phpbb forum. i know about the trouble that the bot can run when crawling forums, but is this normal?
Sounds like you're serving session ID's up with your URL's.
That would be the first thing to check.
TJ
What is the googlebot hitting that is causing so much bandwidth usage? It can't be all HTML, right? If it's hitting images, just block off your images folder in the robots.txt file and the bots won't pull down all your images.
Images are spidered by Google Imagebot not Googlebot.
As TJ said, it sounds like a session id issue.
