Forum Moderators: phranque
Related:
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[edited by: Brett_Tabke at 3:34 pm (utc) on Mar. 25, 2004]
As for how many hits page Gb. That depends too. If you have large pages and graphics then you'll burn more bandwidth than small pages and graphics for the same number of hits.
Googlebot (Google)
WISENutbot (Looksmart)
Inktomi Slurp
Alexa (IA Archiver)
Unknown robot (identified by 'crawl')
Wget
Scooter (AltaVista)
Fast-Webcrawler (AllTheWeb)
Unknown robot (identified by 'robot')
Unknown robot (identified by 'spider')
Voila
Voyager
My problem with Google was that it was indexing the same pages multiple times: domain.com, www.domain.com; /page, /page?currency=CAD, /page?currency=USD. Each page was there 6 times! It might be worth checking the logs for this.
On another note, Google regularly sucks up bandwidth for some of the sites I visit. Frequent updates, new material and links make it look important and useful- and when you reach a certain critical mass, with people linking to you and certain information pages being the most authoritative- this is likely only a prelude to you getting even more traffic.
Check to see if you are starting to get more referrals for some keywords, and your SERP rankings. If so, I would change my hosting plan ASAP to allow for more bandwidth :)