Forum Moderators: phranque
My friend runs a patient led web site for members with a particular medical condition. I've recently taken over technical management of the site. The hosting is donated by the host provider. The network traffic usage has grown from 1GB/month to 20GB/month over the last year. We feel we are imposing unduly on the hosts generosity and would like to use bandwidth more effectively.
Firstly the site at present has no robots.txt or robots pragmas. In one recent day one google bot fetched over 90MB. We want to continue with a good listing with SEs and google in particular, but this seems exessive. How may we shape robot access to maintain good listings but reduce bandwidth consumption.
Secondly the site consists solely of a forum using the SOOP portal. I've been told that this portal is not bandwidth friendly but we cannot change now unless it is possible to retain the member details and the past posts which are the sites major assets. I'm trying to analyse the logs to determine which aspects of the site are bandwidth hogs, but as the daily logs are 12-36MB in size this is slow work. Can anyone offer any advice please.
Keith
PS: some helpful posts (aged, but helpful)
Bandwidth Reduction- Ways to achieve this
[webmasterworld.com...]
Tips and tricks to reduce HTML file size-What are the best ways to trim the fat?
[webmasterworld.com...]
Cutting Bandwidth Needs
[webmasterworld.com...]