Welcome to WebmasterWorld Guest from 54.196.175.173

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Finding bandwidth hogs

     

Mike521

9:30 pm on Apr 24, 2012 (gmt 0)

10+ Year Member



Our site routinely goes over our host's allotted monthly bandwidth, not that big of a deal but we pay extra for the additional bandwidth.

Is there a tool (either desktop or server-based) that can analyze a month's worth of log files and come up with a breakdown of the top files by bandwidth, along with referrer info so I can verify that the traffic is legit? Also useful would be user agent info so I can determine if there are useless bots wasting bandwidth too

Our host has a plesk stat log analysis tool which is handy, but it doesn't get specific enough (it tells me that jpg images take x amount of bandwidth, but not which images in particular or user agent / referrer info for those images)

Thanks in advance for any suggestions

Staffa

10:57 pm on Apr 24, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would suggest that you start by comparing your raw log files with everything you can find in [webmasterworld.com...]

You will be amazed at how much bandwidth is wasted

onlineleben

11:02 am on Apr 25, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There are a few 3rd party products around that even in their free version can give you a good indication of what is using up your bandwidth. Usually they used for optimizing load time, but I found that applying the recommendations also resulted in reducing bandwidth significantly. (I will send you a link to a tool via sticky - not affiliated but happy user of that tool).

onlineleben

11:07 am on Apr 25, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If possible, try to switch on compression for HTML / CSS / JS files with GZip. Saves a lot!

motorhaven

4:26 pm on Apr 25, 2012 (gmt 0)

10+ Year Member



In addition to compression, image cache headers are your friend!

enigma1

11:54 am on Apr 29, 2012 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Maybe something like piwik web analytics will help.

motorhaven

7:37 pm on Apr 30, 2012 (gmt 0)

10+ Year Member



Do you have shell access and raw Apache server logs? If so, I can give you some onliner awk commands which will do exactly what you need.

Mike521

9:32 pm on Aug 29, 2012 (gmt 0)

10+ Year Member



I just noticed this thread in my control panel and that I never responded to anyone, I apologize, my email notifications go to an address that I almost never look at.

anyway I did do some log analysis and found a couple of things that were legit, so it does seem like it's ok

motorhaven if you still have those awk commands though I'd definitely give it a shot, we have about 2 months of logs on a rolling basis

thanks!
 

Featured Threads

Hot Threads This Week

Hot Threads This Month