Forum Moderators: DixonJones

Message Too Old, No Replies

Daily Logs Handling

How to combine them?

         

antarve

7:54 pm on Jan 28, 2005 (gmt 0)

10+ Year Member



My hosting company switched to daily Log File rotation. Previous days are kept in <.gz> compression format.
I am seeking for a tool able to:
- download the daily files in assigned intervals
- combine it with the previous dawnloads to the assigned time period (week or month)
- compress/decompress the files in common compression formats.
I will appreciate sharing your experience in this matter.
(antarve)

geotopolis

8:30 pm on Jan 28, 2005 (gmt 0)

10+ Year Member




I have to do this for our NT sites, since we run webalizer on unix for all our domains.

I wrote a php script that does the following.
1 - curl - for downloads
2 - convert (iis to ncsa format) don't think you need this step
3 - cat to append (NT sites are load balanced) so each day has multiple logs)
4 - sort (webalizer files must be in crono order)
5 - gzip

I keep daily logs sperate becuase the cpu power to decompress a monthly log file just to append a day and then compress again wouldn't be worth it.

antarve

8:39 pm on Jan 28, 2005 (gmt 0)

10+ Year Member



I afraid, it is above my head. I am looking for a small simple software with graphic interface with Regular Joe in mind...
(antarve)