Losing log data - how to capture/preserve?

[palmpal]

I use FastStats for log analysis. I'm losing data so fast now because my logs are rotating and the span dates are changing. I don't know how to modify the logrotate file and haven't yet attempted to download the files via FTP. I thought I had hit on a possible solution when I discovered the export feature of the program. The only problem with this is that the report does not append itself to previous information!

Can anyone tell me what most of you do to capture and preserve this data? Is there a tutorial? Do you FTP the data to your local hard drive? How often? Does the data append itself to the same file or do I need to rename the file and try to combine the stats?

One person from FastStats has answered all my email questions but doesn't provide a "How to" explanation - just "Yes, you should do this or that" or "The program can/cannot do that." The FastStats Forum doesn't have much traffic and isn't any help.

[andreasfriedrich]

I use a perl script that is run via anacron each day on my local server which fetches logfiles from all my hosts and throws away the data that I don't want to store long term. There rest goes into a database.

I guess most people will employ some kind of home grown stuff to download and archieve their logfiles.

Andreas