Forum Moderators: DixonJones

Message Too Old, No Replies

Auto download logfiles

         

Jon12345

2:12 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would like to use a logfile analyser that resides on my PC. However, it would be great if I didn't have to download them manually to analyse.

What do most webmaster do? Have some auto download setup?

Also, do the logfiles keep growing and you manually delete them or do they autoexpire?

Thanks,

Jon

mat

6:22 pm on May 13, 2003 (gmt 0)

10+ Year Member



Depends on how your host has them setup, whether they are cumulative or, more commonly, they get overwritten each day. We just zip them up remotely and then FTP them down each day - 30 or 40 meg zips down to 2 to 4 meg.

Jon12345

6:30 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have 12 websites and soon 20. That would be very time consuming to do it manually.

mat

6:51 pm on May 13, 2003 (gmt 0)

10+ Year Member



Set up a cron job.

lorax

7:00 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I use a PC so I have an AT command setup to download the log files.

Macguru

7:03 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I use FileMaker Pro, Apple Script and some FTP client to automate this task on Macs.

lorax

7:23 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



>> FileMaker Pro, Apple Script and some FTP client

Surely it's not as complicated as you make it sound Mac! It is an Apple after all. Why FMP?

Macguru

7:32 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>Why FMP?

I deal with many sites from different clients. FMP stores client's datas like url of logfile, username, password, ID and billing infos. It also triggers the download at a given date and time.

FMP is at the heart of many custom built relational database I use to manage my business. I automate some entries during the task so it will show later in other files. Like time sheet and bills, for instance.

lorax

7:42 pm on May 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



OT
I thought that might be the case. I'm just now beginning to realize that custom built management tools are a necessity. I use NetTracker to do the analysis of the logfiles so all I need to do is get them downloaded. But there are other things that I've been looking to do and some custom scripts running on my development server seem to make the most sense.

BTW - think you'll make London in the fall?

jpirelli

5:59 pm on May 27, 2003 (gmt 0)

10+ Year Member



I script wget, that way I do not have to script enough to manage file overwriting, naming etc, it already has enough of that code in it.

I run it on Win2k, just make sure that your batch files or VBS set the correct directory, otherwise it will send the log files to the winnt/system32 folder.

Of course I have never let that happen and found out when my c drive was full ;-)