homepage Welcome to WebmasterWorld Guest from 54.237.77.181
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
W3c Logs With Percentage Downloaded
Trying to show only files where 30+% was downloaded.
doubleJ




msg:4289154
 6:36 pm on Mar 29, 2011 (gmt 0)

Hello...
First, I wasn't sure if this should be in Logging, IIS, or Database. Please move if inappropriate.
We host .mp3 and .wmv files. I'm tasked with getting monthly download statistics (which would be very simple), except they want to know how many files are being downloaded, at least, 30% or more of the file. The percentage is supposed to remove those people that left-click on the link and it starts playing, only to then close the player. They want to see legitimate downloads.
We have IIS (Windows Server 2008 R2) logging with the W3c format. I see no file size or amount downloaded statistics. The closest thing that I see is the transfer time (time-taken) field, but that can be radically different from file to file.
Are there any simple ways of doing this? I was thinking that, if a filesize and size downloaded was included, I could do a calculation to base the report on that, but they aren't included.
JJ

 

doubleJ




msg:4289168
 6:59 pm on Mar 29, 2011 (gmt 0)

I was looking at our windows media streaming server and it does have some of that functionality (filesize and sc-bytes/c-bytes).
It looks like, though, that streaming server uses a windows media logging format.
JJ

doubleJ




msg:4289248
 8:52 pm on Mar 29, 2011 (gmt 0)

Hmmm...
Another thing I just realized is that I don't think my logs are showing any 206 status entries. Everything is either 200 or 404.
That doesn't seem realistic. Is it possible that my logs are rejecting 206? If that's the case, then these statistics could be very simple.
JJ

doubleJ




msg:4289259
 9:23 pm on Mar 29, 2011 (gmt 0)

Well, that's irritating...
The logs show all transfers as 200.
I left-clicked on a wmv and it opened windows media player. As soon as it started playing, I closed windows media player and the logs show it as 200.
I right-clicked and save as and the file started downloading. I cancelled the download after 100MB and the logs show it as 200.
I did figure out how to add sc-bytes (server to client transferred). I think I'm going to have to do a calculation based upon the bytes sent and the average filesize for each type of file. Thankfully, the files are split up into directories in such a fashion that similar filesizes are together.
JJ

doubleJ




msg:4290163
 2:47 pm on Mar 31, 2011 (gmt 0)

This is what I ended up with. I think it works pretty well, but I don't really have a basis to judge. I'll have to wait until the end of next month to be able to compare figure with past stats.
Hehehe...
This is using logparser to run sql statements on the IIS logs. I had to enable logging of sc-bytes in IIS before it would work.
Note the %music%.mp3. The logs will show /music/BlehBlehBleh.mp3, but I wanted to make sure that anything with "music" and ".mp3" would show up.
Also note the sc-byte >= 1377915. That's 30% of the average filesize of all the music mp3s on that server.
JJ

"C:\Program Files (x86)\Log Parser 2.2\LogParser.exe" "SELECT COUNT(cs-uri-stem) FROM c:\inetpub\logs\logfiles\w3svc1\u_ex1104*.log WHERE sc-status=200 AND cs-uri-stem LIKE '%music%.mp3' AND sc-bytes >= 1377915" -i:W3C -o:W3C

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved