Reading Access Logs

any good software?

[SammiGirl]

I'm looking for some software(free if possible but not nesissary) that will take my raw access logs and sort or read it or something. My website is with yahoo webhosting and it seems that the programs I've found(what few I have) don't support the way that yahoo's server writes it. Here's an example of how it looks, I'm susbstituting adress and stuff to make it shorter:

12.223.170.135 - - [15/Jul/2003:04:46:47 -0700] "GET /thefile" 304 - "http://referer" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Avant Browser [avantbrowser.com]; Hotbar 4.3.1.0)" "ysos.sammigirl.com"

Does anyone know any software that could help me out? Yahoo is being very unresponsive because they implied that there is software out there.

Thanks,
Sammi

[Ally_Cat]

My logs look very similar to that, and I use a program called OpenWebScope. It isn't free, but you can try before you buy. Good luck.

[wkitty42]

that appears to be in "Common Log Format" (AKA clf)... there are quite a few analyzers out there for clf logs... i use Webalizer and it has several flavors depending on your chosen operating system... it was developed on a *nix system and i run it on an OS/2 system (from IBM, not MAC related at all)... IIRC, there's also a winwhatever version...

for operation, i simply feed it the raw access log and then go view the web pages it creates of the stats... it is very configurable and relatively easy to use once you get things set up the way you like... on my system, i'm always adding domains and referrers for grouping so that i don't get huge lists of all accesses...

hope this helps...

[David_M]

I've played around with a program called Sawmill. It handles most formats and may also allow you to create a custom format. It also lets you to create all sorts of nifty filters.

[le_gber]

You could also use awstats, it's free and I think it supports CLF.

Leo

[jm_uk]

Just a small note - your web logs are in a "combined plus virtual server" format and not common format.

It's not a big deal though as most log parser programs should cope with your format.

Ultimately, you don't actually need to final field in your log file for analysis as it is the name of your web site. It's only there because Yahoo chooses to log in that way.

[analyst]

Analog

Free and the best. A little learning curve, but great.

[SammiGirl]

I tried analog, it wasn't reading it.

[1milehgh80210]

I used analog for a while. I'm now using a program called Summary, which I find a bit more thorough and user-friendly.

[SammiGirl]

Mainly what I want to be able to do is see specifically each visitor, much like the way the logs are, just I don't like the time it takes to sort through it. I don't care about hits because hits don't mean anything and stats don't show how one related to another in a users specific viewing. I don't know if there is or isn't a program that will just put the specific visits activities or not. I guess that's what I'm really looking for.
Here's where I wish I knew programing to make my own.

Sammi

[BobXpl2k3]

I use Fluid Dynamics [xav.com...]
it works great and it's free!

All you have to do is insert simple tag in your pages
upload 4 files and set up simple cgi-bin configuration.
This script even has self install feature.

Sample output:

A visitor from 62.232.31.2 (62.232.31.2)
arrived without a referring URL,
and visited www.xav.com/perl/site/lib/Win32/TieRegistry.html
at 07:01:30 AM on Thursday, July 17, 2003.
This visitor used Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0).

[Hagstrom]

Mainly what I want to be able to do is see specifically each visitor, much like the way the logs are

That's exactly what I like do to myself. What I do (on Windows) is:

1. use LookUpIp (freeware) to translate IP-addresses.
   
2. Use GREP or SED to remove log-entries caused by robots.
   
3. Use Loggling (freeware) to study the result
   

[NeedScripts]

Check out NetTrcaker, from sane.com... it is sure to solve all your problems.. :)

NS