homepage Welcome to WebmasterWorld Guest from 23.20.77.156
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Hardware and OS Related Technologies / Linux, Unix, and *nix like Operating Systems
Forum Library, Charter, Moderators: bakedjake

Linux, Unix, and *nix like Operating Systems Forum

    
Better log analysis for Linux
Webalizer just doesn't cut it.
Nick_W




msg:913522
 9:13 pm on Oct 2, 2002 (gmt 0)

Hi all, looking through my webalizer stats I'm finally realizing how woefully inadequate they are.

Presuming I can download the raw log files to my Linux box: What's my best option?

I'm noticing inexcusable descrepencys between my raw files and my stats. My site gets a hit a few times an hour for one phrase and it does not show in my webalizer stats at all!

Apart from that, I just need more informaion ;)

Thanks

Nick

 

digitalghost




msg:913523
 9:19 pm on Oct 2, 2002 (gmt 0)

Sawmill is pretty decent, but I prefer FastStats. Sawmill has the advantage of being free.

Nick_W




msg:913524
 9:27 pm on Oct 2, 2002 (gmt 0)

Right! Well it seems I have Sawmill so:

$> man sawmill

it is then ;)

Cheers...

Nick

dingman




msg:913525
 9:27 pm on Oct 2, 2002 (gmt 0)

'analog' is the standard against which all others seem to compare themselves, so you might want to try that. It's extremely configurable and I am only beginning to think at all about website statistics, so I have little experience to base any analysis on, but there you go. There's also something called 'awstats' that claims to be better and easier to use than webalizer.

Nick_W




msg:913526
 9:30 pm on Oct 2, 2002 (gmt 0)

....er

Sawmill is/was a windows manager (now called sawfish) no man entry and doesn't appear to be the right tool anyway...what gives?

Nick

dingman




msg:913527
 9:30 pm on Oct 2, 2002 (gmt 0)

I thought Sawmill was a window manager... in fact, I'm pretty sure it's the one I'm using :)

Mark_A




msg:913528
 9:42 pm on Oct 2, 2002 (gmt 0)

Nick_W - might you be able to set up webaliser a little better?

Webaliser needs you to tell it the preceeding code before the search term for each search engine - in its configuration - for it to correctly identify the key word from the search / referral string. If you dont check that for every engine then you may not get correct key terms results.

After all its not as if all the engines keep the same referrer information over time. Compare to your raw logs and adjust accordingly.

imho for free you dont get much better value for money than webaliser :-)

Example from a standard config ... (may not be up to date)

#MangleAgents 0

# The SearchEngine keywords allow specification of search engines and
# their query strings on the URL. These are used to locate and report
# what search strings are used to find your site. The first word is
# a substring to match in the referrer field that identifies the search
# engine, and the second is the URL variable used by that search engine
# to define it's search terms.

SearchEngineyahoo.comp=
SearchEnginealtavista.comq=
SearchEnginegoogle.comq=
SearchEngineeureka.comq=
SearchEnginelycos.comquery=
SearchEnginehotbot.comMT=
SearchEnginemsn.comMT=
SearchEngineinfoseek.comqt=
SearchEnginewebcrawlersearchText=
SearchEngineexcitesearch=
SearchEnginenetscape.comsearch=
SearchEnginemamma.comquery=
SearchEnginealltheweb.comquery=
SearchEnginenorthernlight.com qr=

Hope this helps

digitalghost




msg:913529
 10:01 pm on Oct 2, 2002 (gmt 0)

There is a Sawmill for Linux version folks. A search will find it. Some of my clients have access to raw logs, others do not so I have to use whatever I can to get the best stats I can get. Out of all of them, Webalizer seems to be the weakest.

Mark_A




msg:913530
 10:21 pm on Oct 2, 2002 (gmt 0)

Hi digitalghost I see you are pretty sold on sawmill I have never seen that one .. I think if Nick_W confirms that his webaliser is configured correctly he might like it rather better (again as I mentioned cost benefit does not get much better) I find it fine as a basic quick check on activity - there are always logs and offline dbases for detailed work.

fwiw I hated analog the one time I had to look at it.

The online one I like the best is urchin .. allows quick easy deep drill down into individual search engine referrals etc etc all online .. the only negative I could see was that the version I get to play with does not provide paper reports which some larger clients would rather have than online access ..

Nick_W




msg:913531
 10:29 pm on Oct 2, 2002 (gmt 0)

Hi,

Thanks everyone. Can't confirm if Webalizer is configed right as I'm just not up to huge edit jobs tonight ;)

But, I can confirm that Sawmill is absolutely great! just gotta check out what it'll cost me after my 30 days is up ;)

Nick

4eyes




msg:913532
 7:08 am on Oct 3, 2002 (gmt 0)

We use webalyzer on all our accounts.

It is excellent at what it does once you realise its limitation.

If you modify the config files wou can get a lot more out of it than the default settings - which frankly are poor.

However the big 'down' is that it won't show key phrases by engine - ie you get key phrases and you get search engines - but you can't see which came from where.

For this I use 'Relax' - its a free perl script which I run locally on downloaded files. It specialises in Search Engine referral analysis and is better than anything else I have tried - very detailed and covers loads of engines.

scotty




msg:913533
 1:19 pm on Oct 3, 2002 (gmt 0)

I also had a look at Sawmil, and played through its samples. Very nice product, but too bad it is not free.

Personally I use AWStats [awstats.sourceforge.net] which is available at Source Forge. It is driven by Perl so it is a bit slower than Webalizer. However it provides a lot more information regarding to bots, search engine referrals, browser/OS identification, etc. Most importantly, it is in active development, whereas webalizer has not had a serious update for ages...

Nick_W




msg:913534
 2:02 pm on Oct 3, 2002 (gmt 0)

Digital ghost showed me this link:
[sawmill.net ]

Where you can get it free! ;)

Nick

martin




msg:913535
 8:44 pm on Oct 3, 2002 (gmt 0)

I've used webalizer, AWStats, http-analyze, Analog, and a few others.

The most correct statistics are produced by Analog but they are not as fancy as the others. Get Report Magic if you want fancy reports.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Hardware and OS Related Technologies / Linux, Unix, and *nix like Operating Systems
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved