Forum Moderators: DixonJones

Message Too Old, No Replies

What is the best choice today regarding log analysis software?

Log analysis tools for webmasters of several sites?

         

pvdm

3:20 pm on Jul 26, 2002 (gmt 0)

10+ Year Member



Hi,

I have searched Webmasterworld on this subject and read this thread:
[webmasterworld.com...]

I thought it would be great to update the situation. It seems a lot has changed in this market.

What would be the best choice for a webmaster who want to analyse the logs of several customer's websites?

Would it be best to download their logs and analyse them locally? What would be the best choice(s) today?

hayluke

7:54 am on Aug 16, 2002 (gmt 0)

10+ Year Member



I've only really used Webtrends but i like it. It seems to have everything I need and our clients are happy with the reports they get at the end of it.

rcxotic

5:19 pm on Aug 18, 2002 (gmt 0)

10+ Year Member



I also recommnad [awstats.sourceforge.net...] (AWSTATS). It's go pretty graphs! and is highly configurable made for the human eyes. Pretty easy to configure too.

BitStrike

9:57 pm on Aug 22, 2002 (gmt 0)

10+ Year Member



Hi, guys,
I am an author of new log analysis tool. My program puts all log information into the database and then you can work with statistics in realtime.
As a log analysis software developer I can recommend WebLog Expert and 123loganalyzer. Advanced Log Analyzer also has several interesting features.

--
Alexey Stcherbic

[edited by: engine at 7:25 am (utc) on Aug. 23, 2002]

[edited by: mark_roach at 7:43 pm (utc) on Aug. 24, 2002]

Trisha

6:16 pm on Aug 23, 2002 (gmt 0)

10+ Year Member



Does anyone here use Summary? I've been considering it for a while, and have heard it recommended elsewhere, but haven't tried it yet.

Robert Charlton

5:53 am on Aug 26, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



>>Almost forgot, you can set up 5 profiles (URL's) within your account for the above pricing.<<

pageone - Do you mean "domains" rather than "URLs"? I can see where if it's domains, it might be an attractive option to offer to small clients.

stephen

2:11 pm on Sep 6, 2002 (gmt 0)

10+ Year Member



Interesting.

Any advise for someone wanting to track hits to pages on a retail site. We are not wanting to create reports for clients... we want to create reports for our own selves which will help us to determine what advertising brings people to our site who actually buy.

Also, to see which search engines are bringing people to our site who actually buy.

There is a possibility we could put software on our server.

Ideally looking for something, that whether hard or easy to set up, After is was set up, would work semi-automatically if not automatically.

We would be working with 3-6 of our sites.

To summarize: main goal is to track those who actually buy.

Thank you,

Stephen Wick

Dino_M

2:22 pm on Sep 6, 2002 (gmt 0)

10+ Year Member



We use Redsheriff, A bit pricey but customer service is exceptional the Redsheriff lady comes about once a month for Q and A sessions and additional training.

They do not monitor Robot crawling which is a shame.

Mikkel Svendsen

2:40 pm on Sep 6, 2002 (gmt 0)

10+ Year Member



Sorry, but in my personal oppinion RedSherrif do not manitor much usefull stuff when you work with online marketing or SEO. RedSherrif is good for one thing only and that is reporting stats to the outside world as the stats are varified by RedSherrif. I don't think RedSheriff was ever ment to be a "trafic analysis tool" rather a "visitor reporting service" - which is something completely different :)

EliteWeb

5:47 pm on Sep 6, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



oOoo im surprised nobody mentioned FlashStats, its a sexy program that runs server side and handles my logs without problems. and I have gig log files ;P

visibot

9:48 pm on Sep 15, 2002 (gmt 0)

10+ Year Member



I'm used Analog and don't think I even scratched the surface of the config possibilities but got a little weary of all the time needed to uncover those possibilities. They have a very active mailing list and a searchable archive of same, so help is always a few minutes away.

In recent months I've been testing Summary and have become pretty attached to it. It has a lot of customizable features and a ton of pre-configured reports that are downloadle in text or spreadsheet form. They also have one of the best online tutorials I've seen on web analytics. I haven't been able to get clearance to install it on any of my clients' hosting accounts, so I can't speak to performance on a server, but as an analysis tool for downloaded logs I really like it. Speed is pretty decent too.

Due to feedback at WebmasterWorld I'm also giving FastStats a try. Still trying to sort out their approach to filter includes/excludes and I'm still waiting to see the "fast" part. DNS lookups have been running for several hours (as I speak), but I'm assuming that's something that's cached for future reports. I did some tests on just a day's worth of logs and I think I may have found a good blend of qualities that I can use for client reporting but still have most of the 'at-a-glance' data that's important to me. For more depth and customization, Summary will fill most of my other needs.

A neat FastStats feature that I haven't seen mentioned above is Tree View. It's an interactive graphical display where, for any specific page, it shows referring pages and next pages visited, with percentages and special alerts on things like frequent exits.

tedster

10:17 pm on Sep 15, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



DNS lookups have been running for several hours

Yes, the DNS lookups really slow FastStats down - and any other analyzer as well. FastStats uses a multi-threaded DNS lookup and it can be resolving up to 64 IP addresses at one time. But it's still time intensive - after all, it's using the net.

Most of the time I don't need DNS information. Without the added time for DNS lookup, FastStats reports run mighty fast for me - averaging around 4 minutes to crunch 1 GB of standard Apache files.

visibot

11:05 pm on Sep 15, 2002 (gmt 0)

10+ Year Member



> Without the added time for DNS lookup, FastStats reports run mighty fast

Good to know!

I can get along without the DNS lookups 'most' of the time but I just got used to having them, and they run pretty fast after the initial run in Summary. Is that the case with FastStats too?

visibot

12:45 am on Sep 16, 2002 (gmt 0)

10+ Year Member



Yup - with DNS lookups turned off FastStats ripped right through the logs.

In the dept. of boneheaded blunders: I highly recommend making sure the filters and settings are working BEFORE you run with DNS lookups on. I ran afoul of the AND vs OR settings mentioned earlier...and several hours later...I had nada.

running scared

6:07 pm on Sep 19, 2002 (gmt 0)

10+ Year Member



I'm with Steven on wanting to know how to actually track from site entry point to sale. I use webtrends and whilst the info is useful it does not appear to help track ROI in anyway. Do any of the packages mentioned in this thread achieve this?

Perhaps I am just being stupid and haven't paid out for the all singing, all dancing version or just do not know how to configure it properly to achieve basic ROI info? :)

P.S. I am not a programmer.

martin

6:34 pm on Sep 19, 2002 (gmt 0)

10+ Year Member



The entry point reported by log analyzers is not always correct.

There was a link to Analog's documentation above, read that.

tedster

10:48 pm on Sep 19, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



track from site entry point to sale

That's a job much better done with cookies, IMO. The AOL visitors alone are good enough reason. A server log analysis can really get counfounded by those dynamic IP addresses.

Mikkel Svendsen

6:33 am on Sep 20, 2002 (gmt 0)

10+ Year Member



I completely agree, Tedster. IP's is the least precise method to determine unique users. You mention AOL as an example but what about all the users you have visiting though other proxys? One IP on the proxy could be used by many people - and do.

Coockies is better but still not perfect (nothing is perfect in web-statstistics :)) If you target school kids and teenagers cookies is not very precise as they move a lot around. They acces the web from home, from school (maybe even from a notebook), from after-school activites and from several friends. So one person could activate multiple cookies and one cookies could be used by many friends (on the same computer). So for this cookies is not very precise.

The most precise (but still not 100%) is log in. If you count the number of passowrd protected log ins you will have a better count but still you cannot expect it to be 100% correct. Let's say it's a bank. I know of several families where husbond and wife share the same online bank account and there is no way to know (from logiles) if its the husbond or wife that has logged in.

dwhite

11:13 am on Oct 13, 2002 (gmt 0)

10+ Year Member



Has anyone tried AXS?
It's incredibly easy to install (site does it for you optionally), and presents the stats via a webpage in your cgi-bin. The homepage is:
[xav.com ]

Black Knight

12:54 pm on Oct 13, 2002 (gmt 0)

10+ Year Member



There's an Apache mod that writes your logs to an SQL database (MySQL by default, I think) which seems like an excellent solution. Once your logs are actually in an SQL database, you should be able to grab as much or as little detail as you like from your own customised SQL queries. A system that lets you define your own reports in whatever details you want. Best of all, it is of course free.

Anyone tried it? Any major limitations (apart from the lack of a built-in dns system)?

Jaze

9:23 pm on Oct 13, 2002 (gmt 0)

10+ Year Member



RE: Mikkel_Svendsen

Cookies - not forgetting those people who deny all cookies (or select which cookies to store)

Problem with logging in is that you'll be excluding search engine spiders from site and hence you'll lose traffic from search engines...

Remember: "Statistics are like bikinis. What they reveal is suggestive, but what they conceal is vital" - Aaron Levenstein (Nature Genetics 24:11, January 2000)

martin

10:24 am on Oct 14, 2002 (gmt 0)

10+ Year Member



>There's an Apache mod that writes your logs to an SQL database

Can you specify which module. I only found mod_status which is for displaying current usage stats and things like that but not logging.

Bernie

8:18 am on Oct 15, 2002 (gmt 0)

10+ Year Member



If you have running PHP and MySQL on your webserver anyway, I would give [phpopentracker.de...] a chance.
pos:
- free
- can be configured in almost any way
- running - once installed on webserver for multible domains
- is not based on the logfile but any page will be tracked by a php-include source-code-block.
- can be extended

neg:
- requires php-programming skills to configure

With some programming around phpOpentracker we could make it possible to track the referrer of a visitor entering the page at any place in the website, comparing the referrer-string to a referrer-group (e.g. google or overture or banner xy) and adding the corresponding referrer-group-id to the session-id phpopentracker adds to any visitor as a standard procedure. once the visitor does a sale or lead, the session-id with the referrer-id is tracked from the response-page. with that you can find out the conversion-rate according to different ads and comparing e.g. the conversion-rate of visitors coming from google to the once coming from overture.

the only problem is that we sometimes loose leads/sales in the tracking process if e.g. the session-id is cut off.

at the moment we are thinking about changing to cookies instead of session-id. So what's your opinion about reliability of cookies?

mnorton

11:41 am on Oct 16, 2002 (gmt 0)

10+ Year Member



That Apache Module to log to a SQL database is

mod_log_sql

Thanks

Mike

Black Knight

2:10 pm on Oct 19, 2002 (gmt 0)

10+ Year Member



Sorry not to have given the relevant URLs to go with the Apache mods

[grubbybaby.com...] is the standard mod that writes the logs to a MySQL database

[digitalstratum.com...] is a similar mod, but writes to a postgreSQL database instead, for those who prefer that flavour.

I'd still like to know if anyone has direct experience of these types of solutions...

Martin_H

9:14 am on Oct 22, 2002 (gmt 0)

10+ Year Member



Will WebLog Expert track mutliple sites on our server? I want a program that will track multiple sites on our dedicated server and allow me to send custom reports to clients, or alow them to log in themselves to check stats.

We currently use sawmill - but it is crashing out our server when we compile the stats at midnight each night. The answer of course might be to get a more pwerful server, but the costs are quite high for us.

Just your thoughts on some very good multiple site/single server tracking software would be grat.

Thanks

M

cynicsmart

7:31 pm on Oct 31, 2002 (gmt 0)



clicktracks (www.clicktracks.com)

It's affordable ($495)
It's flexible
It doesn't give you a bunch of stuff you don't need.
It was actually written by the guy who wrote analog?

My clients love it...mainly because when I show them the results, they understand them.

--cyn

This 56 message thread spans 2 pages: 56