Forum Moderators: DixonJones

Message Too Old, No Replies

Is Web Log Analysis Worthwhile?

Or is the forest obscured by the trees?

         

cyril kearney

6:19 pm on Jun 28, 2002 (gmt 0)

10+ Year Member



I work with a number of high traffic clients and by and large I am finding that no one spends much time with their web logs.

Typically they burn them to cd-rom each month and forget them.

At the summary level they are gathering top level stats on traffic and all the ecommerce sites are capturing data but the logs themselves are largely ignored.

Are you seeing anything different? Are you mining golden nuggets from your logs?

rogerd

6:36 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Cyril, the "collect & forget" syndrome is why you need good analysis software (and someone to spend at least a few minutes running it each month).

Depending on the site and its business objectives, those key nuggets may differ. Certainly, though, undertanding traffic trends, where it's coming from, how long people stay, and whether people get to key action points are just a few key indicators. Error reports are critical, too.

All that data needs to be turned into business information - then people will look at it and use it!

dcheney

6:39 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I typically use the logs for the following:
  • finding internal errors (watch 404's)
  • finding bad external links (404's again), I usually try to contact the site, or if I can't and enough volume - I stick a redirect from where its looking for the file to where it really is
  • browser stats, if a browser I don't normally test with starts showing a reasonable percent then I'll go find a copy to test my site
  • referals, its good to know how your traffic found you (helps to point out what is working and what needs work in promotions)
  • search terms, it helps to know what the users are looking for (shows you what sections you should focus future work on)

tedster

7:01 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I ask my clients for questions they would like answered in ordinary language. "How many people came to the homepage and left without going further?" "Which option was the most clicked on from our new promotions page?" etc, etc.

I try to make the analysis cycle start with a business question and end with a business answer. The rest of the more general analysis may be of little interest to most, but I still eyeball it and bring up any issues that I see which might have business value (positive or negative).

Lisa

7:09 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Log Analysis is the golden key to success on the Internet. Knowing what your site is serving and how it is serving it is the fundamental building block of optimizing. Simple log file analysis programs that just tell you hits and traffic don't do justice to the black art of analysis.

skibum

7:16 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



cyril_kearney - We find the same thing. Most clients have coughed up the cash for a high end analysis tool but then do virtually nothing with it.

An active SEO campaign can definately make use of the engine/keyword referral data.

When it comes to making changes to a site, it's also good to have before and after data to see how trends are affected. If the shopping cart link gets added to a different page or location on a page, does it enable people who land on a product page to checkout faster, does it lead to more browsing/page views.

It's easier on smaller sites that can actually make changes as opposed to the coporate behemoths the almost never do.

dcheney

7:41 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Oops, forgot to add another reason to analyze logs:
something to do between google dances... ;)

piskie

8:08 pm on Jun 28, 2002 (gmt 0)

10+ Year Member



In addition to the obvious gems, the visiting spider info is priceless.

cyril kearney

8:50 pm on Jun 28, 2002 (gmt 0)

10+ Year Member



I think I am hearing 3 things:
First; My clients answer their day to day business questions using another means like online traffic summaries and not their detail web logs.

Second; My clients have given up on web logs.

Third; My clients find the web logs and their content very important to their day to day operation.

This opens up a whole new set of questions. Is it more cost effective to capture traffic summaries than to review the logs? Or is traffic analysis a waste of time?

Is anyone doing traffic analysis by sampling?

skibum

10:02 pm on Jun 28, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Like tedster said, best the reason for sifting through log files or using something that will analyze them is to answer business questions.

Maybe the are considering Overture vs ad words vs Ask PPC, vs whatever and to make the initial decision they want to know which site currently yield the best conversions, the longest visits, or whatever the key metric may be. We run a few months worth of logs thoguh WT with filters to isolate traffic from ASK, Google and Overture syndication sites and they kick off the ad campaign with the one that drives the highest quality traffic as judged by whatever metric they are looking for in the logs..........

If a client is just curious to see what is happening on the site.....how many referrals did Google send us this month, is our trafic up or down, then there is no need to go beyond a summary report(s).

Some people like to know all the details of what is happening on the site regardless of whether they plan to actually use the info for anything. Some people just like to have a fancy report sitting on the desk for which they are willing to pay $$$$$.

We never go line by line through a log file unless something really strange in WT shows up and merits a closer look, but sometimes do do a fair amount of calculations based on various WT tables and reports.

KakenBetaal

9:30 am on Jul 1, 2002 (gmt 0)

10+ Year Member



Looking at your competitors' stats rather than only your own is another good trick I learnt here at WMW. :)

Many sites use free trackers like extreme tracking without using the password protection, and these can be viewed online by anyone. I've got a huge amount more traffic by finding keywords and phrases that my competitors use and I didn't think of at the time.

Your own detail web logfile is really full of gold (Brett_Tabke's tip!), and the information in there can be used in many ways, not least of which is to find lots of opportunities to improve your site in ways that generate more traffic. I spend a man day or more every month on my logfile, and so far it has really paid off.

olias

9:44 am on Jul 1, 2002 (gmt 0)

10+ Year Member



> Many sites use free trackers like extreme tracking without using the password protection.

Yeah my favourite trick on that note is an advanced search at alltheweb for must include 'extreme' in the link to text and whatever broad keyword I am researching. You can mine many good keyphrases this way. :)