homepage Welcome to WebmasterWorld Guest from 54.234.180.187
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Visit PubCon.com
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library : Charter : Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Weird log format
2004mark




msg:3514347		 11:56 am on Nov 27, 2007 (gmt 0)

We are dealing with a site that is hosted with Demon. The log files generated are not readable by our analyzer software (Webtrends Log Analyzer 7).

I have always had "Auto-detect log file type" selected with no problem for logs from 10s of other servers.

This log file has all the required fields but in the wrong order.

Here is an example line (domain and ip details changed):

www.domain.co.uk 111.111.111.111 - - [25/Nov/2007:07:46:25 +0000] "GET / HTTP/1.1" 200 8730 "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9" "http://www.google.co.uk/search?hl=en&q=QUERY&btnG=Search&meta=" "-"

The first thing that jumps out is the domain name is at the start of every line which I have never seen.

The referrer and the browser also seem to be the wrong way around.

Webtrends has around 30 specific log file formats I could select but no idea which one. Is this format familiar to anyone?

Demon say it is a "Demon Internet" format, they can change the format to a standard one, but this will not help for previous months.

Any advice would be greatly appreciated.

 

cgrantski




msg:3514377		 1:01 pm on Nov 27, 2007 (gmt 0)

As I recall, WebTrends Log Analyzer also has an "auto select" log format choice, or something like that. That would be the first one to try if you haven't already.

Also, it shouldn't take too long to go through all 30 formats. WebTrends will give you a pretty quick idea of whether each one is going to generate an error or not.

If none of them work, you could ask Demon to change the format to something standard and then change all your old logs to match with a script or possibly a command line function that tokenizes all the fields and then reorganizes each line according to a specific token list.

Shame on Demon making up their own willy-nilly format. What were they thinking?

2004mark




msg:3514405		 2:07 pm on Nov 27, 2007 (gmt 0)

Well I just spoke with Demon again, this time to someone who was very helpful. He said that it is there own 'version' of NCSA which is out the ark (this is an old domain, I doubt they use it now with new accounts anymore) and he will switch it to NCSA common tonight.

This is great but I still cant read the logs previous to today.

I have tried specifying all the different NCSA formats in Webtrends but with no luck.

I hope somebody can help, I'm sure you can understand how curious I am to see the stats for this domain pre re-design!

cuiyj




msg:3516287		 4:23 pm on Nov 29, 2007 (gmt 0)

www.domain.co.uk : virtual domain
111.111.111.111: remote ip
- -: authenticated user name and remote log file name
[25/Nov/2007:07:46:25 +0000]: time
GET : http method
/ : requested file
HTTP/1.1 : protocol
200: http status code
8730: bytes transferred
"Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9" : user agent
"http://www.google.co.uk/search?hl=en&q=QUERY&btnG=Search&meta=": referrer
"-": I don't know, maybe cookie

The log format can be recognized by Nihuo log analyzer [loganalyzer.net]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved