jatar_k
msg:3315829 | 3:32 pm on Apr 19, 2007 (gmt 0) |
find a database of spider ips then read line from logs
compare ip with db
if no match then write to file to send to webtrends
if match then read next log line if this is a huge file then it could take quite a while to finish we used to scrub image requests et al too (not sure if that matters for you or not), for an example of the apache conf we used see here [webmasterworld.com...]
|
lilydale
msg:3315883 | 4:10 pm on Apr 19, 2007 (gmt 0) |
Thanks jatar_k. This gives be a better idea of the direction I need to go in. I will look around for that spider database. I don't think images are a problem because they don't charge up page views in WebTrends. Just hoping there is a free script out there somewhere or if someone has an idea of where to look for something similar that maybe I can use as an example. Please forgive my inexperience; I'm not sure how to write the code or what it would be written in as I'm very new to this. I've written some VBscript and Javascript for some ASP Web applications and that's about the extent of my experience. Even for that it's been a few years and I now mostly do front-end Web and analytics.
|
JesperFJ
msg:3319749 | 9:14 am on Apr 24, 2007 (gmt 0) |
There is a free tool that can doo this.
"Logparser 2.2" can be downloaded from Microsoft. You can use a SQL like language to select, filter and output data from IIS logfiles. It is really amazing. Jesper
|
lilydale
msg:3320209 | 4:36 pm on Apr 24, 2007 (gmt 0) |
Jesper, Thank you! I will definitely check it out.
|
|
