Forum Moderators: DixonJones

Message Too Old, No Replies

Stats program - exceptional search term info

Search term, engine, webpage info in stats

         

HostingDirectory

8:01 pm on May 1, 2005 (gmt 0)

10+ Year Member



I recently started working for a company to help optimize their traffic. Money isn't an option but we need a good statistics program.

I am looking for a stats program which can do this,

1) Tell me all the search terms used to find the site and also which search engines were used by the user for that particular search term.

Example: Search term - uk jobs - 23 google, 26 yahoo, 12 msn , etc.

2) Tell me the exact page that was entered by the user for each search term.

Example: Search term - uk jobs - www.example.com 23, www.example.com/ukjobs 12, www.example.com/newjobs 3 , etc.

3) Tell me the exact page that the user entered my site from link partners.

Example: Referer - linkpartner.example.com - www.example.com 340, www.example.com/articles 46, www.example.com/?aspid=287384378 23, etc.

4) Shows me where each robot entered the website and the exact route around the site the robot used before leaving.

Example: Googlebot - entry www.example.com , passage www.example.com/jobs, www.example.com/careeradvice, www.example.com/jobsearch.asp, exit www.example.com/jobsearch.asp

5) Shows me the entry url by each robot.

Example: Googlebot - entry referer - somepartnersite.example.com/links.htm

6) If a robot comes with seperate versions for geolocation, i want to see this in the stats.

Example: Googlebot( uk ) , Googlebot ( usa ), Googlebot ( french ), MSNBot ( uk ), WISENutbot ( USA ), Inktomi Slurp ( German )

7) I need to be able to export all the different information produced in excel, not just the overview of information but everything i might wish to export.

Must be a stats program compatable with a windows server.
I do not want a stats program which required a ankor link on each page of the site to show the stats - this would pass the pagerank away from our site.
The website has millions of page impressions each month and about half a million uniques - so must be able to deal with large volume.

Any recommendations?

Perhaps a custom script could be made from the raw logs if no stats program does this?

A stats program should do this, i am sure there is one somewhere.

[edited by: msgraph at 1:09 pm (utc) on May 2, 2005]
[edit reason] examplified [/edit]

leadegroot

11:59 pm on May 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



sidenote:
Googlebot - entry referer - somepartnersite.example.com/links.htm

probably not possible - at least the bots for the major engines dont give a referer.
This is because they traverse the net, noting links they can follow in future (maybe 10 minutes, maybe 10 days), and then at a later date they visit those urls.
So they dont directly jump from page to page, the way we do.

HIH
Lea

[edited by: msgraph at 1:10 pm (utc) on May 2, 2005]
[edit reason] examplified [/edit]

HostingDirectory

12:39 am on May 2, 2005 (gmt 0)

10+ Year Member



I didn't realise the bots worked like that.

Are you sure? It seems that when the bots come on my forums, they hang around for sometime and i can tell from the of the threads whos viewing that they seem to be going from link to link in real time.

Where did you read that bots behave like that or is it common knowledge?

cgrantski

12:54 pm on May 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Did you say money isn't an option? Or money isn't an object? ;-) If it's not an option you're in trouble!

Looking through your list, seems like WebTrends Enterprise could produce all of these. Most of them would be custom reports and custom profiles, but don't let that worry you --- WebTrends is moving in the direction of custom reports being the norm (hope that makes sense).

I'm sure several other solutions can handle it as well. WebTrends is just the one we use, so I'm familiar with it.

Alternative Future

1:21 pm on May 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I used to use this stats program when money was not an issue ;-) my computer [google.com]

-george

topr8

1:33 pm on May 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



remember that ALL stats programs that analyse log files only show an incomplete picture at best... for all kinds of reasons that are sometimes documented here in the forums.

cgrantski

3:50 pm on May 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes. Remember that ALL stats programs only show an incomplete picture at best... and that stats programs that do not use log files are missing time-to-serve stats entirely.

Remember that "it's better than nothing" is a fundamental underpinning for the concept called Progress. :D

Lord Majestic

3:54 pm on May 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Are you sure? It seems that when the bots come on my forums, they hang around for sometime and i can tell from the of the threads whos viewing that they seem to be going from link to link in real time.

You can deduce path of the crawler on your site, but as it was correctly pointed out crawler don't tell you how they found your page. This would not be of value anyway since there can be (and often are) more than one page pointing to you.

topr8

7:13 pm on May 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



>>Remember that "it's better than nothing" is a fundamental underpinning for the concept called Progress. :D

yes i agree of course, my answer was in the context of the original questioner having quite a demanding list and i was letting him know that even the best case scenario will not come up to his specs!

smokey99

6:05 pm on May 21, 2005 (gmt 0)

10+ Year Member



I use masterstats.com they don't give you everything you asked for but almost.

Simple (Like me ;-)
Good info on
Unique visitors
page views
Referring sites
SE stats
KW used and what engine by day week or month

Don't think they show much for bot traffic

Check them out
As long as you don't mind their logo on the bottom of you page

Smokey

TonyHodge

12:29 pm on May 27, 2005 (gmt 0)

10+ Year Member



NetTracker allows the use of Log Files and Page Tagging together... You should take a look at that...that is what we use....