Request Page

[stevelibby]

I have just created a tracking system on my pages so i can try and get a good idea of where and when each link is being clicked.
However, since setting this up, i have noticed that on some not all records the server variable "HTTP_REFERER" is blank, yet the "server name", Ip address shows? How can this be?
Is it a robot going through my web site? Any ideas?

[larryn]

steve,

The individual browser may or may not send the HTTP_REFERER header field. As you noted, most robots/spiders will also not send a referrer. And of course, if someone types in your URL into their browser, there is no referrer. Additionally, some firewalls (NORTON) will give the use the option of stripping out referral information for the sake of privacy.

Unfortunately, there is nothing you can do short of re-writing unique URL's on the way from the server to the browser - Apache as modules designed for rewriting, but that might be a tad much.

Larry

PS Remember, statistics is about trends, so if you don't get every referrral, you should still be able to determine a pattern given enough visits.

[stevelibby]

Thank You Larry
The clicks are going to external sites from my site?
I suppose thinking about it, if my page was bookmarked, and the browser came back and clicked on the exernal link then yes no http_refer, but there again once they browser clicks on the link it goes to redirect page on my site so i can collect information and then fires into a framed page, so should really i should get the http_refer shouldnt i?
Also by me sending the visitor to a framed page does that in thoery mean that the visitor stays longer at my site?
2 questions for you to answer there, tee hee

[gregbo]

The clicks are going to external sites from my site?
I suppose thinking about it, if my page was bookmarked, and the browser came back and clicked on the exernal link then yes no http_refer, but there again once they browser clicks on the link it goes to redirect page on my site so i can collect information and then fires into a framed page, so should really i should get the http_refer shouldnt i

Not necessarily. Try comparing the referrer for the same IPs within a relatively short time frame (approx. 30 minutes) that land on one of your pages vs. are going to the redirect page. If for the same IPs, you're not getting any referrers, they could be blocked by the browser, a proxy, etc.

Also by me sending the visitor to a framed page does that in thoery mean that the visitor stays longer at my site?

Again, not necessarily. For example, the user could close their browser after arriving at your site, and you'd never know how long they stayed.