Welcome to WebmasterWorld Guest from 54.225.58.238

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

headers check

     
9:14 pm on Nov 18, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5459
votes: 3


On a whim (it's been posted many times), I decided to test the lines in this thread [webmasterworld.com] (Apache forum).

Some twelve hours later (course my site is not rumbling with activity) there have been two denies, both AOL users.
One coming from an AOL IP, and the other from a private IP.

Anybody have a clue if something in these lines catches AOL?

I use to have volumes of AOL users amongst the widget folks, these days its rare. Most have switched to mobile.
5:45 am on Nov 19, 2012 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6527
votes: 114


To get a definitive answer to your question, you'd probably need to post the 2 headers that were invalid according to the script. Were any of the server variables blank?
10:27 am on Nov 19, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5459
votes: 3


according to the script


Thanks keyplr.

don't use any doggone scripts.

In any event, I've bigger dragons to sleigh temporarily.

Can I add an exception for UA's? to the header lines?

Don
11:25 am on Nov 19, 2012 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10553
votes: 13


those headers are typically sent by proxy servers and AOL users typically access web pages through proxy servers.
12:19 am on Nov 20, 2012 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6527
votes: 114


Don, try removing all instances of:

%{HTTP:XPROXY_CONNECTION}
3:24 am on Nov 20, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13210
votes: 347


those headers are typically sent by proxy servers and AOL users typically access web pages through proxy servers.

Any way to distinguish between proxy users who can't help it and proxies that are up to no good?

I recently had to de-block one fairly loathsome IP because my local county government uses them as a proxy. Personally I wouldn't give a squat-- the government offices that visit my own site tend to be several thousand miles away-- but I have to let them into the art studio's site. They pay its rent. And we share that part of our htaccess.
4:20 am on Nov 20, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5459
votes: 3


Thanks phran and keyplr.

Don
4:37 am on Nov 20, 2012 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6527
votes: 114



I use a mod_rewrite condition/rule to block prox(i|y) in UA and referrer. The AOL traffic doesn't display any of that (only in headers) so the ones that do are using a proxy service by choice, presumably to hide something.
7:43 pm on Nov 20, 2012 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3121
votes: 3


There are some proxy identifiers I've always found bad - I block those. But in any case I log all uses of a proxy and manually flip through them to check for abuse. G and Y feature prominently. :(
12:56 am on Nov 21, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5459
votes: 3


I've had four valid users coming in on four valid searches.

They may be using proxies, however their certainly NOT do anything devious.