Welcome to WebmasterWorld Guest from 54.160.221.82

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

headers check

     
9:14 pm on Nov 18, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


On a whim (it's been posted many times), I decided to test the lines in this thread [webmasterworld.com] (Apache forum).

Some twelve hours later (course my site is not rumbling with activity) there have been two denies, both AOL users.
One coming from an AOL IP, and the other from a private IP.

Anybody have a clue if something in these lines catches AOL?

I use to have volumes of AOL users amongst the widget folks, these days its rare. Most have switched to mobile.
5:45 am on Nov 19, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5798
votes: 64


To get a definitive answer to your question, you'd probably need to post the 2 headers that were invalid according to the script. Were any of the server variables blank?
10:27 am on Nov 19, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


according to the script


Thanks keyplr.

don't use any doggone scripts.

In any event, I've bigger dragons to sleigh temporarily.

Can I add an exception for UA's? to the header lines?

Don
11:25 am on Nov 19, 2012 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10542
votes: 8


those headers are typically sent by proxy servers and AOL users typically access web pages through proxy servers.
12:19 am on Nov 20, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5798
votes: 64


Don, try removing all instances of:

%{HTTP:XPROXY_CONNECTION}
3:24 am on Nov 20, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12696
votes: 244


those headers are typically sent by proxy servers and AOL users typically access web pages through proxy servers.

Any way to distinguish between proxy users who can't help it and proxies that are up to no good?

I recently had to de-block one fairly loathsome IP because my local county government uses them as a proxy. Personally I wouldn't give a squat-- the government offices that visit my own site tend to be several thousand miles away-- but I have to let them into the art studio's site. They pay its rent. And we share that part of our htaccess.
4:20 am on Nov 20, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


Thanks phran and keyplr.

Don
4:37 am on Nov 20, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5798
votes: 64



I use a mod_rewrite condition/rule to block prox(i|y) in UA and referrer. The AOL traffic doesn't display any of that (only in headers) so the ones that do are using a proxy service by choice, presumably to hide something.
7:43 pm on Nov 20, 2012 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3091
votes: 2


There are some proxy identifiers I've always found bad - I block those. But in any case I log all uses of a proxy and manually flip through them to check for abuse. G and Y feature prominently. :(
12:56 am on Nov 21, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


I've had four valid users coming in on four valid searches.

They may be using proxies, however their certainly NOT do anything devious.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members