Welcome to WebmasterWorld Guest from 50.16.24.12

Forum Moderators: incrediBILL

Issues with browsers loading same content 100's of times

A crazy browser bug? Problem with chunked delivery? Proxy?

   
7:01 pm on Oct 14, 2009 (gmt 0)

10+ Year Member



For years we've been seeing an anomaly in our logs. A browser will fire up, maybe get a favicon, and hit a URL from our site which downloads a large file.

Then it will do it again, about once a second, for 10... 15... 50... 100... or more times.

The user-agent strings always look reasonable. The IP addresses are often overseas, but nearly as often a random DSL line in the USA.

The referrer is often the same page it is loading, after the first request. The number of bytes downloaded is usually the only difference in each request: most of the requests are less than the original size, though often the entire file will be downloaded first, then subsets of the file are requested later.

As reported by our front end apache proxy:

[code]
84.165.91.nnn #*$!#*$!#*$!x.#*$!x.edu - [12/Oct/2009:07:17:10 -0700]
"GET /cgi/viewcontent.cgi?article=1031&context=usepapapers HTTP/1.1"
200
192175
"http://#*$!#*$!#*$!x.#*$!x.edu/cgi/viewcontent.cgi?article=1031&context=usepapapers"
"Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729)" "-" - - xff="84.165.91.42, 72.5.9.197"

84.165.91.nnn #*$!#*$!#*$!x.#*$!x.edu - [12/Oct/2009:07:17:10 -0700]
"GET /cgi/viewcontent.cgi?article=1031&context=usepapapers HTTP/1.1"
200
80175
"http://#*$!#*$!#*$!x.#*$!x.edu/cgi/viewcontent.cgi?article=1031&context=usepapapers"
"Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729)" "-" - - xff="84.165.91.42, 72.5.9.197"
[code]

Anyone else see stuff like this?

Our server is a mod_perl apache backend, with a apache front end, on Linux.

[edited by: incrediBILL at 7:19 pm (utc) on Oct. 14, 2009]
[edit reason] Obscured IPs [/edit]

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month