Forum Moderators: open
We know firefox will give a header "X-Moz: prefetch" when it perform prefetch, will IE (IE7) do the same thing?
Btw, for this header, do you think it's a fake by spider (because it claw my spidertrap page from different IPs.
Connection: Close
Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-shockwave-flash, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */*
Accept-Language: en-us
Host: www.example.net
User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
UA-CPU: x86
X-Rewrite-URL: /url.htm
[edited by: tedster at 2:25 am (utc) on Mar. 9, 2008]
[edit reason] switch to example.net - it can never be owned [/edit]
However, there are many applications and add-ons that piggyback on IE. For instance, various ISPs offer their users some kind of "web accelerator" software that might prefetch various links on a page that is already loaded.
That is an interesting snippet you posted - it's only looking for media files of various kinds, not text/html!
Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-ms-application, application/vnd.ms-xpsdocument, application/xaml+xml, application/x-ms-xbap, application/x-shockwave-flash, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-silverlight, */*
I don't think IE7 puts "text/html" in the Accept header.
The weird header that I don't understand in the original message is:
X-Rewrite-URL: /url.htm
I have only seen this header coming from servers, and not in the GET from a client. This is the weird one that makes me think it might not be a browser sending this request.