Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- WebSense Hiding Behind Rotating User Agents


wilderness - 11:55 pm on Jul 7, 2008 (gmt 0)


The following from May with an IP range of a content filter:

208.80.193.zz - - [07/May/2008:00:26:40 -0500] "GET / HTTP/1.1" 200 6774 "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Sky Broadband; FunWebProducts; Sky Broadband; Sky Broadband)"

Thus far during July and on one of my sites, I've the following UA's which include "Sky Brodband":

"Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; Sky Broadband; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506)"

"Mozilla/4.0 (compatible; MSIE 7.0; AOL 9.0; Windows NT 5.1; Sky Broadband; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0)"

"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0)"

"Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; Sky Broadband; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506)"

There were ALL referred by on-topic searches.
Three were from different-RIPE IP ranges (Class A or B) and denied access to my sites.
The shortest UA was an ARIN range and allowed access.

As a result, I may only assume that Sky is not using proxies. At least consistently.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3692641.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com