Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- WebSense Hiding Behind Rotating User Agents


thetrasher - 11:58 am on Jul 8, 2008 (gmt 0)


My very small site gets a visit from an ip either the same as or very close to static-208-80-193-**.as13448.com perhaps 10 times a day

I see 208.80.193/24 coming to my homepage with different fake UAs, too. Since 2007-12-01 with rising frequency, now once day. I don't know why Websense is interested in my root page and why they (try to) pretend to use infected browsers.

deny from 208.80.192.0/21

"Websense Stealth Crawler Bypassing Security?"


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3692641.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com