grandma_genie - 12:37 am on Jun 9, 2012 (gmt 0)
Leosghost - I know Funwebproducts is spyware, but what I thought was odd was it appearing twice in the ua string.
lucy24 - I got so desperate about ridding myself of the 193s, that I blocked the whole thing: deny from 193 I really only want visits from the US and Canada, so if I block the rest of the world it won't matter - especially China, though they may own us soon.
dstiles - Thanks for the URLs. Will check them out.
Was hoping to be able to recognize suspicious activity by the ua, but lately the scrapers seem to be using perfectly legitimate uas. I had one visitor today spending 45 minutes looking at all my NEW products, 45 pages worth of stuff. I can't believe anyone would do that, unless they are spending time in a federal prison and have nothing better to do. Maybe a teenager in detention.
Here's their ua:
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
This type of activity happens every day. Scrape, scrape, scrape.
I do have a sizable listing of user_agent blocks in htaccess. But I can't block legitimate uas. So what does one do to hinder that type of activity?