Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Are there ANY legitimate visits from AWS?


1script - 2:41 am on Mar 4, 2013 (gmt 0)


There's absolutely no way I'm allowing proximic access to my server.
Looks like they claim their crawls affect rating of your pages for CPM advertisers, presumably on networks that they then sell info about your site to. If you are not running any third-party ads like AdSense, then that's not really a concern. But if you do, perhaps it warrants additional investigation.

I have to admit though - Proximic was the very first bad UA I ever disallowed server-wide. I also just found out I had them in the Regex for bad UAs not just once but twice - I must have really-really wanted them gone 2 years ago (and of course they just kept pounding all these years). But if there's some use, I'll let them be: at this point Chinese/Russian fake referrer bots, Facebook after-crawls from 40 different IPs within the same second, Twitter URL crawlers, Web application vulnerability probe bots and other types of various illegitimate and borderline activities have deposed Proximic from *the* most prolific questionable bot title, so it sounds like I have other, more clearly devious bots to worry about.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4550485.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com