Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Don't stop fearing the webreaper
keyplyr - 2:12 am on May 4, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4570216.htm
WebReaper must have been one of the first scraper tools identified in this forum. It's listed many places. Even wannaBrowser uses the UA to test your blocking defenses. My notes say I blocked it about 11 years ago.
Brought to you by WebmasterWorld: http://www.webmasterworld.com