Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yasni


blend27 - 9:04 pm on Dec 2, 2012 (gmt 0)


Over 1200 scrape attempts from 227 distinct IPs from all over of 94.23.0.0/16 dating back as far as 2009-01-14 18:52:07

Including 1 bumb-*** competitor who tried to scrape product descriptions from an IP that is translated to a hyphenated .com & .net version of our domain registered to an actual B&M Store in Paris. Nailed by DMCA to all SEs.

The sad part is they actually had a pretty good inventory of widgets, quality stuff too.
The fun part is everybody from that range get a generic version of "90% off - Going out Of Business!" message since 2009.

Ha.., just checked that site: Site actuellement indisponible!


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4524284.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com