- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- amazonaws.com plays host to wide variety of bad bots
Samizdata - 7:19 pm on Mar 9, 2009 (gmt 0)
|Are there any legitimate services using Amazon/EC2 |
Worthwhile for webmasters, almost certainly not.
I block the whole lot and lose no sleep.
Thread source: http://www.webmasterworld.com/search_engine_spiders/3828718.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com