Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
incrediBILL - 12:13 am on May 24, 2010 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4121207.htm
Planet Labs runs lots of different projects.
I block anything that returns RDNS with "planetlab" and have for years.
Brought to you by WebmasterWorld: http://www.webmasterworld.com