Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Who is Kosmix?


Dijkgraaf - 11:47 pm on Aug 16, 2010 (gmt 0)


Visited my site as well
Fetched robots.txt and the root page.
The IP I have is 38.113.234.180
rDNS crawl0.kosmix.com

Page in the UA describes the bot and claims it obeys robots.txt.
Main page of the site says "The best of social media - filtered and organized by topic"

Seems well behaved so far.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4188052.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com