Forum Moderators: bakedjake
Wonder what's up? Better, more refined algo? Bigger db? Anybody seen their bot recently?
I haven't seen their bot for a while, but there are only a few spiders on my 'watch' list anymore.
2003-04-09 02:00:49 66.237.60.23 GET/robots.txt-200 Openfind+data+gatherer, +Openbot/3.0+ (robot-response@openfind.com.tw +http://www.openfind.com/robot.html)
grep openfind.com /www/logs/something-access-log Śwc 5 75 951 4 of those 5 are robots.txt request.