Found this in my logs, obviously something to do with DMOZ but I can't find any info on it anywhere.
Anyone know specifically?
fiestagirl
4:10 pm on May 26, 2005 (gmt 0)
I believe that it is a crawler provided by UC Riverside called Infomine. [infomine.ucr.edu...]
kentuckyslone
2:35 am on May 27, 2005 (gmt 0)
You are fortunate to be getting "hits" from DMOZ that is the Open Directory Project
David
Dijkgraaf
5:20 am on May 31, 2005 (gmt 0)
Agent=DataFountains/DMOZ Downloader? It has visited one page on my web site twice, 9 days between visits. The second time it didn't request robots.txt though, I will monitor to see if it comes back and what it does next time. Yes, IP address belongs to ucr.edu (University of California, Riverside).