Does anyone know what this crawler is? It did hit robots.txt. I don't know yet if it takes it into account.
209.11.120.** - Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; fr_crawler)
[edited by: volatilegx at 12:25 am (utc) on Dec. 4, 2007]
[edit reason] obfuscated ip address [/edit]