Forum Moderators: open

Message Too Old, No Replies

fr crawler

         

zerillos

2:02 pm on Dec 2, 2007 (gmt 0)

10+ Year Member Top Contributors Of The Month



Does anyone know what this crawler is? It did hit robots.txt. I don't know yet if it takes it into account.

209.11.120.** - Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; fr_crawler)

[edited by: volatilegx at 12:25 am (utc) on Dec. 4, 2007]
[edit reason] obfuscated ip address [/edit]

wilderness

2:37 am on Dec 4, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just a data center that sells to other providers.

Have some of their colo's denied as far back as 2002.