Welcome to WebmasterWorld Guest from 54.92.160.119

Forum Moderators: Ocean10000 & keyplyr

CRMNLCrawlAgent

     
7:42 pm on Aug 11, 2018 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:12771
votes: 874


UA: CRMNLCrawlAgent/Nutch-1.15-SNAPSHOT
Protocol: HTTP/1.0
Robots.txt: Yes
Host: sentia.com (vellance.com)
79.99.184.0 - 79.99.191.255
79.99.184.0/21

Canada Montreal Centre De Recherche Informatique De Montreal
crim.ca

Previous UAs:
CRIM Crawler/Nutch-2.3 (Crawler du Centre de Recherche Informatique de Montr\xc3\xa9al (CRIM))
Mozilla/5.0 (compatible; heritrix/3.2.0 +http://www.crim.ca)
12:21 am on Aug 12, 2018 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15173
votes: 679


You gotta admit, CRMNL or CRIM is a pretty droll UA name. Can't call it a linguistic oversight, since it would look exactly the same in French.
4:07 am on Aug 13, 2018 (gmt 0)

Senior Member

WebmasterWorld Senior Member Top Contributors Of The Month

joined:Apr 1, 2016
posts:2178
votes: 579


@Lucy24 was using the word "droll" supposed to be a pun? Drole (with an accent over the o) is French for funny or strange, it's where the English word is derived from.
4:27 am on Aug 13, 2018 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:12771
votes: 874


Back on topic... also seen coming from Canadian ISP

UA: CRMNLCrawlAgent/Nutch-1.15-SNAPSHOT
Protocol: HTTP/1.0
Robots.txt: Yes
Host: rogers.com
142.146.0.0 - 142.146.255.255
142.146.0.0/16
5:24 am on Aug 13, 2018 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15173
votes: 679


it's where the English word is derived from.
Heh, thatís funny, I always assumed we stole it from German. Dictionary says it was originally MDu, of all things. (This is the second consecutive time I've looked something up and found it traced back to Middle Dutch--a language I never formally knew existed, though if you think about it, it obviously had to. Fancy that.)

So, itís a criminal robot that, Nutch-like, reads robots.txt. Huh. And crawls from ordinary public Canadian ISPs?
5:37 am on Aug 13, 2018 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:12771
votes: 874


You're obviously not from Pennsylvania.

It could be a renamed organic Nutch. A lot of them do that. Nutch is free, easy to use and returns clean results. I ran it for a while.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members