Forum Moderators: DixonJones

Message Too Old, No Replies

Enterprise Crawler 6 used by CNR - ITD Sez

Not what you might be used to seeing...

         

pendanticist

9:02 pm on Nov 26, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



While there are bunches of Fast Crawler type threads that can be dug up around here, I think this one must have been licensed? I know it is certainly new.

194.119.209.95 - - [26/Nov/2004:06:19:37 -0800] "GET /robots.txt HTTP/1.1" 200 1705 "-" "FAST Enterprise Crawler 6 used by CNR - ITD Sez. palermo (searchgroup'at'itd.cnr.it)"

[itd.cnr.it...] entitled "ITD :: The Institute for Educational Technology :: CNR"

The Istituto per le Tecnologie Didattiche (ITD) is one of the research institutes of the Italian National Research Council. The institute is devoted to the study of educational innovation brought about through the use of Information and Communication Technologies (ICT). The research undertaken focuses on:

  • the integration of ICT in various educational settings (school, university, business);
  • issues related to different disciplines and themes (humanities, sciences, environmental education, etc.)
  • learning issues of particular social significance (disability, learning difficulties, social disadvantage, intercultural issues, etc.)
  • the study of technological innovation as a learning resource.

    The main areas of reference for the Institute's research work are the cognitive sciences, computer science and the pedagogy of the various disciplines.

  • The bot continued after reading robots.txt and scarfed ten files simultaneously! Bummer. They need to slow that puppy down some....

    On a good note, it did NOT harvest my entire site.

    11/26/04 14:03:50 IP block 194.119.209.95
    Trying 194.119.209.95 at ARIN
    Trying 194.119.209 at ARIN

    OrgName: RIPE Network Coordination Centre
    OrgID: RIPE
    Address: Singel 258
    Address: 1016 AB
    City: Amsterdam
    StateProv:
    PostalCode:
    Country: NL

    ReferralServer: whois://whois.ripe.net:43

    NetRange: 194.0.0.0 - 194.255.255.255
    CIDR: 194.0.0.0/8
    NetName: RIPE-CBLK2
    NetHandle: NET-194-0-0-0-1
    Parent:
    NetType: Allocated to RIPE NCC
    NameServer: NS-PRI.RIPE.NET
    NameServer: NS2.NIC.FR
    NameServer: SUNIC.SUNET.SE
    NameServer: AUTH03.NS.UU.NET
    NameServer: SEC1.APNIC.NET
    NameServer: SEC3.APNIC.NET
    NameServer: TINNIE.ARIN.NET
    Comment: These addresses have been further assigned to users in
    Comment: the RIPE NCC region. Contact information can be found in
    Comment: the RIPE database at [ripe.net...]
    RegDate: 1993-07-21
    Updated: 2004-03-16

    # ARIN WHOIS database, last updated 2004-11-25 19:10
    # Enter? for additional hints on searching ARIN's WHOIS database.

    Looks like it is time to ban by IP Number until I hear back from them.

    How many of these FAST bots are there?

    Are they all good, bad or otherwise?

    pendanticist

    8:58 pm on Dec 18, 2004 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    ...