Forum Moderators: open

Message Too Old, No Replies

mediawords bot

         

keyplyr

8:43 pm on Feb 16, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




UA: mediawords bot (http://cyber.law.harvard.edu)
Protocol: HTTP/1.1
Robots.txt: No
Host: mcquery3.media.mit.edu
Parent: Massachusetts Institute of Technology
18.0.0.0 - 18.129.255.255
18.0.0.0/9, 18.128.0.0/15

lucy24

9:13 pm on Feb 16, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Huh. I knew that Harvard and MIT do some academic exchanges (if you're enrolled in one, you can sometimes take classes at the other) but I didn't know they shared robots too.

keyplyr

9:20 pm on Feb 16, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I don't see them sharing a robot. I just see something that says it's from Harvard using an MIT range, probably just leasing the IP. With all that IP space, MIT surely diversies their income stream.