Forum Moderators: open

Message Too Old, No Replies

Default User Agent

         

keyplyr

2:10 am on Oct 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA: Default User Agent
Protocol: HTTP/1.1
Robots.txt: Yes
Host: AWS
18.128.0.0 - 18.255.255.255
18.128.0.0/9

It got my default 403 page

lucy24

3:21 am on Oct 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Oh.

Gosh.

You meant it literally.

:: insert ROFL emoticon to taste ::

I'm going to keep my eyes peeled. With that level of operator intelligence, you can bet it will also send, letter-for-letter, the script's default headers ... which I mean to study carefully for comparison purposes.

keyplyr

3:46 am on Oct 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Note that Amazon (AWS) is now using the full /9

18.128.0.0 - 18.255.255.255
8.128.0.0/9

* * *

MIT has the first half of the /8, but AWS may eventually take it over as it progressively has with the rest of the block:

Massachusetts Institute of Technology
18.0.0.0 - 18.127.255.255
18.0.0.0/9

lucy24

4:45 am on Oct 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Yikes, missed that. Well, as long as MIT don't give up 128.30-31 where the validators live ...
:: detour to check something ::
Still very unevenly distributed; I see hardly anything below 18.184, except a few familiar robots around 18.130.

Wonder what, if anything, MIT does with their half of 18?
:: more checking ::
18.85.22.abc
mediawords bot (http://cyber.law.harvard.edu)
sporadically in spring-summer of this year. (That answers that: MIT has been renting space to their neighbors at Harvard.) In fact it was posted here [webmasterworld.com] at the time. They were also mildly active in the third quarter of last year, though I don't think anyone noticed that time.

You will be gratified to note that the URL in the above UA string now redirects to
https://cyber.harvard.edu/
but perhaps less gratified to learn that Search at that location does not admit to having heard of “mediawords”. Don't suppose it has anything to do with the Dutch marketing firm of the same name, though.

keyplyr

5:59 am on Oct 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It looks like mcquery3.media.mit.edu vanished. Could have been a project that was shut down.