Forum Moderators: open

Message Too Old, No Replies

Trendsmap Resolver

         

keyplyr

9:20 pm on Mar 30, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




UA: Trendsmap Resolver/0.0.1
Protocol: HTTP/1.1
Robots.txt: No
Host: hetzner.de
138.201.0.0 - 138.201.255.255
138.201.0.0/16

"/0.0.1" = looks like I saw the very first one.

keyplyr

2:54 am on Apr 1, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Also from...
Host: hetzner.de
88.99.0.0 - 88.99.255.255
88.99.0.0/16
94.130.0.0 - 94.130.255.255
94.130.0.0/16
136.243.0.0 - 136.243.255.255
136.243.0.0/16

and...
iiNet, Australia (ISP)
210.84.0.0 - 210.84.63.255
210.84.0.0/17

lucy24

6:33 pm on Jul 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



:: bump for changed UA ::

UA: Mozilla/5.0 (compatible; TrendsmapResolver/0.1)
IP: 88.99.29.abc

robots.txt: no
Range: bytes=0-2097152

To the best of my knowledge, I have met this robot only once in my life--and only noticed it at all because it happened to be the very last entry in one day's logs. Requested one interior page, which strongly suggests they're grabbing links from somewhere else, probably social media. I mention the Range: header because it's slightly unusual. (“Send only the first two megabytes* of content”? Just how big does it think my pages are?)


* That was an eyeball estimate, but calculator tells me it’s exactly 2^21, which I guess is two megs.

keyplyr

7:36 pm on Jul 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have met this robot only once in my life
You must not share links to your pages in Twitter or other SM. This is a SM trends bot. I see it approx 80 times per day.

lucy24

8:32 pm on Jul 19, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You must not share links to your pages in Twitter or other SM.
Me, personally, nope. But sometimes others do, and I see the applicable robots. The specific page it requested was the same Barsetshire page that led to my query about Preview headers in connection with the FB app, a week or two back. So, yeah, it was following-up on social media--but lagging somewhat behind in its trend-following.

keyplyr

6:54 pm on Jul 20, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




136.243.154.*** - - [20/Jul/2018:11:08:56 -0700] "GET / HTTP/1.1" 403 4750 "https://example.com" "Mozilla/5.0 (compatible; TrendsmapResolver/0.1)"
136.243.154.** - - [20/Jul/2018:11:08:56 -0700] "GET / HTTP/1.1" 403 4749 "https://example.com" "Mozilla/5.0 (compatible; TrendsmapResolver/0.1)"
138.201.129.** - - [20/Jul/2018:11:08:57 -0700] "GET / HTTP/1.1" 403 4749 "https://example.com" "Mozilla/5.0 (compatible; TrendsmapResolver/0.1)"
https://example.com = short-urls for Tweets