YandexMobileBot

[dstiles]

This bot could have been nipping in for a while but I haven't seen it before. Normal Yandex bot identifies with YandexBot.

User-Agent:Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B411 Safari/600.1.4 (compatible; YandexMobileBot/3.0; +http://yandex.com/bots)

[martinibuster]

Oh, this is interesting! I haven't seen all the different Yandex Bots before but this is an actual UA.

The Yandex Robots page [yandex.com] lists it as not obeying Robots.txt.

Its purpose is:

"Defines pages with layout suitable for mobile devices."

[tangor]

Not seen here ... but that might not last very long. :)

(seems like every bot finds me eventually!)

[dstiles]

martinibuster - Hadn't seen that page before, thanks. It's good to see that the bots have identifiable name and not several using a similar UA.

Shame there is no mention of IP ranges. For what it's worth, I allow yandex bots for allowable UAs from the ranges below.

5.45.192.0/18
5.255.192.0/18
37.9.64.0/18
37.140.128.0/18
77.88.0.0/18
84.201.128.0/18
87.250.224.0/19
93.158.128.0/18
95.108.128.0/17
100.43.64.0/19
130.193.32.0/19
141.8.128.0/18
178.154.128.0/17
199.21.96.0/22
199.36.240.0/22
213.180.192.0/19

[martinibuster]

AS numbers are good for identifying ranges.

https://whois.ipip.net/AS13238 [whois.ipip.net]

If I can't find the AS number, I use ipinfo.io to run an IP address search to find the AS number and then I use whois.ipip.net to find all of the associated IP ranges.

[lucy24]

:: quick detour to raw logs, followed by inspection of At Home with the Robots ::

Nope, haven’t set eyes on it within this calendar year; last regular visit was September 2020, after which it stopped fairly abruptly. It asks for supporting files such as css, js and fonts (why, for heaven’s sake?), but not images. In particular it requests piwik.js, which is roboted-out.

fwiw, I don’t remember meeting a robot that was unequivocally a Yandex faker. In years past the main offender was fake Googlebots, now increasingly rare; there are also a good number of fake Baidu robots, for all the good it does them.