Forum Moderators: open

Message Too Old, No Replies

: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

new UA

         

keyplyr

7:53 pm on Jun 17, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




UA: : Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
- and -
: Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
Protocol: HTTP/1.1
Robots.txt: Yes
Host: spider-178-154-189-202.yandex.com
178.154.189.0 - 178.154.189.255
178.154.189.0/24

Starting UA string with a colon to bypass blocks?

lucy24

11:18 pm on Jun 17, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Starting UA string with a colon to bypass blocks?

Considering that one of my universal blocks is
^\W
that can only be considered counterproductive ;)

Yandex has an absolutely staggering range of IPs.

:: detour to re-check ::

Used by YandexBot within the last 3-4 years:
5.45.192-255
5.255.192-255
37.140.128-191
77.88.0-63
84.201.128-191
87.250.224-255
93.158.128-191
95.108.128-255
100.43.64-95
130.193.32-71 (really)
141.8.128-191
178.154.128-255
199.21.96-99
199.36.240-243

Whew.

I am also left wondering if the numbers "128-191" have some special numerological significance in Russia.

keyplyr

11:35 pm on Jun 17, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Yandex has an absolutely staggering range of IPs
Yeah, they even say (or used to) not to filter by IP. I would have thought that after they got off the ground, they would have used one or two crawl ranges like the other big SEs, but noooooooooo.........