ExtLinksBot

[jonasjacek]

UA: Mozilla/5.0 (compatible; ExtLinksBot/1.5 +https://extlinks.com/Bot.html
Protocol: HTTP/1.1
Robots.txt: Don't know
Host: OVH
NetRange: 142.4.192.0 - 142.4.223.255
CIDR: 142.4.192.0/19

Ate my robots.txt files with a 403. Got blocked for coming from OVH, bot page says it respects robots.txt.

[keyplyr]

Ate my robots.txt files with a 403.

So it *did* request robots.txt. The documentation only says the UA requested robots.txt, not whether or not it followed directives included in robots.txt since different agents interpret these directives differently.

BTW - I allow everyone access to my robots.txt. That's it's purpose IMO.

ExtLinksBot crawls to gather data used in backlinks reports. It doesn't need access to your site to compile your backlink report. It needs access to your site to collect data for other site's reports.

[jonasjacek]

You are right. I should make some adjustments.
Thanks for the hint.