And that is the full UA ...
Robots.txt: no
googlecloud ...
Takes root, css, and some images ...
<tin foil hat, but it ain't>
I have had a large number of "signups" for SemRush, LinkTiger, Hexometer, Atomseo and others THAT I NEVER DID and that makes me wonder why I have become such a popular guy for lihk checkers, speed checkers, validators etc. Wonder where all that "signup stuff" came from? Exploring where the source might be for bandwidth bandits like this I removed the link from my WW profile ... will see if that has an effect. NOT SAYING WW is involved, only that my info here where a batch of SEOs haunt the site might have made me a target.
</tin foil hat, but it ain't>
At any rate, I am now in a DAILY battle with these undesired and never engaged entities banging my site with NO TRAFFIC BENEFIT or visitors.
Odd thing is these folks are so proud of their "products" they send emails saying they are "getting started with your request" and/or complaining when they can't access the site (my deny, of course). The chuckle is this little 775 page hobby site has actually become a honey pot for this new form of SEO robotic abuse in the name of a "helper product". More fun is that it has become a magnet so that I can roll out confirmed deny updates to .htacess to the OTHER commercial properties I manage, many with tens of thousands pages. That saves a boatload of time and bandwidth filtering out noise in search of humans who might actually click a revenue generator.
Hexometer ... even their website is light on what they actually DO ...
</rant off>
YMMV