JUST FYI
One note on that OVH range above: 217.182.0.0/16
I had 2 hits from the same IP from that range. One with
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +https://www.ubtsupport.com/legal/Streamline3Bot.php) Streamline3Bot/1.0
and about 3 minutes later with:
M
That is it, just
M.
I took a look at some other things and it looks like it was a valid request from Streamline3Bot. RDNS pointed to crawler.classify.ubtsupport.com.
UBT provides a classification service for public websites based on their content. To classify your website, we use the Streamline3Bot to crawl the web on a daily basis.
Seems like a classification service/site-content filtering for Home and Businesses.
The bot info could be found at URL in UA. The IP listed on that page is the same IP that accessed(well, they tried ;)) on of my sites. and
NO they did not for
robots.txt