Forum Moderators: open
It really is a decision you must make to decide what is beneficial or detrimental to your own website (s)!
Is the spidering being done by a website that is going to benefit your website (s) with reciprocal links and traffic?
OR
Is it just somebody harvesting your website (s) URl's?
I have Link anything denied as a UA.
It is also known to be a user-agent employed by email Harvesters. See the Project Honeypot site:
[projecthoneypot.org...]
Personally, I have all the SevenTwentyFour IPs banned.