Forum Moderators: open
They crawled quite a large part of my different specialized web directories. Because they were cheating (User-Agent "Mozilla/4.7") and since they grabbed URLs that are explicitly disallowed for crawling (robots.txt) i sent them a warning email.
I warned them about the violation of our TOS / Copyright and asked for their comment. This was 3 days ago - still waiting for a reply. Since they know something about copyrights it's strange that they ignrore our's. No requests for robots.txt at all ...
they have no legit right to suck all your bandwidth, just get rid of them and watch for the next dozen bots that do the same thing
or just install a spider trap which will catch 70% of them automatically for you