A couple of years ago, Chinese hackers got access to my FTP (I believe it to be the fault of my hosting company). For a few days they uploaded pages to advertise designer clothing. I soon spotted these new pages after a couple of days, notified the hosting company, changed all passwords and removed and deindexed the half a dozen or so new pages they added.
The problem remaining is that my most numerous backlinks (which now just go to a 404 page) and anchor phrases are all spammy clothing ones that have no relation to my website. There's thousands of them, so I do not know what action I can take (if any?) and what effect this might have on my SEO?