Tree, the problem is that those folks also consume server resources. Yeah, you might get a link or two back. So what? Is that worth possibly slowing down your server for the other readers?
I doubt it. But your mileage may vary.
As I said before, ad blockers are a direct threat to the web economy. And, sooner or later, tools will be developed that will disrupt them. It will probably be an arms race, but so what? It's the same thing with the scraper bots and other web nuisances.