Forum Moderators: open
And then came Nutch:
BobCrawl/Nutch-0.9+(Test/Development+crawler;+http://notavalable.com;+notavailable@notavailable.com)
I love the notavailable.com domain name! I wonder if the band who owns the legit version of that domain name is aware of how it's being abused?