We have been in the index for over 6 months and now we have dissapeared. We were at NO. 2 for "search engine promoters" on Monday morning when we checked and we had all our pages indexed. We checked this with host:hiposition.net.
Today we are not in the index and when we tried to submit a page which has the no index, no follow meta tag, AV accepted the submission. In our experience with other banned sites if the test page is allowed the site is banned and if the site is not banned, we would have received the message that the spider could not index the page.
Should you have any luck with AV please let me know, as we have a clients site that has been banned and the only e-mail we have ever had from them other than the really annoying 2 day responce e-mail was telling me "You have been blocked from submitting because you have chosen to use keywords which do not accurately represent your page's content " RUBBISH !!!!
This I know is not correct as the site is for a swimming pool company and all the keywords relate to that. Over the last few months I have sent around 10 e-mails asking them to look agian at this, leaving an average of 7 days between each e-mail.
So remove the robots.txt and see what happens. I'd question quite that complex a robots.txt myself. Especially since it is pretty obvious you are custom feeding spiders. aka: it looks like a doorway page house.