On another site it indexed the index page and another one along with a few ancient links. The most important site is not in the db at all.
The robots.txt is valid and I don't think I've done anything to spam, never had any problems. The url are apache re-written and fully indexed by Google. I had blocked indexing (now it's back on) of the /cgi/ bin but I don't think that should matter since the URL were re-written anyway.
any advice, suggestion? I just e-mailed to email@example.com as someone suggested...
This is just a complete guess but you might try using some absolute href's for urls that point deeper into your site. I had had trouble with ink not understainding some relative url's at one time and after I got it past that I got in.