I have some duplicate content that I don't want Google (to keep) penalizing me for, and I was wondering how to accomplish the following with a robots.txt:
1) Disallow Google totally.
2) Allow Googlebot into index page (and links pages), but disallow to other sub-pages.
Thanks!