Page is a not externally linkable
ergophobe - 7:18 pm on Nov 4, 2012 (gmt 0)
the robots exclusion prevents the noindex from being seen.
Read my comment again. Suggestion was to
- no-index the PDF *index* pages (i.e. the lists of PDFs or whatever s/he has). This is to keep titles/snippets out of the SERPS, but the page can get crawled.
- robots.txt on the PDFs themselves so they don't get crawled at all.