Page is a not externally linkable
dgc223 - 3:30 pm on May 9, 2009 (gmt 0)
So we had to implement a robots.txt to block everything. I submitted a removal request as well through Google Webmaster Tools plus Yahoo site explorer. However, I am wondering, is there a way in the Robots.txt file to request that the home page itself (e.g., oursite.com) be indexed, but no other pages? I haven't been able to find how to do this - it seems as though the only option is to remove all pages, but I would think there's a way to let the home page only be indexed. Any suggestions would be appreciated. Hopefully this forum will be useful to others as well. Thank you,
@le_gber - thanks for the tip. We first tried the nofollow and noarchive tags, but these did not appear to prevent Google or Yahoo from indexing no pages, nor did it make Google/Yahoo un-archive the pages.
Daniel