Page is a not externally linkable
draftzero - 1:10 am on Sep 6, 2011 (gmt 0)
[edited by: Robert_Charlton at 4:00 am (utc) on Sep 6, 2011]
If the page has Google Plus button on it, the bot will not follow the robots.txt directive: [seroundtable.com...]
Mod's note: adding quote for context
Googler, Jenny Murphy, provides a quick answer:
The +1 Button interacts with robots.txt and other crawler directives in an interesting way. Since +1's can only be applied to public pages, we may visit your page at the time the +1 Button is clicked to verify that it is indeed public. This check ignores crawler directives. This does not, however, impact the behavior of Google web search crawlers and how they interact with your robots.txt file.
[edit reason] Added quote [/edit]