Welcome to WebmasterWorld Guest from 18.104.22.168
The same IP just got banned again. Have whitelisted once more, but it seems this googlebot is simply not adhering to the robots.txt file
It just doesnt read,
Googler, Jenny Murphy, provides a quick answer:
The +1 Button interacts with robots.txt and other crawler directives in an interesting way. Since +1's can only be applied to public pages, we may visit your page at the time the +1 Button is clicked to verify that it is indeed public. This check ignores crawler directives. This does not, however, impact the behavior of Google web search crawlers and how they interact with your robots.txt file.
[edited by: Robert_Charlton at 4:00 am (utc) on Sep 6, 2011]
[edit reason] Added quote [/edit]