MrSavage - 8:23 am on Sep 5, 2011 (gmt 0)
I'm late to this thread. There are plenty people 1000x smarter than me. However, who actually has the audacity to think they can block Google from seeing their site? People just pointed out 2 in this thread. Based on my personal experience, I would assume they know about your site whether you realize it or not. Wouldn't the conclusion of this thread be something like, don't assume that your methods of denying a Google snoop are going to work. You don't know what they know. Safer to assume they know everything. Afterall, they are ultimately out to get the bad guys and if you're blocking them, isn't that a smoke signal? Whaddya got to hide from us? The brains of 100's of Google engineers and employees who are on a crusade to keep the "bad guys" from cashing in is > than webmasters trying to figure out what's behind that concrete wall. False sense of security that's all I'm saying even with my modest intelligence.