mhansen - 1:49 pm on Dec 28, 2010 (gmt 0)
What response do you give to those banned IP addresses?
We return a 403.
If googlebot doesn't specifically come from a banned IP, how will it even know it's banned?
I'm not sure on this, but the way I assume many of these are found are through the toolbar.
- Googlebot sees a 100k page, 26 links, 6 images, etc
- Visitor A Toolbar, Sees a 100k page, with 26 links, and 6 images, etc
- Visitor B Toolbar, Sees a 2k page, no images, no links, no content.
Just a guess though...