rowan194 - 11:38 pm on Aug 14, 2012 (gmt 0)
referrals from google for...
220.127.116.11 -> 4.2%
example.com -> 1.1%
www.example.com -> 94.7%
I'd be happy to lose 5% of my visitors if Gbot stopped banging my site 3 times for every possible page (IP, example.com, www.example.com). I'm having trouble understanding why Google is ranking example.com and the IP, since they are 100% duplicate content.
I think part of the problem is that my site has so many pages that what's in the index is stale. I checked my logs for the first few results of "site:18.104.22.168" and Googlebot last fetched the URLs 6 months (!) ago. Perhaps this is the reason that duplicate content detection isn't working, as the page content generally changes (sometimes drastically) every 3-4 months.
The sheer number of pages on my site causes Gbot to fetch at a decent rate (100,000+ per hostname per day if not manually configured in GWT), which is why doing it in triplicate is even more of an issue.