My site is mostly dynamic pages. I've tried very hard to ensure that Google bot can only access the most critical dynamic pages via one URL. However, because I run Adsense on my site, I allow Mediapartners-Google/2.1 full access to all pages to make sure targeted ads show on all pages when visitors access ones that are denied to Google bot.
The reason for this separation is because the basic data available can be viewed in a number of helpful reports and views that users find valuable. But these multiple views cause duplicate problems for my site with Google. I do not want to only show ads on the pages accesses by Google bot as my analysis of visitor activity shows that most of my ad clicks come from these various views.
My logs show that the bots are accessing the pages as I have indicated (Google bot only accesses limited pages via a single URL and Mediapartners-Google/2.1 accesses all pages on my site). However, I have massive supplemental pages because Google bot has only been restricted for a couple of months, since I've learned of the duplicate page impact on my site.
My question is, 1. Is allowing Mediapartners-Google/2.1 full access to my site exacerbating the duplicate page issue on my site? And
2. If it is does anyone have a suggestion on how to control the duplicate page issue while allowing Mediapartners-Google/2.1 access to provide targeted ads?
I had read that before posting but wasn't sure if they were including the cross-over information between the Metapartners-Google Bot and the normal Google Bot. But reading it again I believe that is what they are trying to convey.