homepage Welcome to WebmasterWorld Guest from 54.237.99.131
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google AdSense
Forum Library, Charter, Moderators: incrediBILL & jatar k & martinibuster

Google AdSense Forum

    
Mediapartners-Google Bot and Duplicate Pages
Does Mediapartners-Google/2.1 bot cause duplicate page in Google?
sjwinslow

5+ Year Member



 
Msg#: 3065803 posted 1:59 pm on Aug 30, 2006 (gmt 0)

My site is mostly dynamic pages. I've tried very hard to ensure that Google bot can only access the most critical dynamic pages via one URL. However, because I run Adsense on my site, I allow Mediapartners-Google/2.1 full access to all pages to make sure targeted ads show on all pages when visitors access ones that are denied to Google bot.

The reason for this separation is because the basic data available can be viewed in a number of helpful reports and views that users find valuable. But these multiple views cause duplicate problems for my site with Google. I do not want to only show ads on the pages accesses by Google bot as my analysis of visitor activity shows that most of my ad clicks come from these various views.

My logs show that the bots are accessing the pages as I have indicated (Google bot only accesses limited pages via a single URL and Mediapartners-Google/2.1 accesses all pages on my site). However, I have massive supplemental pages because Google bot has only been restricted for a couple of months, since I've learned of the duplicate page impact on my site.

My question is,
1. Is allowing Mediapartners-Google/2.1 full access to my site exacerbating the duplicate page issue on my site? And

2. If it is does anyone have a suggestion on how to control the duplicate page issue while allowing Mediapartners-Google/2.1 access to provide targeted ads?

Thanks in advance for you help.

 

rbacal



 
Msg#: 3065803 posted 2:38 pm on Aug 30, 2006 (gmt 0)

The two bots share cache, so I suppose it's possible. Interesting question though.

frox

5+ Year Member



 
Msg#: 3065803 posted 3:33 pm on Aug 30, 2006 (gmt 0)

Yes, scince few months googlebot and mediapartners rely on each other for spidering...

Anyway, read here:

[sitemaps.blogspot.com...]

for a robots.txt based solution

sjwinslow

5+ Year Member



 
Msg#: 3065803 posted 6:13 pm on Aug 30, 2006 (gmt 0)

Thanks Frox,

I had read that before posting but wasn't sure if they were including the cross-over information between the Metapartners-Google Bot and the normal Google Bot. But reading it again I believe that is what they are trying to convey.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google AdSense
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved