Meta Robots to allow adsense and disallow googlebot

has to be ON PAGE only

[Clark]

I have certain dynamic pages based on a script that delivers lots of duplicate content. I DO NOT want googlebot to index those pages due to duplicate content penalties. So I dynamically inject <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> on those pages. But then I realized that this will probably cause the Mediapartners Adsense bot to not visit the page and therefore invalidate the ads for that page. How do I ALLOW adsense bot and DISALLOW the standard googlebot on a page by page basis using the META tag? I do not want to touch robots.txt. Thank you.

[asinah]

From my experience u can use the following in your robots.txt file

User-agent: Mediapartners-Google*
Disallow:

User-agent: googlebot
Disallow: filename.html

u could of course use a directory and not a filename.

[jdMorgan]

> I do not want to touch robots.txt.

Modify your script to check the HTTP_USER_AGENT variable and write the appropriate meta-robots tage to the page.

You could also do this using server-side includes on a non-script-driven site.

Jim

[Clark]

So there is no meta tag to specify a particular bot? And the above meta code would cause Mediapartners to ignore the page then?

[Jenstar]

<meta name="googlebot" content="noarchive, nofollow">

This will allow all bots (including the AdSense media partners bot) except for the googlebot.

[Clark]

<meta name="googlebot" content="noarchive, nofollow">

So it doesn't matter that the Adsense bot is Called MediaPartners Googlebot?

This will allow all bots (including the AdSense media partners bot) except for the googlebot.

I guess not?

Beautiful. :KISS: Thank you.

[Jenstar]

I *believe* so, but put it on a new page and see if mediabot comes when you execute the javascript. I have never heard of them using the meta for the mediabot though.