Forum Moderators: goodroi

Message Too Old, No Replies

Possible to have a page disalowed by robots.txt but indexed by adsense

Possible to do this?

         

brakkar

11:12 am on Nov 5, 2004 (gmt 0)

10+ Year Member



Hi,
I have some pages that I don't want indexed by google search (disalowed in robots.txt) yet, I want adsense on them.

But it is not possible right? As robots txt will prevent adsense? Any workaround?

Thanks,
Brakkar

dmorison

9:16 pm on Nov 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No problem; just add...

User-agent: Mediapartners-Google* 
Disallow:

...to your robots.txt.

On a side issue, I have absolutely no idea why Mediapartners-Google bothers with robots.txt at all. By using the AdSense code on a page you are by definition giving the bot permission to retrieve that page in order to do the job that YOU want it do. robots.txt shouldn't come into it!