Welcome to WebmasterWorld Guest from 54.242.72.36

Forum Moderators: goodroi

Message Too Old, No Replies

Possible to have a page disalowed by robots.txt but indexed by adsense

Possible to do this?

     

brakkar

11:12 am on Nov 5, 2004 (gmt 0)

10+ Year Member



Hi,
I have some pages that I don't want indexed by google search (disalowed in robots.txt) yet, I want adsense on them.

But it is not possible right? As robots txt will prevent adsense? Any workaround?

Thanks,
Brakkar

dmorison

9:16 pm on Nov 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No problem; just add...

User-agent: Mediapartners-Google* 
Disallow:

...to your robots.txt.

On a side issue, I have absolutely no idea why Mediapartners-Google bothers with robots.txt at all. By using the AdSense code on a page you are by definition giving the bot permission to retrieve that page in order to do the job that YOU want it do. robots.txt shouldn't come into it!

 

Featured Threads

Hot Threads This Week

Hot Threads This Month