Welcome to WebmasterWorld Guest from 50.19.190.144

Forum Moderators: incrediBILL & martinibuster

Message Too Old, No Replies

Block Googlebot, allow AdSense?

     
7:49 pm on Nov 27, 2007 (gmt 0)

Preferred Member from GB 

10+ Year Member

joined:Jan 26, 2004
posts:636
votes: 0


i have blocked a page in my robots.txt site where i have lots of parameters, yet i have adsense on it, will i still get paid for the click and how can i let google media(adsense)crawl lets say
page.asp
and stop googlebot?
10:08 pm on Nov 27, 2007 (gmt 0)

Preferred Member

5+ Year Member

joined:June 8, 2006
posts:556
votes: 0


Do it just like this:

[google.com...]
Allow Adsense bot to get it and block Googlebot

User-Agent: *
Disallow: /folder1/

User-Agent: MediaPartners-Google
Allow: /folder1/

[edited by: encyclo at 2:30 am (utc) on Nov. 28, 2007]
[edit reason] fixed link [/edit]

11:03 am on Nov 28, 2007 (gmt 0)

Preferred Member from GB 

10+ Year Member

joined:Jan 26, 2004
posts:636
votes: 0


does this
"
User-Agent: *
Disallow: /folder1/
"
Disallow all bots?
11:31 am on Nov 28, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 9, 2003
posts:2072
votes: 2


Yes. The asterisk is a wild-card.
8:51 pm on Dec 4, 2007 (gmt 0)

Junior Member

5+ Year Member

joined:Aug 6, 2007
posts:78
votes: 0


Just curious why you would want to block googlebot? Wouldn't you also be blocking google from spidering that page to give you better paying and more relevant ads? or blocking your chances at a page rank which in theory helps your adsense?
11:55 am on Dec 5, 2007 (gmt 0)

Preferred Member from GB 

10+ Year Member

joined:Jan 26, 2004
posts:636
votes: 0


i am blocking the dynamic search page with all parameters from gbot for ther minute as i have created static page, but mediabot i am letting through to give best results.