WiseWebDude
msg:3514772 | 10:08 pm on Nov 27, 2007 (gmt 0) |
Do it just like this: [google.com...]
Allow Adsense bot to get it and block Googlebot User-Agent: *
Disallow: /folder1/ User-Agent: MediaPartners-Google
Allow: /folder1/ |
|
[edited by: encyclo at 2:30 am (utc) on Nov. 28, 2007]
[edit reason] fixed link [/edit]
|
stevelibby
msg:3515140 | 11:03 am on Nov 28, 2007 (gmt 0) |
does this
"
User-Agent: *
Disallow: /folder1/
"
Disallow all bots?
|
ronin
msg:3515160 | 11:31 am on Nov 28, 2007 (gmt 0) |
Yes. The asterisk is a wild-card.
|
mixart
msg:3520403 | 8:51 pm on Dec 4, 2007 (gmt 0) |
Just curious why you would want to block googlebot? Wouldn't you also be blocking google from spidering that page to give you better paying and more relevant ads? or blocking your chances at a page rank which in theory helps your adsense?
|
stevelibby
msg:3520833 | 11:55 am on Dec 5, 2007 (gmt 0) |
i am blocking the dynamic search page with all parameters from gbot for ther minute as i have created static page, but mediabot i am letting through to give best results.
|
|
