homepage Welcome to WebmasterWorld Guest from 54.167.182.201
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google AdSense
Forum Library, Charter, Moderators: incrediBILL & jatar k & martinibuster

Google AdSense Forum

    
Block Googlebot, allow AdSense?
stevelibby

10+ Year Member



 
Msg#: 3514677 posted 7:49 pm on Nov 27, 2007 (gmt 0)

i have blocked a page in my robots.txt site where i have lots of parameters, yet i have adsense on it, will i still get paid for the click and how can i let google media(adsense)crawl lets say
page.asp
and stop googlebot?

 

WiseWebDude

5+ Year Member



 
Msg#: 3514677 posted 10:08 pm on Nov 27, 2007 (gmt 0)

Do it just like this:

[google.com...]
Allow Adsense bot to get it and block Googlebot

User-Agent: *
Disallow: /folder1/

User-Agent: MediaPartners-Google
Allow: /folder1/

[edited by: encyclo at 2:30 am (utc) on Nov. 28, 2007]
[edit reason] fixed link [/edit]

stevelibby

10+ Year Member



 
Msg#: 3514677 posted 11:03 am on Nov 28, 2007 (gmt 0)

does this
"
User-Agent: *
Disallow: /folder1/
"
Disallow all bots?

ronin

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3514677 posted 11:31 am on Nov 28, 2007 (gmt 0)

Yes. The asterisk is a wild-card.

mixart

5+ Year Member



 
Msg#: 3514677 posted 8:51 pm on Dec 4, 2007 (gmt 0)

Just curious why you would want to block googlebot? Wouldn't you also be blocking google from spidering that page to give you better paying and more relevant ads? or blocking your chances at a page rank which in theory helps your adsense?

stevelibby

10+ Year Member



 
Msg#: 3514677 posted 11:55 am on Dec 5, 2007 (gmt 0)

i am blocking the dynamic search page with all parameters from gbot for ther minute as i have created static page, but mediabot i am letting through to give best results.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google AdSense
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved