Forum Moderators: martinibuster

Message Too Old, No Replies

AdSense on private sections

Should I allow mediabot?

         

Cakkie

3:30 pm on Apr 13, 2006 (gmt 0)

10+ Year Member



On my site, there's a members-only section that contains a reasonable amount of content.

I've noticed in my logs that an IP address from Google is hitting this section of my website quite a lot (every few minutes or so). I assume this is mediabot trying to index the pages to serve relevant ads.

Since the bot doesn't log in (duh), it gets a nice "you must log in to access this page" message. Needingless to say that this isn't really helpfull to get relevant ads showing.

Now I was thinking on giving the bot access to the section, using it's IP address. Would this be considdered a good idea?

I assume this would get me more relevant ads, but I'm a little concerned about the security. Is the content indexed by mediabot used in the search engine? I wouldn't like to see the content showing up in google search results, or in google cache.

jomaxx

3:54 pm on Apr 13, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



AFAIK you have to grant the Mediapartners bot access to any pages you intend to show ads on. I'd recommend making sure each page in the members section contains a META NOINDEX tag, and also using your robots.txt file to exclude other spiders from trying to go there.

There are instructions on how to do this here:
[google.com ]