Forum Moderators: martinibuster
I've noticed in my logs that an IP address from Google is hitting this section of my website quite a lot (every few minutes or so). I assume this is mediabot trying to index the pages to serve relevant ads.
Since the bot doesn't log in (duh), it gets a nice "you must log in to access this page" message. Needingless to say that this isn't really helpfull to get relevant ads showing.
Now I was thinking on giving the bot access to the section, using it's IP address. Would this be considdered a good idea?
I assume this would get me more relevant ads, but I'm a little concerned about the security. Is the content indexed by mediabot used in the search engine? I wouldn't like to see the content showing up in google search results, or in google cache.
There are instructions on how to do this here:
[google.com ]