homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google AdSense
Forum Library, Charter, Moderators: incrediBILL & jatar k & martinibuster

Google AdSense Forum

Mediapartners-Google vs. Googlebot

 12:31 am on Aug 24, 2003 (gmt 0)

If the User-agent Mediapartners-Google crawls the AdSense Publisher's site, does that mean the crawled pages will also be included in Google's search engine index if it wasn't already in? Or is this only the function of Googlebot?



 1:00 am on Aug 24, 2003 (gmt 0)

No, the only function of the Mediapartners-Google bot is to provide targeted ads for AdSense. To be included in the regular Google search engine index, you will need to be indexed by Googlebot.


 3:09 am on Aug 24, 2003 (gmt 0)

the only function of the Mediapartners-Google bot is to provide targeted ads for AdSense.

... or at least thats what Google have lead us to believe.

Its not what I see in practice.


 3:32 am on Aug 24, 2003 (gmt 0)

I remembered some initial posts about the possibility of a crossover when Google initially launched, but I haven't seen any posts on it since.

None of the sites/pages I am running AdSense on seem to be affected in the regular index. But then, maybe I am not checking or noticing what 4eyes is seeing.


 4:06 am on Aug 24, 2003 (gmt 0)

Its not what I see in practice

What do you see?


 10:07 am on Aug 24, 2003 (gmt 0)

I changed a domain name to completely content the other day. Google only had the front page in its index and it was showing contextual based on its *previous* content, however, the site's sub-pages - which google did not have indexed - were correctly contextual, so I'm thinking that Google adsense must be using something of Google's index when it needs to, until it's index/adsense is updated?


 1:35 pm on Aug 24, 2003 (gmt 0)

What do you see?

I see many pages from my sites appearing in Google after only being visited by Mediapartners-Googlebot


 2:24 pm on Aug 24, 2003 (gmt 0)

4eyes - what you see is common. Seems that Google does decide whether to show a site or not but I'm not sure why. I've seen client logs that show the googlebot being there almost daily but even trying to find the url in the index doesn't work. Do you run a site that Google could consider a threat, no matter how small, to their core business? That might explain it. If they can make money from your content then I don't see why they wouldn't index you for adsense. So maybe that's it.


 2:33 pm on Aug 24, 2003 (gmt 0)

Yes its common enough. I have more than enough evidence to support this - multiple sites and thousands of pages. I have no query in my mind as to what is happening - nor am I complaining about it;)


 2:43 pm on Aug 24, 2003 (gmt 0)

Common sense would say that if you've been accepted as an Adsense publisher, you have some quality content.

Then, why would google want to waste bandwidth and spider your sites twice? And by wasting bandwidth, we're talking about the millions of pages which show adsense ads. Just does not make sense to spider twice.


 3:11 pm on Aug 24, 2003 (gmt 0)

Actually, Google *must* spider the adsense sites often or the advertisements will no longer be relevant. Even if you have a static site Google does not know that so they still *must* spider much more often than ever before.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google AdSense
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved