Welcome to WebmasterWorld Guest from 3.80.4.76

Forum Moderators: martinibuster

Question about mediapartners-google (bot) and brand safety

     
8:14 am on Aug 30, 2019 (gmt 0)

New User

joined:Aug 30, 2019
posts:30
votes: 6


Hello everybody-

I have a recurring issue with my sites, since approximately 1 year and a half, my adsense coverage went from nearly 90% to bellow 50% . While researching about this, I came up to the conclusion that it might be due to Adsense's brand safety protection, which, from my understanding, requires to verify the nature of the content of a page, before ads can be served on this page.

So I would like to ask:

- does it mean that, until a page is fetched by the mediapartners-google bot, no adsense ads will be served?

- is it the first visit of the page, which triggers a visit from this bot? Or does the bot browse the site on its own like Googlebot too?

- after a while, doesn't Adsense deliver a "white card" to a site? Like for example, after visiting xxxx pages, without encountering "bad" content, it whitelists the whole site?

Thank you for your enlightenment,
8:39 am on Sept 1, 2019 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:10334
votes: 1061


@JorgeV ... Welcome to Webmasterworld!

Sadly I don't have any answers as I have nothing on my sites that intice the mediapartners-g to visit. Perhaps others will have more information to share.
12:38 pm on Sept 1, 2019 (gmt 0)

Administrator from US 

WebmasterWorld Administrator not2easy is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Dec 27, 2006
posts:4470
votes: 332


If you have created and uploaded an "ads.txt" file, the mediapartners-google bot should be able to sort your account. If you have not visited your AdSense account for awhile you can see right away in your account interface whether your sites are ready.
9:51 am on Sept 2, 2019 (gmt 0)

New User

joined:Aug 30, 2019
posts:30
votes: 6


Hello-

Thank you for your comments. It's not a problem of access, or allowance. I do have the ads.txt file, and all is fine. It's just that, I have a very old site, running since 1993, and over the time, it reached millions of pages, and on pages which are not frequently visited, the first visit , since a while, is not showing ads, then some minutes later, ads are available, after the adsense bot's hit.
10:09 pm on Sept 3, 2019 (gmt 0)

Senior Member

WebmasterWorld Senior Member Top Contributors Of The Month

joined:Apr 1, 2016
posts:2693
votes: 816


Here are some answers to your questions, based on the information I had when dealing with this issue in early 2018:
- does it mean that, until a page is fetched by the mediapartners-google bot, no adsense ads will be served?

Basically yes. If mediapartners-bot has not indexed the page no ad will be displayed. It is important to know that the Adsense index has a TTL(Time-To-Live) of about two weeks, so if a page is crawled and then not revisited within two weeks the ads may not show again.

- is it the first visit of the page, which triggers a visit from this bot? Or does the bot browse the site on its own like Googlebot too?

Each time a an ad-request is made from a page AdSense checks it's index for the page, if the page is not found then mediapartners-bot is sent to retrieve the page, the bot may also retrieve the page at other times, but this is the main mechanism.

- after a while, doesn't Adsense deliver a "white card" to a site? Like for example, after visiting xxxx pages, without encountering "bad" content, it whitelists the whole site?

There does seem to be some sort of a white-list but I don't think it is time dependent and I'm not sure how to get on it.

Now the bad news... I doubt that any of this is relevant anymore. Adsense has announced some significant changes in the last few weeks. Specifically on how they handle ad-serving and policy violations. Basically they will limit serving ads on pages that do not meet their requirements, while allowing some advertisers to opt in to showing ads on these questionable pages. This new policy completely changes how "Brand Safety" is handled. This change has gotten little traction here at WW (likely due to the labor-day long-weekend), here is the link to a thread discussing it and providing more details:
[webmasterworld.com...]

Basically, this may help you. If your site was "black-listed" on the domain level, then this change should allow ads to be served on the "ok" pages. But as with all changes only time will tell.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members