Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & andy langton & goodroi

Message Too Old, No Replies

AdSense spider providing content for Google SERPs

Matt Cutts apparently confirms the bot now performs this dual role.

11:54 pm on Apr 19, 2006 (gmt 0)

Full Member

10+ Year Member

joined:Apr 12, 2006
votes: 0

Shoemoney reports in his blog that Matt Cutts has just verified that the AdSense mediabot is performing spidering of content which will also be added into the search results pages.

As you all may know, the AdSense bot will spider a page which has Google Ads on it, so that they can figure out what keyword-targeted ads should be displayed on the page.

Now, this bot will also supply the spidered content over into Google's web content indices, allowing the page's link to appear in the SERPs. Google apparently did this to improve their overall efficiency, so they wouldn't need to spider pages twice.

I think this potentially also creates a new page URL submission method -- add AdSense ads onto your page, and it might get spidered sooner than otherwise.

[edited by: tedster at 6:33 am (utc) on April 20, 2006]