New crawler? Only for Adwords?

[shrirch]

I have a new online store, which sells books and dvds. I added most of the titles to google adwords for targetting Hong Kong audiences.

This was done over the weekend. Now look at these crawls that I'm getting. The curious thing is the "Mediapartners". Anyone know about this?

crawler8.googlebot.com - - [19/May/2003:13:19:00 -0600] "GET /advanced_search_result.php?keywords=bob+builder HTTP/1.0" 200 34810 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"

crawler8.googlebot.com - - [19/May/2003:13:16:21 -0600] "GET /advanced_search_result.php?keywords=girlfriend HTTP/1.0" 200 28586 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"

crawler8.googlebot.com - - [19/May/2003:13:05:23 -0600] "GET /advanced_search_result.php?keywords=pregnancy HTTP/1.0" 200 35680 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"

crawler8.googlebot.com - - [19/May/2003:13:17:38 -0600] "GET /advanced_search_result.php?keywords=Blues+Clues HTTP/1.0" 200 30211 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"

These are some of the URLs I've listed in google and NO WHERE ELSE!

[jeremy goodrich]

That is for the Google Syndication (the content targeted ads) which appear on other sites...

the stats are reported seperately in the AdWords interface, and you can 'opt out' of syndicating your ads, as far as I know.

So far, I haven't heard anybody say they get stellar results with those, but of course, your milage may vary.

[shrirch]

Jeremy,

The url's were manually verified by google. I'm just curious as to why they had to crawl them using a different spider.

[jeremy goodrich]

Afaik, they have a system which attempts to match the content of the page -> to the page that the ad showed on.

In case the pages were changed, they might respider with *that system* instead of their regular one, in an attempt to improve the targeting of their new ads.

However, the above is mostly speculation based on fact. :)

[shrirch]

Ok. Would make sense if the spidering allows them to pick up more keywords and theme the page appropriately before adding them to their syndication rotations.