Welcome to WebmasterWorld Guest from 220.127.116.11
I put a site online yesterday, on a brand new domain name and linked it from one site. Around 15 hours later I had a visit from the Mediapartners/Google bot. I read several months ago that this was something to do with AdWords etc but couldn't find any recent information on it. Forgive me if a thread is hiding somewhere deep in the archives.
Anyway, the thing that is confusing me is that this is a brand new domain name and i've never used AdWords/AdSense on this site, nor have I used it on the site that is linking it? The other thing is after it tried to access robots.txt, it didn't go for my index, it went straight for my log file?
18.104.22.168 - - [16/Nov/2003:16:04:35 +0000] "GET /robots.txt HTTP/1.0" 404 277 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"
22.214.171.124 - - [16/Nov/2003:16:04:36 +0000] "GET /logs/usage_200311.html HTTP/1.0" 200 81638 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"
Which is a little strange... What do you guys reckon?
I'm thinking it must be something to do with my toolbar as I accessed the log several hours before... Or does anyone have any more up to date info on this mediapartners bot?
If Mediapartners bot is for the targeting of ads for sites that are AdSense partners, why would google want to wast resources on spidering a site that is not an AdSense parnter?
Other than serving relevant ads in Opera, I'm not sure why they *would* want to - but they most certainly do. This topic has come up over and over here - there are many members that have non-adsense sites that have been visited by the MediaPartners bot.