Is this googlebot or mediapartners?

Same IP, different host resolution?

[johnnie]

Hello! In my access log I find the following tw referral strings:

66.249.72.226 - - [25/Jul/2007:21:31:10 +0200] "GET /nieuws/29/marsrovers-trotseren-zware-stofstorm HTTP/1.1" 200 12642 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

and

66.249.72.226 - - [25/Jul/2007:15:16:04 +0200] "GET /nieuws/34/mysterie-van-de-walnoot-opgelost HTTP/1.1" 200 10726 "-" "Mediapartners-Google/2.1"

Their IP addresses are the same, yet one resolves to the adsense spider and the other resolves to googlebot. Are they really separate spiders? I'd be quite happy if they were, since my site has only be live for a couple fo days or so :)

[cgrantski]

The User Agent strings are saying that those really are two different spiders, as long as you trust that Google has put correct information in the User Agent field.

I'm not surprised about the 2 days. I've seen Googlebot appear in logs as early as 20 minutes after a page has been created and published (with no links to it from any other page). As far as I can tell, the Google Toolbar in my browser sends info to Google when I browse to my new page, and apparently Googlebot then visits that URL.

[incrediBILL]

Googlebot and Mediapartners-Google crawl from the same IPs and share the same cache server meaning that if one crawls a page, the other might just use the last copy of that page.

The easiest way to validate it's really a proper Google crawler is with the REVERSE->FORWARD DNS a specified by google.

66.249.72.226 -> crawl-66-249-72-226.googlebot.com -> 66.249.72.226

If the reverse DNS says Googlebot.com, you know it's actually one of those 2 crawlers.