Welcome to WebmasterWorld Guest from 54.146.191.2

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Googlebot Media Bot Visiting Right After Page is Called

     
1:59 am on May 19, 2005 (gmt 0)

Moderator

WebmasterWorld Administrator 10+ Year Member

joined:July 2, 2000
posts:2454
votes: 0


Just looking through my log files today and I saw for the first time that when someone found my site from google, google media bot hit the page not more than 10 seconds after the first GET from the visitor. This appears new to me or else I didn't notice it before. Is this something new that anyone else has seen, or is this old hat? Idon't know if there is any significance to this, but thought it was interesting.
1:48 pm on May 20, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 23, 2002
posts:1052
votes: 0


There are quite a few ways for Google to find out that a particular page is visited by someone and occasionally this may prompt them to spider that page. It has been well known for many months that if you visit a page using Opera with the Google adbar in it the media bot will often follow in a few minutes. I wonder if the phenomeon that you tell about is basically a result of the same strategy?
2:07 pm on May 20, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 16, 2003
posts:746
votes: 0


I think this happens when you have adsense on the page.

ALso a while back there was a discussion that talked about the toolbar inviting googlebot to visit the page.
[webmasterworld.com...]

2:13 pm on May 20, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 9, 2004
posts:1435
votes: 0


This is an adsense thing.

The mediabot has nothing to do with the main index either, it just tries to understand what a page is about. 10 seconds is quite slow for mediabot, I have tested stuff before and have seen it immediately appear when a new page is asked for.

I wouldn't worry about this, it's natural (unless you don't have adsense on the page!)

There's no need to think how you can exploit this bot either, you can't.