Welcome to WebmasterWorld Guest from 23.20.248.132

Forum Moderators: Robert Charlton & andy langton & goodroi

Message Too Old, No Replies

Googlebot following my surfing behavior!?

     
8:35 pm on Sep 1, 2005 (gmt 0)

Full Member

10+ Year Member

joined:Aug 29, 2003
posts:244
votes: 0


Hi Guys,

I was building a stats script for some of my brandnew sites and I noticed something really astonishing ... a googlebot following my surfing behavior! Is this common practice by Google or should I panic? :-> I'm running Firefox as a browser (no plugins installed). I replaced my own IP address with x.x.x.x.

crawl-66-249-65-15.googlebot.com --> /article/12645/NTT.html
x.x.x.x --> /article/12645/NTT.html
crawl-66-249-65-15.googlebot.com --> /browse/n/0.html
crawl-66-249-65-15.googlebot.com --> /browse/n/0.html
x.x.x.x --> /browse/n/0.html
crawl-66-249-65-15.googlebot.com --> /search.html
crawl-66-249-65-15.googlebot.com --> /linkexchange.html
x.x.x.x --> /search.html
crawl-66-249-65-15.googlebot.com --> /linkexchange.html
x.x.x.x --> /linkexchange.html
x.x.x.x --> /

1:10 pm on Sept 2, 2005 (gmt 0)

New User

10+ Year Member

joined:Mar 23, 2005
posts:2
votes: 0


If you run AdSense I think Google will spider the pages once it knows about them. By visiting your pages you may have been telling Google that the pages exist. If you don't run AdSence then I have no idea.
10:08 pm on Sept 2, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 25, 2002
posts:407
votes: 0


The toolbar also tells them about the page if you are running that.
6:54 pm on Sept 3, 2005 (gmt 0)

Full Member

10+ Year Member

joined:Aug 29, 2003
posts:244
votes: 0


It's got to be Adsense ...
7:12 pm on Sept 3, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:May 28, 2004
posts:128
votes: 0


I noticed this as well while tailing my access log, the bot would "follow" my visitors around. Trippy!
1:20 am on Sept 4, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 1, 2004
posts:607
votes: 0


It's got to be Adsense ...

Yup, that's typical MediaBot behavior. To the OP: try modifying your tracking script to show the User Agent; that will give you a definite answer.