Forum Moderators: martinibuster

Message Too Old, No Replies

Someone from google browsing my site for hours

         

breezeman

8:47 pm on May 16, 2005 (gmt 0)

10+ Year Member



Someone who's IP resolved to google INC has been browsing my site for a few hours. It is not a bot I think, the referer was a google search

In the logs I see they are checking out almost every page on my site, so that is strange I think. And about a page every few minutes, so it looks like their reading it for a couple of hours by now.

Perhaps investigating my adsense site, but not for that long I would think.

What do you think?

Jenstar

8:50 pm on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google employees are allowed to surf from their desks, I wouldn't worry about it, unless you are guilty of something ;)

breezeman

8:50 pm on May 16, 2005 (gmt 0)

10+ Year Member



Yeah but just finding it strange to browse one site for so many hours, it's not that interesting ;)

Plus it's an ip from google usa, and my site is in Dutch..

hunderdown

8:56 pm on May 16, 2005 (gmt 0)



Maybe it's a competitor.

fiestagirl

8:56 pm on May 16, 2005 (gmt 0)

10+ Year Member



Could be someone using this:
[webmasterworld.com...]

ClosedGL

9:02 pm on May 16, 2005 (gmt 0)

10+ Year Member



Yeah, Googlebot visits one of my sites a lot too. Actually, he's the only visitor. *Sob*

breezeman

9:20 pm on May 16, 2005 (gmt 0)

10+ Year Member



Could be someone using this:
[webmasterworld.com...]

Yes must be it, read that google web accelerator ips start with 72.14.192. thanks.

What a waste of bandwith to cache 50 pages when only viewing one.

incrediBILL

10:43 pm on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What a waste of bandwith to cache 50 pages when only viewing one.

Welcome to the Wonderful World of Pre-Fetch.

nanotopia

11:24 pm on May 16, 2005 (gmt 0)

10+ Year Member



Your site is probably being spidered by Google, regardless of what your logs say. Seems strange to me that any real person from Google would linger that long.

larryhatch

11:36 pm on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Are they downloading pages only, or pages + images the way a normal viewer would? -Larry

breezeman

11:50 pm on May 16, 2005 (gmt 0)

10+ Year Member



Are they downloading pages only, or pages + images the way a normal viewer would? -Larry

+ images & favicon.ico from mozilla

larryhatch

11:57 pm on May 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Breezeman: If they are downloading pages + images + favicon.ico, it sounds more like a browser,
possibly using prefetch. All the robots I see take either all images, or all .html files.
How about robots.txt? Did that get fetched early on or not?

breezeman

12:07 am on May 17, 2005 (gmt 0)

10+ Year Member



Never got robots.txt at all.
First entry:
72.14.192.52 - - [16/May/2005:21:37:57 +0200] "GET /<snip>.htm HTTP/1.1" 200 2628 "http://www.google.com/search?hl=nl&client=firefox-a&rls=org.mozilla%3Anl-NL%3Aofficial_s&q=[snip>+&btnG=Zoeken&lr=lang_nl" "Mozilla/5.0 (Windows; U; Windows NT 5.1; nl-NL; rv:1.7.7) Gecko/20050414 Firefox/1.0.3"

last entry:

72.14.192.52 - - [16/May/2005:22:46:16 +0200] <snip>

larryhatch

12:38 am on May 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



well, your visitor reads Dutch. My best guess is somebody using prefetch.
&btnG=zoeken is the Dutch Google-Search button.
They won't call for robots.txt of course. -Larry