Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Googlebot visiting after doing a sitelink search

         

studee

11:33 am on Jan 4, 2009 (gmt 0)

10+ Year Member



Hi,

I am using statcounter for real time stats and WMT for detail traffic tracking . lately I am seeing in my statcounter stats that googlebot is visiting my site ( example.com) from this link.

www.google.com/search?hl=en&q=site%3Aexample.com

( doing a site specific search site:example.com )

and its not just that! many time the googlebot comes from USA then just after that in second access (next visit) it comes from Europe again doing a ( site:example.com ) before hitting the home page.

Is this a normal behavior ! May be Googlebot is preparing to give me Sitelinks.

Wishfull !

Any thoughts on this

Dee

tedster

11:04 pm on Jan 4, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I suspect something is wrong with your statcounter. Googlebot does not send a referer when it requests a url from you. You may be seeing a manual visit from a Google employee, but that's not the same as googlebot.

asinah

1:17 am on Jan 5, 2009 (gmt 0)

10+ Year Member



Its other websites that maybe download your content and they may fake the UA.

studee

11:59 am on Jan 5, 2009 (gmt 0)

10+ Year Member



okay i did some research and Search ( with limited knowledge i have ) i found a post on this forum about an ip the bot visiting my site got the same ip as mentioned in this post.

[webmasterworld.com ]

The bot that visit my site have these variables

IP Address 66.249.85.134 [Label IP Address]
Country United States
Region California
City Mountain View
ISP Google
Returning Visits 0
Visit Length 3 hours 9 mins 14 secs

VISITOR SYSTEM SPECS

Browser IE 6.0
Operating System WinXP
Resolution 1024x768
Javascript Enabled

The IP is same as mentioned in the above post i am referring to
66.249.85.134

i don't know if its a threat or whatever it is, the bot just visits the home page ..

i don't know how to further validate the location or origin of the ip as it sure shows its from google.

i wonder if its a googlebot Exclusively for pages with lots of javascript !

Dee

tedster

5:35 pm on Jan 5, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This thread may also help you: How to Verify Googlebot and Avoid Rogue Spiders [webmasterworld.com]

Note that in the thread you linked to, the poster mentions these points:

...it passes no User-Agent string.

Doing a WHOIS says it's registered to Google and lists Google nameservers, but I think those are forged, because running a "host 66.249.85.134" command returns "not found".

That is not googlebot behavior.