Forum Moderators: open

Message Too Old, No Replies

Googlebot with Referer

         

dstiles

7:11 pm on Apr 4, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just noticed an odd googlebot hit:

IP: 66.249.71.nn
UA: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Referer: (Brazilian forumnow)
Target: example.JPG (which it failed to find because of an extra :80 in the URL)

The image has actually been linked to from the source site, probably illegally.

Anyone else noticed a referer going back to the source site? Can't say I recall a referer on any googlebot hit.

Note: this is googlebot not googlemedia.

incrediBILL

7:14 pm on Apr 4, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've seen lots of googlebot referrers recently, didn't think much about it really, but it is nice to know where some links originate.

dstiles

8:04 pm on Apr 4, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It does imply that google is following external links from other sites - which we sort of knew but I'm surprised they are Referer'ing it.

incrediBILL

9:46 pm on Apr 4, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It could help track down bogus links that cause crawl errors if you know where they originate from, plus Google's WMTs is showing the source of bad links, so maybe it's related.

dstiles

10:11 pm on Apr 5, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Good points, Bill. Thanks.