homepage Welcome to WebmasterWorld Guest from 54.211.34.105
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
google and favicon
strange google behavior
dupres01



 
Msg#: 4483884 posted 5:20 pm on Aug 11, 2012 (gmt 0)

why would i get something like this:

74.125.181.19 - - [11/Aug/2012:09:37:09 -0600] "GET /favicon.ico HTTP/1.1" 200 766 "-" "-"
74.125.18.147 - - [11/Aug/2012:09:37:11 -0600] "GET /favicon.ico HTTP/1.1" 200 766 "-" "-"
74.125.44.85 - - [11/Aug/2012:09:37:17 -0600] "GET /favicon.ico HTTP/1.1" 200 766 "-" "-"
74.125.19.229 - - [11/Aug/2012:09:37:18 -0600] "GET /favicon.ico HTTP/1.1" 200 766 "-" "-"

supposedly from google, each request from a slightly different ip, each a few seconds apart, with no UA, and no other google requests within many minutes?

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4483884 posted 7:47 pm on Aug 11, 2012 (gmt 0)

Who knows the logic of google.

FWIW, unless you utilize the GWT or Adsense, you may virtually deny all the g ranges with the exception of the 66.249.64-95 and it would not harm your sites in the least.

There are some mobile devices that are using the many Google tool ranges as well, that you'd be denying as well.

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4483884 posted 8:01 pm on Aug 11, 2012 (gmt 0)


There are some mobile devices that are using the many Google tool ranges as well, that you'd be denying as well.


Not quite IMO. App developers may use Google IPs when working on their apps, but once they're completed, released to the public & installed on a mobile device, the hits to your server will come from the mobile user's ISP.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4483884 posted 11:42 pm on Aug 11, 2012 (gmt 0)

Do you use GWT? That's one of the places you'll see your favicon. By convention the faviconbot is sent out with no clothes on. I have to say this is pretty dimwitted on google's part, because they have to know that blocking visitors without a UA is one of the first things people do when they start putting up barriers around their site. On mine I've got a FilesMatch exception for the favicon to help flag humans who got locked out by mistake; the faviconbot is an unplanned beneficiary.

dupres01



 
Msg#: 4483884 posted 3:48 am on Aug 12, 2012 (gmt 0)

No I don't use GWT (at least not that I am aware of).

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4483884 posted 7:28 pm on Aug 12, 2012 (gmt 0)

Trying to load favicon from a site's root is unreliable anyway. One of the faults of browsers such as FF.

Without looking in a page header it's not possible to be sure. I generate a LOT of rejections on my server to FF and similar, since my favicons are not in the root; a left-over from favicon scrapers prevalent a few years ago and still, in some cases, an annoyance.

As to 74.125.0.0/16 - I block the whole boiling!

thetrasher

5+ Year Member



 
Msg#: 4483884 posted 11:40 am on Aug 13, 2012 (gmt 0)

74.125.18.21 - - [**/Mar/2012:**:**:** +0200] "GET /favicon.ico HTTP/1.1" 200 - "-" "-"

GET /favicon.ico HTTP/1.1
Accept-Encoding: gzip
Host: www.example.com
X-Forwarded-For: 213.209.119.***

213.209.119.*** didn't visit any page.



Maybe there's a connection to Google's Web Preview?

74.125.17.224 - - [31/Jul/2012:13:13:51 +0200] "GET / HTTP/1.1" 403 - "http://www.google.com/search" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/536.8 (KHTML, like Gecko; Google Web Preview) Chrome/19.0.1084.36 Safari/536.8"
74.125.18.163 - - [31/Jul/2012:13:16:27 +0200] "GET /favicon.ico HTTP/1.1" 200 - "-" "-"
74.125.18.160 - - [31/Jul/2012:14:15:40 +0200] "GET /favicon.ico HTTP/1.1" 200 - "-" "-"

GET / HTTP/1.1
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Encoding: gzip,deflate
Host: www.example.com
Referer: [google.com...]
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/536.8 (KHTML, like Gecko; Google Web Preview) Chrome/19.0.1084.36 Safari/536.8
X-Forwarded-For: 79.204.***.***

GET /favicon.ico HTTP/1.1
Accept-Encoding: gzip
Host: example.com
X-Forwarded-For: 79.204.***.***

GET /favicon.ico HTTP/1.1
Accept-Encoding: gzip
Host: www.example.com
X-Forwarded-For: 79.204.***.***

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved