Possible Yahoo bot. No user agent or HTTP_REFERER header

Forum Moderators: open

Message Too Old, No Replies

Possible Yahoo bot. No user agent or HTTP_REFERER header

volatilegx

2:25 pm on Jul 15, 2005 (gmt 0)

IP: 66.94.237.140
Host: proxy1.search.scd.yahoo.net

IP: 66.94.237.141
Host: proxy2.search.scd.yahoo.net

volatilegx

3:08 pm on Jul 15, 2005 (gmt 0)

Here's an update,

I also found the IP 66.94.237.140 (Host: proxy1.search.scd.yahoo.net ) with this user agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4

fiestagirl

4:52 pm on Jul 17, 2005 (gmt 0)

It appears that these IPs are being used by Yahoo for WAP and the toolbar/personal search. I have referrers and UAs from:
66.94.237.140 to 147
toolbar.yahoo.com
wap.oa.yahoo.com
postfavorites (UA)
and multiple generic UAs.

None without any UA or Referrer.

volatilegx

4:47 am on Jul 18, 2005 (gmt 0)

The one I mentioned in message 2 did not have a HTTP_REFERER header.