Forum Moderators: open

Message Too Old, No Replies

Yahoo (but no bot)

what does it mean?

         

RobBroekhuis

5:21 pm on Oct 26, 2004 (gmt 0)

10+ Year Member



Noticed in my logs today a request for a single page from the middle of my website from a Yahoo IP (resolved to bff104.search.scd.yahoo.com). Useragent was listed as MSIE 6.0. No referral string. Any idea what this means?
Rob

Brett_Tabke

5:17 pm on Nov 9, 2004 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



You were hand checked...

pendanticist

2:24 am on Nov 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



209.131.41.19 - - [10/Nov/2004:17:48:27 -0800] "GET /robots.txt HTTP/1.0" 200 1705 "-" "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)"
209.131.41.19 - - [10/Nov/2004:17:48:27 -0800] "GET /Blahblah.html HTTP/1.0" 200 12310 "-" "Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)"

Would that be the case here, too? As you can see, it requested robots.txt and a single file.

[11/10/04 19:19:59 IP block 209.131.41.19
Trying 209.131.41.19 at ARIN
Trying 209.131.41 at ARIN

OrgName: Yahoo
OrgID: YHOO
Address: 701 First Avenue
City: Sunnyvale
StateProv: CA
PostalCode: 94089
Country: US

NetRange: 209.131.32.0 - 209.131.63.255
CIDR: 209.131.32.0/19
NetName: FC-YAHOO1
NetHandle: NET-209-131-32-0-1
Parent: NET-209-0-0-0-0
NetType: Direct Allocation
NameServer: NS1.YAHOO.COM
NameServer: NS2.YAHOO.COM
NameServer: NS3.YAHOO.COM
NameServer: NS4.YAHOO.COM
NameServer: NS5.YAHOO.COM
Comment:
RegDate: 1999-07-09
Updated: 2004-02-23

OrgTechHandle: NA258-ARIN
OrgTechName: Netblock Admin
OrgTechPhone: +1-408-349-3300
OrgTechEmail: netblockadmin'at'yahoo-inc.com

# ARIN WHOIS database, last updated 2004-11-10 19:10
# Enter? for additional hints on searching ARIN's WHOIS database.

Is the act of requesting robots.txt significant in some way?

<Good thing I checked this IP Number as those that request robots.txt (without a declarative UA) are usually looked upon as potentially dangerous and summarily banned.> :)

PatrickDeese

2:27 am on Nov 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Did you try putting bff104.search.scd.yahoo.com into your browser? It's babelfish, the old AV translation tool.

RobBroekhuis

1:31 pm on Nov 11, 2004 (gmt 0)

10+ Year Member



Thanks! I'd never seen that before. I had some good fun trying to read the translation of my English-language page into Dutch (my other language).
Rob

pendanticist

9:50 pm on Nov 22, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Anyone?