Forum Moderators: open

Message Too Old, No Replies

New junk from Yahoo

         

GaryK

2:32 am on Apr 21, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



First up is Konfabulator which Yahoo bought awhile back. This is the first time I've seen Konfabulator-branded bots crawling from Yahoo IP Addresses.

Mozilla/5.0 (LGE; U; Linux; en-US) Konfabulator/5.2.0
Mozilla/5.0 (Sony; U; Linux; ) Konfabulator/5.1.0
216.145.60.47
quickpawn-lx.corp.yahoo.com
-----
OrgName: Yahoo! Inc.
OrgID: YAHOOI-2
Address: 701 First Avenue
City: Sunnyvale
StateProv: CA
PostalCode: 94089

They both crawled my entire browser project site, something I let all bots do unless they are extremely abusive. It never did read robots.txt though.

Next up is something mobile from Yahoo. What seems odd to me is that while the rDNS is Yahoo, it's crawling from Level 3. Does that makes sense to anyone?

Samsung-SPHA900 AU-MIC-A900/2.0 MMP/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Novarra-Vision/7.3
8.12.144.17
cach2.nov.mobile.re2.yahoo.net
-----
OrgName: Level 3 Communications, Inc.
OrgID: LVLT
Address: 1025 Eldorado Blvd.
City: Broomfield
StateProv: CO
PostalCode: 80021
Country: US

thetrasher

11:45 am on Apr 21, 2009 (gmt 0)

10+ Year Member



OrgName: Yahoo
OrgID: YHOO
NetRange: 8.12.144.0 - 8.12.144.255
CIDR: 8.12.144.0/24

[webmasterworld.com...]

GaryK

3:45 pm on Apr 21, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Please clarify the significance of your comment. Cause in that thread I saw no reference to Level 3, and that's what interested me most about the last mobile bot. Thanks.

wilderness

3:57 pm on Apr 21, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Gary,
The entire Class A (8.) is Level3, although the sub-net is assigned to Yahoo.

BTW, I'm seeing "loads" of Level3 in behind the scenes tracerts.

GaryK

8:44 pm on Apr 21, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Oh, thanks, Don. Now I get it.

jdMorgan

1:29 am on Apr 25, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Novarra vision is a cell-phone data gateway/transcoder, if that helps.

The HTTP request should have a "Via" header showing the proxies/transcoders that it passed through.

Jim

GaryK

1:41 am on Apr 26, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, that helps. Thank you, Jim.