Welcome to WebmasterWorld Guest from 54.159.19.75

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

On Dasher?

     
12:51 am on Dec 12, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Feb 20, 2008
posts:94
votes: 0


I'm periodically hit by bots with a UA of '-',
probably trying to make you not notice as next to referring page which could be a '-'.

However this last one originates from yahoo range.

68.180.211.xx

OrgName: Yahoo! Inc.
OrgID: YHOO
Address: 701 First Ave
City: Sunnyvale
StateProv: CA
PostalCode: 94089
Country: US

NetRange: 68.180.128.0 - 68.180.255.255

Any idea why they are doing this?

9:01 pm on Dec 12, 2009 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts: 3091
votes: 2


68.180.211.nnn is not a yahoo bot range - at least, not slurp. As with most larger engines, a lot of their IP range has nothing directly to do with crawling.

If you do an rDNS lookup on the actual IP it should show you what it really is for. That particular C-net range comprises betas, shops, video search (which may be some kind of bot but not identified as such) but is mostly answers and mobile. Again, these may be some kind of bot but if so they're not being honest about it.

I get a lot of yahoo accesses with absolutely no headers but rDNS returns of things like ycar1.mobile.ch1.yahoo.com. Since they have no UA or other headers they get blocked.

12:10 am on Dec 13, 2009 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5805
votes: 64


I allow blank referrers from the mobile Yahoo ranges which include the IP in OP. A rapidly increasing share of my traffic comes from mobile search including Yahoo.
3:10 am on Dec 14, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Feb 20, 2008
posts:94
votes: 0


Thanks! I see '-' from alot of other addresses but not from yahoo range.