Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Microsoft launches Azure, an AWS competitor

Expect more unverifiable bots

     
3:23 am on Jul 15, 2009 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88



With the launch of Azure, Microsoft finds itself in a new type of business, where it competes with the likes of Amazon.com's Amazon Web Services

[news.cnet.com...]

The AWS [webmasterworld.com] service already plays host to a myriad of bad bots distributed randomly over AWS's IPs with no validation scheme [webmasterworld.com].

Many of us just block AWS completely to solve the problem.

A few more cloud computing situations like this and it will cause a serious rift between new technologies and sites blocking overwhelming bot abuse.

Wonder if Azure would be open to providing validation schemes for their clients?

IMO, depending on how it's implemented, Azure could cause some serious trust issues between webmasters and Microsoft.

4:04 am on July 15, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5408
votes: 2


Wonder if Azure would be open to providing validation schemes for their clients?

You mean like MS has been doing at 131.107. since 2003 ;)

4:05 am on July 15, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


Great. More 'bots with dynamic, un-ascribable IP addresses.

On the other hand, I already have 'serious trust issues' with Microsoft, ranging from the malformed MSN user-agent strings, to the "tide" hosts issuing their bogus search referrals, to the various past malfunctions in msnbot's handling of robots.txt and on-page robots metatags, to the lack of rDNS on many requests from their IP blocks... IMO, Bing works amazingly well considering the extreme 'sloppiness' of their infrastructure compared to other search providers.

If Azure's IP blocks are not well-partitioned away from other MS services, I will likely just pull the plug and block the lot of them; Google, Yahoo, and Ask traffic will just have to do -- as before.

Jim

6:22 am on July 15, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


My trust issues with Microsoft have led me to block anything that looks like it's coming from them on all but one of my sites; I need to know what they're up to.

This will likely be one more thing to block. Just like I do with AWS. Unless they manage to implement some form of validation scheme--perhaps like the one Lord Majestic claims to be working on. But I think we all know how likely that is.

Bill, will we be permitted to post the Azure IP ranges as they become known to us so anyone who wants to can add them to their ban lists?

11:23 am on July 15, 2009 (gmt 0)

Junior Member

10+ Year Member

joined:June 25, 2005
posts:179
votes: 1


NetRange: 70.37.0.0 - 70.37.191.255
CIDR: 70.37.0.0/17, 70.37.128.0/18
NetName: MICROSOFT-DYNAMIC-HOSTING
7:10 pm on July 15, 2009 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts: 3092
votes: 2


Thanks for the IP range. Blocked. MS is bad enough at the best of times.

I see the /18 above that is unallocated: watch out for expansion?

9:35 pm on July 15, 2009 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14624
votes: 88


Bill, will we be permitted to post the Azure IP ranges as they become known to us so anyone who wants to can add them to their ban lists?

I think thetrasher beat everyone to it! :)

Not sure that's the range they'll be using but it'll be easy to spot stuff bouncing off my firewall when it starts to happen.

12:59 am on July 16, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


but it'll be easy to spot stuff bouncing off my firewall when it starts to happen.

I really should write a script to track stuff like that and incorporate it into my weekly report. I have no idea what UAs are getting blocked at the door based on IP Address bans.