Welcome to WebmasterWorld Guest from 23.22.46.195

Forum Moderators: bakedjake

Need Linux-based load balancing for web farms

based on URL

   
8:12 pm on Jul 4, 2013 (gmt 0)

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



Here's the proposed setup:
Server Farm A- 2 or more web servers
Server Farm B- 2 or more web servers
Load Balancer that distributes incoming web traffic to the server farms.

Scenario:
www.example.com/most URLs- forward requests to Server Farm A
www.example.com/special URLs- forward requests to Server Farm B

I'm guessing this would be considered layer 7 load balancing?

Any recommendations?

TIA!
7:06 am on Jul 6, 2013 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month



My apologies if I am telling you what you already know.

No recommendations, but there are quite a few thing that look as though they will work. The ones that are familiar to me are high performance http servers: Lighttpd (I like the config syntax), nginx (most popular choice, and probably highest performance) or even Cherokee (gui config, least active devs) should be able to do it.

I also think Pound should be able to do it too. There are a host of others that may do.
1:34 am on Jul 7, 2013 (gmt 0)

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



I don't see how it would work doing the load balancing at the web server level. At that point, the request is already at the web server (which may be the wrong server for the intended content).

And without a load balancer between the user and the web servers, how are you determining which web server is to be used to process the request in the first place?

Pound looks like it may fit the bill though. It was one I put on my short list to look at in more detail.
10:41 am on Jul 7, 2013 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month



I did not make myself clear. I was suggesting that you use a fast web server as a proxy. Nginx is quite often used this way.

see:

[cherokee-project.com ]
12:22 am on Jul 11, 2013 (gmt 0)

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



It looks like we're going to go with Zen load balancer- pretty easy to setup and do basic configuration.

The documentation is a bit lacking on details for setting up granular rules. But Google came through and I managed to get it setup to do what I wanted it to do with URL-based rules.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month