Sample 52: Sessionless Load Balancing Between 3 Endpoints
- Former user (Deleted)
- Former user (Deleted)
Objective: Demonstrate simple load balancing among a set of endpoints.
Prerequisites
Start Synapse with the following sample configuration:
<definitions xmlns="http://ws.apache.org/ns/synapse"> Â Â Â <sequence name="main" onError="errorHandler"> Â Â Â Â Â Â Â <in> Â Â Â Â Â Â Â Â Â Â Â <send> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <loadbalance> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <address uri="http://localhost:9001/services/LBService1"> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <enableAddressing/> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <suspendDurationOnFailure>60</suspendDurationOnFailure> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </address> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <address uri="http://localhost:9002/services/LBService1"> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <enableAddressing/> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <suspendDurationOnFailure>60</suspendDurationOnFailure> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </address> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <address uri="http://localhost:9003/services/LBService1"> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <enableAddressing/> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â <suspendDurationOnFailure>60</suspendDurationOnFailure> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </address> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </endpoint> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </loadbalance> Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â </endpoint> Â Â Â Â Â Â Â Â Â Â Â </send> Â Â Â Â Â Â Â Â Â Â Â <drop/> Â Â Â Â Â Â Â </in> Â Â Â Â Â Â Â <out> Â Â Â Â Â Â Â Â Â Â Â <!-- Send the messages where they have been sent (i.e. implicit To EPR) --> Â Â Â Â Â Â Â Â Â Â Â <send/> Â Â Â Â Â Â Â </out> Â Â Â </sequence> Â Â Â <sequence name="errorHandler"> Â Â Â Â Â Â Â <makefault response="true"> Â Â Â Â Â Â Â Â Â Â Â <code value="tns:Receiver" xmlns:tns="http://www.w3.org/2003/05/soap-envelope"/> Â Â Â Â Â Â Â Â Â Â Â <reason value="COULDN'T SEND THE MESSAGE TO THE SERVER."/> Â Â Â Â Â Â Â </makefault> Â Â Â Â Â Â Â <send/> Â Â Â </sequence> </definitions>
Deploy the LoadbalanceFailoverService by switching to <Synapse installation directory>/samples/axis2Server/src/LoadbalanceFailoverService directory and running ant.
Start three instances of sample Axis2 server on HTTP ports 9001, 9002 and 9003 and give some unique names to each server.
Example commands to run sample Axis2 servers from the <Synapse installation directory>/samples/axis2Server directory in Linux are listed below:
./axis2server.sh -http 9001 -https 9005 -name MyServer1 ./axis2server.sh -http 9002 -https 9006 -name MyServer2 ./axis2server.sh -http 9003 -https 9007 -name MyServer3
Now we are done with setting up the environment for load balancing. Start the load balance and failover client using the following command:
ant loadbalancefailover -Di=100
This client sends 100 requests to the LoadbalanceFailoverService through Synapse. Synapse will distribute the load among the three endpoints mentioned in the configuration in round-robin manner. LoadbalanceFailoverService appends the name of the server to the response, so that client can determine which server has processed the message. If you examine the console output of the client, you can see that requests are processed by three servers as follows:
[java] Request: 1 ==> Response from server: MyServer1 [java] Request: 2 ==> Response from server: MyServer2 [java] Request: 3 ==> Response from server: MyServer3 [java] Request: 4 ==> Response from server: MyServer1 [java] Request: 5 ==> Response from server: MyServer2 [java] Request: 6 ==> Response from server: MyServer3 [java] Request: 7 ==> Response from server: MyServer1 ...
Now run the client without the -Di=100 parameter to send infinite requests. While running the client, shutdown the server named MyServer1. You can observe that requests are only distributed among MyServer2 and MyServer3 after shutting down MyServer1. Console output before and after shutting down MyServer1 is listed below (MyServer1 was shutdown after request 63):
... [java] Request: 61 ==> Response from server: MyServer1 [java] Request: 62 ==> Response from server: MyServer2 [java] Request: 63 ==> Response from server: MyServer3 [java] Request: 64 ==> Response from server: MyServer2 [java] Request: 65 ==> Response from server: MyServer3 [java] Request: 66 ==> Response from server: MyServer2 [java] Request: 67 ==> Response from server: MyServer3
Now restart MyServer1. You can observe that requests will be again sent to all three servers roughly after 60 seconds. This is because we have specified <suspendDurationOnFailure> as 60 seconds in the configuration. Therefore, load balance endpoint will suspend any failed child endpoint only for 60 seconds after detecting the failure.