Auto-Scaling in Load Balancer
The WSO2 Elastic Load Balancer is designed to distribute the load of incoming traffic amongst a set of back-end worker nodes and automatically scale up and down, depending on the prevailing load. Elasticity is one of its key capabilities.
The current default auto-scaling implementation (ServiceRequestsInFlightAutoscaler) considers a number of requests in-flight for a particular service cluster as the basis for making autoscaling decisions. We follow the paradigm, "scale up early and scale down slowly" in the default auto-scaling algorithm. At the moment, the WSO2 ELB supports AWS EC2, Openstack-nova IaaSes and theoretically, any IaaS that is supported via jclouds (http://www.jclouds.org).
The following sections describe how to enable and configure auto-scaling in WSO2 ELB and a demonstration of the default auto-scaling algorithm.