Managing Throttling
This section guides you through the following areas:
IP Whitelisting
IP whitelisting is a way of configuring a filter to extract a particular set of known IP addresses and grant the access to the given assets for requests comes from those IPs only. With introducing Advanced Throttling in WSO2 API Manager you can achieve IP whitelisting via the features provided by Traffic Manager. For this we are creating an Advanced Throttling policy and attach it to the API.
Creating the Advanced Throttling policy
- Login to the admin portal of WSO2 API Manager (https://<ip_address>:9443/admin).
- Open Throttling Policies tab and navigate to Advanced Throttling.
- Click ADD TIER to add a new Throttling tier.
- Fill the details as below and click Add Conditional Group.
Open the Conditional Group added and fill the details.
Property Value IP Condition Policy Checked IP Condition Type Specific IP IP Address <IP_Address_to_be_whitelisted> E.g. 193.100.3.106
Invert Condition Checked (If Invert Condition check then condition only apply to the IPs which not mention in IP Address above) Request Count 0 Following is a example configuration.
In above configuration we are whitelisting a Specific IP.
You can whitelist a rang of IP as well by selecting IP Range for the IP Condition Type in the Conditional Group and specifying the range.
- Click Save.
You have successfully created the policy. Now we should engage this policy to an API.
Engage the policy with an API
- Login to API Publisher https://<IP_address>:9443/publisher.
- Edit API and go to Manage tab.
- Enable Apply to API under Advance Throttling Policies and select the newly created Throttling policy.
Save and Publish the API.
Now the API will be accessible only by the IP specified in the throttling policy.Since it takes some time to deploy the policy, the first few requests from the IPs other than the white-listed IP/IPs will be passed through. After the policy is successfully deployed, non-white-listed IP access will be blocked.
API-M Throttling is asynchronous. When you apply a new whitelisting condition, note that at least one request has to go through for the condition to be applied
Blacklisting requests
By blacklisting requests, you can protect servers from common attacks and abuse by users. For example, if a malicious user misuses the system, all requests received from that particular user can be completely blocked. Tenant administrative users can block requests based on the following parameters:
- Block calls to specific APIs
- Block all calls from a given application
- Block requests coming from a specific IP address
- Block a specific user from accessing APIs
To blacklist a request,
- Log in to the Admin Portal using the URL
https://localhost:9443/admin
and your admin credentials. - Click Black List under the Throttle Policies section and click Add Item.
- Select the item to black list, enter a value and click Blacklist.
Note that you have to use "/" always infront of the ${context} value when blacklisting the APIs with API context. E.g. /test/1.0.0. The sample provided in the product does not include "/" due to a known issue.
You can temporary on/off the blacklisting condition by enabling/disabling the Condition status that is auto enabled when a blacklisting condition is created.
Blacklisting PhoneVerification API
As described above you can blacklist requests for APIs, by Applications, to IP Addresses and for Users. Let's see how we can blacklist the requests come to the PhoneVerification API that we published in Quick Start Guide.
- Log in to the Admin Portal using the URL
https://localhost:9443/admin
and your admin credentials. - Click Black List under the Throttle Policies section and click Add Item.
- Select API Context and provide the Context of PhoneVerification API with version as the Value.
- Click Blacklist.
- Now login to API Store using the URL
https://localhost:9443/store
and invoke the API.
You will see the following response.
Custom throttling
Custom throttling allows system administrators to define dynamic rules for specific use cases, which are applied globally across all tenants. When a custom throttling policy is created, it is possible to define any policy you like. The Traffic Manager acts as the global throttling engine and is based on the same technology as WSO2 Complex Event Processor (CEP), which uses the Siddhi query language. Users are therefore able to create their own custom throttling policies by writing custom Siddhi queries. The specific combination of attributes being checked in the policy need to be defined as the key (also called the key template). The key template usually includes a predefined format and a set of predefined parameters. It can contain a combination of allowed keys separated by a colon (:), where each key must start with the prefix $. The following keys can be used to create custom throttling policies:
resourceKey, userId, apiContext, apiVersion, appTenant, apiTenant, appId
For example, the following sample custom policy allows the admin user to send 5 requests per minute to the Pizza Shack API.
$userId:$apiContext:$apiVersion
FROM RequestStream SELECT userId, ( userId == 'admin@carbon.super' and apiContext == '/pizzashack/1.0.0' and apiVersion == '1.0.0') AS isEligible , str:concat('admin@carbon.super',':','/pizzashack/1.0.0:1.0.0') as throttleKey INSERT INTO EligibilityStream; FROM EligibilityStream[isEligible==true]#throttler:timeBatch(1 min) SELECT throttleKey, (count(userId) >= 5) as isThrottled, expiryTimeStamp group by throttleKey INSERT ALL EVENTS into ResultStream;
As shown in the above Siddhi query, the throttle key must match the key template format. If there is a mismatch between the key template format and the throttle key, requests will not be throttled.