Page Comparison

log4j configs

Follow the steps below to set up the correlation logs related to the database calls.

1. Open the log4j.properties file in the <IS_HOME>/repository/conf directory.

2. Add the following code to it.

   Code Block

   # Appender config to put correlation Log. log4j.logger.correlation=INFO, CORRELATION log4j.additivity.correlation=false log4j.appender.CORRELATION=org.apache.log4j.RollingFileAppender log4j.appender.CORRELATION.File=${carbon.home}/repository/logs/${instance.log}/correlation.log log4j.appender.CORRELATION.MaxFileSize=10MB50MB log4j.appender.CORRELATION.MaxBackupIndex=100 log4j.appender.CORRELATION.layout=org.apache.log4j.PatternLayout log4j.appender.CORRELATION.Threshold=INFO log4j.appender.CORRELATION.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss,SSS}|%X{Correlation-ID}|%t|%m%n

Tomcat valve configs

Follow the steps below to set up the correlation ID mapping between the request database call and the response database call.

1. Open the catalina-server.xml file in the <IS_HOME>/repository/conf/tomcat directory.

2. Add the following value under the <Host> tag.

   Code Block
   <Valve className="org.wso2.carbon.tomcat.ext.valves.RequestCorrelationIdValve" headerToCorrelationIdMapping="{'activityid':'Correlation-ID'}" queryToCorrelationIdMapping="{'RelayState':'Correlation-ID'}"/>

   Note
   This should be the first valve under the <Host> tag.

JDBC database call logging

Format:

timestamp | correlationID | threadID | duration | callType | startTime | methodName | query | connectionUrl 

Example:

Eg:
2018-10-22 17:54:46,869|cf57a4a6-3ba7-46aa-8a2b-f02089d0172c|http-nio-9443-exec-2|4|jdbc|1540211086865|executeQuery|SELECT ID, TENANT_ID, IDP_ID, PROVISIONING_CONNECTOR_TYPE, IS_ENABLED, IS_BLOCKING  FROM IDP_PROVISIONING_CONFIG WHERE IDP_ID=?|jdbc:mysql://localhost:13306/apimgtdb?autoReconnect=true&useSSL=false

LDAP database call logging

Format:

timestamp | correlationID | threadID | duration | callType | startTime | methodName | providerUrl | principal | argsLengeth | args

Example:

2018-10-2310:55:02,279|c4eaede8-914d-4712-b630-73f6534b8def|http-nio-9443-exec-18|19|ldap|1540272302260|search|ldap://localhost:10392|uid=admin,ou=system| ou=Users,dc=wso2,dc=org,(&(objectClass=person)(uid=admin)),javax.naming.directory.SearchControls@6359ae3a

Beginning of the request call

Main:

timestamp | correlationID | threadID | duration | HTTP-In-Request | startTime | methodName | requestQuery | requestPath

Example:

2018-11-0514:57:06,757|f884a93d-e3a3-431f-a1ea-f6973e125cb6|http-nio-9443-exec-28|0|HTTP-In-Request|1541410026757|GET|null|/carbon/admin/images/favicon.ico

Ending of the request call

Format:

timestamp | correlationID | threadID | totalDurationForRequest | HTTP-In-Response | startTime | methodName | requestQuery | requestPath

Example:

2018-11-05 14:57:06,764|f884a93d-e3a3-431f-a1ea-f6973e125cb6|http-nio-9443-exec-28|7|HTTP-In-Response|1541410026764|GET|null|/carbon/admin/images/favicon.ico

Blacklisting the threads

Certain threads continuously print unnecessary logs. Blacklisting prevents the unwanted threads from printing logs thereby improving the readability of the logs.

Follow the steps below to configure thread blacklistingdenylisting.

1. Open either of the following files in the <IS_HOME>/bin directory on a command prompt.
   1. For Mac/Linux: wso2server.sh file
   2. For Windows: wso2server.bat file

2. Add the following configuration as a system property.

   Code Block
   -Dorg.wso2.CorrelationLogInterceptor.BlacklistedThreads=threadName1,threadName2 \

   Tip
   Make sure to add it before the org.wso2.carbon.bootstrap.Bootstrap $* line.

   Note
   This configuration is not required by default, as all unnecessary threads are already blacklisted denylisted by the MessageDeliveryTaskThreadPool thread. If the above configuration is added, the default value will be overridden.

3. Restart the WSO2 IS server.

   Code Block
   sh wso2server.sh -DenableCorrelationLogs=true stop sh wso2server.sh -DenableCorrelationLogs=true start

Single header configs

By default, RequestCorrelationIdValve in the catalina-server.xml file in the <IS_HOME>/repository/conf/tomcat directory is configured to map to the value sent by the activityid header as the Correlation ID. You can change this by editing the RequestCorrelationIdValve by replacing the activityid with any other headerName that you will be sending.

Let's consider an authentication request that is sent with a new header configuration.

1. Change the RequestCorrelationIdValve in the cataline-server.xml file to the value given below.

   Code Block
   <Valve className="org.wso2.carbon.tomcat.ext.valves.RequestCorrelationIdValve" headerToCorrelationIdMapping="{'customHeader':'Correlation-ID'}" queryToCorrelationIdMapping="{'RelayState':'Correlation-ID'}"/>

2. Restart the WSO2 IS Server.

   Code Block
   sh wso2server.sh -DenableCorrelationLogs=true stop sh wso2server.sh -DenableCorrelationLogs=true start

3. To send the authentication request, execute the following cURL command.

   Code Block
   curl -v -k -X POST --basic -u <CLIENT_KEY>:<CLIENT_SECRET> -H "Content-Type: application/x-www-form-urlencoded;charset=UTF-8" -H "customHeader:correlationvalue" -d "grant_type=client_credentials" https://localhost:9443/oauth2/token

   Tip
   Use the  client key  and  client secret  of the service provider you created after enabling product observability

4. Open the correlation.log on a command prompt and notice the related logs.

   Code Block
   tail -f ../repository/logs/correlation.log

   

Multiple header configs

Even though the default configuration maps a single header to a single Correlation ID, it is possible to add multiple headers and map them to multiple Correlation IDs.

Let's consider an authentication request that is sent with multiple headers.

1. Change the RequestCorrelationIdValve in the cataline-server.xml file to the value given below.

   Code Block
   language java
   <Valve className="org.wso2.carbon.tomcat.ext.valves.RequestCorrelationIdValve" headerToCorrelationIdMapping="{'customHeader1':'Correlation-ID', 'customHeader2':'Second-Correlation-ID'}" queryToCorrelationIdMapping="{'RelayState':'Correlation-ID'}"/>

2. Change the  log4j.appender.CORRELATION.layout.ConversionPattern  appender in the  log4j.properties  file in the  <IS_HOME>/repository/conf/  directory as follows.

   Code Block
   log4j.appender.CORRELATION.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss,SSS}|%X{Correlation-ID}|%X{Second-Correlation-ID}|%t|%m%n

3. Restart the WSO2 IS server.

   Code Block
   sh wso2server.sh -DenableCorrelationLogs=true stop sh wso2server.sh -DenableCorrelationLogs=true start

4. To send the authentication request, execute the following cURL command.

   Code Block
   curl -v -k -X POST --basic -u <CLIENT_KEY>:<CLIENT_SECRET> -H "Content-Type: application/x-www-form-urlencoded;charset=UTF-8" -H "customHeader1:correlationvalue1" -H "customHeader2:correlationvalue2" -d "grant_type=client_credentials" https://localhost:9443/oauth2/token

   Tip
   Use the  client key  and  client secret  of the service provider you created after enabling product observability

5. Open the correlation.log on a command prompt and notice the related logs.

   Code Block
   tail -f ../repository/logs/correlation.log