APIM 1.10.x is default support for fetch data from DAS REST API. If you still want to configure APIM and DAS without RDBMS, please refer blog Publishing APIM Runtime Statistics to DAS.

APIM 1.10.x has two clients for fetching Summarized data. One is REST Client which fetch data directly from the DAS. The second one is RDBMS client which fetches data from RDBMS. By default, APIM is configured to REST client. To use with RDBMS Client you have to select the Client from <APIM_HOME>/repository/conf/api-manager.xml. you can configure it to Configure WSO2 API Manager section

Follow are the prerequisites and link to download them.

• wso2 API Manager 1.10.0 from here
• wso2 DAS 3.0.0 from here
• RDBMS Instance (MySQL,MsSQL, H2 etc)

If APIM and DAS run on the same machine, increase the default service port of DAS by setting offset value in <DAS_HOME>/repository/conf/carbon.xml

  <Offset>1</Offset>
  

  <datasource>
    <name>WSO2AM_STATS_DB</name>
    <description>The datasource used for setting statistics to API Manager</description>
    <jndiConfig>
      <name>jdbc/WSO2AM_STATS_DB</name>
      </jndiConfig>
    <definition type="RDBMS">
      <configuration>
        <url>jdbc:mysql://localhost:3306/TestStatsDB</url>
        <username>db_username</username>
        <password>db_password</password>
        <driverClassName>com.mysql.jdbc.Driver</driverClassName>
        <maxActive>50</maxActive>
        <maxWait>60000</maxWait>
        <testOnBorrow>true</testOnBorrow>
        <validationQuery>SELECT 1</validationQuery>
        <validationInterval>30000</validationInterval>
        </configuration>
      </definition>
  </datasource>

If you are used MySQL as the database, download and paste MySQL driver from here to <DAS_HOME>/repository/components/lib.

Like earliar, APIM stat publishing and analyzing using BAM, DAS does not create the table structure in the database automatically and have to do it manually. Thus find the correct schema declaration script under <APIM_HOME>/dbscript/stat/sql folder and import it to the above database.

  ex:
  use the mysql.sql to create schema in the above DB

• Since APIM 1.10.x not released yet, you can build it from source.
• Set to RDBMS Client in <APIM_HOME>/repository/conf/api-manager.xml

       <!-- For APIM implemented Statistic client for DAS REST API -->
      <!--StatisticClientProvider>org.wso2.carbon.apimgt.usage.client.impl.APIUsageStatisticsRestClientImpl</StatisticClientProvider-->
  
       <!-- For APIM implemented Statistic client for RDBMS -->
      <StatisticClientProvider>org.wso2.carbon.apimgt.usage.client.impl.APIUsageStatisticsRdbmsClientImpl</StatisticClientProvider>
       

• Start APIM
• go to admin-dashboard using https://localhost:9443/admin-dashboard/
• login and click Configure Analytics under the settings section
• select enable combo box and will appear setting to configure analytics
• set the Event Receiver Configurations according to the DAS
• Then click the Add url group button to save it.
• Enter Data Analyzer Configurations according to the DAS
• For Statistics Summary Datasource, add the same DB configuration you added in WSO2AM_STATS_DB datasource in das.
• Once done click save

Note that: If you are use the MySQL copy and paste the MySQL driver library to <AM_HOME>/repository/components/lib

DAS configuration overview

• Let's invoke a API to generate Traffic and see the Statistics

Deploy Sample Wheather API

• Deploy sample sample WeatherAPI by loggin to the APIM Publisher

Sample Wheather API

• Then loggin to the Store and subscribe to API you created
• Using Store API console or using Curl invoke the API

Invoke the API

• Then wait for a few minutes(‹ 5 mins) to generate Analytics
• Then Navigate to Publisher Statistics Section and click on API Usage

WeatherAPI usage

Data purge is one option to remove historical data in DAS. Since DAS does not allow to delete the DAS table data or Table deletion this option is very important. With data purging you can achieve high performance on data analyzing without removing analyzed summary data.

Here we purge data only on stream data fired by APIM. Those data are contained in the following tables.

  ORG_WSO2_APIMGT_STATISTICS_DESTINATION
  ORG_WSO2_APIMGT_STATISTICS_FAULT
  ORG_WSO2_APIMGT_STATISTICS_REQUEST
  ORG_WSO2_APIMGT_STATISTICS_RESPONSE
  ORG_WSO2_APIMGT_STATISTICS_WORKFLOW
  ORG_WSO2_APIMGT_STATISTICS_THROTTLE

Make sure not to purge data other than the above table. it will result in vanishing your summarized historical data.

There is two ways to purge data in DAS.

1. Using admin console
   • Go the the Data-explorer and select above at a time.
   • Then click schedule data purge button.
   • Then set the time and days you need to purge.
   • Do this all of the above tables and wait for the data purging.

   

   Data Purge Dialog box

2. Global method

   Note that this will affect all the tenants

   • Open the <DAS_HOME>/repository/conf/analytics/analytics-config.xml
   • change content of <analytics-data-purging> tag as below

     <analytics-data-purging>
       <!-- Below entry will indicate purging is enable or not. If user wants to enable data purging for cluster then this property need to be enable in all nodes -->
       <purging-enable>true</purging-enable>
       <cron-expression>0 0 12 * * ?</cron-expression>
       <!-- Tables that need include to purging. Use regex expression to specify the table name that need include to purging.-->
       <purge-include-table-patterns>
         <table>.*</table>
         <!--<table>.*jmx.*</table>-->
         </purge-include-table-patterns>
       <!-- All records that insert before the specified retention time will be eligible to purge -->
       <data-retention-days>365</data-retention-days>
     </analytics-data-purging>