Our vBulletin migration is complete.
Welcome vBulletin users! All content and user information from the Micro Focus Forums (vBulletin) site has been migrated to this site. READ MORE.

Monitor Apache Kafka using AppManager

Monitor Apache Kafka using AppManager

To monitor Apache Kafka using AppManager you need to use Kafka-Monitor and Java Application Server on Windows and UNIX module. Kafka-Monitor is a framework that allows you to monitor Kafka cluster using end-to-end pipelines to obtain a number of stats such as service availability.

Kafka-Monitor and steps to configure it are available at GitHub at the following location:
https://github.com/linkedin/kafka-monitor

Once the kafka-monitor has been deployed and configured we need to use AppManager for Java module to discover the Kafka.

Steps to discover Kafka




  1. Download and install Java Application Server on Windows and UNIX 8.0 module. It is available at the following location:
    https://www.netiq.com/Support/am/trialcenter.asp




  1. Run the discovery KS for Java and in the field “Jolokia URL address” input the address for Jolokia as:

    {IP address of Kafka server}:8778




2


  1. Once the job stops, Kafka will be discovered in JAVA view and you can see the tree structure with managed beans.



3


  1. Now we can run the “ManagedBeanUtil” KS to monitor various parameters of Kafka.

  2. E.g. To monitor the kafka.consumer/consumer-fetch-manager-metrics/kmf-consumer/fetch-rate we deploy the KS on its respective component and specify the max-min thresholds, as shown below:



5


  1. We get an event when the thresholds are crossed, as below:


6


  1. Some of the important parameters to monitor can be found here:
    https://blog.serverdensity.com/how-to-monitor-kafka/




 

DISCLAIMER:

Some content on Community Tips & Information pages is not officially supported by Micro Focus. Please refer to our Terms of Use for more detail.
Top Contributors
Version history
Revision #:
1 of 1
Last update:
‎2016-12-21 00:13
Updated by:
 
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.