Introduction

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that enables you to build and run applications that use Apache Kafka to process streaming data.

Amazon MSK provides the control-plane operations, such as those for creating, updating, and deleting clusters.

  • It lets you use Apache Kafka data-plane operations, such as those for producing and consuming data.
  • It runs open-source versions of Apache Kafka. This means existing applications, tooling, and plugins from partners and the Apache Kafka community are supported without requiring changes to application code.

Setup

To set up the OpsRamp AWS integration and discover the AWS service, go to AWS Integration Discovery Profile and select MSK Cluster.

Metrics

OpsRamp MetricMetric Display NameUnitAggregation TypeDescription
aws_kafka_ActiveControllerCountActiveControllerCountCountAverageOnly one (1) controller per cluster should be active at any given time.
aws_kafka_GlobalPartitionCountGlobalPartitionCountCountAverageTotal number of partitions across all brokers in the cluster.
aws_kafka_GlobalTopicCountGlobalTopicCountCountAverageTotal number of topics across all brokers in the cluster.
aws_kafka_OfflinePartitionsCountOfflinePartitionsCountCountAverageTotal number of partitions that are offline in the cluster.
cloud.instance.stateStatus/Staten/an/aCluster State Metric

Event support

CloudTrail event support

  • Supported
  • Configurable in OpsRamp AWS Integration Discovery Profile.

CloudWatch alarm support

  • Supported
  • Configurable in OpsRamp AWS Integration Discovery Profile.

External reference