Introduction
Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that enables you to build and run applications that use Apache Kafka to process streaming data.
Amazon MSK provides the control-plane operations, such as those for creating, updating, and deleting clusters.
- It lets you use Apache Kafka data-plane operations, such as those for producing and consuming data.
- It runs open-source versions of Apache Kafka. This means existing applications, tooling, and plugins from partners and the Apache Kafka community are supported without requiring changes to application code.
Note
Use the OpsRamp AWS public cloud integration to discover and collect metrics against the AWS service.Setup
To set up the OpsRamp AWS integration and discover the AWS service,
go to AWS Integration Discovery Profile and select MSK Cluster.
Metrics
| OpsRamp Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|
| aws_kafka_CpuIdle | CpuIdle | Percent | Average | Percentage of CPU idle time. |
| aws_kafka_CpuSystem | CpuSystem | Percent | Average | Percentage of CPU in kernel space. |
| aws_kafka_CpuUser | CpuUser | Percent | Average | Percentage of CPU in user space. |
| aws_kafka_KafkaAppLogsDiskUsed | KafkaAppLogsDiskUsed | Percent | Average | Percentage of disk space used for application logs. |
| aws_kafka_KafkaDataLogsDiskUsed | KafkaDataLogsDiskUsed | Percent | Average | Percentage of disk space used for data logs. |
| aws_kafka_MemoryBuffered | MemoryBuffered | Bytes | Average | Size in bytes of buffered memory for the broker. |
| aws_kafka_MemoryCached | MemoryCached | Bytes | Average | Size in bytes of cached memory for the broker. |
| aws_kafka_MemoryFree | MemoryFree | Bytes | Average | Size in bytes of memory that is free and available for the broker. |
| aws_kafka_MemoryUsed | MemoryUsed | Bytes | Average | Size in bytes of memory that is in use for the broker. |
| aws_kafka_NetworkRxDropped | NetworkRxDropped | Count | Average | Number of dropped receive packages. |
| aws_kafka_NetworkRxErrors | NetworkRxErrors | Count | Average | Number of network receive errors for the broker. |
| aws_kafka_NetworkRxPackets | NetworkRxPackets | Count | Average | Number of packets received by the broker. |
| aws_kafka_NetworkTxDropped | NetworkTxDropped | Count | Average | Number of dropped transmit packages. |
| aws_kafka_NetworkTxErrors | NetworkTxErrors | Count | Average | Number of network transmit errors for the broker. |
| aws_kafka_NetworkTxPackets | NetworkTxPackets | Count | Average | Number of packets transmitted by the broker. |
| aws_kafka_RootDiskUsed | RootDiskUsed | Percent | Average | Percentage of the root disk used by the broker. |
| aws_kafka_SwapFree | SwapFree | Bytes | Average | Size in bytes of swap memory that is available for the broker. |
| aws_kafka_SwapUsed | SwapUsed | Bytes | Average | Size in bytes of swap memory that is in use for the broker. |
| aws_kafka_ZooKeeperRequestLatencyMsMean | ZooKeeperRequestLatencyMsMean | Milliseconds | Average | Mean latency in milliseconds for ZooKeeper requests from broker. |
| aws_kafka_ZooKeeperSessionState | ZooKeeperSessionState | Count | Average | Connection status of brokers ZooKeeper session. |
Event support
CloudTrail event support
- Not Supported
CloudWatch alarm support
- Supported
- Configurable in OpsRamp AWS Integration Discovery Profile.