Description

This template monitors the Producer related metrics. It is applicable for the devices containing Kafka application.

Prerequisites

Java must be installed on the device. Gateway should be up and running. The device should be reachable from Gateway. The device should be in managed state.

How to Apply:

For Kafka we have Instance Based Monitoring or Component Discovery Monitoring. In order to do that, we should add the following custom parameter:

application.component.name : Producer

Create different monitors for different components in Instance based monitoring.

Only one component is allowed per monitor in Instance based monitoring.

We have three different types of Component Discovery Monitoring. They are:

For a single component :

ALL : ALL your instances will be monitored.

Expression : The Instance Names that match the expression will be monitored.

Manual Selection : With this option, you can select the desired instances while applying templates to the device.

Metric Parameters

Metric Parameters
ParameterDescription
Frequency
  • Frequency is the interval in which you want to probe and collect metric data from the target device/resource
  • Frequency is defined in minutes (min).
  • Warning ThresholdIf the metric value satisfies the condition defined along with Warning Threshold value, then a notification is sent to the user.
    Critical ThresholdIf the metric value satisfies the condition defined along with Critical Threshold value, then a notification is sent to the user.
    AlertThe alert value can be set to either Yes or No. If it is Yes, then an alert message is sent to the user.

    Metrics

    kafka.producer.buffer.available.bytes

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe total amount of buffer memory that is not being used (either unallocated or in the free list).
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.batch.size.avg

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average number of bytes sent per partition per-request.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.compression.rate.avg

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average compression rate of record batches.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitpsec

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.bufferpool.wait.time

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe fraction of time an appender waits for space allocation.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitms

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.batch.size.max

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe max number of bytes sent per partition per-request.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.send.rate

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average number of records sent per second for a topic.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitpsec

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.retry.rate

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average per-second number of retried record sends for a topic.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitpsec

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.error.rate

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average per-second number of retried record sends for a topic.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitpsec

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.records.perrequest.avg

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average number of records sent per second.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.queue.time.avg

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average time in ms record batches spent in the record accumulator.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitms

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.queue.time.max

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe maximum time in ms record batches spent in the record accumulator.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitms

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.size.avg

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe average record size.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.record.size.max

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe maximum record size.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.requests.in.flight

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe current number of in-flight requests awaiting a response.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.metadata.age

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe age in seconds of the current producer metadata being used.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Units

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.buffer.bytes.total

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe maximum amount of buffer memory the client can use (whether or not it is currently used).
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph

    kafka.producer.waiting.threads

    Metric Details

    Metric Details
    Applicable forDevice
    DescriptionThe number of user threads blocked waiting for buffer memory to enqueue their records.
    CategoryApplication
    Collector TypeGateway
    Monitor NameApache Kafka Producer Monitor
    Unitcount

    Possible Inputs

    Possible Inputs
    MetricInput ValueRange of Values
    Frequency51 – 1440 (mins)
    Filter
    Warning Operator
    Warning Threshold
    Warning Repeat Count
    Critical Operator
    Critical Threshold
    Critical Repeat Count
    AlertNoYes/No
    Graph (Yes/No)YesYes/No

    Sample Output

    No graph