Introduction
Amazon Kinesis Data Streams is used to collect and process large streams of data records in real-time.
You can create data-processing applications, known as Kinesis Data Streams applications. A typical Kinesis Data Streams application reads data from a data stream as data records. These applications can use the Kinesis Client Library and run on Amazon EC2 instances.
You can:
- Send the processed records to dashboards.
- Use the record to generate alerts.
- Dynamically change pricing and advertising strategies.
- Send data to a variety of other AWS services.
Note
Use the OpsRamp AWS public cloud integration to discover and collect metrics against the AWS service.Setup
To set up the OpsRamp AWS integration and discover the AWS services (Kinesis and Shard),
go to AWS Integration Discovery Profile and select Kinesis.
Metrics
Standard metrics
| OpsRamp Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|
| aws_kinesis_PutRecord_Bytes | PutRecord.Bytes | Bytes | Average | Number of bytes put to the Amazon Kinesis stream using PutRecord over the specified time period. |
| aws_kinesis_PutRecord_Latency | PutRecord.Latency | ms | Average | Time taken per PutRecord operation, measured over the specified time period. |
| aws_kinesis_PutRecord_Success | PutRecord.Success | Count | Average | Number of successful PutRecord operations per Amazon Kinesis stream, measured over the specified time period. |
| aws_kinesis_PutRecords_Bytes | PutRecords.Bytes | Bytes | Average | Number of bytes put to the Amazon Kinesis stream using PutRecords over the specified time period. |
| aws_kinesis_PutRecords_Latency | PutRecords.Latency | ms | Average | Time taken per PutRecords operation, measured over the specified time period. |
| aws_kinesis_PutRecords_Records | PutRecords.Records | Count | Average | Number of successful records in a PutRecords operation per Amazon Kinesis stream, measured over the specified time period. |
| aws_kinesis_PutRecords_Success | PutRecords.Success | Count | Average | Number of successful PutRecords operations per Amazon Kinesis stream, measured over the specified time period. |
| aws_kinesis_IncomingBytes | IncomingBytes | Bytes | Average | Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords. |
| aws_kinesis_IncomingRecords | IncomingRecords | Count | Average | Number of records sucessfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords. |
| aws_kinesis_GetRecords_Bytes | GetRecords.Bytes | Bytes | Average | Number of bytes retrieved from the stream, measured over the specified time period. |
| aws_kinesis_GetRecords_IteratorAgeMilliseconds | GetRecords.IteratorAgeMilliseconds | ms | Average | Age of the last record in all GetRecords calls made against a stream, measured over the specified time period. Age is the difference between the current time and when the last record of a GetRecords call was written to the stream. Maximum statistic represents the oldest record that has been consumed over the specified time period, while Minimum represents the newest record. |
| aws_kinesis_GetRecords_Latency | GetRecords.Latency | ms | Average | Time taken per GetRecords operation, measured over the specified time period. |
| aws_kinesis_GetRecords_Success | GetRecords.Success | Count | Average | Number of successful GetRecords operations per stream, measured over the specified time period. |
| aws_kinesis_GetRecords_Records | Get Records Records | Count | Average | Number of records retrieved from the shard, measured over the specified time period. |
| aws_kinesis_ReadProvisionedThroughputExceeded | Read Provisioned Throughput Exceeded | Count | Average | Number of GetRecords calls throttled for the stream over the specified time period. |
| aws_kinesis_WriteProvisionedThroughputExceeded | Write Provisioned Throughput Exceeded | Count | Average | Number of records rejected due to throttling for the stream over the specified time period. |
Shard metrics
| OpsRamp Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|
| aws_kinesis_IncomingBytes | IncomingBytes | Bytes | Average | Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords. |
| aws_kinesis_IncomingRecords | IncomingRecords | Count | Average | Number of records sucessfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords. |
| aws_kinesis_ReadProvisionedThroughputExceeded | Read Provisioned Throughput Exceeded | Count | Average | Number of GetRecords calls throttled for the stream over the specified time period. |
| aws_kinesis_WriteProvisionedThroughputExceeded | Write Provisioned Throughput Exceeded | Count | Average | Number of records rejected due to throttling for the stream over the specified time period. |
| aws_kinesis_IteratorAgeMilliseconds | Iterator Age Milliseconds | Milliseconds | Average | The age of the last record in all GetRecords calls made against a shard, measured over the specified time period. |
| aws_kinesis_OutgoingBytes | Outgoing Bytes | Bytes | Average | Number of bytes retrieved from the shard, measured over the specified time period. |
| aws_kinesis_OutgoingRecords | Outgoing Records | Count | Average | Number of records retrieved from the shard, measured over the specified time period. |
Event support
CloudTrail event support
- Not Supported
CloudWatch alarm support
- Supported
- Configurable in OpsRamp AWS Integration Discovery Profile.