Kafka Consumer integration metrics
The official Datadog integration for monitoring Kafka Consumer. It collects 39 metrics.
Official summary
Collect metrics for Kafka consumers.
Metric types
- gauge (value at a point in time): 38
- count (occurrences in the interval): 1
Metrics
Descriptions are the official definitions, unedited.
| Metric | Type | Unit |
|---|---|---|
kafka.Broker configuration for default replication factor. (DSM only) | gauge | item |
kafka.Broker configuration for log retention in bytes. (DSM only) | gauge | byte |
kafka.Broker configuration for log retention in milliseconds. (DSM only) | gauge | millisecond |
kafka.Broker configuration for log segment size in bytes. (DSM only) | gauge | byte |
kafka.Broker configuration for minimum in-sync replicas. (DSM only) | gauge | item |
kafka.Broker configuration for number of I/O threads. (DSM only) | gauge | thread |
kafka.Broker configuration for number of network threads. (DSM only) | gauge | thread |
kafka.Broker configuration for default number of partitions. (DSM only) | gauge | item |
kafka.Total number of brokers in the cluster. (DSM only) | gauge | instance |
kafka.Number of partitions for which this broker is the leader. (DSM only) | gauge | item |
kafka.Total number of partitions on this broker including replicas. (DSM only) | gauge | item |
kafka.Current message offset on broker. | gauge | offset |
kafka.ID of the broker acting as the cluster controller. (DSM only) | gauge | instance |
kafka.Total number of Kafka Connect connectors. (DSM only) | gauge | item |
kafka.Number of tasks configured for this connector. (DSM only) | gauge | item |
kafka.Whether this connector task is running (1) or not (0). (DSM only) | gauge | - |
kafka.Number of tasks for this connector in the given state (tag: task_state). (DSM only) | gauge | item |
kafka.Total number of consumer groups. (DSM only) | gauge | item |
kafka.Number of partitions assigned to this consumer group member. (DSM only) | gauge | item |
kafka.Number of members in the consumer group. (DSM only) | gauge | item |
kafka.Number of times the consumer group membership changed between check runs. (DSM only) | count | - |
kafka.Whether the consumer group is rebalancing (1) or stable (0). (DSM only) | gauge | - |
kafka.Lag in messages between consumer and broker. | gauge | message |
kafka.Current message offset on consumer. | gauge | offset |
kafka.Lag in seconds between consumer and broker. This metric is provided through Data Streams Monitoring. Additional charges may apply. | gauge | second |
kafka.The earliest offset in the partition. (DSM only) | gauge | offset |
kafka.Number of in-sync replicas for this partition. (DSM only) | gauge | item |
kafka.Whether this partition is offline (1) or not (0). (DSM only) | gauge | - |
kafka.Number of replicas for this partition. (DSM only) | gauge | item |
kafka.Number of messages in the partition. (DSM only) | gauge | message |
kafka.Whether this partition is under-replicated (1) or not (0). (DSM only) | gauge | - |
kafka.Total number of schema subjects in the registry. (DSM only) | gauge | item |
kafka.Topic configuration for maximum message size in bytes. (DSM only) | gauge | byte |
kafka.Topic configuration for retention size in bytes. (DSM only) | gauge | byte |
kafka.Topic configuration for retention time in milliseconds. (DSM only) | gauge | millisecond |
kafka.Total number of topics in the cluster. (DSM only) | gauge | item |
kafka.Message production rate for this topic. (DSM only) | gauge | message/ |
kafka.Number of partitions for this topic. (DSM only) | gauge | item |
kafka.Total number of messages in the topic. (DSM only) | gauge | message |
Official documentation
Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.