Kafka Consumer インテグレーションのメトリクス

Kafka Consumer の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 39 件あります。

公式の紹介文 (英語)

Collect metrics for Kafka consumers.

種別の内訳

  • gauge (その時点の値): 38 件
  • count (集計間隔内の発生回数): 1 件

メトリクスの一覧

説明は公式の定義の英文をそのまま載せています。

メトリクス種別単位
kafka.broker.config.default_replication_factorBroker configuration for default replication factor. (DSM only)gaugeitem
kafka.broker.config.log_retention_bytesBroker configuration for log retention in bytes. (DSM only)gaugebyte
kafka.broker.config.log_retention_msBroker configuration for log retention in milliseconds. (DSM only)gaugemillisecond
kafka.broker.config.log_segment_bytesBroker configuration for log segment size in bytes. (DSM only)gaugebyte
kafka.broker.config.min_insync_replicasBroker configuration for minimum in-sync replicas. (DSM only)gaugeitem
kafka.broker.config.num_io_threadsBroker configuration for number of I/O threads. (DSM only)gaugethread
kafka.broker.config.num_network_threadsBroker configuration for number of network threads. (DSM only)gaugethread
kafka.broker.config.num_partitionsBroker configuration for default number of partitions. (DSM only)gaugeitem
kafka.broker.countTotal number of brokers in the cluster. (DSM only)gaugeinstance
kafka.broker.leader_countNumber of partitions for which this broker is the leader. (DSM only)gaugeitem
kafka.broker.partition_countTotal number of partitions on this broker including replicas. (DSM only)gaugeitem
kafka.broker_offsetCurrent message offset on broker.gaugeoffset
kafka.cluster.controller_idID of the broker acting as the cluster controller. (DSM only)gaugeinstance
kafka.connector.countTotal number of Kafka Connect connectors. (DSM only)gaugeitem
kafka.connector.task.countNumber of tasks configured for this connector. (DSM only)gaugeitem
kafka.connector.task.runningWhether this connector task is running (1) or not (0). (DSM only)gauge-
kafka.connector.tasksNumber of tasks for this connector in the given state (tag: task_state). (DSM only)gaugeitem
kafka.consumer_group.countTotal number of consumer groups. (DSM only)gaugeitem
kafka.consumer_group.member.partitionsNumber of partitions assigned to this consumer group member. (DSM only)gaugeitem
kafka.consumer_group.membersNumber of members in the consumer group. (DSM only)gaugeitem
kafka.consumer_group.membership_changesNumber of times the consumer group membership changed between check runs. (DSM only)count-
kafka.consumer_group.rebalancingWhether the consumer group is rebalancing (1) or stable (0). (DSM only)gauge-
kafka.consumer_lagLag in messages between consumer and broker.gaugemessage
kafka.consumer_offsetCurrent message offset on consumer.gaugeoffset
kafka.estimated_consumer_lagLag in seconds between consumer and broker. This metric is provided through Data Streams Monitoring. Additional charges may apply.gaugesecond
kafka.partition.beginning_offsetThe earliest offset in the partition. (DSM only)gaugeoffset
kafka.partition.isrNumber of in-sync replicas for this partition. (DSM only)gaugeitem
kafka.partition.offlineWhether this partition is offline (1) or not (0). (DSM only)gauge-
kafka.partition.replicasNumber of replicas for this partition. (DSM only)gaugeitem
kafka.partition.sizeNumber of messages in the partition. (DSM only)gaugemessage
kafka.partition.under_replicatedWhether this partition is under-replicated (1) or not (0). (DSM only)gauge-
kafka.schema_registry.subjectsTotal number of schema subjects in the registry. (DSM only)gaugeitem
kafka.topic.config.max_message_bytesTopic configuration for maximum message size in bytes. (DSM only)gaugebyte
kafka.topic.config.retention_bytesTopic configuration for retention size in bytes. (DSM only)gaugebyte
kafka.topic.config.retention_msTopic configuration for retention time in milliseconds. (DSM only)gaugemillisecond
kafka.topic.countTotal number of topics in the cluster. (DSM only)gaugeitem
kafka.topic.message_rateMessage production rate for this topic. (DSM only)gaugemessage/second
kafka.topic.partitionsNumber of partitions for this topic. (DSM only)gaugeitem
kafka.topic.sizeTotal number of messages in the topic. (DSM only)gaugemessage

公式ドキュメント

Kafka Consumer インテグレーションの公式ドキュメント

メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。