Druid インテグレーションのメトリクス

Druid の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 113 件あります。

公式の紹介文 (英語)

Track metrics related to queries, ingestion, and coordination.

種別の内訳

  • gauge (その時点の値): 65 件
  • count (集計間隔内の発生回数): 48 件

メトリクスの一覧

説明は公式の定義の英文をそのまま載せています。

メトリクス種別単位
druid.coordinator.segment.countCoordinator segment count.gaugesegment
druid.historical.segment.countHistorical segment count.gaugesegment
druid.ingest.events.bufferedNumber of events queued in the EventReceiverFirehose's buffer.gaugeevent
druid.ingest.events.duplicateNumber of events rejected because the events are duplicated.countevent
druid.ingest.events.messageGapTime gap between the data time in event and current system time.gaugemillisecond
druid.ingest.events.processedNumber of events successfully processed per emission period.countevent
druid.ingest.events.thrownAwayNumber of events rejected because they are outside the windowPeriod.countevent
druid.ingest.events.unparseableNumber of events rejected because the events are unparsable.countevent
druid.ingest.handoff.failedNumber of handoffs that failed.count-
druid.ingest.kafka.avgLagAverage lag between the offsets consumed by the Kafka indexing tasks and latest offsets in Kafka brokers across all partitions. Minimum emission period for this metric is a Minute.gaugeoffset
druid.ingest.kafka.lagTotal lag between the offsets consumed by the Kafka indexing tasks and latest offsets in Kafka brokers across all partitions. Minimum emission period for this metric is a Minute.gaugeoffset
druid.ingest.kafka.maxLagMax lag between the offsets consumed by the Kafka indexing tasks and latest offsets in Kafka brokers across all partitions. Minimum emission period for this metric is a Minute.gaugeoffset
druid.ingest.merge.cpuCpu time in Nanoseconds spent on merging intermediate segments.gaugenanosecond
druid.ingest.merge.timeMilliseconds spent merging intermediate segments.gaugemillisecond
druid.ingest.persists.backPressureMilliseconds spent creating persist tasks and blocking waiting for them to finish.gaugemillisecond
druid.ingest.persists.countNumber of times persist occurred.count-
druid.ingest.persists.cpuCpu time in Nanoseconds spent on doing intermediate persist.gaugenanosecond
druid.ingest.persists.failedNumber of persists that failed.count-
druid.ingest.persists.timeMilliseconds spent doing intermediate persist.gaugemillisecond
druid.ingest.rows.outputNumber of Druid rows persisted.countrow
druid.jvm.bufferpool.capacityBufferpool capacity in bytes.gaugebyte
druid.jvm.bufferpool.countBufferpool count in bytes.gaugebyte
druid.jvm.bufferpool.usedBufferpool used in bytes.gaugebyte
druid.jvm.gc.countGarbage collection count.count-
druid.jvm.gc.cpuCpu time in Nanoseconds spent on garbage collection.gaugenanosecond
druid.jvm.mem.committedCommitted memory in bytes.gaugebyte
druid.jvm.mem.initInitial memory in bytes.gaugebyte
druid.jvm.mem.maxMax memory in bytes.gaugebyte
druid.jvm.mem.usedUsed memory in bytes.gaugebyte
druid.jvm.pool.committedCommitted pool in byte.gaugebyte
druid.jvm.pool.initInitial pool in bytes.gaugebyte
druid.jvm.pool.maxMax pool in bytes.gaugebyte
druid.jvm.pool.usedPool used in bytes.gaugebyte
druid.query.bytesNumber of bytes returned in query response.countbyte
druid.query.cache.delta.averageBytesDelta average cache entry byte size.countbyte
druid.query.cache.delta.errorsDelta number of cache errors.count-
druid.query.cache.delta.evictionsDelta number of cache evictions.counteviction
druid.query.cache.delta.hitRateDelta cache hit rate.countfraction
druid.query.cache.delta.hitsDelta number of cache hits.counthit
druid.query.cache.delta.missesDelta number of cache misses.countmiss
druid.query.cache.delta.numEntriesDelta number of cache entries.count-
druid.query.cache.delta.sizeBytesDelta size in bytes of cache entries.countbyte
druid.query.cache.delta.timeoutsDelta number of cache timeouts.count-
druid.query.cache.total.averageBytesTotal average cache entry byte size.gaugebyte
druid.query.cache.total.errorsTotal number of cache errors.gauge-
druid.query.cache.total.evictionsTotal number of cache evictions.gaugeeviction
druid.query.cache.total.hitRateTotal cache hit rate.gaugefraction
druid.query.cache.total.hitsTotal number of cache hits.gaugehit
druid.query.cache.total.missesTotal number of cache misses.gaugemiss
druid.query.cache.total.numEntriesTotal number of cache entries.gauge-
druid.query.cache.total.sizeBytesTotal size in bytes of cache entries.gaugebyte
druid.query.cache.total.timeoutsTotal number of cache timeouts.gauge-
druid.query.countNumber of total queries.countquery
druid.query.cpu.timeMicroseconds of CPU time taken to complete a query.gaugemicrosecond
druid.query.failed.countNumber of failed queries.countquery
druid.query.interrupted.countNumber of queries interrupted due to cancellation or timeout.countquery
druid.query.intervalChunk.timeOnly emitted if interval chunking is enabled. Milliseconds required to query an interval chunk. This metric is deprecated and will be removed in the future because interval Chunking is deprecated. See Query Context.gaugemillisecond
druid.query.node.backpressureMilliseconds that the channel to this process has spent suspended due to backpressure.gaugemillisecond
druid.query.node.bytesNumber of bytes returned from querying individual historical/realtime processes.countbyte
druid.query.node.timeMilliseconds taken to query individual historical/realtime processes.gaugemillisecond
druid.query.node.ttfbTime to first byte. Milliseconds elapsed until Broker starts receiving the response from individual historical/realtime processes.gaugemillisecond
druid.query.segment.timeMilliseconds taken to query individual segment. Includes time to page in the segment from disk.gaugemillisecond
druid.query.segmentAndCache.timeMilliseconds taken to query individual segment or hit the cache (if it is enabled on the Historical process).gaugemillisecond
druid.query.success.countNumber of queries successfully processed.countquery
druid.query.timeMilliseconds taken to complete a query.gaugemillisecond
druid.query.wait.timeMilliseconds spent waiting for a segment to be scanned.gaugemillisecond
druid.segment.added.bytesSize in bytes of new segments created.countbyte
druid.segment.assigned.countNumber of segments assigned to be loaded in the cluster.countsegment
druid.segment.cost.normalizationUsed in cost balancing. The normalization of hosting segments.count-
druid.segment.cost.normalizedUsed in cost balancing. The normalized cost of hosting segments.count-
druid.segment.cost.rawUsed in cost balancing. The raw cost of hosting segments.count-
druid.segment.deleted.countNumber of segments dropped due to rules.countsegment
druid.segment.dropQueue.countNumber of segments to drop.gaugesegment
druid.segment.dropped.countNumber of segments dropped due to being overshadowed.countsegment
druid.segment.loadQueue.countNumber of segments to load.gaugesegment
druid.segment.loadQueue.failedNumber of segments that failed to load.gaugesegment
druid.segment.loadQueue.sizeSize in bytes of segments to load.gaugebyte
druid.segment.maxMaximum byte limit available for segments.gaugebyte
druid.segment.moved.bytesSize in bytes of segments moved/archived via the Move Task.countbyte
druid.segment.moved.countNumber of segments moved in the cluster.countsegment
druid.segment.nuked.bytesSize in bytes of segments deleted via the Kill Task.countbyte
druid.segment.overShadowed.countNumber of overShadowed segments.gaugesegment
druid.segment.pendingDeleteOn-disk size in bytes of segments that are waiting to be cleared out.gaugebyte
druid.segment.scan.pendingNumber of segments in queue waiting to be scanned.gaugeunit
druid.segment.sizeSize in bytes of available segments.gaugebyte
druid.segment.unavailable.countNumber of segments (not including replicas) left to load until segments that should be loaded in the cluster are available for queries.countsegment
druid.segment.underReplicated.countNumber of segments (including replicas) left to load until segments that should be loaded in the cluster are available for queries.countsegment
druid.segment.unneeded.countNumber of segments dropped due to being marked as unused.countsegment
druid.segment.usedBytes used for served segments.gaugebyte
druid.segment.usedPercentPercentage of space used by served segments.gaugefraction
druid.service.health1 if the service is healthy, 0 otherwisegauge-
druid.sys.cpuCPU used.gaugepercent
druid.sys.disk.read.countReads from disk.countread
druid.sys.disk.read.sizeBytes read from disk. Can we used to determine how much paging is occurring with regards to segments.countbyte
druid.sys.disk.write.countWrites to disk.countwrite
druid.sys.disk.write.sizeBytes written to disk. Can we used to determine how much paging is occurring with regards to segments.countbyte
druid.sys.fs.maxFilesystesm bytes max.gaugebyte
druid.sys.fs.usedFilesystem bytes used.gaugebyte
druid.sys.mem.maxMemory max.gaugebyte
druid.sys.mem.usedMemory used.gaugebyte
druid.sys.net.read.sizeBytes read from the network.countbyte
druid.sys.net.write.sizeBytes written to the network.countbyte
druid.sys.storage.usedDisk space used.gaugebyte
druid.sys.swap.freeFree swap in bytes.gaugebyte
druid.sys.swap.maxMax swap in bytes.gaugebyte
druid.sys.swap.pageInPaged in swap.gaugepage
druid.sys.swap.pageOutPaged out swap.gaugepage
druid.task.failed.countNumber of failed tasks per emission period. This metric is only available if the TaskCountStatsMonitor module is included.counttask
druid.task.pending.countNumber of current pending tasks. This metric is only available if the TaskCountStatsMonitor module is included.counttask
druid.task.run.timeMilliseconds taken to run a task.gaugemillisecond
druid.task.running.countNumber of current running tasks. This metric is only available if the TaskCountStatsMonitor module is included.counttask
druid.task.success.countNumber of successful tasks per emission period. This metric is only available if the TaskCountStatsMonitor module is included.counttask
druid.task.waiting.countNumber of current waiting tasks. This metric is only available if the TaskCountStatsMonitor module is included.counttask

公式ドキュメント

Druid インテグレーションの公式ドキュメント

メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。