Kuma integration metrics

The official Datadog integration for monitoring Kuma. It collects 132 metrics.

Official summary

Collect metrics and logs from Kuma, a service mesh for Kubernetes and VMs. Kuma is the community version of Kong Mesh.

Metric types

  • count (occurrences in the interval): 93
  • gauge (value at a point in time): 39

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
kuma.api_server.http_request_duration_seconds.bucketThe latency of API HTTP requests. (bucket)count-
kuma.api_server.http_request_duration_seconds.countThe latency of API HTTP requests. (count)countrequest
kuma.api_server.http_request_duration_seconds.sumThe latency of API HTTP requests. (sum)countsecond
kuma.api_server.http_requests_inflightThe number of inflight requests being handled simultaneously.gaugerequest
kuma.api_server.http_response_size_bytes.bucketThe size of API HTTP responses. (bucket)count-
kuma.api_server.http_response_size_bytes.countThe size of API HTTP responses. (count)count-
kuma.api_server.http_response_size_bytes.sumThe size of API HTTP responses. (sum)countbyte
kuma.ca_manager.get_cert.countCA manager get certificate latencies. (count)count-
kuma.ca_manager.get_cert.sumCA manager get certificate latencies. (sum)countsecond
kuma.ca_manager.get_root_cert_chain.countCA manager get CA root certificate chain latencies. (count)count-
kuma.ca_manager.get_root_cert_chain.sumCA manager get CA root certificate chain latencies. (sum)countsecond
kuma.cert_generation.countNumber of generated certificates.count-
kuma.certwatcher.read_certificate.errors_total.countTotal number of certificate read errors.counterror
kuma.certwatcher.read_certificate.total.countTotal number of certificate reads.countread
kuma.cla_cacheCluster Load Assignment cache operations.gaugeoperation
kuma.component.catalog_writer.countInter CP Catalog Writer component interval. (count)count-
kuma.component.catalog_writer.quantileInter CP Catalog Writer component interval. (quantile)gaugesecond
kuma.component.catalog_writer.sumInter CP Catalog Writer component interval. (sum)countsecond
kuma.component.heartbeat.countInter CP Heartbeat component interval. (count)count-
kuma.component.heartbeat.quantileInter CP Heartbeat component interval. (quantile)gaugesecond
kuma.component.heartbeat.sumInter CP Heartbeat component interval. (sum)countsecond
kuma.component.hostname_generator.countHostname generator interval. (count)count-
kuma.component.hostname_generator.quantileHostname generator interval. (quantile)gaugesecond
kuma.component.hostname_generator.sumHostname generator interval. (sum)countsecond
kuma.component.ms_status_updater.countInter CP Heartbeat component interval. (count)count-
kuma.component.ms_status_updater.quantileInter CP Heartbeat component interval. (quantile)gaugesecond
kuma.component.ms_status_updater.sumInter CP Heartbeat component interval. (sum)countsecond
kuma.component.mzms_status_updater.countMeshMultizoneService Updater component. (count)countoperation
kuma.component.mzms_status_updater.quantileMeshMultizoneService Updater component. (quantile)gaugeoperation
kuma.component.mzms_status_updater.sumMeshMultizoneService Updater component. (sum)countoperation
kuma.component.store_counter.countStore Counter component interval. (count)count-
kuma.component.store_counter.quantileStore Counter component interval. (quantile)gaugesecond
kuma.component.store_counter.sumStore Counter component interval. (sum)countsecond
kuma.component.sub_finalizer.countSubscription finalizer component interval. (count)count-
kuma.component.sub_finalizer.quantileSubscription finalizer component interval. (quantile)gaugesecond
kuma.component.sub_finalizer.sumSubscription finalizer component interval. (sum)countsecond
kuma.component.vip_allocator.countVirtual IP allocation duration. (count)count-
kuma.component.vip_allocator.quantileVirtual IP allocation duration. (quantile)gaugesecond
kuma.component.vip_allocator.sumVirtual IP allocation duration. (sum)countsecond
kuma.component.zone_available_services.countAvailable services tracker component interval. (count)count-
kuma.component.zone_available_services.quantileAvailable services tracker component interval. (quantile)gaugesecond
kuma.component.zone_available_services.sumAvailable services tracker component interval. (sum)countsecond
kuma.controller_runtime.active_workersNumber of currently used workers per controller.gaugeworker
kuma.controller_runtime.max_concurrent_reconcilesMaximum number of concurrent reconciles per controller.gauge-
kuma.controller_runtime.reconcile.errors_total.countTotal number of reconciliation errors per controller.counterror
kuma.controller_runtime.reconcile.panics_total.countTotal number of reconciliation panics per controller.count-
kuma.controller_runtime.reconcile.time_seconds.bucketLength of time per reconciliation per controller. (bucket)count-
kuma.controller_runtime.reconcile.time_seconds.countLength of time per reconciliation per controller. (count)count-
kuma.controller_runtime.reconcile.time_seconds.sumLength of time per reconciliation per controller. (sum)countsecond
kuma.controller_runtime.reconcile.total.countTotal number of reconciliations per controller.count-
kuma.controller_runtime.terminal_reconcile.errors_total.countTotal number of terminal reconciliation errors per controller.counterror
kuma.controller_runtime.webhook.latency_seconds.bucketHistogram of the latency of processing admission requests. (bucket)count-
kuma.controller_runtime.webhook.latency_seconds.countHistogram of the latency of processing admission requests. (count)count-
kuma.controller_runtime.webhook.latency_seconds.sumHistogram of the latency of processing admission requests. (sum)countsecond
kuma.controller_runtime.webhook.panics_total.countTotal number of webhook panics.count-
kuma.controller_runtime.webhook.requests_in_flightCurrent number of admission requests being served.gauge-
kuma.controller_runtime.webhook.requests_total.countTotal number of admission requests by HTTP status code.countrequest
kuma.cp_infoStatic information about the CP instance.gauge-
kuma.dp_server.http_request_duration_seconds.bucketThe latency of the HTTP requests. (bucket)count-
kuma.dp_server.http_request_duration_seconds.countThe latency of the HTTP requests. (count)count-
kuma.dp_server.http_request_duration_seconds.sumThe latency of the HTTP requests. (sum)countsecond
kuma.dp_server.http_requests_inflightThe number of inflight requests being handled at the same time.gaugerequest
kuma.dp_server.http_response_size_bytes.bucketThe size of the HTTP responses. (bucket)count-
kuma.dp_server.http_response_size_bytes.countThe size of the HTTP responses. (count)count-
kuma.dp_server.http_response_size_bytes.sumThe size of the HTTP responses. (sum)countbyte
kuma.events.dropped.countNumber of dropped events in event bus due to full channels.countevent
kuma.go.gc.duration_seconds.countWall-time pause (stop-the-world) duration in garbage collection cycles. (count)count-
kuma.go.gc.duration_seconds.quantileWall-time pause (stop-the-world) duration in garbage collection cycles. (quantile)gaugesecond
kuma.go.gc.duration_seconds.sumWall-time pause (stop-the-world) duration in garbage collection cycles. (sum)countsecond
kuma.go.goroutinesNumber of goroutines that currently exist.gauge-
kuma.go.memstats.alloc_bytesNumber of bytes allocated in heap and currently in use.gaugebyte
kuma.go.threadsNumber of OS threads created.gaugethread
kuma.grpc.server.handled_total.countTotal number of RPCs completed on the server, regardless of success or failure.countrequest
kuma.grpc.server.handling_seconds.bucketHistogram of response latency (seconds) of gRPC that had been application-level handled by the server. (bucket)count-
kuma.grpc.server.handling_seconds.countHistogram of response latency (seconds) of gRPC that had been application-level handled by the server. (count)count-
kuma.grpc.server.handling_seconds.sumHistogram of response latency (seconds) of gRPC that had been application-level handled by the server. (sum)countsecond
kuma.grpc.server.msg_received_total.countTotal number of gRPC stream messages received on the server.countmessage
kuma.grpc.server.msg_sent_total.countTotal number of gRPC stream messages sent by the server.countmessage
kuma.grpc.server.started_total.countTotal number of RPCs started on the server.countrequest
kuma.insights_resyncer.event_time_processing.countThe time spent to process an event. (count)count-
kuma.insights_resyncer.event_time_processing.quantileThe time spent to process an event. (quantile)gaugesecond
kuma.insights_resyncer.event_time_processing.sumThe time spent to process an event. (sum)countsecond
kuma.insights_resyncer.event_time_to_process.countThe time between an event being added to a batch and it being processed, in a well behaving system this should be less of equal to the MinResyncInterval. (count)count-
kuma.insights_resyncer.event_time_to_process.quantileThe time between an event being added to a batch and it being processed, in a well behaving system this should be less of equal to the MinResyncInterval. (quantile)gaugesecond
kuma.insights_resyncer.event_time_to_process.sumThe time between an event being added to a batch and it being processed, in a well behaving system this should be less of equal to the MinResyncInterval. (sum)countsecond
kuma.insights_resyncer.processor_idle_time.countThe time that the processor loop sits idle, the closer this gets to 0 the more the processing loop is at capacity. (count)count-
kuma.insights_resyncer.processor_idle_time.quantileThe time that the processor loop sits idle, the closer this gets to 0 the more the processing loop is at capacity. (quantile)gaugesecond
kuma.insights_resyncer.processor_idle_time.sumThe time that the processor loop sits idle, the closer this gets to 0 the more the processing loop is at capacity. (sum)countsecond
kuma.leaderIndicates if this instance is the leader (1 for leader).gauge-
kuma.leader_election.master_statusGauge of if the reporting system is master of the relevant lease, 0 indicates backup, 1 indicates master. 'kuma_name' is the tag used to indentify the lease.gauge-
kuma.mesh_cacheMesh context cache operations for XDS resource optimization.gaugeoperation
kuma.process.cpu_seconds_total.countTotal user and system CPU time spent in seconds.countsecond
kuma.process.max_fdsMaximum number of open file descriptors.gauge-
kuma.process.network.receive_bytes_total.countNumber of bytes received by the process over the network.countbyte
kuma.process.network.transmit_bytes_total.countNumber of bytes sent by the process over the network.countbyte
kuma.process.open_fdsNumber of open file descriptors.gauge-
kuma.process.resident_memory_bytesResident memory size in bytes.gaugebyte
kuma.process.start_time_secondsStart time of the process since unix epoch in seconds.gaugesecond
kuma.process.virtual_memory_bytesVirtual memory size in bytes.gaugebyte
kuma.process.virtual_memory_max_bytesMaximum amount of virtual memory available in bytes.gaugebyte
kuma.promhttp.metric_handler.requests_in_flightCurrent number of scrapes being served.gaugerequest
kuma.promhttp.metric_handler.requests_total.countTotal number of scrapes by HTTP status code.countrequest
kuma.resources_countNumber of Kuma resources by type and zone.gauge-
kuma.rest_client.requests_total.countNumber of HTTP requests, partitioned by status code, method, and host.countrequest
kuma.store.bucketStore operations. (bucket)countoperation
kuma.store.countStore operations. (count)countoperation
kuma.store.sumStore operations. (sum)countoperation
kuma.store_cache.countResource store cache operations (Get/List) to reduce database load.countitem
kuma.store_conflicts.countStore conflicts while updating.count-
kuma.vip_generation.countVirtual IP generation. (count)count-
kuma.vip_generation.sumVirtual IP generation. (sum)count-
kuma.vip_generation_errors.countErrors during Virtual IP generation.counterror
kuma.workqueue.adds_total.countTotal number of adds handled by workqueue.countitem
kuma.workqueue.depthCurrent depth of workqueue.gaugeitem
kuma.workqueue.longest_running_processor_secondsHow many seconds has the longest running processor for workqueue been running.gaugesecond
kuma.workqueue.queue_duration_seconds.bucketHow long in seconds an item stays in workqueue before being requested. (bucket)count-
kuma.workqueue.queue_duration_seconds.countHow long in seconds an item stays in workqueue before being requested. (count)count-
kuma.workqueue.queue_duration_seconds.sumHow long in seconds an item stays in workqueue before being requested. (sum)countsecond
kuma.workqueue.retries_total.countTotal number of retries handled by workqueue.count-
kuma.workqueue.unfinished_work_secondsHow many seconds of work has been done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.gaugesecond
kuma.workqueue.work_duration_seconds.bucketHow long in seconds processing an item from workqueue takes. (bucket)count-
kuma.workqueue.work_duration_seconds.countHow long in seconds processing an item from workqueue takes. (count)count-
kuma.workqueue.work_duration_seconds.sumHow long in seconds processing an item from workqueue takes. (sum)countsecond
kuma.xds.delivery.countXDS config delivery including response (ACK/NACK) from client. (count)count-
kuma.xds.delivery.sumXDS config delivery including response (ACK/NACK) from client. (sum)countsecond
kuma.xds.generation.countXDS Snapshot generation. (count)count-
kuma.xds.generation.quantileXDS Snapshot generation. (quantile)gaugesecond
kuma.xds.generation.sumXDS Snapshot generation. (sum)countsecond
kuma.xds.generation_errors.countErrors during XDS generation.counterror
kuma.xds.requests_received.countNumber of confirmations requests from a client.countrequest
kuma.xds.responses_sent.countNumber of responses sent by the server to a client.countresponse
kuma.xds.streams_activeNumber of active connections between a server and a client.gaugeconnection

Official documentation

Official documentation for the Kuma integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.