etcd integration metrics

The official Datadog integration for monitoring etcd. It collects 196 metrics.

Official summary

Track writes, updates, deletes, inter-node latencies, and more Etcd metrics.

Metric types

  • gauge (value at a point in time): 146
  • count (occurrences in the interval): 50

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
etcd.cluster.versionWhich version is the etcd cluster is running. 1 for each version identified in the labelsgaugeitem
etcd.debugging.auth.revisionThe current revision of auth storegaugeitem
etcd.debugging.disk.backend.commit.rebalance.duration.seconds.countThe latency distributions of commit.rebalance called by bboltdb backendgaugesecond
etcd.debugging.disk.backend.commit.rebalance.duration.seconds.sumThe latency distributions of commit.rebalance called by bboltdb backendgaugesecond
etcd.debugging.disk.backend.commit.spill.duration.seconds.countThe latency distributions of commit.spill called by bboltdb backendgaugesecond
etcd.debugging.disk.backend.commit.spill.duration.seconds.sumThe latency distributions of commit.spill called by bboltdb backendgaugesecond
etcd.debugging.disk.backend.commit.write.duration.seconds.countThe latency distributions of commit.write called by bboltdb backendgaugesecond
etcd.debugging.disk.backend.commit.write.duration.seconds.sumThe latency distributions of commit.write called by bboltdb backendgaugesecond
etcd.debugging.lease.granted.totalThe total number of granted leasescountitem
etcd.debugging.lease.renewed.totalThe number of renewed leases seen by the leadercountitem
etcd.debugging.lease.revoked.totalThe total number of revoked leasescountitem
etcd.debugging.lease.ttl.total.countBucketed histogram of lease TTLsgaugeitem
etcd.debugging.lease.ttl.total.sumBucketed histogram of lease TTLsgaugeitem
etcd.debugging.mvcc.compact.revisionThe revision of the last compaction in storegaugeitem
etcd.debugging.mvcc.current.revisionThe current revision of the storegaugeitem
etcd.debugging.mvcc.db.compaction.keys.totalTotal number of db keys compacted.countkey
etcd.debugging.mvcc.db.compaction.lastThe unix time of the last db compaction. Resets to 0 on startgaugesecond
etcd.debugging.mvcc.db.compaction.pause.duration.milliseconds.countBucketed histogram of db compaction pause duration.gaugemillisecond
etcd.debugging.mvcc.db.compaction.pause.duration.milliseconds.sumBucketed histogram of db compaction pause duration.gaugemillisecond
etcd.debugging.mvcc.db.compaction.total.duration.milliseconds.countBucketed histogram of db compaction total duration.gaugemillisecond
etcd.debugging.mvcc.db.compaction.total.duration.milliseconds.sumBucketed histogram of db compaction total duration.gaugemillisecond
etcd.debugging.mvcc.db.total.size.in_bytesTotal size of the underlying database in bytes.gaugebyte
etcd.debugging.mvcc.delete.totalTotal number of deletes seen by this member.countquery
etcd.debugging.mvcc.events.totalTotal number of events sent by this member.countevent
etcd.debugging.mvcc.index.compaction.pause.duration.milliseconds.countBucketed histogram of index compaction pause duration.gaugemillisecond
etcd.debugging.mvcc.index.compaction.pause.duration.milliseconds.sumBucketed histogram of index compaction pause duration.gaugemillisecond
etcd.debugging.mvcc.keys.totalTotal number of keys.gaugekey
etcd.debugging.mvcc.pending.events.totalTotal number of pending events to be sent.gaugeevent
etcd.debugging.mvcc.put.totalTotal number of puts seen by this member.countquery
etcd.debugging.mvcc.range.totalTotal number of ranges seen by this member.countquery
etcd.debugging.mvcc.slow_watcher.totalTotal number of unsynced slow watchers.gaugeconnection
etcd.debugging.mvcc.total.put.size.in_bytesThe total size of put kv pairs seen by this membergaugebyte
etcd.debugging.mvcc.txn.totalTotal number of txns seen by this member.counttransaction
etcd.debugging.mvcc.watch_stream.totalTotal number of watch streams.gaugeconnection
etcd.debugging.mvcc.watcher.totalTotal number of watchers.gaugeconnection
etcd.debugging.server.lease.expired.totalThe total number of expired leases.countitem
etcd.debugging.snap.save.marshalling.duration.seconds.countThe marshalling cost distributions of save called by snapshot.gaugesecond
etcd.debugging.snap.save.marshalling.duration.seconds.sumThe marshalling cost distributions of save called by snapshot.gaugesecond
etcd.debugging.snap.save.total.duration.seconds.countThe total latency distributions of save called by snapshot.gaugesecond
etcd.debugging.snap.save.total.duration.seconds.sumThe total latency distributions of save called by snapshot.gaugesecond
etcd.debugging.store.expires.totalTotal number of expired keys.countkey
etcd.debugging.store.reads.totalTotal number of reads action by (get/getRecursive), local to this member.countread
etcd.debugging.store.watch.requests.totalTotal number of incoming watch requests (new or reestablished).countrequest
etcd.debugging.store.watchersCount of currently active watchers.gaugeconnection
etcd.debugging.store.writes.totalTotal number of writes (e.g. set/compareAndDelete) seen by this member.countwrite
etcd.disk.backend.commit.duration.seconds.countThe latency distributions of commit called by backend.gaugesecond
etcd.disk.backend.commit.duration.seconds.sumThe latency distributions of commit called by backend.gaugesecond
etcd.disk.backend.defrag.duration.seconds.countThe latency distribution of backend defragmentationgaugesecond
etcd.disk.backend.defrag.duration.seconds.sumThe latency distribution of backend defragmentationgaugesecond
etcd.disk.backend.snapshot.duration.seconds.countThe latency distribution of backend snapshots.gaugesecond
etcd.disk.backend.snapshot.duration.seconds.sumThe latency distribution of backend snapshots.gaugesecond
etcd.disk.defrag.inflightWhether or not defrag is active on the member. 1 means active 0 means notgaugecheck
etcd.disk.wal.fsync.duration.seconds.countThe count of latency distributions of fsync called by wal.gaugesecond
etcd.disk.wal.fsync.duration.seconds.sumThe sum of latency distributions of fsync called by wal.gaugesecond
etcd.disk.wal.write.bytes.totalTotal number of bytes written in WALgaugebyte
etcd.disk.wal.write.duration.seconds.countThe latency distributions of write called by WALgaugesecond
etcd.disk.wal.write.duration.seconds.sumThe latency distributions of write called by WALgaugesecond
etcd.etcd.server.client.requests.totalThe total number of client requests per client versioncountrequest
etcd.go.gc.duration.seconds.countA summary of the GC invocation durations.gaugesecond
etcd.go.gc.duration.seconds.quantileGC invocation duration quantile.gaugesecond
etcd.go.gc.duration.seconds.sumA summary of the GC invocation durations.gaugesecond
etcd.go.gc.gogc.percentHeap size target percentage configured by the user otherwise 100gaugepercent
etcd.go.gc.gomemlimit.bytesGo runtime memory limit configured by the user otherwise math.MaxInt64gaugebyte
etcd.go.goroutinesNumber of goroutines that currently exist.gaugethread
etcd.go.infoInformation about the Go environment.gaugeitem
etcd.go.memstats.alloc.bytesNumber of bytes allocated and still in use.gaugebyte
etcd.go.memstats.alloc.bytes.totalTotal number of bytes allocated, even if freed.countbyte
etcd.go.memstats.buck.hash.sys.bytesNumber of bytes used by the profiling bucket hash table.gaugebyte
etcd.go.memstats.frees.totalTotal number of frees.countoccurrence
etcd.go.memstats.gc.cpu.fractionThe fraction of this program's available CPU time used by the GC since the program started.gaugecpu
etcd.go.memstats.gc.sys.bytesNumber of bytes used for garbage collection system metadata.gaugebyte
etcd.go.memstats.heap.alloc.bytesNumber of heap bytes allocated and still in use.gaugebyte
etcd.go.memstats.heap.idle.bytesNumber of heap bytes waiting to be used.gaugebyte
etcd.go.memstats.heap.inuse.bytesNumber of heap bytes that are in use.gaugebyte
etcd.go.memstats.heap.objectsNumber of allocated objects.gaugeitem
etcd.go.memstats.heap.released.bytesNumber of heap bytes released to OS.gaugebyte
etcd.go.memstats.heap.sys.bytesNumber of heap bytes obtained from system.gaugebyte
etcd.go.memstats.last.gc.time.secondsNumber of seconds since 1970 of last garbage collection.gaugesecond
etcd.go.memstats.lookups.totalTotal number of pointer lookups.countoccurrence
etcd.go.memstats.mallocs.totalTotal number of mallocs.countoccurrence
etcd.go.memstats.mcache.inuse.bytesNumber of bytes in use by mcache structures.gaugebyte
etcd.go.memstats.mcache.sys.bytesNumber of bytes used for mcache structures obtained from system.gaugebyte
etcd.go.memstats.mspan.inuse.bytesNumber of bytes in use by mspan structures.gaugebyte
etcd.go.memstats.mspan.sys.bytesNumber of bytes used for mspan structures obtained from system.gaugebyte
etcd.go.memstats.next.gc.bytesNumber of heap bytes when next garbage collection will take place.gaugebyte
etcd.go.memstats.other.sys.bytesNumber of bytes used for other system allocations.gaugebyte
etcd.go.memstats.stack.inuse.bytesNumber of bytes in use by the stack allocator.gaugebyte
etcd.go.memstats.stack.sys.bytesNumber of bytes obtained from system for stack allocator.gaugebyte
etcd.go.memstats.sys.bytesNumber of bytes obtained from system.gaugebyte
etcd.go.sched.gomaxprocs.threadsThe current runtime.GOMAXPROCS setting or the number of operating system threads that can execute user-level Go code simultaneouslygaugethread
etcd.go.threadsNumber of OS threads created.gaugethread
etcd.grpc.proxy.cache.hits.totalTotal number of cache hitsgaugeoccurrence
etcd.grpc.proxy.cache.keys.totalTotal number of keys/ranges cachedgaugeitem
etcd.grpc.proxy.cache.misses.totalTotal number of cache missesgaugeoccurrence
etcd.grpc.proxy.events.coalescing.totalTotal number of events coalescingcountevent
etcd.grpc.proxy.watchers.coalescing.totalTotal number of current watchers coalescinggaugeconnection
etcd.grpc.server.handled.totalTotal number of RPCs completed on the server, regardless of success or failure.countoperation
etcd.grpc.server.msg.received.totalTotal number of RPC stream messages received on the server.countoperation
etcd.grpc.server.msg.sent.totalTotal number of gRPC stream messages sent by the server.countoperation
etcd.grpc.server.started.totalTotal number of RPCs started on the server.countoperation
etcd.leader.counts.failRate of failed Raft RPC requests (ETCD API V2 only)gaugerequest/second
etcd.leader.counts.successRate of successful Raft RPC requests (ETCD API V2 only)gaugerequest/second
etcd.leader.latency.avgAverage latency to each peer in the cluster (ETCD API V2 only)gaugemillisecond
etcd.leader.latency.currentCurrent latency to each peer in the cluster (ETCD API V2 only)gaugemillisecond
etcd.leader.latency.maxMaximum latency to each peer in the cluster (ETCD API V2 only)gaugemillisecond
etcd.leader.latency.minMinimum latency to each peer in the cluster (ETCD API V2 only)gaugemillisecond
etcd.leader.latency.stddevStandard deviation latency to each peer in the cluster (ETCD API V2 only)gaugemillisecond
etcd.mvcc.db.total.size.in_use.bytesTotal size of the underlying database logically in usegaugebyte
etcd.network.active_peersThe current number of active peer connectionsgaugeconnection
etcd.network.client.grpc.received.bytes.totalThe total number of bytes received from grpc clients.countbyte
etcd.network.client.grpc.sent.bytes.totalThe total number of bytes sent to grpc clients.countbyte
etcd.network.disconnected_peers.totalThe total number of disconnected peerscountconnection
etcd.network.known_peersThe current number of known peer connectionsgaugeconnection
etcd.network.peer.received.bytes.totalThe total number of bytes received from peers.countbyte
etcd.network.peer.received.failures.totalThe total number of receive failures from peerscountevent
etcd.network.peer.round_trip_time.secondsRound-Trip-Time histogram between peers.gaugesecond
etcd.network.peer.sent.bytes.totalThe total number of bytes sent to peers.countbyte
etcd.network.peer.sent.failures.totalThe total number of send failures from peerscountevent
etcd.network.snapshot.receive.failures.totalTotal number of snapshot receive failurescountevent
etcd.network.snapshot.receive.inflights.totalTotal number of inflight snapshot sendsgaugeevent
etcd.network.snapshot.receive.success.totalTotal number of successful snapshot receivescountevent
etcd.network.snapshot.receive.total.duration.seconds.countTotal latency distributions of v3 snapshot receivesgaugesecond
etcd.network.snapshot.receive.total.duration.seconds.sumTotal latency distributions of v3 snapshot receivesgaugesecond
etcd.network.snapshot.send.failures.totalThe total number of send failures from peerscountevent
etcd.network.snapshot.send.inflights.totalTotal number of inflight snapshot receivesgaugeevent
etcd.network.snapshot.send.sucess.totalTotal number of successful snapshot sendscountevent
etcd.network.snapshot.send.total.duration.seconds.countTotal latency distributions of v3 snapshot sendsgaugesecond
etcd.network.snapshot.send.total.duration.seconds.sumTotal latency distributions of v3 snapshot sendsgaugesecond
etcd.os.fd.limitThe file descriptor limitgaugeobject
etcd.os.fd.usedThe number of used file descriptorsgaugeobject
etcd.process.cpu.seconds.totalTotal user and system CPU time spent in seconds.countcpu
etcd.process.max.fdsMaximum number of open file descriptors.gaugeitem
etcd.process.network.receive_bytes.totalNumber of bytes received by the process over the networkcountbyte
etcd.process.network.transmit_bytes.totalNumber of bytes sent by the process over the networkcountbyte
etcd.process.open.fdsNumber of open file descriptors.gaugeitem
etcd.process.resident.memory.bytesResident memory size in bytes.gaugebyte
etcd.process.start.time.secondsStart time of the process since unix epoch in seconds.gaugesecond
etcd.process.virtual.memory.bytesVirtual memory size in bytes.gaugebyte
etcd.process.virtual.memory.max_bytesMaximum amount of virtual memory available in bytesgaugebyte
etcd.self.recv.appendrequest.countRate of append requests this node has processed (ETCD API V2 only)gaugerequest/second
etcd.self.recv.bandwidthrateRate of bytes received (ETCD API V2 only)gaugebyte/second
etcd.self.recv.pkgrateRate of packets received (ETCD API V2 only)gaugepacket/second
etcd.self.send.appendrequest.countRate of append requests this node has sent (ETCD API V2 only)gaugerequest/second
etcd.self.send.bandwidthrateRate of bytes sent (ETCD API V2 only)gaugebyte/second
etcd.self.send.pkgrateRate of packets sent (ETCD API V2 only)gaugepacket/second
etcd.server.apply.duration.seconds.countApply request latencygaugerequest/second
etcd.server.apply.duration.seconds.sumApply request latencygaugerequest/second
etcd.server.apply.slow.totalThe total number of slow apply requests (likely overloaded from slow disk)countrequest
etcd.server.feature_enabledFeature flags enabledgaugecheck
etcd.server.go_versionWhich Go version server is running with. 1 with label with current versiongaugeunit
etcd.server.has_leaderWhether or not a leader exists. 1 is existence, 0 is not.gaugecheck
etcd.server.health.failures.totalThe total number of failed health checkscountevent
etcd.server.health.success.totalThe total number of successful health checkscountevent
etcd.server.healthcheckHealth check resultgaugecheck
etcd.server.healthchecks.totalTotal health checkscountevent
etcd.server.heartbeat.send.failures.totalThe total number of leader heartbeat send failures (likely overloaded from slow disk)countevent
etcd.server.idThe server member IDgaugeitem
etcd.server.is_leaderWhether or not this member is a leader. 1 if is, 0 otherwise.gaugecheck
etcd.server.is_learnerWhether this node is a learnergaugecheck
etcd.server.leader.changes.seen.totalThe number of leader changes seen.countevent
etcd.server.learner.promote_failuresLearner promotion failurescountevent
etcd.server.learner.promote_successesLearner promotion successescountevent
etcd.server.lease.expired.totalThe total number of expired leasescountoccurrence
etcd.server.proposals.applied.totalThe total number of consensus proposals applied.gaugeoccurrence
etcd.server.proposals.committed.totalThe total number of consensus proposals committed.gaugeoccurrence
etcd.server.proposals.failed.totalThe total number of failed proposals seen.countoccurrence
etcd.server.proposals.pendingThe current number of pending proposals to commit.gaugeoccurrence
etcd.server.quota.backend.bytesCurrent backend storage quota size in bytesgaugebyte
etcd.server.range.duration.seconds.countRange request latencygaugerequest/second
etcd.server.range.duration.seconds.sumRange request latencygaugerequest/second
etcd.server.read_indexes.failed.totalThe total number of failed read indexes seencountevent
etcd.server.read_indexes.slow.totalThe total number of pending read indexes not in sync with leader or timed out read index requestscountevent
etcd.server.snapshot.apply.in_progress.totalSnapshots being appliedgaugeevent
etcd.server.versionWhich version is running. 1 for 'server_version' label with current version.gaugeitem
etcd.snap.db.fsync.duration.seconds.countThe latency distributions of fsyncing .snap.db filegaugesecond
etcd.snap.db.fsync.duration.seconds.sumThe latency distributions of fsyncing .snap.db filegaugesecond
etcd.snap.db.save.total.duration.seconds.countThe total latency distributions of v3 snapshot savegaugesecond
etcd.snap.db.save.total.duration.seconds.sumThe total latency distributions of v3 snapshot savegaugesecond
etcd.snap.fsync.duration.seconds.countThe latency distributions of fsync called by snapgaugesecond
etcd.snap.fsync.duration.seconds.sumThe latency distributions of fsync called by snapgaugesecond
etcd.store.compareanddelete.failRate of compare and delete requests failure (ETCD API V2 only)gaugerequest/second
etcd.store.compareanddelete.successRate of compare and delete requests success (ETCD API V2 only)gaugerequest/second
etcd.store.compareandswap.failRate of compare and swap requests failure (ETCD API V2 only)gaugerequest/second
etcd.store.compareandswap.successRate of compare and swap requests success (ETCD API V2 only)gaugerequest/second
etcd.store.create.failRate of failed create requests (ETCD API V2 only)gaugerequest/second
etcd.store.create.successRate of successful create requests (ETCD API V2 only)gaugerequest/second
etcd.store.delete.failRate of failed delete requests (ETCD API V2 only)gaugerequest/second
etcd.store.delete.successRate of successful delete requests (ETCD API V2 only)gaugerequest/second
etcd.store.expire.countRate of expired keys (ETCD API V2 only)gaugeeviction/second
etcd.store.gets.failRate of failed get requests (ETCD API V2 only)gaugerequest/second
etcd.store.gets.successRate of successful get requests (ETCD API V2 only)gaugerequest/second
etcd.store.sets.failRate of failed set requests (ETCD API V2 only)gaugerequest/second
etcd.store.sets.successRate of successful set requests (ETCD API V2 only)gaugerequest/second
etcd.store.update.failRate of failed update requests (ETCD API V2 only)gaugerequest/second
etcd.store.update.successRate of successful update requests (ETCD API V2 only)gaugerequest/second
etcd.store.watchersRate of watchers (ETCD API V2 only)gauge-

Official documentation

Official documentation for the etcd integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.