Weaviate integration metrics

The official Datadog integration for monitoring Weaviate. It collects 101 metrics.

Official summary

Open-source vector database for building AI-powered applications.

Metric types

  • count (occurrences in the interval): 51
  • gauge (value at a point in time): 50

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
weaviate.async.operations.runningThe number of currently running async operations. The operation itself is defined through the operation labelgaugeoperation
weaviate.backup.restore.class.ms.countThe number of samples used to calculate the duration of restoring a classcountoperation
weaviate.backup.restore.class.ms.sumThe duration of restoring a classcountmillisecond
weaviate.backup.restore.data.transferredThe total number of bytes transferred during a backup restorecountbyte
weaviate.backup.restore.from.backend.ms.countThe number of samples used to calculate the duration of the file transfer stage of a backup restorecountoperation
weaviate.backup.restore.from.backend.ms.sumThe duration of the file transfer stage of a backup restorecountmillisecond
weaviate.backup.restore.init.ms.countThe number of samples used to calculate the duration of the startup phase of a backup restorecountoperation
weaviate.backup.restore.init.ms.sumThe duration of the startup phase of a backup restorecountmillisecond
weaviate.backup.restore.ms.countThe number of samples used to calculate the duration of backup restorescountoperation
weaviate.backup.restore.ms.sumThe duration of backup restorescountmillisecond
weaviate.backup.store.data.transferredThe total number of bytes transferred during a backup storecountbyte
weaviate.backup.store.to.backend.ms.countThe number of samples used to calculate the duration of the file transfer stage of a backup storecountoperation
weaviate.backup.store.to.backend.ms.sumThe duration of the file transfer stage of a backup storecountmillisecond
weaviate.batch.delete.durations_ms.bucketThe number of operations observed for the batch delete duration histogram by upper_bound bucketscountoperation
weaviate.batch.delete.durations_ms.countThe count of operations observed in the batch delete duration histogramcountoperation
weaviate.batch.delete.durations_ms.sumThe sum of the duration of a batch delete in ms. The operation label further defines what operation as part of the batch delete is being measured. Granularity is a shard of a classcountmillisecond
weaviate.batch.durations_ms.bucketThe number of operations observed for the batch operation duration histogram by upper_bound bucketscountoperation
weaviate.batch.durations_ms.countThe count of operations observed in the batch operation duration histogramcountoperation
weaviate.batch.durations_ms.sumThe sum of the duration of a single batch operation in ms. The operation label further defines what operation as part of the batch (e.g. object, inverted, vector) is being used. Granularity is a shard of a classcountmillisecond
weaviate.bucket.pause.durations.ms.countThe number of samples used to calculate the duration of bucket pausescountoperation
weaviate.bucket.pause.durations.ms.sumThe duration of bucket pausescountmillisecond
weaviate.concurrent.goroutinesThe number of concurrently running goroutinesgauge-
weaviate.concurrent.queriesThe number of concurrently running query operationsgaugeoperation
weaviate.go.gc.duration.seconds.countThe summary count of garbage collection cycles in the Weaviate instancecountsecond
weaviate.go.gc.duration.seconds.quantileA summary of the pause duration of garbage collection cycles in the Weaviate instancegaugesecond
weaviate.go.gc.duration.seconds.sumThe sum of the pause duration of garbage collection cycles in the Weaviate instancecountsecond
weaviate.go.goroutinesThe number of goroutines that currently exist in the Weaviate instancegauge-
weaviate.go.infoMetric containing the Go version as a taggauge-
weaviate.go.memstats.alloc_bytesThe number of bytes allocated and still in use in the Weaviate instancegaugebyte
weaviate.go.memstats.alloc_bytes.countThe monotonic count of bytes allocated and still in use in the Weaviate instancecountbyte
weaviate.go.memstats.buck_hash.sys_bytesThe number of bytes used by the profiling bucket hash table in the Weaviate instancegaugebyte
weaviate.go.memstats.frees.countThe total number of frees in the Weaviate instancecount-
weaviate.go.memstats.gc.cpu_fractionThe fraction of this program's available CPU time used by the GC since the program started in the Weaviate instancegaugefraction
weaviate.go.memstats.gc.sys_bytesThe number of bytes used for garbage collection system metadata in the Weaviate instancegaugebyte
weaviate.go.memstats.heap.alloc_bytesThe number of heap bytes allocated and still in use in the Weaviate instancegaugebyte
weaviate.go.memstats.heap.idle_bytesThe number of heap bytes waiting to be used in the Weaviate instancegaugebyte
weaviate.go.memstats.heap.inuse_bytesThe number of heap bytes that are in use in the Weaviate instancegaugebyte
weaviate.go.memstats.heap.objectsThe number of allocated objects in the Weaviate instancegaugeobject
weaviate.go.memstats.heap.released_bytesThe number of heap bytes released to the OS in the Weaviate instancegaugebyte
weaviate.go.memstats.heap.sys_bytesThe number of heap bytes obtained from system in the Weaviate instancegaugebyte
weaviate.go.memstats.lookups.countThe number of pointer lookupscount-
weaviate.go.memstats.mallocs.countThe number of mallocscount-
weaviate.go.memstats.mcache.inuse_bytesThe number of bytes in use by mcache structures in the Weaviate instancegaugebyte
weaviate.go.memstats.mcache.sys_bytesThe number of bytes used for mcache structures obtained from system in the Weaviate instancegaugebyte
weaviate.go.memstats.mspan.inuse_bytesThe number of bytes in use by mspan structures in the Weaviate instancegaugebyte
weaviate.go.memstats.mspan.sys_bytesThe number of bytes used for mspan structures obtained from system in the Weaviate instancegaugebyte
weaviate.go.memstats.next.gc_bytesThe number of heap bytes when next garbage collection takes place in the Weaviate instancegaugebyte
weaviate.go.memstats.other.sys_bytesThe number of bytes used for other system allocations in the Weaviate instancegaugebyte
weaviate.go.memstats.stack.inuse_bytesThe number of bytes in use by the stack allocator in the Weaviate instancegaugebyte
weaviate.go.memstats.stack.sys_bytesThe number of bytes obtained from system for stack allocator in the Weaviate instancegaugebyte
weaviate.go.memstats.sys_bytesThe number of bytes obtained from system in the Weaviate instancegaugebyte
weaviate.go.threadsThe number of OS threads created in the Weaviate instancegaugethread
weaviate.http.latency_msThe HTTP request response time latency in msgaugemillisecond
weaviate.lsm.active.segmentsThe number of currently present segments per shard. Granularity is shard of a class. Grouped by strategygaugesegment
weaviate.lsm.bloom.filters.duration_ms.countThe number of samples used to calculate the duration of a bloom operationcountoperation
weaviate.lsm.bloom.filters.duration_ms.sumThe duration of a bloom filter operation per shard in ms. Granularity is shard of a class. Grouped by strategycountmillisecond
weaviate.lsm.memtable.durations_ms.countThe number of samples used to calculate the duration of a sync or async vector index maintenance operationcountoperation
weaviate.lsm.memtable.durations_ms.sumThe duration of a sync or async vector index maintenance operation. The operation itself is defined through the operation labelcountmillisecond
weaviate.lsm.memtable.sizeThe size of memtable by pathgauge-
weaviate.lsm.segment.objectsThe number of entries per LSM segment by level. Granularity is shard of a class. Grouped by strategy and levelgaugeobject
weaviate.lsm.segment.sizeThe size of LSM segment by level and unitgauge-
weaviate.lsm.segmentsThe number of segments by levelgaugesegment
weaviate.node.shard.objectsThe number of objects inside a Weaviate shardgaugeobject
weaviate.node.stats.objectsThe number of objects inside a Weaviate nodegaugeobject
weaviate.node.stats.shardsThe number of shard inside a Weaviate shardgaugeshard
weaviate.node.statusThe current status of a Weaviate Node. 0:HEALTHY, 1:UNHEALTHY, 2:UNAVAILABLE, and 3:UNKNOWNgauge-
weaviate.objectsThe numbers of objects present. Granularity is a shard of a classgaugeobject
weaviate.objects.durations_ms.countThe number of samples used to calculate the duration of an individual object operationcountoperation
weaviate.objects.durations_ms.sumThe duration of an individual object operation, such as put, delete, etc. as indicated by the operation label, also as part of a batch. The step label adds additional precisions to each operation. Granularity is a shard of a classcountmillisecond
weaviate.process.cpu.seconds.countThe total user and system CPU time spent in seconds in the Weaviate instancecountsecond
weaviate.process.max_fdsThe maximum number of open file descriptors in the Weaviate instancegauge-
weaviate.process.open_fdsThe number of open file descriptors in the Weaviate instancegauge-
weaviate.process.resident_memory.bytesThe resident memory size in bytes in the Weaviate instancegaugebyte
weaviate.process.start_time.secondsThe start time of the process since unix epoch in seconds in the Weaviate instancegaugesecond
weaviate.process.virtual_memory.bytesThe virtual memory size in bytes in the Weaviate instancegaugebyte
weaviate.process.virtual_memory.max_bytesThe maximum amount of virtual memory available in bytes in the Weaviate instancegaugebyte
weaviate.promhttp.metric_handler.requests.countThe total number of scrapes by HTTP status codecountrequest
weaviate.promhttp.metric_handler.requests_in_flightThe current number of scrapes being servedgaugerequest
weaviate.queries.durations_ms.bucketThe number of operations observed in the query duration histogram by upper_bound bucketscountoperation
weaviate.queries.durations_ms.countThe count of operations observed in the query duration histogramcountoperation
weaviate.queries.durations_ms.sumThe sum of query durations in millisecondscountmillisecond
weaviate.queries.filtered.vector.durations_ms.countThe count of the duration of queries summarycount-
weaviate.queries.filtered.vector.durations_ms.sumThe duration of queries in millisecondscountmillisecond
weaviate.query.dimensions.countThe vector dimensions used by any read-query that involves vectorscount-
weaviate.requestsThe number of requests tagged by a given status(ok, user_error, server_error). Available only on Weaviate version 1.20.0+gaugerequest
weaviate.startup.diskio.throughput.bucketThe number of operations observed for the the disk I/O throughput duration by upper_bound bucketscountoperation
weaviate.startup.diskio.throughput.countThe count of operations observed in the disk I/O throughput duration histogramcountoperation
weaviate.startup.diskio.throughput.sumThe sum of disk I/O throughput startup operations in bytes/s, such as reading back the HNSW index or recovering LSM segments. The operation itself is defined by the operation labelcountbyte/second
weaviate.startup.durations_ms.countThe number of samples used to calculate the duration individual startup operationcountoperation
weaviate.startup.durations_ms.sumThe duration of individual startup operations in ms. The operation itself is defined through the operation labelcountmillisecond
weaviate.startup.progressThe ratio (percentage) of startup progress for a particular component in a shardgauge-
weaviate.vector.dimensions.countThe total dimensions in a shardcount-
weaviate.vector.index.durations_ms.countThe number of samples used to calculate the duration of a sync or async vector index operationcountoperation
weaviate.vector.index.durations_ms.sumThe duration of regular vector index operation, such as insert or delete. The operation itself is defined through the operation label. The step label adds more granularity to each operationcountmillisecond
weaviate.vector.index.maintenance.durations_ms.countThe number of samples used to calculate the duration of a sync or async vector index operationcountoperation
weaviate.vector.index.maintenance.durations_ms.sumThe duration of a sync or async vector index maintenance operation. The operation itself is defined through the operation labelcountmillisecond
weaviate.vector.index.operationsThe total number of mutating operations on the vector index. The operation itself is defined by the operation labelgaugeoperation
weaviate.vector.index.sizeThe total capacity of the vector index. Typically larger than the number of vectors imported as it grows proactivelygauge-
weaviate.vector.index.tombstone.cleaned.countThe total number of deleted and removed vectors after repair operationscount-
weaviate.vector.index.tombstone.cleanup.threadsThe number of currently active threads for repairing/cleaning up the vector index after deletes have occurredgauge-
weaviate.vector.index.tombstonesThe number of active vector index tombstonesgauge-

Official documentation

Official documentation for the Weaviate integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.