Milvus integration metrics
The official Datadog integration for monitoring Milvus. It collects 386 metrics.
Official summary
Monitor the performance and usage of your Milvus deployments.
Metric types
- count (occurrences in the interval): 298
- gauge (value at a point in time): 88
Metrics
Descriptions are the official definitions, unedited.
| Metric | Type | Unit |
|---|---|---|
milvus.Histogram bucket for the number of brute-force searches per request | count | - |
milvus.Count aggregation of brute-force searches per request | count | - |
milvus.Sum aggregation of brute-force searches per request | count | - |
milvus.Bitset ratio histogram bucket | count | - |
milvus.Count of bitset ratio calculations | count | - |
milvus.Sum of bitset ratios | count | - |
milvus.Build information of milvus | gauge | - |
milvus.Index build latency histogram bucket | count | - |
milvus.Count of index builds | count | - |
milvus.Sum of index build latencies(s) | count | second |
milvus.Histogram bucket for the cache hit count per request | count | - |
milvus.Count aggregation of cache hit count per request | count | - |
milvus.Sum aggregation of cache hit count per request | count | - |
milvus.Total number of active futures. | gauge | - |
milvus.Histogram bucket of cgo call duration in seconds | count | - |
milvus.Count of cgo calls | count | - |
milvus.Sum of cgo call duration in seconds. | count | second |
milvus.Histogram bucket for the duration of cgo calls in queue | count | - |
milvus.Counnt of cgo calls in queue | count | - |
milvus.Sum of the duration of cgo calls in queue | count | second |
milvus.Total number of running cgo calls. | gauge | - |
milvus.Channel checkpoint timestamp in Unix seconds | gauge | - |
milvus.Number of collections | gauge | - |
milvus.Now time minus time travel per physical channel | gauge | millisecond |
milvus.Number of data nodes | gauge | - |
milvus.The import tasks grouping by type and state | gauge | - |
milvus.Number of IndexNodes managed by IndexCoord | gauge | - |
milvus.Number of building index requests | count | - |
milvus.Number of index tasks of each type | gauge | - |
milvus.Number of segments | gauge | - |
milvus.Binlog size of healthy segments | gauge | byte |
milvus.Index files size of the segments | gauge | byte |
milvus.Number of stored rows of healthy segment | gauge | - |
milvus.Histogram bucket for the latency of task execute operation | count | - |
milvus.Count of task execute operations | count | - |
milvus.Sum of the latency of task execute operations | count | millisecond |
milvus.The num of data manipulation language channel watched by datanode | gauge | - |
milvus.Count of auto flush buffer operations | count | - |
milvus.Count of consumed bytes | count | - |
milvus.Count of consumed msg | count | - |
milvus.Now time minus time travel per physical channel | gauge | millisecond |
milvus.Histogram bucket for the latency of encode buffer data | count | - |
milvus.Count of encode buffer data operations | count | - |
milvus.Sum of the latency of encode buffer data operations | count | millisecond |
milvus.Number of flowgraphs | gauge | - |
milvus.Count of flush buffer operations | count | - |
milvus.Count of flush request | count | - |
milvus.Num of rows flushed to storage | count | - |
milvus.Byte size of data flushed to storage | count | byte |
milvus.time.Now() sub dispatcher's current consume time | gauge | millisecond |
milvus.Count of rows consumed from msgStream | count | - |
milvus.Histogram bucket for the latency of saving flush data to storage | count | - |
milvus.Count of saving flush data to storage events | count | - |
milvus.Sum of the latency of saving flush data to storage events | count | millisecond |
milvus.Histogram bucket for DISKANN range search iterations | count | - |
milvus.Count of DISKANN range search events | count | - |
milvus.Sum of DISKANN range search iterations | count | - |
milvus.Histogram for DISKANN search hops | count | - |
milvus.Count of DISKANN search hop events | count | - |
milvus.Sum of DISKANN search hops | count | - |
milvus.Histogram bucket for the DISKANN bitset ratio for search and range search | count | - |
milvus.Count of the DISKANN bitset ratio operations for search and range search | count | - |
milvus.Sum of the DISKANN bitset ratio for search and range search | count | - |
milvus.Histogram bucket for the execute latency per request | count | - |
milvus.Count aggregation of the execute latency per request | count | - |
milvus.Sum aggregation of the execute latency per request | count | - |
milvus.Histogram bucket for the average connectivity ratio set under filtering per request | count | - |
milvus.Count of the connectivity ratios set under filtering per request | count | - |
milvus.Sum of the average connectivity ratios set under filtering per request | count | - |
milvus.Histogram bucket of the average materialized view activated fields per request | count | - |
milvus.Count of the requests activating materialized view fields | count | - |
milvus.Sum of the average materialized view activated fields per request | count | - |
milvus.Histogram bucket for the materialized view change base count per request | count | - |
milvus.Count of requests triggering materialized view change base events | count | - |
milvus.Sum of materialized view change base counts per request | count | - |
milvus.Histogram bucket for the materialized view only count per request | count | - |
milvus.Count of requests that trigger materialized view only events | count | - |
milvus.Sum of materialized view only counts | count | - |
milvus.Histogram bucket for materialized view supplement entry point from bitset boolean count per request | count | - |
milvus.Count of requests triggering a materialized view supplement entry point from bitset boolean event | count | - |
milvus.Sum of materialized view supplement entry point from bitset boolean events | count | - |
milvus.Histogram bucket for the number of files for flushed segment | count | - |
milvus.Count of flushed segment events | count | - |
milvus.Sum of the number of files for flushed segments | count | - |
milvus.A summary of the pause duration of garbage collection cycles. | count | - |
milvus.A summary of the pause duration of garbage collection cycles. | gauge | - |
milvus.A summary of the pause duration of garbage collection cycles. | count | - |
milvus.Number of goroutines that currently exist. | gauge | - |
milvus.Information about the Go environment. | gauge | - |
milvus.Number of bytes allocated and still in use. | gauge | - |
milvus.Total number of bytes allocated, even if freed. | count | - |
milvus.Number of bytes used by the profiling bucket hash table. | gauge | - |
milvus.Total number of frees. | count | - |
milvus.Number of bytes used for garbage collection system metadata. | gauge | - |
milvus.Number of heap bytes allocated and still in use. | gauge | - |
milvus.Number of heap bytes waiting to be used. | gauge | - |
milvus.Number of heap bytes that are in use. | gauge | - |
milvus.Number of allocated objects. | gauge | - |
milvus.Number of heap bytes released to OS. | gauge | - |
milvus.Number of heap bytes obtained from system. | gauge | - |
milvus.Number of seconds since 1970 of last garbage collection. | gauge | - |
milvus.Total number of pointer lookups. | count | - |
milvus.Total number of mallocs. | count | - |
milvus.Number of bytes in use by mcache structures. | gauge | - |
milvus.Number of bytes used for mcache structures obtained from system. | gauge | - |
milvus.Number of bytes in use by mspan structures. | gauge | - |
milvus.Number of bytes used for mspan structures obtained from system. | gauge | - |
milvus.Number of heap bytes when next garbage collection will take place. | gauge | - |
milvus.Number of bytes used for other system allocations. | gauge | - |
milvus.Number of bytes in use by the stack allocator. | gauge | - |
milvus.Number of bytes obtained from system for stack allocator. | gauge | - |
milvus.Number of bytes obtained from system. | gauge | - |
milvus.Number of OS threads created. | gauge | - |
milvus.Histogram bucket for the number of graph search per request | count | - |
milvus.Count of requests that trigger a graph search | count | - |
milvus.Sum of graph searches | count | - |
milvus.Histogram bucket of the HNSW bitset ratio for search and range search | count | - |
milvus.Count aggregation of the HNSW bitset ratio for search and range search | count | - |
milvus.Sum aggregation of the HNSW bitset ratio for search and range search | count | - |
milvus.Histogram bucket of the HNSW search hops in layer 0 | count | - |
milvus.Count aggregation of the HNSW search hops in layer 0 | count | - |
milvus.Sum aggregation of the HNSW search hops in layer 0 | count | - |
milvus.Histogram bucket of the latency of build index for segment | count | - |
milvus.Count of build index events | count | - |
milvus.Sum of the latency of build index events | count | millisecond |
milvus.Histogram bucket of the latency of encoding the index file | count | - |
milvus.Count of the index file encoding events | count | - |
milvus.Sum of the latency of index file encoding events | count | millisecond |
milvus.Number of tasks that index node received | count | - |
milvus.Histogram bucket for the latency of index task in queue | count | - |
milvus.Count of index task in queue | count | - |
milvus.Sum of the latency of index task in queue | count | millisecond |
milvus.Histogram bucket for the latency of building the index by knowhere | count | - |
milvus.Count of index builds by knowhere | count | - |
milvus.Sum of the latency of building the index by knowhere | count | millisecond |
milvus.Histogram bucket for the latency of saving the index file | count | - |
milvus.Count of index file save envents | count | - |
milvus.Sum of the latency of saving the index file | count | millisecond |
milvus.Histogram bucket for the [cpp]latency(us) of search on segment | count | - |
milvus.Count aggregation of [cpp]latency(us) of search on segment | count | - |
milvus.Sum aggregation of [cpp]latency(us) of search on segment | count | microsecond |
milvus.Histogram bucket for the [cpp]mmap allocated space stats | count | - |
milvus.Count aggregation of [cpp]mmap allocated space stats | count | - |
milvus.Sum aggregation of [cpp]mmap allocated space stats | count | - |
milvus.[cpp]mmap in used space stats | gauge | - |
milvus.Histogram bucket for the [cpp]key-value size stats | count | - |
milvus.Count aggregation of [cpp]key-value size stats | count | - |
milvus.Sum aggregation of [cpp]key-value size stats | count | - |
milvus.Histogram bucket for the [cpp]durations of load segment | count | - |
milvus.Count aggregation of [cpp]durations of load segment | count | - |
milvus.Sum aggregation of [cpp]durations of load segment | count | - |
milvus.[cpp]count of persistent data operation | count | - |
milvus.Histogram bucket for the [cpp]request latency(ms) on the client side | count | - |
milvus.Count aggregation of [cpp]request latency(ms) on the client side | count | - |
milvus.Sum aggregation of [cpp]request latency(ms) on the client side | count | millisecond |
milvus.Histogram bucket for the IO count per request | count | - |
milvus.Count of requests triggering IO operations | count | - |
milvus.Sum of IO operation counts | count | - |
milvus.Histogram bucket for the number of inverted file search per request | count | - |
milvus.Count of requests trigerring an inverted file search | count | - |
milvus.Sum of inverted file searches | count | - |
milvus.Histogram bucket for the index load latency (ms) | count | - |
milvus.Count of index load events | count | - |
milvus.Sum of index load latency (ms) | count | millisecond |
milvus.Histogram for the key-value size stats | count | - |
milvus.Count aggregation of the key-value size stats | count | - |
milvus.Sum aggregation of the key-value size stats | count | - |
milvus.Count of meta operation | count | - |
milvus.Histogram bucket for the request latency on the client side | count | - |
milvus.Count aggregation of the request latency on the client side | count | - |
milvus.Sum aggregation of the request latency on the client side | count | millisecond |
milvus.Number of consumers | gauge | - |
milvus.Count of stream message operation | count | - |
milvus.Histogram bucket for the request latency on the client side | count | - |
milvus.Count aggregation of the request latency on the client side | count | - |
milvus.Sum aggregation of the request latency on the client side | count | millisecond |
milvus.Number of nodes and coordinates | gauge | - |
milvus.Total user and system CPU time spent in seconds. | count | - |
milvus.Maximum number of open file descriptors. | gauge | - |
milvus.Number of open file descriptors. | gauge | - |
milvus.Resident memory size in bytes. | gauge | - |
milvus.Start time of the process since Unix epoch in seconds. | gauge | - |
milvus.Virtual memory size in bytes. | gauge | - |
milvus.Maximum amount of virtual memory available in bytes. | gauge | - |
milvus.Histogram bucket for the latency of 'apply primary key' events | count | - |
milvus.Count of 'apply primary key' events | count | - |
milvus.Sum of latencies for 'apply primary key' events | count | millisecond |
milvus.Histogram bucket for the latency of proxy 'apply timestamp' events | count | - |
milvus.Count of proxy 'apply timestamp' events | count | - |
milvus.Sum of latencies of proxy 'apply timestamp' events | count | millisecond |
milvus.Histogram bucket for the latency of proxy 'get segmentID from dataCoord' events | count | - |
milvus.Count of proxy 'get segmentID from dataCoord' events | count | - |
milvus.Sum of latencies for proxy 'get segmentID from dataCoord' events | count | millisecond |
milvus.Count of cache hits/miss | count | - |
milvus.Histogram bucket for the latency of proxy 'update cache when cache miss' events | count | - |
milvus.Count of proxy 'update cache when cache miss' events | count | - |
milvus.Sum of latencies of proxy 'update cache when cache miss' | count | millisecond |
milvus.Counter of vectors successfully deleted | count | - |
milvus.Number of MsgStream objects per physical channel | gauge | - |
milvus.Histogram bucket for the latency of proxy 'send insert request to MsgStream' events | count | - |
milvus.Count of proxy 'send insert request to MsgStream' events | count | - |
milvus.Sum of latencies of proxy 'send insert request to MsgStream' events | count | millisecond |
milvus.Count of operation executed | count | - |
milvus.Report value about the request | count | - |
milvus.Count of operation executed | count | - |
milvus.Histogram bucket for the time in queue of request | count | - |
milvus.Count of request in queue | count | - |
milvus.Sum of the time requests spend in queue | count | millisecond |
milvus.Histogram bucket for the latency of each request | count | - |
milvus.Count of request latency events | count | - |
milvus.Sum of latencies of requests | count | millisecond |
milvus.Count of bytes sent back to sdk | count | - |
milvus.Histogram bucket for the latency of proxy 'decode the search result' events | count | - |
milvus.Count of proxy 'decode the search result' events | count | - |
milvus.Sum of latencies for proxy 'decode the search result' events | count | millisecond |
milvus.Histogram bucket for the latency of proxy 'reduces search result' events | count | - |
milvus.Count of proxy 'reduces search result' events | count | - |
milvus.Sum of latencies for proxy 'reduces search result' events | count | millisecond |
milvus.Histogram bucket for the latency of proxy 'waits for the result' events | count | - |
milvus.Count of proxy 'waits for the result' events | count | - |
milvus.Sum of latencies for proxy 'waits for the result' events | count | millisecond |
milvus.Histogram bucket for the length of SegmentIDRequests when assigning segments for insert | count | - |
milvus.Count of assigning segments for insert events | count | - |
milvus.Sum of the length of SegmentIDRequests when assigning segments for insert | count | - |
milvus.Now time minus time travel per physical channel | gauge | millisecond |
milvus.Histogram bucket for the quant compute count per request | count | - |
milvus.Count of requests triggering quant compute events | count | - |
milvus.Sum of quant compute event counts | count | - |
milvus.Number of collections | gauge | - |
milvus.Current target checkpoint timestamp in Unix seconds | gauge | - |
milvus.Histogram bucket Latency of load the entire collection | count | - |
milvus.Latency of load the entire collection | count | - |
milvus.Latency of load the entire collection | count | millisecond |
milvus.Count of load request | count | - |
milvus.Number of partitions | gauge | - |
milvus.Number of QueryNodes managered by QueryCoord | gauge | - |
milvus.Histogram bucket for the latency of release request | count | - |
milvus.Count of release request events | count | - |
milvus.Sum of the latencies of release request events | count | millisecond |
milvus.Count of release request | count | - |
milvus.the number of tasks in QueryCoord's scheduler | gauge | - |
milvus.Histogram bucket for the apply brute-force cost in ms | count | - |
milvus.Count of apply brute-force events | count | - |
milvus.Sum of the apply brute-force cost in ms | count | millisecond |
milvus.Number of collections loaded | gauge | - |
milvus.Count of consumed bytes | count | - |
milvus.Count of consumed msg | count | - |
milvus.Now time minus time travel per physical channel | gauge | millisecond |
milvus.Number of bytes evicted from disk cache | count | byte |
milvus.Number of segments evicted from disk cache | count | - |
milvus.Total time cost of evicting segments from disk cache | count | - |
milvus.Histogram bucket for the global duration of evicting segments from disk cache | count | - |
milvus.Count of evicting segments from disk cache events | count | - |
milvus.Sum of the global duration of evicting segments from disk cache | count | millisecond |
milvus.Number of bytes loaded from disk cache | count | byte |
milvus.Number of segments loaded from disk cache | count | - |
milvus.Total time cost of loading segments from disk cache | count | - |
milvus.Histogram bucket for the global duration of loading segments from disk cache | count | - |
milvus.Count of loading segments from disk cache events | count | - |
milvus.Sum of the global duration of loading segments from disk cache | count | millisecond |
milvus.Disk used size(MB) | gauge | mebibyte |
milvus.Number of data manipulation language channels watched | gauge | - |
milvus.Number of entities which can be searched/queried, clustered by collection, partition and state | gauge | - |
milvus.Entities' memory size, clustered by collection and state | gauge | byte |
milvus.Count of execute bytes | count | - |
milvus.Number of flowgraphs | gauge | - |
milvus.Histogram bucket for the forward delete cost in ms | count | - |
milvus.Count of forward delete events | count | - |
milvus.Sum of the forward delete cost in ms | count | millisecond |
milvus.Histogram bucket for the latency of load per segment's index, in milliseconds | count | - |
milvus.Count of load per segment's index events | count | - |
milvus.Sum of the latencies of load per segment's index events, in milliseconds | count | millisecond |
milvus.Number of concurrent loading segments in QueryNode | gauge | - |
milvus.Histogram bucket for the latency of load per segment | count | - |
milvus.Count of load per segment events | count | - |
milvus.Sum of the latencies of load per segment events | count | millisecond |
milvus.time.Now() sub dispatcher's current consume time | gauge | millisecond |
milvus.Number of partitions loaded | gauge | - |
milvus.Histogram bucket for the process insert or delete cost in ms | count | - |
milvus.Count of process insert or delete events | count | - |
milvus.Sum of process insert or delete cost in ms | count | millisecond |
milvus.Number of concurrent executing read tasks in QueryNode | gauge | - |
milvus.Number of ready read tasks in readyQueue | gauge | - |
milvus.Number of unsolved read tasks in unsolvedQueue | gauge | - |
milvus.Histogram bucket for the number of queries of each grouped search task | count | - |
milvus.Count of grouped search tasks | count | - |
milvus.Sum of the number of queries of grouped search tasks | count | - |
milvus.Histogram bucket for the number of tasks of each grouped search task | count | - |
milvus.Count of grouped search tasks | count | - |
milvus.Sum of the number of tasks of grouped search tasks | count | - |
milvus.Histogram bucket for the topK of each grouped search task | count | - |
milvus.Count of grouped search tasks | count | - |
milvus.Sum of the topK of grouped search tasks | count | - |
milvus.Histogram bucket for the number of queries of each search task | count | - |
milvus.Count of search tasks | count | - |
milvus.Sum of the number of queries of search tasks | count | - |
milvus.Histogram bucket for the top of each search task | count | - |
milvus.Count of search tasks | count | - |
milvus.Sum of the top of search tasks | count | - |
milvus.Number of segments accessed | count | - |
milvus.Total time cost of accessing segments | count | - |
milvus.Histogram bucket for the global time cost of accessing segments | count | - |
milvus.Count of accessing segments events | count | - |
milvus.Sum of the global time cost of accessing segments | count | millisecond |
milvus.Number of segments waiting for loading access | count | - |
milvus.Total time cost of waiting for loading access | count | - |
milvus.Histogram bucket for the global time cost of waiting for loading access | count | - |
milvus.Count of waiting for loading access events | count | - |
milvus.Sum of the global time cost of waiting for loading access events | count | millisecond |
milvus.Histogram bucket for one vector's search latency per segment | count | - |
milvus.Count aggregation of one vector's search latency per segment | count | - |
milvus.Sum aggregation of one vector's search latency per segment | count | millisecond |
milvus.Number of segments loaded, clustered by its collection, partition, state and # of indexed fields | gauge | - |
milvus.Histogram bucket for the latency of searches or queries in segcore | count | - |
milvus.Count of search or query events in segcore | count | - |
milvus.Sum of latencies of searches or queries in segcore | count | millisecond |
milvus.Histogram bucket for the latency of searches or queries in queue | count | - |
milvus.Count of search or query events | count | - |
milvus.Sum of latencies of searches or queries in queue | count | millisecond |
milvus.Histgram bucket for the latency per user of search or query in queue | count | - |
milvus.Count of search or query in queue | count | - |
milvus.Sum of latencies per user of search or query in queue | count | millisecond |
milvus.Histogram bucket for the latencies of reduce search or query result | count | - |
milvus.Count of reduce search or query result events | count | - |
milvus.Sum of latencies of reduce search or query result | count | millisecond |
milvus.count of search / query request | count | - |
milvus.Histogram bucket for the latency of search or query requests | count | - |
milvus.Count of search or query requests | count | - |
milvus.Sum of latencies of search or query requests | count | millisecond |
milvus.Histogram bucket for the latency of search or query per segment | count | - |
milvus.Count of search or query per segment | count | - |
milvus.Sum of latencies of search or query per segment | count | millisecond |
milvus.Histogram bucket for the time that search or query waits for tsafe | count | - |
milvus.Count of occurrences of search or query waiting for tsafe | count | - |
milvus.Sum of the time that search or query wait for tsafe | count | millisecond |
milvus.Count of wait processing msg | gauge | - |
milvus.Histogram bucket for the latencies of watch data manipulation language channel | count | - |
milvus.Count of watch data manipulation language channel events | count | - |
milvus.Sum of the latencies of watch data manipulation language channel events | count | millisecond |
milvus.Histogram bucket for the queue latency per request | count | - |
milvus.Count of request with queue latency | count | - |
milvus.Sum of queue latencies | count | - |
milvus.Histogram bucket for range search latency (ms) | count | - |
milvus.Count of range search operations | count | - |
milvus.Sum of range search latencies (ms) | count | millisecond |
milvus.Histogram bucket for the raw compute count per request | count | - |
milvus.Count of request that trigger raw compute operations | count | - |
milvus.Sum of raw compute operations | count | - |
milvus.Histogram bucket for the number of fallback search per request | count | - |
milvus.Count of requests triggering fallback search operations | count | - |
milvus.Sum of fallback searches | count | - |
milvus.Number of collections | gauge | - |
milvus.Number of credentials | gauge | - |
milvus.Count of DDL operations | count | - |
milvus.Histogram bucket for the latency of each DDL operation | count | - |
milvus.Count of DDL operations | count | - |
milvus.Sum of the latencies of DDL operations | count | millisecond |
milvus.Histogram bucket for the latencies of each DDL operation in queue | count | - |
milvus.Count of DDL operations in queue | count | - |
milvus.Sum of the latencies of DDL operations in queue | count | millisecond |
milvus.Number of DML channels | gauge | - |
milvus.Number of entities, clustered by collection and their status(loaded/total) | gauge | - |
milvus.The number of times milvus turns into force-deny-writing states | count | - |
milvus.Count of ID allocated | count | - |
milvus.Indexed number of entities, clustered by collection, index name and whether it's a vector index | gauge | - |
milvus.Number of message streams | gauge | - |
milvus.The number of roles | gauge | - |
milvus.Number of partitions | gauge | - |
milvus.Now time minus time travel per physical channel | gauge | millisecond |
milvus.Number of proxy nodes managered by rootcoord | gauge | - |
milvus.Querynode memory high water level | gauge | - |
milvus.Histogram bucket for the latencies of synchronizing timetick message | count | - |
milvus.Count of synchronizing timetick message events | count | - |
milvus.Sum of latencies of synchronizing timetick message events | count | millisecond |
milvus.Latest timestamp allocated in memory | gauge | - |
milvus.Timestamp saved in meta storage | gauge | - |
milvus.Runtime information of Milvus | gauge | - |
milvus.Histogram bucket for search latencies (ms) | count | - |
milvus.Count of search events | count | - |
milvus.Sum of search latencies (ms) | count | millisecond |
milvus.Histogram bucket for search topk | count | - |
milvus.Count aggregation of search topk | count | - |
milvus.Sum aggregation of search topk | count | - |
milvus.Key-value size stats | gauge | - |
milvus.Count of persistent data operation | count | - |
milvus.Request latency on the client side | gauge | - |
Official documentation
Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.