Nvidia Triton インテグレーションのメトリクス
Nvidia Triton の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 42 件あります。
公式の紹介文 (英語)
NVIDIA Triton Inference Server is open source inference-serving software
種別の内訳
- gauge (その時点の値): 22 件
- count (集計間隔内の発生回数): 20 件
メトリクスの一覧
説明は公式の定義の英文をそのまま載せています。
| メトリクス | 種別 | 単位 |
|---|---|---|
nvidia_triton.Total cache insertion duration, in microseconds | gauge | microsecond |
nvidia_triton.Total cache lookup duration (hit and miss), in microseconds | gauge | microsecond |
nvidia_triton.Number of responses stored in response cache | gauge | - |
nvidia_triton.Number of cache evictions in response cache | gauge | - |
nvidia_triton.Number of cache hits in response cache | gauge | - |
nvidia_triton.Number of cache lookups in response cache | gauge | - |
nvidia_triton.Number of cache misses in response cache | gauge | - |
nvidia_triton.Cache utilization [0.0 - 1.0] | gauge | - |
nvidia_triton.CPU total memory (RAM), in bytes | gauge | byte |
nvidia_triton.CPU used memory (RAM), in bytes | gauge | byte |
nvidia_triton.CPU utilization rate [0.0 - 1.0] | gauge | - |
nvidia_triton.GPU energy consumption in joules since the Triton Server started | count | - |
nvidia_triton.GPU total memory, in bytes | gauge | byte |
nvidia_triton.GPU used memory, in bytes | gauge | byte |
nvidia_triton.GPU power management limit in watts | gauge | watt |
nvidia_triton.GPU power usage in watts | gauge | watt |
nvidia_triton.GPU utilization rate [0.0 - 1.0) | gauge | - |
nvidia_triton.Cumulative compute inference duration in microseconds (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative compute inference duration in microseconds (count) (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative compute inference duration in microseconds (quantile)(does not include cached requests) | gauge | microsecond |
nvidia_triton.Cumulative compute inference duration in microseconds (sum) (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative compute input duration in microseconds (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative compute input duration in microseconds (sum) (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative compute input duration in microseconds (quantile) (does not include cached requests) | gauge | microsecond |
nvidia_triton.Cumulative compute input duration in microseconds (count) (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative inference compute output duration in microseconds (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative inference compute output duration in microseconds (count) (does not include cached requests) | count | microsecond |
nvidia_triton.Cumulative inference compute output duration in microseconds (quantile) (does not include cached requests) | gauge | microsecond |
nvidia_triton.Cumulative inference compute output duration in microseconds (sum) (does not include cached requests) | count | microsecond |
nvidia_triton.Number of inferences performed (does not include cached requests) | count | - |
nvidia_triton.Number of model executions performed (does not include cached requests) | count | - |
nvidia_triton.Instantaneous number of pending requests awaiting execution per-model. | gauge | - |
nvidia_triton.Cumulative inference queuing duration in microseconds (includes cached requests) | count | microsecond |
nvidia_triton.Summary of inference queuing duration in microseconds (count) (includes cached requests) | count | microsecond |
nvidia_triton.Summary of inference queuing duration in microseconds (quantile) (includes cached requests) | gauge | microsecond |
nvidia_triton.Summary of inference queuing duration in microseconds (sum) (includes cached requests) | count | microsecond |
nvidia_triton.Cumulative inference request duration in microseconds (includes cached requests) | count | microsecond |
nvidia_triton.Summary of inference request duration in microseconds (count) (includes cached requests) | count | microsecond |
nvidia_triton.Summary of inference request duration in microseconds (quantile) (includes cached requests) | gauge | microsecond |
nvidia_triton.Summary of inference request duration in microseconds (sum) (includes cached requests) | count | microsecond |
nvidia_triton.Number of failed inference requests, all batch sizes | count | - |
nvidia_triton.Number of successful inference requests, all batch sizes | count | - |
公式ドキュメント
メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。