BentoML インテグレーションのメトリクス

BentoML の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 11 件あります。

公式の紹介文 (英語)

BentoML is an open-source framework for ML model deployment. This integration collects BentoML service metrics.

種別の内訳

  • count (集計間隔内の発生回数): 7 件
  • gauge (その時点の値): 4 件

メトリクスの一覧

説明は公式の定義の英文をそのまま載せています。

メトリクス種別単位
bentoml.endpoint_livezA liveness probe endpoint that checks if the Service is still alive and needs to restart. This metrics reports a 1 if the endpoint is healthy, 0 otherwise.gauge-
bentoml.endpoint_readyzA readiness probe endpoint that indicates if the Service is ready to accept traffic. This metrics reports a 1 if the endpoint is healthy, 0 otherwise.gauge-
bentoml.service.adaptive_batch_size.bucketThe number of observations since last data collection that fall within a specific upper_bound tag for adaptive batch sizes used during Service execution histogram measurements.count-
bentoml.service.adaptive_batch_size.countThe number of observations since last data collection for adaptive batch sizes used during Service execution histogram measurements.count-
bentoml.service.adaptive_batch_size.sumThe total batch size units across all observations since last data collection for adaptive batch sizes used during Service execution histogram measurements.count-
bentoml.service.request.countThe number of new requests that a Service has processed since last submissioncountrequest
bentoml.service.request.duration.bucketThe number of observations since last data collection that fall within a specific upper_bound tag for request processing duration histogram measurements.count-
bentoml.service.request.duration.countThe number of requests processed since last data collection histogram measurements.count-
bentoml.service.request.duration.sumThe total sum of request processing time in seconds across all observations since last data collection histogram measurements.countsecond
bentoml.service.request.in_progressThe number of requests that are currently being processed by a Service.gaugerequest
bentoml.service.time_since_last_requestThe amount of time in seconds since the last request was processed by a Service.gaugesecond

公式ドキュメント

BentoML インテグレーションの公式ドキュメント

メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。