Hudi インテグレーションのメトリクス
Hudi の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 33 件あります。
公式の紹介文 (英語)
Track metrics for your Hudi configuration.
種別の内訳
- gauge (その時点の値): 19 件
- rate (1 秒あたりの値): 14 件
メトリクスの一覧
説明は公式の定義の英文をそのまま載せています。
| メトリクス | 種別 | 単位 |
|---|---|---|
hudi.The total amount of bytes written in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | byte |
hudi.The commit time of an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | millisecond |
hudi.The amount of compacted records updated in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | record |
hudi.The creation time of an action (commit, deltacommit, replacecommit, compaction, etc) | rate | millisecond |
hudi.The amount of time it took to successfully perform an action on a batch of records (commit, deltacommit, replacecommit, compaction, etc) | gauge | millisecond |
hudi.The amount of files inserted (commit, deltacommit, replacecommit, compaction, etc) | rate | file |
hudi.The amount of files updated (commit, deltacommit, replacecommit, compaction, etc) | rate | file |
hudi.The number of insert records written in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | record |
hudi.The number of log files compacted in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | file |
hudi.The size of all the log files in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | byte |
hudi.The number of partitions written in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | - |
hudi.The number of records written in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | record |
hudi.The total time spent scanned in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | millisecond |
hudi.Measures 50th percentile of time to complete the action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures 75th percentile of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures 95th percentile of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures 98th percentile of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures 999th percentile of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures 99th percentile of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures count of times to complete an action (commit, deltacommit, replacecommit, compaction, etc) | rate | / |
hudi.Measures maximum amount of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures mean amount of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures minimum amount of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.Measures standard deviation of time to complete an action (commit, deltacommit, replacecommit, compaction, etc) | gauge | nanosecond |
hudi.The amount of update records written in an action (commit, deltacommit, replacecommit, compaction, etc) | rate | record |
hudi.The upsert time of an action (commit, deltacommit, replacecommit, compaction, etc) | rate | millisecond |
hudi.The total time spent cleaning | gauge | millisecond |
hudi.The number of files deleted in cleans | gauge | file |
hudi.The total time spent finalizing | gauge | millisecond |
hudi.The number of files finalized" | gauge | file |
hudi.The time spent performing an index command (UPSERT, INSERT_OVERWRITE, etc) | gauge | millisecond |
hudi.The total time spent in rollback | gauge | millisecond |
hudi.The number of files deleted in rollback | gauge | file |
公式ドキュメント
メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。