Hive インテグレーションのメトリクス

Hive の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 123 件あります。

公式の紹介文 (英語)

Gathers various JMX metrics from HiveServer2 and Hive MetaStore

種別の内訳

  • gauge (その時点の値): 89 件
  • rate (1 秒あたりの値): 34 件

メトリクスの一覧

説明は公式の定義の英文をそのまま載せています。

メトリクス種別単位
hive.metastore.api.alter_tableAPI call to alter table.ratetask
hive.metastore.api.alter_table.active_callActive API call to alter table.gaugeunit
hive.metastore.api.create_tableAPI call to create a table.ratetask
hive.metastore.api.create_table.active_callActive API call to create a table.gaugeunit
hive.metastore.api.drop_tableAPI call to drop a table.ratetask
hive.metastore.api.drop_table.active_callActive API call to drop a table.gaugeunit
hive.metastore.api.flushcacheAPI flushcache.ratetask
hive.metastore.api.flushcache.active_callActive API flushcache.gaugeunit
hive.metastore.api.get_all_databasesAPI call to get all databases.ratetask
hive.metastore.api.get_all_databases.active_callActive API call to get all databases.gaugeunit
hive.metastore.api.get_all_functionsAPI call to get all functions.ratetask
hive.metastore.api.get_all_functions.active_callActive API call to get all functions.gaugeunit
hive.metastore.api.get_all_tablesAPI call to get all tables.ratetask
hive.metastore.api.get_all_tables.active_callActive API call to get all tables.gaugeunit
hive.metastore.api.get_databaseAPI call to get a database.ratetask
hive.metastore.api.get_database.active_callActive API call to get a database.gaugeunit
hive.metastore.api.get_tableAPI call to get a table.ratetask
hive.metastore.api.get_table.active_callActive API call to get a table.gaugeunit
hive.metastore.api.get_table_reqratetask
hive.metastore.api.get_table_req.active_callgaugeunit
hive.metastore.api.initAPI initialization.ratetask
hive.metastore.api.init.active_callActive API initialization.gaugeunit
hive.metastore.api.shutdownAPI shutdown.ratetask
hive.metastore.api.shutdown.active_callActive API shutdown.gaugeunit
hive.metastore.db.createdTotal number of created database.rateitem
hive.metastore.db.deletedTotal number of deleted database.rateitem
hive.metastore.db.initNumber of initialized database.rateitem
hive.metastore.directsql_errorsNumber of SQL error.gaugeunit
hive.metastore.open_connectionsNumber of connection opened.gaugeconnection
hive.metastore.partition.createdTotal number of created partition.rateitem
hive.metastore.partition.deletedTotal number of deleted partition.rateitem
hive.metastore.partition.initNumber of initialized partition.rateitem
hive.metastore.table.createdTotal number of created table.ratetable
hive.metastore.table.deletedTotal number of deleted table.ratetable
hive.metastore.table.initNumber of initialized table.ratetable
hive.server.api.operation.initialized.75percentileP75 time to init an operation.gaugemillisecond
hive.server.api.operation.initialized.95percentileP95 time to init an operation.gaugemillisecond
hive.server.api.operation.initialized.active_callActive initialized operation.gaugeuser
hive.server.api.operation.initialized.countNumber of operation initialized.rateoperation
hive.server.api.operation.initialized.maxMax time to init an operation.gaugemillisecond
hive.server.api.operation.initialized.meanMean time to init an operation.gaugemillisecond
hive.server.api.operation.initialized.meanrateOperation initialization rate.gaugeoperation
hive.server.api.operation.initialized.minMin time to init an operation.gaugemillisecond
hive.server.api.operation.pending.75percentileP75 time in pending state for an sql operation.gaugemillisecond
hive.server.api.operation.pending.95percentileP95 time in pending state for an sql operation.gaugemillisecond
hive.server.api.operation.pending.active_callActive pending operation.gaugeoperation
hive.server.api.operation.pending.countNumber of operation in pending state.rateoperation
hive.server.api.operation.pending.maxMax time in pending state for an sql operation.gaugemillisecond
hive.server.api.operation.pending.meanMean time in pending state for an sql operation.gaugemillisecond
hive.server.api.operation.pending.meanrateOperation pending rate.gaugeoperation/second
hive.server.api.operation.pending.minMin time in pending state for an sql operation.gaugemillisecond
hive.server.api.operation.running.75percentileP75 time in running state for an sql operation.gaugemillisecond
hive.server.api.operation.running.95percentileP95 time in running state for an sql operation.gaugemillisecond
hive.server.api.operation.running.active_callActive running operation.gaugeoperation
hive.server.api.operation.running.countNumber of operation in running state.ratemillisecond
hive.server.api.operation.running.maxMax time in running state for an sql operation.gaugemillisecond
hive.server.api.operation.running.meanMean time in running state for an sql operation.gaugemillisecond
hive.server.api.operation.running.meanrateOperation running rate.gaugeoperation/second
hive.server.api.operation.running.minMin time in running state for an sql operation.gaugemillisecond
hive.server.api.queries.executing.active_callActive executing queries.gaugequery
hive.server.api.sql_operation.pending.75percentileP75 time in pending state for an sql operation.gaugemillisecond
hive.server.api.sql_operation.pending.95percentileP95 time in pending state for an sql operation.gaugemillisecond
hive.server.api.sql_operation.pending.active_callActive pending sql operation.gaugeoperation
hive.server.api.sql_operation.pending.countNumber of sql operation in pending state.rateoperation
hive.server.api.sql_operation.pending.maxMax time in pending state for an sql operation.gaugemillisecond
hive.server.api.sql_operation.pending.meanMean time in pending state for an sql operation.gaugemillisecond
hive.server.api.sql_operation.pending.meanratePending sql operation rate.gaugeoperation/second
hive.server.api.sql_operation.pending.minMin time in pending state for an sql operation.gaugemillisecond
hive.server.api.sql_operation.running.75percentileP75 time for running state for a sql operation.gaugemillisecond
hive.server.api.sql_operation.running.95percentileP95 time for running state for a sql operation.gaugemillisecond
hive.server.api.sql_operation.running.active_callActive running sql operation.gaugeoperation
hive.server.api.sql_operation.running.countNumber of sql operation in running state.rateoperation
hive.server.api.sql_operation.running.maxMax time for running state for a sql operation.gaugemillisecond
hive.server.api.sql_operation.running.meanMean time for running state for a sql operation.gaugemillisecond
hive.server.api.sql_operation.running.meanrateRunning sql operation rate.gaugeoperation/second
hive.server.api.sql_operation.running.minMin time for running state for a sql operation.gaugemillisecond
hive.server.memory.heap.committedCommitted memory for the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.heap.initMemory used at the initialization by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.heap.maxMaximum memory that can be used by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.heap.usedMemory used by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.non_heap.committedCommitted memory for the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.non_heap.initMemory used at the initialization by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.non_heap.maxMaximum memory that can be used by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.non_heap.usedMemory used by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.total.committedTotal committed memory for the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.total.initTotal memory at the initialization by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.total.maxTotal maximum memory that can be used for the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.memory.total.usedTotal memory used by the HiveServer2 or Metastore. Depends on the connected instance typegaugebyte
hive.server.open_operationsOperation opened in the HiveServer2.gaugeoperation
hive.server.operation.completed.closedNumber of closed operation.rateoperation
hive.server.operation.completed.finishedNumber of finished operation.rateoperation
hive.server.queries.compiling.75percentileP75 time for compiling a query.gaugemillisecond
hive.server.queries.compiling.95percentileP95 time for compiling a query.gaugemillisecond
hive.server.queries.compiling.active_callActive compiling queries.gaugequery
hive.server.queries.compiling.countNumber of compiled query.ratequery
hive.server.queries.compiling.maxMax time for compiling a query.gaugemillisecond
hive.server.queries.compiling.meanMean time for compiling a query.gaugemillisecond
hive.server.queries.compiling.meanrateCompiling query rate.gaugequery/second
hive.server.queries.compiling.minMin time for compiling a query.gaugemillisecond
hive.server.queries.executing.75percentileP75 time for executing a query.gaugemillisecond
hive.server.queries.executing.95percentileP95 time for executing a query.gaugemillisecond
hive.server.queries.executing.countNumber of executed queries.ratequery
hive.server.queries.executing.maxMax time for executing a query.gaugemillisecond
hive.server.queries.executing.meanMean time for executing a query.gaugemillisecond
hive.server.queries.executing.meanrateExecuting query rate.gaugequery/second
hive.server.queries.executing.minMin time for executing a query.gaugemillisecond
hive.server.queries.submitted.75percentileP75 time for a submitted query.gaugemillisecond
hive.server.queries.submitted.95percentileP95 time for a submitted query.gaugemillisecond
hive.server.queries.submitted.active_callActive submitted queries.gaugequery
hive.server.queries.submitted.countNumber of submitted query.ratequery
hive.server.queries.submitted.maxMax time for a submitted query.gaugemillisecond
hive.server.queries.submitted.meanMean time for a submitted query.gaugemillisecond
hive.server.queries.submitted.meanrateSubmitted query rate.gaugequery/second
hive.server.queries.submitted.minMin time for a submitted query.gaugemillisecond
hive.server.queries.succeeded.countNumber of succeeded queries.ratequery
hive.server.queries.succeeded.meanrateSucceeded queries rate.gaugequery/second
hive.server.session.activeNumber of active session.gaugesession
hive.server.session.active.time_meanAverage time a session has been active.gaugemillisecond
hive.server.session.openNumber of opened session.gaugesession
hive.server.session.open.time_meanAverage time a session has been opened.gaugemillisecond
hive.server.sql_operation.completed.closedNumber of closed sql operation.rateoperation
hive.server.sql_operation.completed.finishedNumber of finished sql operation.rateoperation
hive.server.sql_operation.user.activeNumber of active user.gaugeuser

公式ドキュメント

Hive インテグレーションの公式ドキュメント

メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。