Pulsar インテグレーションのメトリクス

Pulsar の監視に使う Datadog の公式インテグレーションです。収集するメトリクスは 196 件あります。

公式の紹介文 (英語)

Monitor your Pulsar clusters.

種別の内訳

  • gauge (その時点の値): 132 件
  • count (集計間隔内の発生回数): 64 件

メトリクスの一覧

説明は公式の定義の英文をそのまま載せています。

メトリクス種別単位
pulsar.active_connectionsThe number of active connections.gaugeconnection
pulsar.authentication_failures_count.countThe number of failing authentication operations.count-
pulsar.authentication_success_count.countThe number of successful authentication operations.count-
pulsar.bookie_DELETED_LEDGER_COUNT.countThe total number of ledgers deleted since the bookie has started.count-
pulsar.bookie_READ_BYTES.countThe total number of bytes read from the bookie.countbyte
pulsar.bookie_SERVER_STATUSThe server status for bookie server. 1: the bookie is running in writable mode.0: the bookie is running in readonly mode.gauge-
pulsar.bookie_WRITE_BYTES.countThe total number of bytes written to the bookie.countbyte
pulsar.bookie_entries_countThe total number of entries stored in the bookie.gauge-
pulsar.bookie_flushThe table flush latency of bookie memory.gauge-
pulsar.bookie_journal_JOURNAL_CB_QUEUE_SIZEThe total number of callbacks pending in the callback queue.gauge-
pulsar.bookie_journal_JOURNAL_FORCE_WRITE_QUEUE_SIZEThe total number of force write (fsync) requests pending in the force-write queue.gaugerequest
pulsar.bookie_journal_JOURNAL_QUEUE_SIZEThe total number of requests pending in the journal queue.gaugerequest
pulsar.bookie_journal_JOURNAL_SYNC_count.countThe total number of journal fsync operations happening at the bookie. The success label is used to distinguish successes and failures.count-
pulsar.bookie_ledger_writable_dirsThe number of writable directories in the bookie.gauge-
pulsar.bookie_ledgers_countThe total number of ledgers stored in the bookie.gauge-
pulsar.bookie_read_cache_sizeThe bookie read cache size (in bytes).gaugebyte
pulsar.bookie_throttled_write_requests.countThe number of write requests to be throttled.countrequest
pulsar.bookie_write_cache_sizeThe bookie write cache size (in bytes).gaugebyte
pulsar.bookkeeper_server_ADD_ENTRY_count.countThe total number of ADD_ENTRY requests received at the bookie. The success label is used to distinguish successes and failures.countrequest
pulsar.bookkeeper_server_BOOKIE_QUARANTINE_count.countThe number of bookie clients to be quarantined.count-
pulsar.bookkeeper_server_READ_ENTRY_count.countThe total number of READ_ENTRY requests received at the bookie. The success label is used to distinguish successes and failures.countrequest
pulsar.brk_ml_cursor_nonContiguousDeletedMessagesRangeThe number of non-contiguous deleted messages ranges.gauge-
pulsar.brk_ml_cursor_persistLedgerErrorsThe number of ledger errors occurred when acknowledgment states fail to be persistent to the ledger.gaugeerror
pulsar.brk_ml_cursor_persistLedgerSucceedThe number of acknowledgment states that is persistent to a ledger.gauge-
pulsar.brk_ml_cursor_persistZookeeperErrorsThe number of ledger errors occurred when acknowledgment states fail to be persistent to ZooKeeper.gaugeerror
pulsar.brk_ml_cursor_persistZookeeperSucceedThe number of acknowledgment states that is persistent to ZooKeeper.gauge-
pulsar.brk_ml_cursor_readLedgerSizeThe size of read from ledger.gauge-
pulsar.brk_ml_cursor_writeLedgerLogicalSizeThe size of write to ledger (accounting for without replicas).gauge-
pulsar.brk_ml_cursor_writeLedgerSizeThe size of write to ledger.gauge-
pulsar.broker_load_manager_bundle_assignmentThe summary of latency of bundles ownership operations.gauge-
pulsar.broker_lookup.countNumber of samples of the latency of all lookup operations.count-
pulsar.broker_lookup.quantileLatency of all lookup operations by quantile.gauge-
pulsar.broker_lookup.sumTotal latency of all lookup operations.count-
pulsar.broker_lookup_answers.countThe number of lookup responses (i.e. not redirected requests).countresponse
pulsar.broker_lookup_failures.countThe number of lookup failures.count-
pulsar.broker_lookup_pending_requestsThe number of pending lookups in broker. When it is up to the threshold, new requests are rejected.gaugerequest
pulsar.broker_lookup_redirects.countThe number of lookup redirected requests.countrequest
pulsar.broker_throttled_connectionsThe number of throttled connections.gaugeconnection
pulsar.broker_throttled_connections_global_limitThe number of throttled connections because of per-connection limit.gaugeconnection
pulsar.broker_topic_load_pending_requestsThe load of pending topic operations.gauge-
pulsar.bundle_consumer_countThe consumer count of the topics in this bundle.gauge-
pulsar.bundle_msg_rate_inThe total message rate coming into the topics in this bundle (messages/second).gauge-
pulsar.bundle_msg_rate_outThe total message rate going out from the topics in this bundle (messages/second).gauge-
pulsar.bundle_msg_throughput_inThe total throughput coming into the topics in this bundle (bytes/second).gauge-
pulsar.bundle_msg_throughput_outThe total throughput going out from the topics in this bundle (bytes/second).gauge-
pulsar.bundle_producer_countThe producer count of the topics in this bundle.gauge-
pulsar.bundle_topics_countThe topic count in this bundle.gauge-
pulsar.compaction_compacted_entries_countThe total number of the compacted entries.gauge-
pulsar.compaction_compacted_entries_sizeThe total size of the compacted entries.gauge-
pulsar.compaction_duration_time_in_millsThe duration time of the compaction.gauge-
pulsar.compaction_failed_countThe total number of failures of the compaction.gauge-
pulsar.compaction_read_throughputThe read throughput of the compaction.gauge-
pulsar.compaction_removed_event_countThe total number of removed events of the compaction.gauge-
pulsar.compaction_succeed_countThe total number of successes of the compaction.gauge-
pulsar.compaction_write_throughputThe write throughput of the compaction.gauge-
pulsar.connection_closed_total_countThe total number of closed connections.gaugeconnection
pulsar.connection_create_fail_countThe number of failed connections.gaugeconnection
pulsar.connection_create_success_countThe number of successfully created connections.gaugeconnection
pulsar.connection_created_total_countThe total number of connections.gaugeconnection
pulsar.consumer_available_permitsThe available permits for for a consumer.gauge-
pulsar.consumer_blocked_on_unacked_messagesIndicate whether a consumer is blocked on unacknowledged messages or not. 1 means the consumer is blocked on waiting unacknowledged messages to be acked.0 means the consumer is not blocked on waiting unacknowledged messages to be acked.gauge-
pulsar.consumer_msg_rate_outThe total message dispatch rate for a consumer (messages/second).gauge-
pulsar.consumer_msg_rate_redeliverThe total message rate for message being redelivered (messages/second).gauge-
pulsar.consumer_msg_throughput_outThe total message dispatch throughput for a consumer (bytes/second).gauge-
pulsar.consumer_unacked_messagesThe total number of unacknowledged messages of a consumer (messages).gaugemessage
pulsar.consumers_countThe number of active consumers of the namespace connected to this broker.gauge-
pulsar.expired_token_count.countThe number of expired tokens in Pulsar.count-
pulsar.function_last_invocationThe timestamp of the last invocation of the function.gauge-
pulsar.function_processed_successfully_total.countThe total number of messages processed successfully.countmessage
pulsar.function_processed_successfully_total_1min.countThe total number of messages processed successfully in the last 1 minute.countmessage
pulsar.function_received_total.countThe total number of messages received from source.countmessage
pulsar.function_received_total_1min.countThe total number of messages received from source in the last 1 minute.countmessage
pulsar.function_system_exceptions_total.countThe total number of system exceptions.count-
pulsar.function_system_exceptions_total_1min.countThe total number of system exceptions in the last 1 minute.count-
pulsar.function_user_exceptions_total.countThe total number of user exceptions.count-
pulsar.function_user_exceptions_total_1min.countThe total number of user exceptions in the last 1 minute.count-
pulsar.in_bytes_totalThe number of messages in bytes received for this topic.gaugebyte
pulsar.in_messages_totalThe total number of messages received for this topic.gaugemessage
pulsar.jetty_async_dispatches_total.countNumber of requested that have been asynchronously dispatched.count-
pulsar.jetty_async_requests_total.countTotal number of async requests.countrequest
pulsar.jetty_async_requests_waitingCurrently waiting async requests.gaugerequest
pulsar.jetty_async_requests_waiting_maxMaximum number of waiting async requests.gaugerequest
pulsar.jetty_dispatched_activeNumber of dispatches currently active.gauge-
pulsar.jetty_dispatched_active_maxMaximum number of active dispatches being handled.gauge-
pulsar.jetty_dispatched_time_maxMaximum time spent in dispatch handling.gauge-
pulsar.jetty_dispatched_time_seconds_total.countTotal time spent in dispatch handling.countsecond
pulsar.jetty_dispatched_total.countNumber of dispatches.count-
pulsar.jetty_expires_total.countNumber of async requests requests that have expired.countrequest
pulsar.jetty_request_time_max_secondsMaximum time spent handling requests.gaugesecond
pulsar.jetty_request_time_seconds_total.countTotal time spent in all request handling.countsecond
pulsar.jetty_requests_activeNumber of requests currently active.gaugerequest
pulsar.jetty_requests_active_maxMaximum number of requests that have been active at once.gaugerequest
pulsar.jetty_requests_total.countNumber of requests.countrequest
pulsar.jetty_responses_bytes_total.countTotal number of bytes across all responses.countbyte
pulsar.jetty_responses_total.countNumber of responses, labeled by status code. The code label can be "1xx", "2xx", "3xx", "4xx", or "5xx".countresponse
pulsar.jetty_stats_secondsTime in seconds stats have been collected for.gaugesecond
pulsar.lb_bandwidth_in_usageThe broker inbound bandwith usage (in percent).gauge-
pulsar.lb_bandwidth_out_usageThe broker outbound bandwith usage (in percent).gauge-
pulsar.lb_bundles_split_count.countbundle split count in this bundle splitting check intervalcount-
pulsar.lb_cpu_usageThe broker cpu usage (in percent).gauge-
pulsar.lb_directMemory_usageThe broker process direct memory usage (in percent).gauge-
pulsar.lb_memory_usageThe broker process memory usage (in percent).gauge-
pulsar.lb_unload_broker_count.countUnload broker count in this bundle unloadingcount-
pulsar.lb_unload_bundle_count.countBundle unload count in this bundle unloadingcount-
pulsar.ml_AddEntryBytesRateThe bytes/s rate of messages addedgauge-
pulsar.ml_AddEntryErrorsThe number of addEntry requests that failedgaugerequest
pulsar.ml_AddEntryMessagesRateThe msg/s rate of messages addedgauge-
pulsar.ml_AddEntrySucceedThe number of addEntry requests that succeededgaugerequest
pulsar.ml_AddEntryWithReplicasBytesRateThe bytes/s rate of messages added with replicasgauge-
pulsar.ml_MarkDeleteRateThe rate of mark-delete ops/sgauge-
pulsar.ml_NumberOfMessagesInBacklogThe number of backlog messages for all the consumersgaugemessage
pulsar.ml_ReadEntriesBytesRateThe bytes/s rate of messages readgauge-
pulsar.ml_ReadEntriesErrorsThe number of readEntries requests that failedgaugerequest
pulsar.ml_ReadEntriesRateThe msg/s rate of messages readgauge-
pulsar.ml_ReadEntriesSucceededThe number of readEntries requests that succeededgaugerequest
pulsar.ml_StoredMessagesSizeThe total size of the messages in active ledgers (accounting for the multiple copies stored)gauge-
pulsar.ml_cache_evictionsThe number of cache evictions during the last minute.gaugeeviction
pulsar.ml_cache_hits_rateThe number of cache hits per second on the broker side.gaugehit
pulsar.ml_cache_hits_throughputThe amount of data is retrieved from the cache on the broker side (in byte/s).gauge-
pulsar.ml_cache_misses_rateThe number of cache misses per second on the broker side.gaugemiss
pulsar.ml_cache_misses_throughputThe amount of data is not retrieved from the cache on the broker side (in byte/s).gauge-
pulsar.ml_cache_pool_active_allocationsThe number of currently active allocations in direct arenagauge-
pulsar.ml_cache_pool_active_allocations_hugeThe number of currently active huge allocation in direct arenagauge-
pulsar.ml_cache_pool_active_allocations_normalThe number of currently active normal allocations in direct arenagauge-
pulsar.ml_cache_pool_active_allocations_smallThe number of currently active small allocations in direct arenagauge-
pulsar.ml_cache_pool_allocatedThe total allocated memory of chunk lists in direct arenagauge-
pulsar.ml_cache_pool_usedThe total used memory of chunk lists in direct arenagauge-
pulsar.ml_cache_used_sizeThe size in byte used to store the entries payloadsgaugebyte
pulsar.ml_countThe number of currently opened managed ledgersgauge-
pulsar.out_bytes_totalThe total number of messages in bytes read from this topic.gaugebyte
pulsar.out_messages_totalThe total number of messages read from this topic.gaugemessage
pulsar.producers_countThe number of active producers of the namespace connected to this broker.gauge-
pulsar.proxy_active_connectionsNumber of connections currently active in the proxy.gaugeconnection
pulsar.proxy_binary_bytes.countCounter of proxy bytes.countbyte
pulsar.proxy_binary_ops.countCounter of proxy operations.count-
pulsar.proxy_new_connections.countCounter of connections being opened in the proxy.countconnection
pulsar.proxy_rejected_connections.countCounter for connections rejected due to throttling.countconnection
pulsar.rate_inThe total message rate of the namespace coming into this broker (messages/second).gauge-
pulsar.rate_outThe total message rate of the namespace going out from this broker (messages/second).gauge-
pulsar.replication_backlogThe total backlog of the namespace replicating to remote cluster (messages).gaugemessage
pulsar.replication_connected_countThe count of replication-subscriber up and running to replicate to remote cluster.gauge-
pulsar.replication_delay_in_secondsTime in seconds from the time a message was produced to the time when it is about to be replicated.gaugesecond
pulsar.replication_rate_expiredTotal rate of messages expired (messages/second).gauge-
pulsar.replication_rate_inThe total message rate of the namespace replicating from remote cluster (messages/second).gauge-
pulsar.replication_rate_outThe total message rate of the namespace replicating to remote cluster (messages/second).gauge-
pulsar.replication_throughput_inThe total throughput of the namespace replicating from remote cluster (bytes/second).gauge-
pulsar.replication_throughput_outThe total throughput of the namespace replicating to remote cluster (bytes/second).gauge-
pulsar.sink_last_invocationThe timestamp of the last invocation of the sink.gauge-
pulsar.sink_received_total.countThe total number of records that a sink has received from Pulsar topics.count-
pulsar.sink_received_total_1min.countThe total number of messages that a sink has received from Pulsar topics in the last 1 minute.countmessage
pulsar.sink_sink_exceptionThe exception from a sink.gauge-
pulsar.sink_sink_exceptions_total.countThe total number of sink exceptions.count-
pulsar.sink_sink_exceptions_total_1min.countThe total number of sink exceptions in the last 1 minute.count-
pulsar.sink_system_exceptionThe exception from system code.gauge-
pulsar.sink_system_exceptions_total.countThe total number of system exceptions.count-
pulsar.sink_system_exceptions_total_1min.countThe total number of system exceptions in the last 1 minute.count-
pulsar.sink_written_total.countThe total number of records processed by a sink.count-
pulsar.sink_written_total_1min.countThe total number of records processed by a sink in the last 1 minute.count-
pulsar.source_last_invocationThe timestamp of the last invocation of the source.gauge-
pulsar.source_received_total.countThe total number of records received from source.count-
pulsar.source_received_total_1min.countThe total number of records received from source in the last 1 minute.count-
pulsar.source_source_exceptionThe exception from a source.gauge-
pulsar.source_source_exceptions_total.countThe total number of source exceptions.count-
pulsar.source_source_exceptions_total_1min.countThe total number of source exceptions in the last 1 minute.count-
pulsar.source_system_exceptionThe exception from system code.gauge-
pulsar.source_system_exceptions_total.countThe total number of system exceptions.count-
pulsar.source_system_exceptions_total_1min.countThe total number of system exceptions in the last 1 minute.count-
pulsar.source_written_total.countThe total number of records written to a Pulsar topic.count-
pulsar.source_written_total_1min.countThe total number of records written to a Pulsar topic in the last 1 minute.count-
pulsar.split_bytes_read.countNumber of bytes read from BookKeeper.countbyte
pulsar.split_num_messages_deserialized.countNumber of messages deserialized.countmessage
pulsar.split_num_record_deserialized.countNumber of records deserialized.count-
pulsar.storage_backlog_quota_limitThe total amount of the data in this topic that limit the backlog quota (bytes).gaugebyte
pulsar.storage_backlog_sizeThe total backlog size of the topics of this namespace owned by this broker (messages).gauge-
pulsar.storage_logical_sizeThe storage size of topics in the namespace owned by the broker without replicas (in bytes).gauge-
pulsar.storage_offloaded_sizeThe total amount of the data in this namespace offloaded to the tiered storage (bytes).gauge-
pulsar.storage_read_rateThe total message batches (entries) read from the storage for this namespace (message batches / second).gauge-
pulsar.storage_sizeThe total storage size of the topics in this namespace owned by this broker (bytes).gauge-
pulsar.storage_write_rateThe total message batches (entries) written to the storage for this namespace (message batches / second).gauge-
pulsar.subscription_back_logThe total backlog of a subscription (messages).gaugemessage
pulsar.subscription_blocked_on_unacked_messagesIndicate whether a subscription is blocked on unacknowledged messages or not. 1 means the subscription is blocked on waiting unacknowledged messages to be acked.0 means the subscription is not blocked on waiting unacknowledged messages to be acked.gauge-
pulsar.subscription_delayedThe total message batches (entries) are delayed for dispatching.gauge-
pulsar.subscription_msg_rate_outThe total message dispatch rate for a subscription (messages/second).gauge-
pulsar.subscription_msg_rate_redeliverThe total message rate for message being redelivered (messages/second).gauge-
pulsar.subscription_msg_throughput_outThe total message dispatch throughput for a subscription (bytes/second).gauge-
pulsar.subscription_unacked_messagesThe total number of unacknowledged messages of a subscription (messages).gaugemessage
pulsar.subscriptions_countThe number of Pulsar subscriptions of the namespace served by this broker.gauge-
pulsar.throughput_inThe total throughput of the namespace coming into this broker (bytes/second).gauge-
pulsar.throughput_outThe total throughput of the namespace going out from this broker (bytes/second).gauge-
pulsar.topics_countThe number of Pulsar topics of the namespace owned by this broker.gauge-
pulsar.txn_aborted_count.countNumber of aborted transactions of this coordinator.counttransaction
pulsar.txn_active_countNumber of active transactions.gaugetransaction
pulsar.txn_append_log_count.countNumber of append transaction logs.count-
pulsar.txn_committed_count.countNumber of committed transactions.counttransaction
pulsar.txn_created_count.countNumber of created transactions.counttransaction
pulsar.txn_timeout_count.countNumber of timeout transactions.counttransaction

公式ドキュメント

Pulsar インテグレーションの公式ドキュメント

メトリクスの名前と説明は Datadog の公式インテグレーションの定義 (Copyright Datadog, Inc.・BSD-3-Clause) を英文のまま載せています。利用条件の全文は サイトについてにあります。