Pulsar integration metrics
The official Datadog integration for monitoring Pulsar. It collects 196 metrics.
Official summary
Monitor your Pulsar clusters.
Metric types
- gauge (value at a point in time): 132
- count (occurrences in the interval): 64
Metrics
Descriptions are the official definitions, unedited.
| Metric | Type | Unit |
|---|---|---|
pulsar.The number of active connections. | gauge | connection |
pulsar.The number of failing authentication operations. | count | - |
pulsar.The number of successful authentication operations. | count | - |
pulsar.The total number of ledgers deleted since the bookie has started. | count | - |
pulsar.The total number of bytes read from the bookie. | count | byte |
pulsar.The server status for bookie server. 1: the bookie is running in writable mode.0: the bookie is running in readonly mode. | gauge | - |
pulsar.The total number of bytes written to the bookie. | count | byte |
pulsar.The total number of entries stored in the bookie. | gauge | - |
pulsar.The table flush latency of bookie memory. | gauge | - |
pulsar.The total number of callbacks pending in the callback queue. | gauge | - |
pulsar.The total number of force write (fsync) requests pending in the force-write queue. | gauge | request |
pulsar.The total number of requests pending in the journal queue. | gauge | request |
pulsar.The total number of journal fsync operations happening at the bookie. The success label is used to distinguish successes and failures. | count | - |
pulsar.The number of writable directories in the bookie. | gauge | - |
pulsar.The total number of ledgers stored in the bookie. | gauge | - |
pulsar.The bookie read cache size (in bytes). | gauge | byte |
pulsar.The number of write requests to be throttled. | count | request |
pulsar.The bookie write cache size (in bytes). | gauge | byte |
pulsar.The total number of ADD_ENTRY requests received at the bookie. The success label is used to distinguish successes and failures. | count | request |
pulsar.The number of bookie clients to be quarantined. | count | - |
pulsar.The total number of READ_ENTRY requests received at the bookie. The success label is used to distinguish successes and failures. | count | request |
pulsar.The number of non-contiguous deleted messages ranges. | gauge | - |
pulsar.The number of ledger errors occurred when acknowledgment states fail to be persistent to the ledger. | gauge | error |
pulsar.The number of acknowledgment states that is persistent to a ledger. | gauge | - |
pulsar.The number of ledger errors occurred when acknowledgment states fail to be persistent to ZooKeeper. | gauge | error |
pulsar.The number of acknowledgment states that is persistent to ZooKeeper. | gauge | - |
pulsar.The size of read from ledger. | gauge | - |
pulsar.The size of write to ledger (accounting for without replicas). | gauge | - |
pulsar.The size of write to ledger. | gauge | - |
pulsar.The summary of latency of bundles ownership operations. | gauge | - |
pulsar.Number of samples of the latency of all lookup operations. | count | - |
pulsar.Latency of all lookup operations by quantile. | gauge | - |
pulsar.Total latency of all lookup operations. | count | - |
pulsar.The number of lookup responses (i.e. not redirected requests). | count | response |
pulsar.The number of lookup failures. | count | - |
pulsar.The number of pending lookups in broker. When it is up to the threshold, new requests are rejected. | gauge | request |
pulsar.The number of lookup redirected requests. | count | request |
pulsar.The number of throttled connections. | gauge | connection |
pulsar.The number of throttled connections because of per-connection limit. | gauge | connection |
pulsar.The load of pending topic operations. | gauge | - |
pulsar.The consumer count of the topics in this bundle. | gauge | - |
pulsar.The total message rate coming into the topics in this bundle (messages/second). | gauge | - |
pulsar.The total message rate going out from the topics in this bundle (messages/second). | gauge | - |
pulsar.The total throughput coming into the topics in this bundle (bytes/second). | gauge | - |
pulsar.The total throughput going out from the topics in this bundle (bytes/second). | gauge | - |
pulsar.The producer count of the topics in this bundle. | gauge | - |
pulsar.The topic count in this bundle. | gauge | - |
pulsar.The total number of the compacted entries. | gauge | - |
pulsar.The total size of the compacted entries. | gauge | - |
pulsar.The duration time of the compaction. | gauge | - |
pulsar.The total number of failures of the compaction. | gauge | - |
pulsar.The read throughput of the compaction. | gauge | - |
pulsar.The total number of removed events of the compaction. | gauge | - |
pulsar.The total number of successes of the compaction. | gauge | - |
pulsar.The write throughput of the compaction. | gauge | - |
pulsar.The total number of closed connections. | gauge | connection |
pulsar.The number of failed connections. | gauge | connection |
pulsar.The number of successfully created connections. | gauge | connection |
pulsar.The total number of connections. | gauge | connection |
pulsar.The available permits for for a consumer. | gauge | - |
pulsar.Indicate whether a consumer is blocked on unacknowledged messages or not. 1 means the consumer is blocked on waiting unacknowledged messages to be acked.0 means the consumer is not blocked on waiting unacknowledged messages to be acked. | gauge | - |
pulsar.The total message dispatch rate for a consumer (messages/second). | gauge | - |
pulsar.The total message rate for message being redelivered (messages/second). | gauge | - |
pulsar.The total message dispatch throughput for a consumer (bytes/second). | gauge | - |
pulsar.The total number of unacknowledged messages of a consumer (messages). | gauge | message |
pulsar.The number of active consumers of the namespace connected to this broker. | gauge | - |
pulsar.The number of expired tokens in Pulsar. | count | - |
pulsar.The timestamp of the last invocation of the function. | gauge | - |
pulsar.The total number of messages processed successfully. | count | message |
pulsar.The total number of messages processed successfully in the last 1 minute. | count | message |
pulsar.The total number of messages received from source. | count | message |
pulsar.The total number of messages received from source in the last 1 minute. | count | message |
pulsar.The total number of system exceptions. | count | - |
pulsar.The total number of system exceptions in the last 1 minute. | count | - |
pulsar.The total number of user exceptions. | count | - |
pulsar.The total number of user exceptions in the last 1 minute. | count | - |
pulsar.The number of messages in bytes received for this topic. | gauge | byte |
pulsar.The total number of messages received for this topic. | gauge | message |
pulsar.Number of requested that have been asynchronously dispatched. | count | - |
pulsar.Total number of async requests. | count | request |
pulsar.Currently waiting async requests. | gauge | request |
pulsar.Maximum number of waiting async requests. | gauge | request |
pulsar.Number of dispatches currently active. | gauge | - |
pulsar.Maximum number of active dispatches being handled. | gauge | - |
pulsar.Maximum time spent in dispatch handling. | gauge | - |
pulsar.Total time spent in dispatch handling. | count | second |
pulsar.Number of dispatches. | count | - |
pulsar.Number of async requests requests that have expired. | count | request |
pulsar.Maximum time spent handling requests. | gauge | second |
pulsar.Total time spent in all request handling. | count | second |
pulsar.Number of requests currently active. | gauge | request |
pulsar.Maximum number of requests that have been active at once. | gauge | request |
pulsar.Number of requests. | count | request |
pulsar.Total number of bytes across all responses. | count | byte |
pulsar.Number of responses, labeled by status code. The code label can be "1xx", "2xx", "3xx", "4xx", or "5xx". | count | response |
pulsar.Time in seconds stats have been collected for. | gauge | second |
pulsar.The broker inbound bandwith usage (in percent). | gauge | - |
pulsar.The broker outbound bandwith usage (in percent). | gauge | - |
pulsar.bundle split count in this bundle splitting check interval | count | - |
pulsar.The broker cpu usage (in percent). | gauge | - |
pulsar.The broker process direct memory usage (in percent). | gauge | - |
pulsar.The broker process memory usage (in percent). | gauge | - |
pulsar.Unload broker count in this bundle unloading | count | - |
pulsar.Bundle unload count in this bundle unloading | count | - |
pulsar.The bytes/s rate of messages added | gauge | - |
pulsar.The number of addEntry requests that failed | gauge | request |
pulsar.The msg/s rate of messages added | gauge | - |
pulsar.The number of addEntry requests that succeeded | gauge | request |
pulsar.The bytes/s rate of messages added with replicas | gauge | - |
pulsar.The rate of mark-delete ops/s | gauge | - |
pulsar.The number of backlog messages for all the consumers | gauge | message |
pulsar.The bytes/s rate of messages read | gauge | - |
pulsar.The number of readEntries requests that failed | gauge | request |
pulsar.The msg/s rate of messages read | gauge | - |
pulsar.The number of readEntries requests that succeeded | gauge | request |
pulsar.The total size of the messages in active ledgers (accounting for the multiple copies stored) | gauge | - |
pulsar.The number of cache evictions during the last minute. | gauge | eviction |
pulsar.The number of cache hits per second on the broker side. | gauge | hit |
pulsar.The amount of data is retrieved from the cache on the broker side (in byte/s). | gauge | - |
pulsar.The number of cache misses per second on the broker side. | gauge | miss |
pulsar.The amount of data is not retrieved from the cache on the broker side (in byte/s). | gauge | - |
pulsar.The number of currently active allocations in direct arena | gauge | - |
pulsar.The number of currently active huge allocation in direct arena | gauge | - |
pulsar.The number of currently active normal allocations in direct arena | gauge | - |
pulsar.The number of currently active small allocations in direct arena | gauge | - |
pulsar.The total allocated memory of chunk lists in direct arena | gauge | - |
pulsar.The total used memory of chunk lists in direct arena | gauge | - |
pulsar.The size in byte used to store the entries payloads | gauge | byte |
pulsar.The number of currently opened managed ledgers | gauge | - |
pulsar.The total number of messages in bytes read from this topic. | gauge | byte |
pulsar.The total number of messages read from this topic. | gauge | message |
pulsar.The number of active producers of the namespace connected to this broker. | gauge | - |
pulsar.Number of connections currently active in the proxy. | gauge | connection |
pulsar.Counter of proxy bytes. | count | byte |
pulsar.Counter of proxy operations. | count | - |
pulsar.Counter of connections being opened in the proxy. | count | connection |
pulsar.Counter for connections rejected due to throttling. | count | connection |
pulsar.The total message rate of the namespace coming into this broker (messages/second). | gauge | - |
pulsar.The total message rate of the namespace going out from this broker (messages/second). | gauge | - |
pulsar.The total backlog of the namespace replicating to remote cluster (messages). | gauge | message |
pulsar.The count of replication-subscriber up and running to replicate to remote cluster. | gauge | - |
pulsar.Time in seconds from the time a message was produced to the time when it is about to be replicated. | gauge | second |
pulsar.Total rate of messages expired (messages/second). | gauge | - |
pulsar.The total message rate of the namespace replicating from remote cluster (messages/second). | gauge | - |
pulsar.The total message rate of the namespace replicating to remote cluster (messages/second). | gauge | - |
pulsar.The total throughput of the namespace replicating from remote cluster (bytes/second). | gauge | - |
pulsar.The total throughput of the namespace replicating to remote cluster (bytes/second). | gauge | - |
pulsar.The timestamp of the last invocation of the sink. | gauge | - |
pulsar.The total number of records that a sink has received from Pulsar topics. | count | - |
pulsar.The total number of messages that a sink has received from Pulsar topics in the last 1 minute. | count | message |
pulsar.The exception from a sink. | gauge | - |
pulsar.The total number of sink exceptions. | count | - |
pulsar.The total number of sink exceptions in the last 1 minute. | count | - |
pulsar.The exception from system code. | gauge | - |
pulsar.The total number of system exceptions. | count | - |
pulsar.The total number of system exceptions in the last 1 minute. | count | - |
pulsar.The total number of records processed by a sink. | count | - |
pulsar.The total number of records processed by a sink in the last 1 minute. | count | - |
pulsar.The timestamp of the last invocation of the source. | gauge | - |
pulsar.The total number of records received from source. | count | - |
pulsar.The total number of records received from source in the last 1 minute. | count | - |
pulsar.The exception from a source. | gauge | - |
pulsar.The total number of source exceptions. | count | - |
pulsar.The total number of source exceptions in the last 1 minute. | count | - |
pulsar.The exception from system code. | gauge | - |
pulsar.The total number of system exceptions. | count | - |
pulsar.The total number of system exceptions in the last 1 minute. | count | - |
pulsar.The total number of records written to a Pulsar topic. | count | - |
pulsar.The total number of records written to a Pulsar topic in the last 1 minute. | count | - |
pulsar.Number of bytes read from BookKeeper. | count | byte |
pulsar.Number of messages deserialized. | count | message |
pulsar.Number of records deserialized. | count | - |
pulsar.The total amount of the data in this topic that limit the backlog quota (bytes). | gauge | byte |
pulsar.The total backlog size of the topics of this namespace owned by this broker (messages). | gauge | - |
pulsar.The storage size of topics in the namespace owned by the broker without replicas (in bytes). | gauge | - |
pulsar.The total amount of the data in this namespace offloaded to the tiered storage (bytes). | gauge | - |
pulsar.The total message batches (entries) read from the storage for this namespace (message batches / second). | gauge | - |
pulsar.The total storage size of the topics in this namespace owned by this broker (bytes). | gauge | - |
pulsar.The total message batches (entries) written to the storage for this namespace (message batches / second). | gauge | - |
pulsar.The total backlog of a subscription (messages). | gauge | message |
pulsar.Indicate whether a subscription is blocked on unacknowledged messages or not. 1 means the subscription is blocked on waiting unacknowledged messages to be acked.0 means the subscription is not blocked on waiting unacknowledged messages to be acked. | gauge | - |
pulsar.The total message batches (entries) are delayed for dispatching. | gauge | - |
pulsar.The total message dispatch rate for a subscription (messages/second). | gauge | - |
pulsar.The total message rate for message being redelivered (messages/second). | gauge | - |
pulsar.The total message dispatch throughput for a subscription (bytes/second). | gauge | - |
pulsar.The total number of unacknowledged messages of a subscription (messages). | gauge | message |
pulsar.The number of Pulsar subscriptions of the namespace served by this broker. | gauge | - |
pulsar.The total throughput of the namespace coming into this broker (bytes/second). | gauge | - |
pulsar.The total throughput of the namespace going out from this broker (bytes/second). | gauge | - |
pulsar.The number of Pulsar topics of the namespace owned by this broker. | gauge | - |
pulsar.Number of aborted transactions of this coordinator. | count | transaction |
pulsar.Number of active transactions. | gauge | transaction |
pulsar.Number of append transaction logs. | count | - |
pulsar.Number of committed transactions. | count | transaction |
pulsar.Number of created transactions. | count | transaction |
pulsar.Number of timeout transactions. | count | transaction |
Official documentation
Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.