obsdog

HDFS Namenode integration metrics

The official Datadog integration for monitoring HDFS Namenode. It collects 23 metrics.

Official summary

Track cluster disk usage, volume failures, dead DataNodes, and more.

Metric types

  • gauge (value at a point in time): 23

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
hdfs.namenode.blocks_totalTotal number of blocksgaugeblock
hdfs.namenode.capacity_remainingRemaining disk space left in bytesgaugebyte
hdfs.namenode.capacity_totalTotal disk capacity in bytesgaugebyte
hdfs.namenode.capacity_usedDisk usage in bytesgaugebyte
hdfs.namenode.corrupt_blocksNumber of corrupt blocksgaugeblock
hdfs.namenode.estimated_capacity_lost_totalEstimated capacity lost in bytesgaugebyte
hdfs.namenode.files_totalTotal number of filesgaugefile
hdfs.namenode.fs_lock_queue_lengthLock queue lengthgauge-
hdfs.namenode.max_objectsMaximum number of files HDFS supportsgaugeobject
hdfs.namenode.missing_blocksNumber of missing blocksgaugeblock
hdfs.namenode.num_dead_data_nodesTotal number of dead data nodesgaugenode
hdfs.namenode.num_decom_dead_data_nodesNumber of decommissioning dead data nodesgaugenode
hdfs.namenode.num_decom_live_data_nodesNumber of decommissioning live data nodesgaugenode
hdfs.namenode.num_decommissioning_data_nodesNumber of decommissioning data nodesgaugenode
hdfs.namenode.num_live_data_nodesTotal number of live data nodesgaugenode
hdfs.namenode.num_stale_data_nodesNumber of stale data nodesgaugenode
hdfs.namenode.num_stale_storagesNumber of stale storagesgauge-
hdfs.namenode.pending_deletion_blocksNumber of pending deletion blocksgaugeblock
hdfs.namenode.pending_replication_blocksNumber of blocks pending replicationgaugeblock
hdfs.namenode.scheduled_replication_blocksNumber of blocks scheduled for replicationgaugeblock
hdfs.namenode.total_loadTotal load on the file systemgauge-
hdfs.namenode.under_replicated_blocksNumber of under replicated blocksgaugeblock
hdfs.namenode.volume_failures_totalTotal volume failuresgauge-

Official documentation

Official documentation for the HDFS Namenode integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.

Related products

IntegrationsIntegrations are the bundle of entry points that pour data from external systems such as AWS and MySQL into Datadog. Where you configure them splits into two families, the Agent side and the cloud account side, and which one you choose changes both what you can see and how billing is counted.Foundation and data collectionLog ManagementLog Management is the product that gathers logs from servers, containers, and cloud services in one place and connects them to search, retention, and notification. It has a distinctive structure in which ingestion and indexing are billed separately.Log managementInfrastructure MonitoringInfrastructure Monitoring is the product that visualizes the state of servers, containers, and cloud resources at the host level. The host map and process list let you grasp at a glance which host is struggling right now.Infrastructure monitoringProcess MonitoringA feature (Live Processes) for identifying the processes consuming a host's CPU and memory. It goes one level below host monitoring and lets you track who is using resources without logging in to the server.Infrastructure monitoring

Other OS & System integrations

HyperV16 metricsIBM i27 metricsIBM Spectrum LSF163 metricsIBM WAS53 metricsLinux Proc Extras9 metricsLPARStats41 metricsNfsstat16 metricsNutanix129 metricsOpenTelemetry155 metricsProcesses25 metricsProxmox38 metricsSystem Core26 metrics