obsdog

HDFS Datanode integration metrics

The official Datadog integration for monitoring HDFS Datanode. It collects 11 metrics.

Official summary

Track cluster disk usage, volume failures, dead DataNodes, and more.

Metric types

  • gauge (value at a point in time): 11

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
hdfs.datanode.cache_capacityCache capacity in bytesgaugebyte
hdfs.datanode.cache_usedCache used in bytesgaugebyte
hdfs.datanode.dfs_capacityDisk capacity in bytesgaugebyte
hdfs.datanode.dfs_remainingThe remaining disk space left in bytesgaugebyte
hdfs.datanode.dfs_usedDisk usage in bytesgaugebyte
hdfs.datanode.estimated_capacity_lost_totalThe estimated capacity lost in bytesgaugebyte
hdfs.datanode.last_volume_failure_dateThe date/time of the last volume failure in milliseconds since epochgaugemillisecond
hdfs.datanode.num_blocks_cachedThe number of blocks cachedgaugeblock
hdfs.datanode.num_blocks_failed_to_cacheThe number of blocks that failed to cachegaugeblock
hdfs.datanode.num_blocks_failed_to_uncacheThe number of failed blocks to remove from cachegaugeblock
hdfs.datanode.num_failed_volumesNumber of failed volumesgauge-

Official documentation

Official documentation for the HDFS Datanode integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.

Related products

IntegrationsIntegrations are the bundle of entry points that pour data from external systems such as AWS and MySQL into Datadog. Where you configure them splits into two families, the Agent side and the cloud account side, and which one you choose changes both what you can see and how billing is counted.Foundation and data collectionLog ManagementLog Management is the product that gathers logs from servers, containers, and cloud services in one place and connects them to search, retention, and notification. It has a distinctive structure in which ingestion and indexing are billed separately.Log managementInfrastructure MonitoringInfrastructure Monitoring is the product that visualizes the state of servers, containers, and cloud resources at the host level. The host map and process list let you grasp at a glance which host is struggling right now.Infrastructure monitoringProcess MonitoringA feature (Live Processes) for identifying the processes consuming a host's CPU and memory. It goes one level below host monitoring and lets you track who is using resources without logging in to the server.Infrastructure monitoring

Other OS & System integrations

HDFS Namenode23 metricsHyperV16 metricsIBM i27 metricsIBM Spectrum LSF163 metricsIBM WAS53 metricsLinux Proc Extras9 metricsLPARStats41 metricsNfsstat16 metricsNutanix129 metricsOpenTelemetry155 metricsProcesses25 metricsProxmox38 metrics