Map Reduce integration metrics

The official Datadog integration for monitoring Map Reduce. It collects 36 metrics.

Official summary

Monitor the status and duration of map and reduce tasks.

Metric types

  • rate (per second): 24
  • gauge (value at a point in time): 12

Metrics

Descriptions are the official definitions, unedited.

MetricTypeUnit
mapreduce.job.counter.map_counter_valueCounter value of map tasksratetask/second
mapreduce.job.counter.reduce_counter_valueCounter value of reduce tasksratetask/second
mapreduce.job.counter.total_counter_valueCounter value of all tasksratetask/second
mapreduce.job.elapsed_time.95percentile95th percentile elapsed time since the application startedgaugemillisecond
mapreduce.job.elapsed_time.avgAverage elapsed time since the application startedgaugemillisecond
mapreduce.job.elapsed_time.countNumber of times the elapsed time was sampledrate-
mapreduce.job.elapsed_time.maxMax elapsed time since the application startedgaugemillisecond
mapreduce.job.elapsed_time.medianMedian elapsed time since the application startedgaugemillisecond
mapreduce.job.failed_map_attemptsNumber of failed map attemptsratetask/second
mapreduce.job.failed_reduce_attemptsNumber of failed reduce attemptsratetask/second
mapreduce.job.killed_map_attemptsNumber of killed map attemptsratetask/second
mapreduce.job.killed_reduce_attemptsNumber of killed reduce attemptsratetask/second
mapreduce.job.map.task.elapsed_time.95percentile95th percentile of all map tasks elapsed timegaugemillisecond
mapreduce.job.map.task.elapsed_time.avgAverage of all map tasks elapsed timegaugemillisecond
mapreduce.job.map.task.elapsed_time.countNumber of times the map tasks elapsed time were sampledrate-
mapreduce.job.map.task.elapsed_time.maxMax of all map tasks elapsed timegaugemillisecond
mapreduce.job.map.task.elapsed_time.medianMedian of all map tasks elapsed timegaugemillisecond
mapreduce.job.maps_completedNumber of completed mapsratetask/second
mapreduce.job.maps_pendingNumber of pending mapsratetask/second
mapreduce.job.maps_runningNumber of running mapsratetask/second
mapreduce.job.maps_totalTotal number of mapsratetask/second
mapreduce.job.new_map_attemptsNumber of new map attemptsratetask/second
mapreduce.job.new_reduce_attemptsNumber of new reduce attemptsratetask/second
mapreduce.job.reduce.task.elapsed_time.95percentile95th percentile of all reduce tasks elapsed timegaugemillisecond
mapreduce.job.reduce.task.elapsed_time.avgAverage of all reduce tasks elapsed timegaugemillisecond
mapreduce.job.reduce.task.elapsed_time.countNumber of times the reduce tasks elapsed time were sampledrate-
mapreduce.job.reduce.task.elapsed_time.maxMax of all reduce tasks elapsed timegaugemillisecond
mapreduce.job.reduce.task.elapsed_time.medianMedian of all reduce tasks elapsed timegaugemillisecond
mapreduce.job.reduces_completedNumber of completed reducesratetask/second
mapreduce.job.reduces_pendingNumber of pending reducesratetask/second
mapreduce.job.reduces_runningNumber of running reducesratetask/second
mapreduce.job.reduces_totalNumber of reducesratetask/second
mapreduce.job.running_map_attemptsNumber of running map attemptsratetask/second
mapreduce.job.running_reduce_attemptsNumber of running reduce attemptsratetask/second
mapreduce.job.successful_map_attemptsNumber of successful map attemptsratetask/second
mapreduce.job.successful_reduce_attemptsNumber of successful reduce attemptsratetask/second

Official documentation

Official documentation for the Map Reduce integration

Metric names and descriptions are the official Datadog integration definitions (Copyright Datadog, Inc., BSD-3-Clause), reproduced unedited. The full license terms are on the About page.