Monitoring disk I/O on hadoop cluster with ganglia

Question

3.3k views Asked by mathieu At 24 November 2024 at 00:35

I deployed hadoop 2 (HDP2), and would like to get the disk i/o metrics of my slave nodes in ganglia. I didn't find any relevant metric so far.

What metric do you suggest to use or to add to ganglia ?

Thanks

There are 3 answers

**zhutoulala** · Answer 1 · 2013-12-25 08:39:17

zhutoulala On 25 December 2013 at 08:39

cloudera-manager can help monitor the cluster status including Disk I/O

**vishnu** · Answer 2 · 2014-01-06 07:07:51

vishnu On 06 January 2014 at 07:07

You can also use Ganglia Python Module Disk-stat provided here

**harschware** · Answer 3 · 2015-01-24 23:19:15

harschware On 24 January 2015 at 23:19

As stated by @vishnu: Ganglia Python Module Disk-stat provided here

You can also use gmetric scripts that you would run from cron from here

Finally, you can use collectl and export disk metrics to ganglia, see here