CS 244 ’19: Reproducing Results from Dominant Resource Fairness

Download report

Keshav Santhanam, Homero Roman Roman

Original paper: Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, and Ion Stoica. 2011. Dominant Resource Fairness: Fair Allocation of Multiple Resource Types.. In NSDI, Vol. 11. 24–24.

We reproduce Figures 9, 10, 13, and 14 in the DRF paper using a simulation-driven approach. Our goal is to measure metrics such as resource utilization and job completion time achieved by DRF compared to the Hadoop slot-based algorithm. We study the behavior of DRF using a microbenchmark trace derived from the paper and a large synthetic trace and find that DRF does in fact outperform the naive slot based policy for most use cases.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s