Hadoop job scheduling with dynamic task splitting

• Main Author: Xu, Yongliang
• Other Authors: Cai Wentong
• Format: Theses and Dissertations
• Language: English
• Published: 2015
• Subjects: DRNTU::Engineering::Computer science and engineering::Information systems::Information systems applications
• Online Access: https://hdl.handle.net/10356/65309
• Institution: Nanyang Technological University

Job scheduling affects the fairness and performance of shared Hadoop clusters. Fairness measures how fair the resources in the cluster are shared among different users in the Hadoop cluster. In Hadoop, schedulers will always attempt to maximize data locality. Data locality refers to the processing o...