TY - JOUR

T1 - RALB-HC: A Resource Aware Load Balancer for Heterogeneous Cluster

AU - Ahmed, Usman

AU - Aleem, Muhammad

AU - Khalid, Yasir Noman

AU - Islam, Muhammad Arshad

AU - Iqbal, Muhammad Azhar

PY - 2021/6/23

Y1 - 2021/6/23

N2 - In the heterogeneous computing environment, programmers map the applications either on CPUs or GPUs. However, this default mapping process does not produce improved results, particularly on the heterogeneous clusters. If one resource of the cluster is more compute capable, then most of the scheduling schemes favor that powerful device. In this scenario, the scheduling schemes overload the powerful resources while making all other compute resources remain under utilized. This load imbalance problem results in higher energy consumption and increased execution time. In this research, a novel Resource-Aware Load Balancer for the Heterogeneous Cluster (RALB-HC) is proposed that distributes workload based on resources computing capabilities and applications computing needs. The RALB-HC uses supervised machine learning approach to classify applications using the static code-features. The RALB-HC framework comprises of two phases: (1) job mapping based on the availability of the resources and (2) the resource-aware load balancing to achieve the higher resource utilization ratio. The experimental results on a large set of real-world and synthetic workloads show that the RALB-HC reduces execution time by 31.61%, increased resource utilization ratio by 67.8% and improved throughout 147.35% as compared to baseline scheduling schemes.

AB - In the heterogeneous computing environment, programmers map the applications either on CPUs or GPUs. However, this default mapping process does not produce improved results, particularly on the heterogeneous clusters. If one resource of the cluster is more compute capable, then most of the scheduling schemes favor that powerful device. In this scenario, the scheduling schemes overload the powerful resources while making all other compute resources remain under utilized. This load imbalance problem results in higher energy consumption and increased execution time. In this research, a novel Resource-Aware Load Balancer for the Heterogeneous Cluster (RALB-HC) is proposed that distributes workload based on resources computing capabilities and applications computing needs. The RALB-HC uses supervised machine learning approach to classify applications using the static code-features. The RALB-HC framework comprises of two phases: (1) job mapping based on the availability of the resources and (2) the resource-aware load balancing to achieve the higher resource utilization ratio. The experimental results on a large set of real-world and synthetic workloads show that the RALB-HC reduces execution time by 31.61%, increased resource utilization ratio by 67.8% and improved throughout 147.35% as compared to baseline scheduling schemes.

KW - computation-aware scheduling

KW - heterogeneous system

KW - load balancing

KW - machine learning

KW - resource utilization

KW - scheduling

U2 - 10.1002/cpe.5606

DO - 10.1002/cpe.5606

M3 - Journal article

VL - 33

JO - Concurrency and Computation Practice and Experience

JF - Concurrency and Computation Practice and Experience

SN - 1532-0634

M1 - e5606

ER -