BatchLens: a visualization approach for analyzing batch jobs in cloud systems

• Main Authors: RUAN, Shaolun, WANG, Yong, JIANG, Hailong, XU, Weijia, GUAN, Qiang.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Cloud computing; Human-computer interaction; Visual analytics; Computer Engineering; Data Storage Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/7704; https://ink.library.smu.edu.sg/context/sis_research/article/8707/viewcontent/2112.15300.pdf
• Institution: Singapore Management University

Cloud systems are becoming increasingly powerful and complex. It is highly challenging to identify anomalous execution behaviors and pinpoint problems by examining the overwhelming intermediate results/states in complex application workflows. Domain scientists urgently need a friendly and functional interface to understand the quality of the computing services and the performance of their applications in real time. To meet these needs, we explore data generated by job schedulers and investigate general performance metrics (e.g., utilization of CPU, memory and disk I/O). Specifically, we propose an interactive visual analytics approach, BatchLens, to provide both providers and users of cloud service with an intuitive and effective way to explore the status of system batch jobs and help them conduct root-cause analysis of anomalous behaviors in batch jobs. We demonstrate the effectiveness of BatchLens through a case study on the public Alibaba bench workload trace datasets.