Pruning-aware merging for efficient multitask inference

• Main Authors: GAO, Dawei, HE, Xiaoxi, ZHOU, Zimu, TONG, Yongxin, THIELE, Lothar
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: Deep learning; Network pruning; Multitask inference; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/6804; https://ink.library.smu.edu.sg/context/sis_research/article/7807/viewcontent/kdd21_he.pdf
• Institution: Singapore Management University

Many mobile applications demand selective execution of multiple correlated deep learning inference tasks on resource-constrained platforms. Given a set of deep neural networks, each pre-trained for a single task, it is desired that executing arbitrary combinations of tasks yields minimal computation...