On-device deep multi-task inference via multi-task zipping

• Main Authors: HE, Xiaoxi, WANG, Xu, ZHOU, Zimu, WU, Jiahang, YANG, Zheng, THIELE, Lothar
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Deep Neural Networks; Model Compression; Multi-Task Learning; OS and Networks; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/6724; https://ink.library.smu.edu.sg/context/sis_research/article/7727/viewcontent/tmc21_he.pdf
• Institution: Singapore Management University

Future mobile devices are anticipated to perceive, understand and react to the world on their own by running multiple correlated deep neural networks locally on-device. Yet the complexity of these deep models needs to be trimmed down both within-model and cross-model to fit in mobile storage and mem...