EvoLP: self-evolving latency predictor for model compression in real-time edge systems

• Main Authors: Huai, Shuo, Kong, Hao, Li, Shiqing, Luo, Xiangzhong, Subramaniam, Ravi, Makaya, Christian, Lin, Qian, Liu, Weichen
• 其他作者: School of Computer Science and Engineering
• 格式: Article
• 語言: English
• 出版: 2023
• 主題: Engineering::Computer science and engineering; Predictive Models; Hardware
• 在線閱讀: https://hdl.handle.net/10356/171636

Edge devices are increasingly utilized for deploying deep learning applications on embedded systems. The real-time nature of many applications and the limited resources of edge devices necessitate latency-targeted neural network compression. However, measuring latency on real devices is challenging...