Decoupled neural network training with re-computation and weight prediction

• المؤلفون الرئيسيون: Peng, Jiawei, Xu, Yicheng, Lin, Zhiping, Weng, Zhenyu, Yang, Zishuo, Zhuang, Huiping
• مؤلفون آخرون: School of Electrical and Electronic Engineering
• التنسيق: مقال
• اللغة: English
• منشور في: 2023
• الموضوعات: Engineering::Electrical and electronic engineering; Back Propagation; Convolutional Neural Network
• الوصول للمادة أونلاين: https://hdl.handle.net/10356/169712
• المؤسسة: Nanyang Technological University

To break the three lockings during backpropagation (BP) process for neural network training, multiple decoupled learning methods have been investigated recently. These methods either lead to significant drop in accuracy performance or suffer from dramatic increase in memory usage. In this paper, a n...