Auxiliary network design for local learning in deep neural networks

• Main Author: Peng, Jiawei
• Other Authors: Lin Zhiping
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/149869
• Institution: Nanyang Technological University

The training of deep neural networks utilizes the backpropagation algorithm which consists of the forward pass, backward pass and parameters update. The output of a certain layer is produced based on the output of its lower layers in a sequential manner, and the gradients can only flow back layer by...