Distributed training for multi-layer neural networks by consensus

• Main Authors: Liu, Bo, Ding, Zhengtao, Lv, Chen
• Other Authors: School of Mechanical and Aerospace Engineering
• Format: Article
• Language: English
• Published: 2022
• Subjects: Engineering::Mechanical engineering; Engineering::Electrical and electronic engineering; Backpropagation; Consensus
• Online Access: https://hdl.handle.net/10356/161253
• Institution: Nanyang Technological University

Over the past decade, there has been a growing interest in large-scale and privacy-concerned machine learning, especially in the situation where the data cannot be shared due to privacy protection or cannot be centralized due to computational limitations. Parallel computation has been proposed to ci...