Global convergence of online BP training with dynamic learning rate

• Main Authors: Zhang, Rui, Xu, Zong-Ben, Huang, Guang-Bin, Wang, Dianhui
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2013
• Subjects: DRNTU::Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/99834; http://hdl.handle.net/10220/13532
• Institution: Nanyang Technological University

The online backpropagation (BP) training procedure has been extensively explored in scientific research and engineering applications. One of the main factors affecting the performance of the online BP training is the learning rate. This paper proposes a new dynamic learning rate which is based on th...