A robust recurrent simultaneous perturbation stochastic approximation training algorithm for recurrent neural networks

• Main Authors: Song, Qing, Xu, Zhao, Wang, Danwei
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2014
• Subjects: DRNTU::Engineering::Electrical and electronic engineering::Electric power
• Online Access: https://hdl.handle.net/10356/105067; http://hdl.handle.net/10220/20401; http://dx.doi.org/10.1007/s00521-013-1436-5
• Institution: Nanyang Technological University

Training of recurrent neural networks (RNNs) introduces considerable computational complexities due to the need for gradient evaluations. How to get fast convergence speed and low computational complexity remains a challenging and open topic. Besides, the transient response of learning process of RN...