A training algorithm and stability analysis for recurrent neural networks

• Main Authors: Xu, Zhao, Song, Qing, Wang, Danwei, Fan, Haijin
• Other Authors: School of Electrical and Electronic Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2014
• Subjects: DRNTU::Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/101742; http://hdl.handle.net/10220/19738; http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6290583&url=http%3A%2F%2Fieeexplore.ieee.org%2Fiel5%2F6269381%2F6289713%2F06290583.pdf%3Farnumber%3D6290583
• Institution: Nanyang Technological University

Training of recurrent neural networks (RNNs) introduces considerable computational complexities due to the need for gradient evaluations. How to get fast convergence speed and low computational complexity remains a challenging and open topic. Besides, the transient response of learning process of RN...