An optimized second order stochastic learning algorithm for neural network training

• Main Authors: Liew, S. S., Khalil-Hani, M., Bakhteri, R.
• Format: Article
• Published: Elsevier B.V. 2016
• Subjects: TK Electrical engineering. Electronics Nuclear engineering
• Online Access: http://eprints.utm.my/id/eprint/72624/; https://www.scopus.com/inward/record.uri?eid=2-s2.0-84954287399&doi=10.1016%2fj.neucom.2015.12.076&partnerID=40&md5=ff2533ba41bd7889b43e8d2f164b4f27
• Institution: Universiti Teknologi Malaysia

This paper proposes an improved stochastic second order learning algorithm for supervised neural network training. The proposed algorithm, named bounded stochastic diagonal Levenberg-Marquardt (B-SDLM), utilizes both gradient and curvature information to achieve fast convergence while requiring only...