Adaptive learning rate for neural network

• Main Author: Teo, Chee Seong
• Other Authors: Chua Chek Beng
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Science::Mathematics
• Online Access: https://hdl.handle.net/10356/148493
• Institution: Nanyang Technological University

The learning rate is one of the most important hyper-parameters to tune in a neural network and Deep Learning. The right choice of learning rate results in a better model and faster convergence during the learning process. Time is often wasted on selecting and tuning the learning rate. The purpose o...