Regularization of deep neural network with batch contrastive loss

• Main Authors: Tanveer, Muhammad, Tan, Hung-Khoon, Ng, Hui-Fuang, Leung, Maylor Karhang, Chuah, Joon Huang
• Format: Article
• Published: Institute of Electrical and Electronics Engineers 2021
• Subjects: QA75 Electronic computers. Computer science; TA Engineering (General). Civil engineering (General)
• Online Access: http://eprints.um.edu.my/28105/
• Institution: Universiti Malaya

Neural networks have become deeper in recent years and this has improved its capacity to handle more complex tasks. However, deep neural network has more parameters and is easier to overfit, especially when training samples are insufficient. In this paper, we present a new regularization technique c...