Using mutual information to evaluate the generalization capability of deep learning neural networks

• Main Author: Kan, Shawn Jung Tze
• Other Authors: Althea Liang
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2020
• Subjects: Engineering::Computer science and engineering::Information systems
• Online Access: https://hdl.handle.net/10356/137910
• Institution: Nanyang Technological University

There is a need to better understand how generalization works in a deep learning model. The goal of this paper is to provide a clearer view of the black box called neural network. This is done by using information theory to compute the flow of information within a network. The proposed framework use...