Norm-based generalisation bounds for deep multi-class convolutional neural networks

• Main Authors: LEDENT, Antoine, MUSTAFA, Waleed, LEI, Yunwen, KLOFT, Marius
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: (Deep) Neural Network Learning Theory; Learning Theory; Artificial Intelligence and Robotics; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/7202; https://ink.library.smu.edu.sg/context/sis_research/article/8205/viewcontent/norm_based.pdf
• Institution: Singapore Management University

We show generalisation error bounds for deep learning with two main improvements over the state of the art. (1) Our bounds have no explicit dependence on the number of classes except for logarithmic factors. This holds even when formulating the bounds in terms of the Frobenius-norm of the weight mat...