Improved generalisation bounds for deep learning through L∞ covering numbers

• Main Authors: LEDENT, Antoine, LEI, Yunwen, KLOFT, Marius
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Deep Learning; convolutions; multi-class; multi-label; Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/7211; https://ink.library.smu.edu.sg/context/sis_research/article/8214/viewcontent/85_wrshpnew.pdf
• Institution: Singapore Management University

Using proof techniques involving L∞ covering numbers, we show generalisation error bounds for deep learning with two main improvements over the state of the art. First, our bounds have no explicit dependence on the number of classes except for logarithmic factors. This holds even when formulating th...