Resource efficient neural networks through Hessian based pruning

• 主要作者: Chong, Jack Huai Jie
• 其他作者: Lihui Chen
• 格式: Final Year Project
• 語言: English
• 出版: Nanyang Technological University 2023
• 主題: Engineering::Electrical and electronic engineering
• 在線閱讀: https://hdl.handle.net/10356/167151
• 機構: Nanyang Technological University

Neural network pruning is a practical way for reducing the size of trained models and the number of floating-point operations (FLOPs). One way of pruning is to use the relative Hessian trace to calculate sensitivity of each channel, as compared to the more common magnitude pruning approach. However,...