Resource efficient neural networks through Hessian based pruning

• Main Author: Chong, Jack Huai Jie
• Other Authors: Lihui Chen
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2023
• Subjects: Engineering::Electrical and electronic engineering
• Online Access: https://hdl.handle.net/10356/167151
• Institution: Nanyang Technological University

Neural network pruning is a practical way for reducing the size of trained models and the number of floating-point operations (FLOPs). One way of pruning is to use the relative Hessian trace to calculate sensitivity of each channel, as compared to the more common magnitude pruning approach. However,...