Friendly sharpness-aware minimization
Sharpness-Aware Minimization (SAM) has been instrumental in improving deep neural network training by minimizing both training loss and loss sharpness. Despite the practical success, the mechanisms behind SAM’s generalization enhancements remain elusive, limiting its progress in deep learning optimi...
Saved in:
Main Authors: | LI, Tao, ZHOU, Pan, HE, Zhengbao, CHENG, Xinwen, HUANG, Xiaolin |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2024
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9018 https://ink.library.smu.edu.sg/context/sis_research/article/10021/viewcontent/2024_CVPR_FSAM.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
L-opacity: Linkage-aware graph anonymization
by: NOBARI, Sadegh, et al.
Published: (2014) -
Task similarity aware meta learning: Theory-inspired improvement on MAML
by: ZHOU, Pan, et al.
Published: (2021) -
Understanding generalization and optimization performance of deep CNNs
by: ZHOU, Pan, et al.
Published: (2018) -
Inception transformer
by: SI, Chenyang, et al.
Published: (2022) -
Sampling based approaches for minimizing regret in uncertain Markov Decision Problems (MDPs)
by: AHMED, Asrar, et al.
Published: (2017)