Empirical risk landscape analysis for understanding deep neural networks
This work aims to provide comprehensive landscape analysis of empirical risk in deep neural networks (DNNs), including the convergence behavior of its gradient, its stationary points and the empirical risk itself to their corresponding population counterparts, which reveals how various network param...
Saved in:
Main Authors: | ZHOU, Pan, FENG, Jiashi |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2018
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9023 https://ink.library.smu.edu.sg/context/sis_research/article/10026/viewcontent/2018_ICLR_DNN_Theory.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
Efficient stochastic gradient hard thresholding
by: ZHOU, Pan, et al.
Published: (2018) -
Understanding generalization and optimization performance of deep CNNs
by: ZHOU, Pan, et al.
Published: (2018) -
Towards theoretically understanding why SGD generalizes better than ADAM in deep learning
by: ZHOU, Pan, et al.
Published: (2020) -
New insight into hybrid stochastic gradient descent: Beyond with-replacement sampling and convexity
by: ZHOU, Pan, et al.
Published: (2018) -
Watch out! Motion is blurring the vision of your deep neural networks
by: GUO, Qing, et al.
Published: (2020)