Simple and optimal stochastic gradient methods for nonsmooth nonconvex optimization
We propose and analyze several stochastic gradient algorithms for finding stationary points or local minimum in nonconvex, possibly with nonsmooth regularizer, finite-sum and online optimization problems. First, we propose a simple proximal stochastic gradient algorithm based on variance reduction c...
Saved in:
Main Authors: | LI, Zhize, LI, Jian |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2022
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/8692 https://ink.library.smu.edu.sg/context/sis_research/article/9695/viewcontent/JMLR22_nonsmooth__1_.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
DESTRESS: Computation-optimal and communication-efficient decentralized nonconvex finite-sum optimization
by: LI, Boyue, et al.
Published: (2022) -
A simple proximal stochastic gradient method for nonsmooth nonconvex optimization
by: LI, Zhize, et al.
Published: (2018) -
Block-coordinate gradient descent method for linearly constrained nonsmooth separable optimization
by: Tseng, P., et al.
Published: (2014) -
A gradient-free distributed optimization method for convex sum of nonconvex cost functions
by: Pang, Yipeng, et al.
Published: (2023) -
STOCHASTIC BREGMAN GRADIENT-TYPE ALGORITHMS FOR NONCONVEX OPTIMIZATION AND CONVEX-CONCAVE SADDLE POINT PROBLEMS
by: DING KUANGYU
Published: (2023)