Hybrid stochastic-deterministic minibatch proximal gradient: Less-than-single-pass optimization with nearly optimal generalization
Stochastic variance-reduced gradient (SVRG) algorithms have been shown to work favorably in solving large-scale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRG-type algorithms usually scales linearly with data size and thus could still be expensive for h...
Saved in:
Main Authors: | ZHOU, Pan, YUAN, Xiaotong |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9030 https://ink.library.smu.edu.sg/context/sis_research/article/10033/viewcontent/2020_ICML_HSDN.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
A hybrid stochastic-deterministic minibatch proximal gradient method for efficient optimization and generalization
by: ZHOU, Pan, et al.
Published: (2021) -
Efficient meta learning via minibatch proximal update
by: ZHOU, Pan, et al.
Published: (2019) -
A simple proximal stochastic gradient method for nonsmooth nonconvex optimization
by: LI, Zhize, et al.
Published: (2018) -
Simple and optimal stochastic gradient methods for nonsmooth nonconvex optimization
by: LI, Zhize, et al.
Published: (2022) -
Deterministic Policy Gradient: Convergence Analysis
by: Huaqing, Xiong, et al.
Published: (2022)