Fully decoupled neural network learning using delayed gradients

Fully decoupled neural network learning using delayed gradients

Training neural networks with back-propagation (BP) requires a sequential passing of activations and gradients. This has been recognized as the lockings (i.e., the forward, backward, and update lockings) among modules (each module contains a stack of layers) inherited from the BP. In this paper,...

Saved in:

書目詳細資料
Main Authors:	Zhuang, Huiping, Wang, Yi, Liu, Qinglai, Lin, Zhiping
其他作者:	School of Electrical and Electronic Engineering
格式:	Article
語言:	English
出版:	2024
主題:	Computer and Information Science Decoupled learning Delayed gradients
在線閱讀:	https://hdl.handle.net/10356/174476
標簽:	添加標簽沒有標簽, 成為第一個標記此記錄!

相似書籍

Accumulated decoupled learning with gradient staleness mitigation for convolutional neural networks
由: Zhuang, Huiping, et al.
出版: (2024)

Decoupling Smith predictor design for multivariable systems with multiple time delays
由: Wang, Q.-G., et al.
出版: (2014)

Decoupling internal model control for multivariable systems with multiple time delays
由: Wang, Q.-G., et al.
出版: (2014)

Decoupling internal model control for multivariable systems with multiple time delays
由: Wang, Q.-G., et al.
出版: (2014)

High efficient crossing-order decoupling in Vold-Kalman filtering order tracking based on independent component analysis
由: Guo, Y., et al.
出版: (2014)

Practical adaptive neural control of nonlinear systems with unknown time delays
由: Hong, F., et al.
出版: (2014)

Transfer function matrix approach to decoupling problem with stability
由: Wang, Q.-G., et al.
出版: (2014)

Variational quantum circuit decoupling
由: Wang, Ximing, et al.
出版: (2024)

EXPLOITING GRADIENT INFORMATION FOR MODERN MACHINE LEARNING PROBLEMS
由: CHEN YIZHOU
出版: (2022)

Speeding up deep neural network training with decoupled and analytic learning
由: Zhuang, Huiping
出版: (2021)

Decoupling contact and mirror: an effective way to improve the reflector for flip-chip InGaN/GaN-based light-emitting diodes
由: Zhu, Binbin, et al.
出版: (2017)

DECOUPLING AND MATCHING TECHNOLOGY OF MILLIMETER-WAVE ANTENNAS
由: XU ZHI YUE, JULIA
出版: (2022)

DECOUPLING AND MATCHING TECHNOLOGY OF MILLIMETER-WAVE ANTENNAS
由: XU ZHI YUE, JULIA
出版: (2022)

Hessian matrix distribution for Bayesian policy gradient reinforcement learning
由: Vien, N.A., et al.
出版: (2013)

Microstrip decoupling networks for low-order multiport arrays with reduced element spacing
由: Chua, P.T., et al.
出版: (2014)

Solvability conditions and parameterization of all solutions for the triangular decoupling problem
由: Chu, D., et al.
出版: (2014)

Adaptive control of uncertain lorenz system using decoupled backstepping
由: Ge, S.S.
出版: (2014)

A numerical solution for the simultaneous disturbance decoupling and row-by-row decoupling problem
由: Chu, D., et al.
出版: (2014)

Novel decoupling networks for small antenna arrays
由: YU YANTAO
出版: (2010)

High-sulfur loading and single ion-selective membranes for high-energy and durable decoupled aqueous batteries
由: Zhang, Xinyuan, et al.
出版: (2024)

Time delayed repetitive learning control for chaotic systems
由: Song, Y., et al.
出版: (2014)

Several new designs for PID, IMC, Decoupling and Fuzzy Control
由: YANG YONGSHENG
出版: (2011)

Disturbance decoupling for descriptor systems by measurement feedback
由: Chu, D., et al.
出版: (2014)

Decoupled neural network training with re-computation and weight prediction
由: Peng, Jiawei, et al.
出版: (2023)

A case study for the open question: Disturbance decoupling problem for singular systems by output feedback
由: Chu, D.
出版: (2014)

Active magnetic decoupling for improving the performance of integrated LCL-filters in grid-connected converters
由: Li, Xiaoqiang, et al.
出版: (2019)

Absolute periodicity and absolute stability of delayed neural networks
由: Yi, Z., et al.
出版: (2014)

Dual-band decoupling and matching network design for very closely spaced antennas
由: Tang, X., et al.
出版: (2014)

Delay-dependent state estimation for delayed neural networks
由: He, Y., et al.
出版: (2014)

State feedback decoupling problem with stability for (a,b, c,d) quadruples
由: Chu, D., et al.
出版: (2014)

A matrix pencil approach to the row by row decoupling problem for descriptor systems
由: Chu, D., et al.
出版: (2014)

Numerically reliable computing for the row by row decoupling problem with stability
由: Chu, D., et al.
出版: (2014)

On the use of Hadamard weightings in the partial decoupling of H∞ based designs
由: Loh, A.P., et al.
出版: (2014)

Hybrid learning for interval type-2 intuitionistic fuzzy logic systems as applied to identification and prediction problems
由: Eyoh, Imo, et al.
出版: (2020)

A decoupling module based on a geometrical-balance mechanism for mitigating cable length variation in cable-driven applications
由: Nguyen, Van Pho, et al.
出版: (2025)

Full-space spin-decoupled versatile wavefront manipulations using non-interleaved metasurface
由: Wang, Chaohui, et al.
出版: (2023)

Global convergence of Lotka-Volterra recurrent neural networks with delays
由: Yi, Z., et al.
出版: (2014)

LMI-based stability criteria for neural networks with multiple time-varying delays
由: He, Y., et al.
出版: (2014)

An integrated framework for multi-state driver monitoring using heterogeneous loss and attention-based feature decoupling
由: Hu, Zhongxu, et al.
出版: (2023)

Gradient boosted graph convolutional network on heterophilic graph
由: Seah, Ming Yang
出版: (2024)