Spectral tensor train parameterization of deep learning layers

Spectral tensor train parameterization of deep learning layers

We study low-rank parameterizations of weight matrices with embedded spectral properties in the Deep Learning context. The low-rank property leads to parameter efficiency and permits taking computational shortcuts when computing mappings. Spectral properties are often subject to constraints in optim...

Saved in:

書目詳細資料
Main Authors:	OBUKHOV, A., RAKHUBA, M., LINIGER, A., HUANG, Zhiwu, GEORGOULIS, S., DAI, D., VAN Gool L.
格式:	text
語言:	English
出版:	Institutional Knowledge at Singapore Management University 2021
主題:	Artificial Intelligence and Robotics Databases and Information Systems
在線閱讀:	https://ink.library.smu.edu.sg/sis_research/6259 https://ink.library.smu.edu.sg/context/sis_research/article/7262/viewcontent/Spectral_Tensor_Train_Parameterization_of_Deep_Learning_Layers.pdf
標簽:	添加標簽沒有標簽, 成為第一個標記此記錄!
機構:	Singapore Management University
語言:	English

相似書籍

Building deep networks on grassmann manifolds
由: HUANG, Zhiwu, et al.
出版: (2018)

Outlier-robust tensor PCA
由: ZHOU, Pan, et al.
出版: (2016)

Weakly-supervised deep anomaly detection with pairwise relation learning
由: PANG, Guansong, et al.
出版: (2019)

Deep multi-task learning for depression detection and prediction in longitudinal data
由: PANG, Guansong, et al.
出版: (2020)

Alignment-enriched tuning for patch-level pre-trained document image models
由: WANG, Lei, et al.
出版: (2023)

A deep learning method to predict bacterial ADP-ribosyltransferase toxins
由: ZHENG, Dandan, et al.
出版: (2024)

Deep one-class classification via interpolated Gaussian descriptor
由: CHEN, Yuanhong, et al.
出版: (2022)

Learning expensive coordination: An event-based deep RL approach
由: YU, Runsheng, et al.
出版: (2020)

A Riemannian network for SPD matrix learning
由: HUANG, Zhiwu, et al.
出版: (2017)

An approach for self-training audio event detectors using web data
由: ELIZALDE, Benjamin, et al.
出版: (2017)

NumGPT: Improving numeracy ability of generative pre-trained models
由: JIN, Zhihua, et al.
出版: (2023)

Generative flows with invertible attentions
由: SUKTHANKER, Rhea Sanjay, et al.
出版: (2022)

ROME: Evaluating pre-trained vision-language models on reasoning beyond visual common sense
由: ZHOU, Kankan, et al.
出版: (2023)

Sample-efficient iterative lower bound optimization of deep reactive policies for planning in continuous MDPs
由: LOW, Siow Meng, et al.
出版: (2022)

Self-trained deep ordinal regression for end-to-end video anomaly detection
由: PANG, Guansong, et al.
出版: (2020)

S-prompts learning with pre-trained transformers: An Occam's razor for domain incremental learning
由: WANG, Yabin, et al.
出版: (2022)

Goal awareness for conversational AI: Proactivity, non-collaborativity, and beyond
由: DENG, Yang, et al.
出版: (2023)

A unified dialogue user simulator for few-shot data augmentation
由: WAN, Dazhen, et al.
出版: (2022)

Neural multimodal belief tracker with adaptive attention for dialogue systems
由: ZHANG, Zheng, et al.
出版: (2019)

Dual-SLAM: A framework for robust single camera navigation
由: HUANG, Huajian, et al.
出版: (2020)

A continual deepfake detection benchmark: Dataset, methods, and essentials
由: LI, Chuqiao, et al.
出版: (2021)

Building action sets in a deep reinforcement learner
由: WANG, Yongzhao, et al.
出版: (2021)

Machine comprehension using match-LSTM and answer pointer
由: WANG, Shuohang, et al.
出版: (2017)

Effect of Quality Management Practices in Distributed Offshore Software Development: An Empirical Analysis
由: RAMASUBBU, Narayan, et al.
出版: (2004)

An LSTM model for cloze-style machine comprehension
由: WANG, Shuohang, et al.
出版: (2018)

Causal intervention for weakly-supervised semantic segmentation
由: ZHANG Dong,, et al.
出版: (2020)

Using constraint programming and graph representation learning for generating interpretable cloud security policies
由: KAZDAGLI, Mikhail, et al.
出版: (2022)

Online hyperparameter optimization for class-incremental learning
由: LIU, Yaoyao, et al.
出版: (2023)

Trajectory similarity learning with auxiliary supervision and optimal matching
由: ZHANG, Hanyuan, et al.
出版: (2020)

Enhancing recursive supervised learning using clustering and combinatorial optimization (RSL-CC)
由: RAMANATHAN, Kiruthika, et al.
出版: (2008)

Integrating motivated learning and k-winner-take-all to coordinate multi-agent reinforcement learning
由: TENG, Teck-Hou, et al.
出版: (2014)

Preface: WI 2015
由: TAN, Ah-Hwee, et al.
出版: (2015)

Preface IAT 2015
由: TAN, Ah-hwee, et al.
出版: (2015)

Preface to WI-IAT 2015 workshops and demo/posters
由: TAN, Ah-hwee, et al.
出版: (2015)

Silver assistants for aging-in-place
由: WANG, Di, et al.
出版: (2015)

Towards intelligent caring agents for Aging-In-Place: Issues and challenges
由: WANG, Di, et al.
出版: (2014)

Non-intrusive robust human activity recognition for diverse age groups
由: WANG, Di, et al.
出版: (2015)

An adaptive computational model for personalized persuasion
由: KANG, Yilin, et al.
出版: (2015)

Guest editorial: Non-IID outlier detection in complex contexts
由: PANG, Guansong, et al.
出版: (2021)

ZERO++: Harnessing the power of zero appearances to detect anomalies in large-scale data sets
由: PANG, Guansong, et al.
出版: (2016)