Recurrent online kernel recursive least square algorithm for nonlinear modeling
In this paper, we proposed a recurrent kernel recursive least square (RLS) algorithm for online learning. In classical kernel methods, the kernel function number grows as the number of training sample increases, which makes the computational cost of the algorithm very high and only applicable for of...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2013
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/101013 http://hdl.handle.net/10220/16315 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-101013 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1010132020-03-07T13:24:50Z Recurrent online kernel recursive least square algorithm for nonlinear modeling Fan, Haijin Song, Qing Xu, Zhao School of Electrical and Electronic Engineering Annual Conference on IEEE Industrial Electronics Society (38th : 2012 : Montreal, Canada) DRNTU::Engineering::Electrical and electronic engineering In this paper, we proposed a recurrent kernel recursive least square (RLS) algorithm for online learning. In classical kernel methods, the kernel function number grows as the number of training sample increases, which makes the computational cost of the algorithm very high and only applicable for offline learning. In order to make the kernel methods suitable for online learning where the system is updated when a new training sample is obtained, a compact dictionary (support vectors set) should be chosen to represent the whole training data, which in turn reduces the number of kernel functions. For this purpose, a sparsification method based on the Hessian matrix of the loss function is applied to continuously examine the importance of the new training sample and determine the update of the dictionary according to the importance measure. We show that the Hessian matrix is equivalent to the correlation matrix of the training samples in the RLS algorithm. This makes the sparsification method able to be easily incorporated into the RLS algorithm and reduce the computational cost futher. Simulation results show that our algorithm is an effective learning method for online chaotic signal prediction and nonlinear system identification. 2013-10-10T01:28:56Z 2019-12-06T20:31:59Z 2013-10-10T01:28:56Z 2019-12-06T20:31:59Z 2012 2012 Conference Paper Fan, H., Song, Q., & Xu, Z. (2012). Recurrent online kernel recursive least square algorithm for nonlinear modeling. IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society, pp.1574-1579. https://hdl.handle.net/10356/101013 http://hdl.handle.net/10220/16315 10.1109/IECON.2012.6388534 en |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering::Electrical and electronic engineering |
spellingShingle |
DRNTU::Engineering::Electrical and electronic engineering Fan, Haijin Song, Qing Xu, Zhao Recurrent online kernel recursive least square algorithm for nonlinear modeling |
description |
In this paper, we proposed a recurrent kernel recursive least square (RLS) algorithm for online learning. In classical kernel methods, the kernel function number grows as the number of training sample increases, which makes the computational cost of the algorithm very high and only applicable for offline learning. In order to make the kernel methods suitable for online learning where the system is updated when a new training sample is obtained, a compact dictionary (support vectors set) should be chosen to represent the whole training data, which in turn reduces the number of kernel functions. For this purpose, a sparsification method based on the Hessian matrix of the loss function is applied to continuously examine the importance of the new training sample and determine the update of the dictionary according to the importance measure. We show that the Hessian matrix is equivalent to the correlation matrix of the training samples in the RLS algorithm. This makes the sparsification method able to be easily incorporated into the RLS algorithm and reduce the computational cost futher. Simulation results show that our algorithm is an effective learning method for online chaotic signal prediction and nonlinear system identification. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Fan, Haijin Song, Qing Xu, Zhao |
format |
Conference or Workshop Item |
author |
Fan, Haijin Song, Qing Xu, Zhao |
author_sort |
Fan, Haijin |
title |
Recurrent online kernel recursive least square algorithm for nonlinear modeling |
title_short |
Recurrent online kernel recursive least square algorithm for nonlinear modeling |
title_full |
Recurrent online kernel recursive least square algorithm for nonlinear modeling |
title_fullStr |
Recurrent online kernel recursive least square algorithm for nonlinear modeling |
title_full_unstemmed |
Recurrent online kernel recursive least square algorithm for nonlinear modeling |
title_sort |
recurrent online kernel recursive least square algorithm for nonlinear modeling |
publishDate |
2013 |
url |
https://hdl.handle.net/10356/101013 http://hdl.handle.net/10220/16315 |
_version_ |
1681046235915485184 |