Transport in reservoir computing

Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A fundamental question that needs to be addressed in this framewo...

Full description

Saved in:
Bibliographic Details
Main Authors: Manjunath, G., Ortega, Juan-Pablo
Other Authors: School of Physical and Mathematical Sciences
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/169352
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-169352
record_format dspace
spelling sg-ntu-dr.10356-1693522023-07-17T15:34:54Z Transport in reservoir computing Manjunath, G. Ortega, Juan-Pablo School of Physical and Mathematical Sciences Science::Mathematics Driven Dynamical Systems Reservoir Computing Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A fundamental question that needs to be addressed in this framework is the statistical relationship between the input and the system states. This paper provides conditions that guarantee the existence and uniqueness of asymptotically invariant measures for driven systems and shows that their dependence on the input process is continuous when the set of input and output processes are endowed with the Wasserstein distance. The main tool in these developments is the characterization of those invariant measures as fixed points of naturally defined Foias operators that appear in this context and which have been profusely studied in the paper. Those fixed points are obtained by imposing a newly introduced stochastic state contractivity on the driven system that is readily verifiable in examples. Stochastic state contractivity can be satisfied by systems that are not state-contractive, which is a need typically evoked to guarantee the echo state property in reservoir computing. As a result, it may actually be satisfied even if the echo state property is not present. Submitted/Accepted version 2023-07-14T04:51:40Z 2023-07-14T04:51:40Z 2022 Journal Article Manjunath, G. & Ortega, J. (2022). Transport in reservoir computing. Physica D: Nonlinear Phenomena, 449, 133744-. https://dx.doi.org/10.1016/j.physd.2023.133744 0167-2789 https://hdl.handle.net/10356/169352 10.1016/j.physd.2023.133744 2-s2.0-85152238053 449 133744 en Physica D: Nonlinear Phenomena © 2023 Elsevier B.V. All rights reserved. This paper was published in Physica D: Nonlinear Phenomena and is made available with permission of Elsevier B.V. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Science::Mathematics
Driven Dynamical Systems
Reservoir Computing
spellingShingle Science::Mathematics
Driven Dynamical Systems
Reservoir Computing
Manjunath, G.
Ortega, Juan-Pablo
Transport in reservoir computing
description Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A fundamental question that needs to be addressed in this framework is the statistical relationship between the input and the system states. This paper provides conditions that guarantee the existence and uniqueness of asymptotically invariant measures for driven systems and shows that their dependence on the input process is continuous when the set of input and output processes are endowed with the Wasserstein distance. The main tool in these developments is the characterization of those invariant measures as fixed points of naturally defined Foias operators that appear in this context and which have been profusely studied in the paper. Those fixed points are obtained by imposing a newly introduced stochastic state contractivity on the driven system that is readily verifiable in examples. Stochastic state contractivity can be satisfied by systems that are not state-contractive, which is a need typically evoked to guarantee the echo state property in reservoir computing. As a result, it may actually be satisfied even if the echo state property is not present.
author2 School of Physical and Mathematical Sciences
author_facet School of Physical and Mathematical Sciences
Manjunath, G.
Ortega, Juan-Pablo
format Article
author Manjunath, G.
Ortega, Juan-Pablo
author_sort Manjunath, G.
title Transport in reservoir computing
title_short Transport in reservoir computing
title_full Transport in reservoir computing
title_fullStr Transport in reservoir computing
title_full_unstemmed Transport in reservoir computing
title_sort transport in reservoir computing
publishDate 2023
url https://hdl.handle.net/10356/169352
_version_ 1773551281797857280