Transport in reservoir computing
Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A fundamental question that needs to be addressed in this framewo...
Saved in:
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/169352 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-169352 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1693522023-07-17T15:34:54Z Transport in reservoir computing Manjunath, G. Ortega, Juan-Pablo School of Physical and Mathematical Sciences Science::Mathematics Driven Dynamical Systems Reservoir Computing Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A fundamental question that needs to be addressed in this framework is the statistical relationship between the input and the system states. This paper provides conditions that guarantee the existence and uniqueness of asymptotically invariant measures for driven systems and shows that their dependence on the input process is continuous when the set of input and output processes are endowed with the Wasserstein distance. The main tool in these developments is the characterization of those invariant measures as fixed points of naturally defined Foias operators that appear in this context and which have been profusely studied in the paper. Those fixed points are obtained by imposing a newly introduced stochastic state contractivity on the driven system that is readily verifiable in examples. Stochastic state contractivity can be satisfied by systems that are not state-contractive, which is a need typically evoked to guarantee the echo state property in reservoir computing. As a result, it may actually be satisfied even if the echo state property is not present. Submitted/Accepted version 2023-07-14T04:51:40Z 2023-07-14T04:51:40Z 2022 Journal Article Manjunath, G. & Ortega, J. (2022). Transport in reservoir computing. Physica D: Nonlinear Phenomena, 449, 133744-. https://dx.doi.org/10.1016/j.physd.2023.133744 0167-2789 https://hdl.handle.net/10356/169352 10.1016/j.physd.2023.133744 2-s2.0-85152238053 449 133744 en Physica D: Nonlinear Phenomena © 2023 Elsevier B.V. All rights reserved. This paper was published in Physica D: Nonlinear Phenomena and is made available with permission of Elsevier B.V. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Science::Mathematics Driven Dynamical Systems Reservoir Computing |
spellingShingle |
Science::Mathematics Driven Dynamical Systems Reservoir Computing Manjunath, G. Ortega, Juan-Pablo Transport in reservoir computing |
description |
Reservoir computing systems are constructed using a driven dynamical system
in which external inputs can alter the evolving states of a system. These
paradigms are used in information processing, machine learning, and
computation. A fundamental question that needs to be addressed in this
framework is the statistical relationship between the input and the system
states. This paper provides conditions that guarantee the existence and
uniqueness of asymptotically invariant measures for driven systems and shows
that their dependence on the input process is continuous when the set of input
and output processes are endowed with the Wasserstein distance. The main tool
in these developments is the characterization of those invariant measures as
fixed points of naturally defined Foias operators that appear in this context
and which have been profusely studied in the paper. Those fixed points are
obtained by imposing a newly introduced stochastic state contractivity on the
driven system that is readily verifiable in examples. Stochastic state
contractivity can be satisfied by systems that are not state-contractive, which
is a need typically evoked to guarantee the echo state property in reservoir
computing. As a result, it may actually be satisfied even if the echo state
property is not present. |
author2 |
School of Physical and Mathematical Sciences |
author_facet |
School of Physical and Mathematical Sciences Manjunath, G. Ortega, Juan-Pablo |
format |
Article |
author |
Manjunath, G. Ortega, Juan-Pablo |
author_sort |
Manjunath, G. |
title |
Transport in reservoir computing |
title_short |
Transport in reservoir computing |
title_full |
Transport in reservoir computing |
title_fullStr |
Transport in reservoir computing |
title_full_unstemmed |
Transport in reservoir computing |
title_sort |
transport in reservoir computing |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/169352 |
_version_ |
1773551281797857280 |