Ordinal-pattern transition networks as a symbolic substrate for reservoir computing
Max Potratzki, Thomas G. de Jong, Michael Small, Timo Bröhl
Abstract
Reservoir computing has established itself as a computationally efficient alternative to fully trained recurrent neural networks using a fixed high-dimensional nonlinear substrate to map temporal input into a feature space for a simple readout. Here, we argue that reservoir computing can be realized entirely within a coarse-grained, symbolic state space, and that constrained random walks on ordinal-pattern transition networks provide a natural instance of this realization, replacing the reservoir's continuous state space with a discrete and directly data-derived one. We develop a formal correspondence between the two frameworks, show that the echo-state property has a natural discrete analog in the ergodicity and spectral gap of the walk's underlying Markov chain, and illustrate the correspondence with a minimal example and an empirical one-step-ahead prediction task evaluated across five paradigmatic model systems. These systems exhibit dynamics that correspond to strictly periodic, quasiperiodic, chaotic, or stochastic signals. We argue that this symbolic reservoir perspective allows a redefinition of the reservoir substrate itself, replacing the requirement of a continuous, randomly generated dynamical system with any sufficiently ergodic, data-derived symbolic process. This opens a route toward interpretable, data-adaptive reservoirs whose internal structure is inferred rather than randomly assigned, with implications for surrogate-data methods and reservoir design more broadly.
Create a lesson
Related papers
A general feedback mechanism unifying stochasticity, long transients, and resilience
Misha Chai, Holger Kantz
Statistical Characterization of Erratic and Chaotic Processes through Their Extrema I. Thermodynamics
Jacob Sonnenschein
Online training of Echo State Networks to predict chaotic dynamical systems
Astero Provata, Markos Syroukis, Johanne Hizanidis
Partial Multistep Prediction of Chaotic Time Series: What Remains Predictable beyond the Horizon of Predictability?
Vasilii A. Gromov, Maksim Lomakin, Aleksei Kudryashov et al.
Stability of inverse cascade in NLS Wave turbulence
Guillaume Costa, Sergey Nazarenko, Giorgio Krstulovic
Beyond RMSE and Granger Gain: Multi-Horizon Forecast-Error Entropy for Nonlinear Predictive Coupling
Andrei Velichko