1
|
Goldmann M, Fischer I, Mirasso CR, C Soriano M. Exploiting oscillatory dynamics of delay systems for reservoir computing. CHAOS (WOODBURY, N.Y.) 2023; 33:093139. [PMID: 37748487 DOI: 10.1063/5.0156494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 09/05/2023] [Indexed: 09/27/2023]
Abstract
Nonlinear dynamical systems exhibiting inherent memory can process temporal information by exploiting their responses to input drives. Reservoir computing is a prominent approach to leverage this ability for time-series forecasting. The computational capabilities of analog computing systems often depend on both the dynamical regime of the system and the input drive. Most studies have focused on systems exhibiting a stable fixed-point solution in the absence of input. Here, we go beyond that limitation, investigating the computational capabilities of a paradigmatic delay system in three different dynamical regimes. The system we chose has an Ikeda-type nonlinearity and exhibits fixed point, bistable, and limit-cycle dynamics in the absence of input. When driving the system, new input-driven dynamics emerge from the autonomous ones featuring characteristic properties. Here, we show that it is feasible to attain consistent responses across all three regimes, which is an essential prerequisite for the successful execution of the tasks. Furthermore, we demonstrate that we can exploit all three regimes in two time-series forecasting tasks, showcasing the versatility of this paradigmatic delay system in an analog computing context. In all tasks, the lowest prediction errors were obtained in the regime that exhibits limit-cycle dynamics in the undriven reservoir. To gain further insights, we analyzed the diverse time-distributed node responses generated in the three regimes of the undriven system. An increase in the effective dimensionality of the reservoir response is shown to affect the prediction error, as also fine-tuning of the distribution of nonlinear responses. Finally, we demonstrate that a trade-off between prediction accuracy and computational speed is possible in our continuous delay systems. Our results not only provide valuable insights into the computational capabilities of complex dynamical systems but also open a new perspective on enhancing the potential of analog computing systems implemented on various hardware platforms.
Collapse
Affiliation(s)
- Mirko Goldmann
- Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain
| | - Ingo Fischer
- Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain
| | - Claudio R Mirasso
- Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain
| | - Miguel C Soriano
- Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain
| |
Collapse
|
2
|
Li XZ, Sheng B, Zhang M. Predicting the dynamical behaviors for chaotic semiconductor lasers by reservoir computing. OPTICS LETTERS 2022; 47:2822-2825. [PMID: 35648939 DOI: 10.1364/ol.459638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 05/06/2022] [Indexed: 06/15/2023]
Abstract
We demonstrate the successful prediction of the continuous intensity time series and reproduction of the underlying dynamical behaviors for a chaotic semiconductor laser by reservoir computing. The laser subject to continuous-wave optical injection is considered using the rate-equation model. A reservoir network is constructed and trained using over 2 × 104 data points sampled every 1.19 ps from the simulated chaotic intensity time series. Upon careful optimization of the reservoir parameters, the future evolution of the continuous intensity time series can be accurately predicted for a time duration of longer than 0.6 ns, which is six times the reciprocal of the relaxation resonance frequency of the laser. Moreover, we demonstrate for the first time, to the best of our knowledge, that the predicted intensity time series allows for accurate reproduction of the chaotic dynamical behaviors, including the microwave power spectrum, probability density function, and the chaotic attractor. In general, the demonstrated approach offers a relatively high flexibility in the choice of reservoir parameters according to the simulation results, and it provides new insights into the learning and prediction of semiconductor laser dynamics based on measured intensity time series.
Collapse
|
3
|
Jüngling T, Stemler T, Small M. Laminar chaos in nonlinear electronic circuits with delay clock modulation. Phys Rev E 2020; 101:012215. [PMID: 32069600 DOI: 10.1103/physreve.101.012215] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Indexed: 11/07/2022]
Abstract
We study laminar chaos in an electronic experiment. A two-diode nonlinear circuit with delayed feedback shows chaotic dynamics similar to the Mackey-Glass or Ikeda delay systems. Clock modulation of a single delay line leads to a conservative variable delay, which with a second delay line is augmented to dissipative delays, leading to laminar chaotic regimes. We discuss the properties of this particular delay modulation and demonstrate experimental aspects of laminar chaos in terms of power spectra and return maps.
Collapse
Affiliation(s)
- Thomas Jüngling
- Complex Systems Group, Department of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - Thomas Stemler
- Complex Systems Group, Department of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - Michael Small
- Complex Systems Group, Department of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia.,Mineral Resources, CSIRO, Kensington, WA 6151, Australia
| |
Collapse
|
4
|
Jüngling T, Soriano MC, Oliver N, Porte X, Fischer I. Consistency properties of chaotic systems driven by time-delayed feedback. Phys Rev E 2018; 97:042202. [PMID: 29758606 DOI: 10.1103/physreve.97.042202] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2017] [Indexed: 06/08/2023]
Abstract
Consistency refers to the property of an externally driven dynamical system to respond in similar ways to similar inputs. In a delay system, the delayed feedback can be considered as an external drive to the undelayed subsystem. We analyze the degree of consistency in a generic chaotic system with delayed feedback by means of the auxiliary system approach. In this scheme an identical copy of the nonlinear node is driven by exactly the same signal as the original, allowing us to verify complete consistency via complete synchronization. In the past, the phenomenon of synchronization in delay-coupled chaotic systems has been widely studied using correlation functions. Here, we analytically derive relationships between characteristic signatures of the correlation functions in such systems and unequivocally relate them to the degree of consistency. The analytical framework is illustrated and supported by numerical calculations of the logistic map with delayed feedback for different replica configurations. We further apply the formalism to time series from an experiment based on a semiconductor laser with a double fiber-optical feedback loop. The experiment constitutes a high-quality replica scheme for studying consistency of the delay-driven laser and confirms the general theoretical results.
Collapse
Affiliation(s)
- T Jüngling
- Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat Illes Balears, 07122 Palma de Mallorca, Spain
| | - M C Soriano
- Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat Illes Balears, 07122 Palma de Mallorca, Spain
| | - N Oliver
- Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat Illes Balears, 07122 Palma de Mallorca, Spain
| | - X Porte
- Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat Illes Balears, 07122 Palma de Mallorca, Spain
| | - I Fischer
- Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat Illes Balears, 07122 Palma de Mallorca, Spain
| |
Collapse
|
5
|
Rombouts J, Vandervelde A, Gelens L. Delay models for the early embryonic cell cycle oscillator. PLoS One 2018; 13:e0194769. [PMID: 29579091 PMCID: PMC5868829 DOI: 10.1371/journal.pone.0194769] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2017] [Accepted: 03/09/2018] [Indexed: 11/19/2022] Open
Abstract
Time delays are known to play a crucial role in generating biological oscillations. The early embryonic cell cycle in the frog Xenopus laevis is one such example. Although various mathematical models of this oscillating system exist, it is not clear how to best model the required time delay. Here, we study a simple cell cycle model that produces oscillations due to the presence of an ultrasensitive, time-delayed negative feedback loop. We implement the time delay in three qualitatively different ways, using a fixed time delay, a distribution of time delays, and a delay that is state-dependent. We analyze the dynamics in all cases, and we use experimental observations to interpret our results and put constraints on unknown parameters. In doing so, we find that different implementations of the time delay can have a large impact on the resulting oscillations.
Collapse
Affiliation(s)
- Jan Rombouts
- Laboratory of Dynamics in Biological Systems, Department of Cellular and Molecular Medicine, University of Leuven, 3000 Leuven, Belgium
| | - Alexandra Vandervelde
- Laboratory of Dynamics in Biological Systems, Department of Cellular and Molecular Medicine, University of Leuven, 3000 Leuven, Belgium
| | - Lendert Gelens
- Laboratory of Dynamics in Biological Systems, Department of Cellular and Molecular Medicine, University of Leuven, 3000 Leuven, Belgium
- * E-mail:
| |
Collapse
|
6
|
Ruschel S, Yanchuk S. Chaotic bursting in semiconductor lasers. CHAOS (WOODBURY, N.Y.) 2017; 27:114313. [PMID: 29195313 DOI: 10.1063/1.5007876] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
We investigate the dynamic mechanisms for low frequency fluctuations in semiconductor lasers subjected to delayed optical feedback, using the Lang-Kobayashi model. This system of delay differential equations displays pronounced envelope dynamics, ranging from erratic, so called low frequency fluctuations to regular pulse packages, if the time scales of fast oscillations and envelope dynamics are well separated. We investigate the parameter regions where low frequency fluctuations occur and compute their Lyapunov spectra. Using the geometric singular perturbation theory, we study this intermittent chaotic behavior and characterize these solutions as bursting slow-fast oscillations.
Collapse
Affiliation(s)
- Stefan Ruschel
- Institute of Mathematics, Technical University of Berlin, Berlin, Germany
| | - Serhiy Yanchuk
- Institute of Mathematics, Technical University of Berlin, Berlin, Germany
| |
Collapse
|
7
|
Li XZ, Zhuang JP, Li SS, Gao JB, Chan SC. Randomness evaluation for an optically injected chaotic semiconductor laser by attractor reconstruction. Phys Rev E 2016; 94:042214. [PMID: 27841550 DOI: 10.1103/physreve.94.042214] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2016] [Indexed: 06/06/2023]
Abstract
State-space reconstruction is investigated for evaluating the randomness generated by an optically injected semiconductor laser in chaos. The reconstruction of the attractor requires only the emission intensity time series, allowing both experimental and numerical evaluations with good qualitative agreement. The randomness generation is evaluated by the divergence of neighboring states, which is quantified by the time-dependent exponents (TDEs) as well as the associated entropies. Averaged over the entire attractor, the mean TDE is observed to be positive as it increases with the evolution time through chaotic mixing. At a constant laser noise strength, the mean TDE for chaos is observed to be greater than that for periodic dynamics, as attributed to the effect of noise amplification by chaos. After discretization, the Shannon entropies continually generated by the laser for the output bits are estimated in providing a fundamental basis for random bit generation, where a combined output bit rate reaching 200 Gb/s is illustrated using practical tests. Overall, based on the reconstructed states, the TDEs and entropies offer a direct experimental verification of the randomness generated in the chaotic laser.
Collapse
Affiliation(s)
- Xiao-Zhou Li
- Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China
| | - Jun-Ping Zhuang
- Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China
| | - Song-Sui Li
- Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China
| | - Jian-Bo Gao
- Institute of Complexity Science and Big Data Technology, Guangxi University, Nanning, Guangxi, China
| | - Sze-Chun Chan
- Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China
- State Key Laboratory of Millimeter Waves, City University of Hong Kong, Hong Kong, China
| |
Collapse
|