Is there chaos in the brain? II. Experimental evidence and related models

Dynamical analysis of a periodically forced chaotic chemical oscillator

We present a comprehensive dynamical analysis of a chaotic chemical model referred to as the autocatalator, when subject to a periodic administration of one substrate. Our investigation encompasses the dynamical characterization of both unforced and forced systems utilizing isospikes and largest Lyapunov exponents-based parameter planes, bifurcation diagrams, and analysis of complex oscillations. Additionally, we present a phase diagram showing the effect of the period and amplitude of the forcing signal on the system's behavior. Furthermore, we show how the landscapes of parameter planes are altered in response to forcing application. This analysis contributes to a deeper understanding of the intricate dynamics induced by the periodic forcing of a chaotic system.

Analysis of dynamics of a map-based neuron model via Lorenz maps

Modeling nerve cells can facilitate formulating hypotheses about their real behavior and improve understanding of their functioning. In this paper, we study a discrete neuron model introduced by Courbage et al. [Chaos 17, 043109 (2007)], where the originally piecewise linear function defining voltage dynamics is replaced by a cubic polynomial, with an additional parameter responsible for varying the slope. Showing that on a large subset of the multidimensional parameter space, the return map of the voltage dynamics is an expanding Lorenz map, we analyze both chaotic and periodic behavior of the system and describe the complexity of spiking patterns fired by a neuron. This is achieved by using and extending some results from the theory of Lorenz-like and expanding Lorenz mappings.

Efficient digital design of the nonlinear behavior of Hindmarsh-Rose neuron model in large-scale neural population

Spiking networks, as the third generation of neural networks, are of great interest today due to their low power consumption in cognitive processes. This important characteristic has caused the hardware implementation techniques of spiking networks in the form of neuromorphic systems attract a lot of attention. For the first time, the focus is on the digital implementation based on CORDIC approximation of the Hindmarsh-Rose (HR) neuron so that the hardware implementation cost is lower than previous studies. If the digital design of a neuron is done efficient, the possibility of implementing a population of neurons is provided for the feasibility of low-consumption implementation of high-level cognitive processes in hardware, which is considered in this paper through edge detector, noise removal and image magnification spiking networks based on the proposed CORDIC_HR model. While using less hardware resources, the proposed HR neuron model follows the behavior of the original neuron model in the time domain with much less error than previous study. Also, the complex nonlinear behavior of the original and the proposed model of HR neuron through the bifurcation diagram, phase space and nullcline space analysis under different system parameters was investigated and the good follow-up of the proposed model was confirmed from the original model. In addition to the fact that the individual behavior of the original and the proposed neurons is the same, the functional and behavioral performance of the randomly connected neuronal population of original and proposed neuron model is equal. In general, the main contribution of the paper is in presenting an efficient hardware model, which consumes less hardware resources, follows the behavior of the original model with high accuracy, and has an acceptable performance in image processing applications such as noise removal and edge detection.

Self-Assembled Monolayer and Nanoparticles Coenhanced Fragmented Silver Nanowire Network Memristor

Silver nanowire (AgNW) networks with self-assembled structures and synaptic connectivity have been recently reported for constructing neuromorphic memristors. However, resistive switching at the cross-point junctions of the network is unstable due to locally enhanced Joule heating and the Gibbs-Thomson effect, which poses an obstacle to the integration of threshold switching and memory function in the same AgNW memristor. Here, fragmented AgNW networks combined with Ag nanoparticles (AgNPs) and mercapto self-assembled monolayers (SAMs) are devised to construct memristors with stable threshold switching and memory behavior. In the above design, the planar gaps between NW segments are for resistive switching, the AgNPs act as metal islands in the gaps to reduce threshold voltage (Vth) and holding voltage (Vhold), and the SAMs suppress surface atom diffusion to avoid Oswald ripening of the AgNPs, which improves switching stability. The fragmented NW-NP/SAM memristors not only circumvent the side effects of conventional NW-stacked junctions to provide durable threshold switching at >Vth but also exhibit synaptic characteristics such as long-term potentiation at ultralow voltage (≪Vth). The combination of NW segments, nanoparticles, and SAMs blazes a new trail for integrating artificial neurons and synapses in AgNW network memristors.

Dynamic Analysis and FPGA Implementation of a New Fractional-Order Hopfield Neural Network System under Electromagnetic Radiation

Fractional calculus research indicates that, within the field of neural networks, fractional-order systems more accurately simulate the temporal memory effects present in the human brain. Therefore, it is worthwhile to conduct an in-depth investigation into the complex dynamics of fractional-order neural networks compared to integer-order models. In this paper, we propose a magnetically controlled, memristor-based, fractional-order chaotic system under electromagnetic radiation, utilizing the Hopfield neural network (HNN) model with four neurons as the foundation. The proposed system is solved by using the Adomain decomposition method (ADM). Then, through dynamic simulations of the internal parameters of the system, rich dynamic behaviors are found, such as chaos, quasiperiodicity, direction-controllable multi-scroll, and the emergence of analogous symmetric dynamic behaviors in the system as the radiation parameters are altered, with the order remaining constant. Finally, we implement the proposed new fractional-order HNN system on a field-programmable gate array (FPGA). The experimental results show the feasibility of the theoretical analysis.

Design and Analysis of Multiscroll Memristive Hopfield Neural Network With Adjustable Memductance and Application to Image Encryption

Memristor is an ideal electronic device used as an artificial nerve synapse due to its unique memory function. This article presents a design of a new Hopfield neural network (HNN) that can generate multiscroll attractors by utilizing a new memristor as a synapse in the HNN. Differing from the others, this memristor is constructed with hyperbolic tangent functions. Taking the memristor as a self-feedback synapse of a neuron in the HNN, the memristive HNN can yield multidouble-scroll attractors, and its parameters can be used to effectively control the number of double scrolls contained in an attractor. Interestingly, the generation of multidouble-scroll attractors is independent of the memductance function but depends only on the internal state equation. Thus, the memductance function can be adjusted to yield various complex dynamical behaviors. Moreover, amplitude control effects and quantitatively controllable multistability are revealed by numerical analysis. The accurate reproduction of some dynamical behaviors by a designed circuit verifies the correctness of the numerical analysis. Finally, based on the proposed memristive HNN, a novel image encryption scheme in the 3-D setting is designed and evaluated, demonstrating its good encryption performances.

Reliability and robustness of oscillations in some slow-fast chaotic systems

A variety of nonlinear models of biological systems generate complex chaotic behaviors that contrast with biological homeostasis, the observation that many biological systems prove remarkably robust in the face of changing external or internal conditions. Motivated by the subtle dynamics of cell activity in a crustacean central pattern generator (CPG), this paper proposes a refinement of the notion of chaos that reconciles homeostasis and chaos in systems with multiple timescales. We show that systems displaying relaxation cycles while going through chaotic attractors generate chaotic dynamics that are regular at macroscopic timescales and are, thus, consistent with physiological function. We further show that this relative regularity may break down through global bifurcations of chaotic attractors such as crises, beyond which the system may also generate erratic activity at slow timescales. We analyze these phenomena in detail in the chaotic Rulkov map, a classical neuron model known to exhibit a variety of chaotic spike patterns. This leads us to propose that the passage of slow relaxation cycles through a chaotic attractor crisis is a robust, general mechanism for the transition between such dynamics. We validate this numerically in three other models: a simple model of the crustacean CPG neural network, a discrete cubic map, and a continuous flow.

Star Memristive Neural Network: Dynamics Analysis, Circuit Implementation, and Application in a Color Cryptosystem

At present, memristive neural networks with various topological structures have been widely studied. However, the memristive neural network with a star structure has not been investigated yet. In order to investigate the dynamic characteristics of neural networks with a star structure, a star memristive neural network (SMNN) model is proposed in this paper. Firstly, an SMNN model is proposed based on a Hopfield neural network and a flux-controlled memristor. Then, its chaotic dynamics are analyzed by using numerical analysis methods including bifurcation diagrams, Lyapunov exponents, phase plots, Poincaré maps, and basins of attraction. The results show that the SMNN can generate complex dynamical behaviors such as chaos, multi-scroll attractors, and initial boosting behavior. The number of multi-scroll attractors can be changed by adjusting the memristor's control parameters. And the position of the coexisting chaotic attractors can be changed by switching the memristor's initial values. Meanwhile, the analog circuit of the SMNN is designed and implemented. The theoretical and numerical results are verified through MULTISIM simulation results. Finally, a color image encryption scheme is designed based on the SMNN. Security performance analysis shows that the designed cryptosystem has good security.

Stability analysis of fractional order memristor synapse-coupled hopfield neural network with ring structure

A memristor is a nonlinear two-terminal electrical element that incorporates memory features and nanoscale properties, enabling us to design very high-density artificial neural networks. To enhance the memory property, we should use mathematical frameworks like fractional calculus, which is capable of doing so. Here, we first present a fractional-order memristor synapse-coupling Hopfield neural network on two neurons and then extend the model to a neural network with a ring structure that consists of n sub-network neurons, increasing the synchronization in the network. Necessary and sufficient conditions for the stability of equilibrium points are investigated, highlighting the dependency of the stability on the fractional-order value and the number of neurons. Numerical simulations and bifurcation analysis, along with Lyapunov exponents, are given in the two-neuron case that substantiates the theoretical findings, suggesting possible routes towards chaos when the fractional order of the system increases. In the n-neuron case also, it is revealed that the stability depends on the structure and number of sub-networks.

Using neuronal models to capture burst-and-glide motion and leadership in fish

While mathematical models, in particular self-propelled particle models, capture many properties of large fish schools, they do not always capture the interactions of smaller shoals. Nor do these models tend to account for the use of intermittent locomotion, often referred to as burst-and-glide, by many species. In this paper, we propose a model of social burst-and-glide motion by combining a well-studied model of neuronal dynamics, the FitzHugh-Nagumo model, with a model of fish motion. We first show that our model can capture the motion of a single fish swimming down a channel. Extending to a two-fish model, where visual stimulus of a neighbour affects the internal burst or glide state of the fish, we observe a rich set of dynamics found in many species. These include: leader-follower behaviour; periodic changes in leadership; apparently random (i.e. chaotic) leadership change; and tit-for-tat turn taking. Moreover, unlike previous studies where a randomness is required for leadership switching to occur, we show that this can instead be the result of deterministic interactions. We give several empirically testable predictions for how bursting fish interact and discuss our results in light of recently established correlations between fish locomotion and brain activity.

Simple cyclic memristive neural networks with coexisting attractors and large-scale amplitude control

The memristor's unique memory function and non-volatile nature make it an ideal electronic bionic device for artificial neural synapses. This paper aims to construct a class of memristive neural networks (MNNs) with a simple circular connection relationship and complex dynamics by introducing a generic memristor as synapse. For placing the memristive synapse in different coupling positions, three MNNs with the same coupling cyclic connection are yielded. One remarkable feature of the proposed MNNs is that they can yield complex dynamics, in particular, abundant coexisting attractors and large-scale parameter-relied amplitude control, by comparing with some existing MNNs. Taking one of the MNNs as an example, the complex dynamics (including chaos, period-doubling bifurcation, symmetric coexisting attractors, large-scale amplitude control) and circuit implementation are studied . The number of equilibria and their stabilities are discussed. The parameter-relied dynamic evolution and the coexisting attractors are numerically shown by using bifurcations and phase portraits. A microcontroller-based hardware circuit is given to realize the network, which verifies the correctness of the numerical results and experimental results.

Chaotic dynamics of the Hénon map and neuronal input-output: A comparison with neurophysiological data

In this study, the Hénon map was analyzed using quantifiers from information theory in order to compare its dynamics to experimental data from brain regions known to exhibit chaotic behavior. The goal was to investigate the potential of the Hénon map as a model for replicating chaotic brain dynamics in the treatment of Parkinson's and epilepsy patients. The dynamic properties of the Hénon map were compared with data from the subthalamic nucleus, the medial frontal cortex, and a q-DG model of neuronal input-output with easy numerical implementation to simulate the local behavior of a population. Using information theory tools, Shannon entropy, statistical complexity, and Fisher's information were analyzed, taking into account the causality of the time series. For this purpose, different windows over the time series were considered. The findings revealed that neither the Hénon map nor the q-DG model could perfectly replicate the dynamics of the brain regions studied. However, with careful consideration of the parameters, scales, and sampling used, they were able to model some characteristics of neural activity. According to these results, normal neural dynamics in the subthalamic nucleus region may present a more complex spectrum within the complexity-entropy causality plane that cannot be represented by chaotic models alone. The dynamic behavior observed in these systems using these tools is highly dependent on the studied temporal scale. As the size of the sample studied increases, the dynamics of the Hénon map become increasingly different from those of biological and artificial neural systems.

Reconstructing Network Dynamics of Coupled Discrete Chaotic Units from Data

Reconstructing network dynamics from data is crucial for predicting the changes in the dynamics of complex systems such as neuron networks; however, previous research has shown that the reconstruction is possible under strong constraints such as the need for lengthy data or small system size. Here, we present a recovery scheme blending theoretical model reduction and sparse recovery to identify the governing equations and the interactions of weakly coupled chaotic maps on complex networks, easing unrealistic constraints for real-world applications. Learning dynamics and connectivity lead to detecting critical transitions for parameter changes. We apply our technique to realistic neuronal systems with and without noise on a real mouse neocortex and artificial networks.

Methodological Considerations in the Kinematic and Kinetic Analysis of Human Movement among Healthy Adolescents: A Scoping Review of Nonlinear Measures in Data Processing

Nonlinear measures have increasingly revealed the quality of human movement and its behaviour over time. Further analyses of human movement in real contexts are crucial for understanding its complex dynamics. The main objective was to identify and summarize the nonlinear measures used in data processing during out-of-laboratory assessments of human movement among healthy adolescents. Summarizing the methodological considerations was the secondary objective. The inclusion criteria were as follows: According to the Population, Concept, and Context (PCC) framework, healthy teenagers between 10 and 19 years old that reported kinetic and/or kinematic nonlinear data-processing measurements related to human movement in non-laboratory settings were included. PRISMA-ScR was used to conduct this review. PubMed, Science Direct, the Web of Science, and Google Scholar were searched. Studies published between the inception of the database and March 2022 were included. In total, 10 of the 2572 articles met the criteria. The nonlinear measures identified included entropy (n = 8), fractal analysis (n = 3), recurrence quantification (n = 2), and the Lyapunov exponent (n = 2). In addition to walking (n = 4) and swimming (n = 2), each of the remaining studies focused on different motor tasks. Entropy measures are preferred when studying the complexity of human movement, especially multiscale entropy, with authors also carefully combining different measures, namely entropy and fractal analysis.

Dominant Attractor in Coupled Non-Identical Chaotic Systems

The dynamical interplay of coupled non-identical chaotic oscillators gives rise to diverse scenarios. The incoherent dynamics of these oscillators lead to the structural impairment of attractors in phase space. This paper investigates the couplings of Lorenz-Rössler, Lorenz-HR, and Rössler-HR to identify the dominant attractor. By dominant attractor, we mean the attractor that is less changed by coupling. For comparison and similarity detection, a cost function based on the return map of the coupled systems is used. The possible effects of frequency and amplitude differences between the systems on the results are also examined. Finally, the inherent chaotic characteristic of systems is compared by computing the largest Lyapunov exponent. The results suggest that in each coupling case, the attractor with the greater largest Lyapunov exponent is dominant.

Cupolets in a chaotic neuron model

This paper reports the first finding of cupolets in a chaotic Hindmarsh-Rose neural model. Cupolets (chaotic, unstable, periodic, orbit-lets) are unstable periodic orbits that have been stabilized through a particular control scheme by applying a binary control sequence. We demonstrate different neural dynamics (periodic or chaotic) of the Hindmarsh-Rose model through a bifurcation diagram where the external input current, I, is the bifurcation parameter. We select a region in the chaotic parameter space and provide the results of numerical simulations. In this chosen parameter space, a control scheme is applied when the trajectory intersects with either of the two control planes. The type of the control is determined by a bit in a binary control sequence. The control is either a small microcontrol (0) or a large macrocontrol (1) that adjusts the future dynamics of the trajectory by a perturbation determined by the coding function _r ( x ). We report the discovery of many cupolets with corresponding control sequences and comment on the differences with previously reported cupolets in the double scroll system. We provide some examples of the generated cupolets and conclude by discussing potential implications for biological neurons.

Classification of SARS-CoV-2 viral genome sequences using Neurochaos Learning

Abstract

The high spread rate of SARS-CoV-2 virus has put the researchers all over the world in a demanding situation. The need of the hour is to develop novel learning algorithms that can effectively learn a general pattern by training with fewer genome sequences of coronavirus. Learning from very few training samples is necessary and important during the beginning of a disease outbreak when sequencing data is limited. This is because a successful detection and isolation of patients can curb the spread of the virus. However, this poses a huge challenge for machine learning and deep learning algorithms as they require huge amounts of training data to learn the pattern and distinguish from other closely related viruses. In this paper, we propose a new paradigm – Neurochaos Learning (NL) for classification of coronavirus genome sequence that addresses this specific problem. NL is inspired from the empirical evidence of chaos and non-linearity at the level of neurons in biological neural networks. The average sensitivity, specificity and accuracy for NL are 0.998, 0.999 and 0.998 respectively for the multiclass classification problem (SARS-CoV-2, Coronaviridae, Metapneumovirus, Rhinovirus and Influenza) using leave one out crossvalidation. With just one training sample per class for 1000 independent random trials of training, we report an average macro F1-score \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$> 0.99$$\end{document}>0.99 for the classification of SARS-CoV-2 from SARS-CoV-1 genome sequences. We compare the performance of NL with K-nearest neighbours (KNN), logistic regression, random forest, SVM, and naïve Bayes classifiers. We foresee promising future applications in genome classification using NL with novel combinations of chaotic feature engineering and other machine learning algorithms.

Graphical abstract

Supplementary Information

The online version contains supplementary material available at 10.1007/s11517-022-02591-3.

From chaos to clock in recurrent neural net. Case study

What is the reason for complex dynamical patterns registered from real biological neuronal networks? Noise and dynamical reconfiguring of a network (functional/dynamic connectome) were proposed as possible answers. In this case study, we report a complex dynamical pattern observed in a simple deterministic network of 25 excitatory neurons with fixed connectome. After a short initial stimulation, the network is engaged into a complex dynamics, which lasts for a long time. Eventually, with no external intervention, the dynamics comes to a periodic one with a short period. The long transient is positively checked for being chaotic. We conclude that the complex dynamics observed is the output of neural computation performed in the process of neuronal firings and spikes propagation.

A simple topological model for two coupled neurons

A simple topological model describing the chaotic dynamics of two coupled neurons is established and analyzed based on the Smale horseshoe theory.

Chaotic and stochastic dynamics of epileptiform-like activities in sclerotic hippocampus resected from patients with pharmacoresistant epilepsy

The types of epileptiform activity occurring in the sclerotic hippocampus with highest incidence are interictal-like events (II) and periodic ictal spiking (PIS). These activities are classified according to their event rates, but it is still unclear if these rate differences are consequences of underlying physiological mechanisms. Identifying new and more specific information related to these two activities may bring insights to a better understanding about the epileptogenic process and new diagnosis. We applied Poincaré map analysis and Recurrence Quantification Analysis (RQA) onto 35 in vitro electrophysiological signals recorded from slices of 12 hippocampal tissues surgically resected from patients with pharmacoresistant temporal lobe epilepsy. These analyzes showed that the II activity is related to chaotic dynamics, whereas the PIS activity is related to deterministic periodic dynamics. Additionally, it indicates that their different rates are consequence of different endogenous dynamics. Finally, by using two computational models we were able to simulate the transition between II and PIS activities. The RQA was applied to different periods of these simulations to compare the recurrences between artificial and real signals, showing that different ranges of regularity-chaoticity can be directly associated with the generation of PIS and II activities.

Temporal lobe epilepsy (TLE) is the most prevalent type of epilepsy in adults and hippocampal sclerosis is the major pathophysiological substrate of pharmaco-refractory TLE. Different patterns of epileptiform-like activity have been described in human hippocampal sclerosis, but the standard analysis applied to characterize the activities usually do not consider the nonlinear features that epileptiform patterns exhibit. Here, using Poincaré map and Recurrence Quantitative Analysis we characterized the most prevalent type of epileptiform-like activities—interictal-like events (II) and periodic ictal spiking (PIS), recorded in vitro from resected hippocampi of pharmacoresistant patients with TLE—according to their levels of stochasticity, chaoticity and determinism. The II activities showed to be more chaotic with complex rhythmicity than PIS activities. The nonlinear dynamic differences between II and PIS leads us to conjecture that they are expressions of different seizure susceptibility. We also identified that each hippocampal subfield expresses II and PIS activities in a specific and different way. Finally, from the modulation of internal parameters of two computational models, we show the conversion of one type of activity into the other, showing how specific neuron networks synchronize over time, leading to II and PIS activities and then into a generalized seizure.

Consciousness is supported by near-critical slow cortical electrodynamics

Mounting evidence suggests that during conscious states, the electrodynamics of the cortex are poised near a critical point or phase transition and that this near-critical behavior supports the vast flow of information through cortical networks during conscious states. Here, we empirically identify a mathematically specific critical point near which waking cortical oscillatory dynamics operate, which is known as the edge-of-chaos critical point, or the boundary between stability and chaos. We do so by applying the recently developed modified 0-1 chaos test to electrocorticography (ECoG) and magnetoencephalography (MEG) recordings from the cortices of humans and macaques across normal waking, generalized seizure, anesthesia, and psychedelic states. Our evidence suggests that cortical information processing is disrupted during unconscious states because of a transition of low-frequency cortical electric oscillations away from this critical point; conversely, we show that psychedelics may increase the information richness of cortical activity by tuning low-frequency cortical oscillations closer to this critical point. Finally, we analyze clinical electroencephalography (EEG) recordings from patients with disorders of consciousness (DOC) and show that assessing the proximity of slow cortical oscillatory electrodynamics to the edge-of-chaos critical point may be useful as an index of consciousness in the clinical setting.

STAnet: A Spatiotemporal Attention Network for Decoding Auditory Spatial Attention from EEG

OBJECTIVE

Humans are able to localize the source of a sound. This enables them to direct attention to a particular speaker in a cocktail party. Psycho-acoustic studies show that the sensory cortices of the human brain respond to the location of sound sources differently, and the auditory attention itself is a dynamic and temporally based brain activity. In this work, we seek to build a computational model which uses both spatial and temporal information manifested in EEG signals for auditory spatial attention detection (ASAD).

METHODS

We propose an end-to-end spatiotemporal attention network, denoted as STAnet, to detect auditory spatial attention from EEG. The STAnet is designed to assign differentiated weights dynamically to EEG channels through a spatial attention mechanism, and to temporal patterns in EEG signals through a temporal attention mechanism.

RESULTS

We report the ASAD experiments on two publicly available datasets. The STAnet outperforms other competitive models by a large margin under various experimental conditions. Its attention decision for 1-second decision window outperforms that of the state-of-the-art techniques for 10-second decision window. Experimental results also demonstrate that the STAnet achieves competitive performance on EEG signals ranging from 64 to as few as 16 channels.

CONCLUSION

This study provides evidence suggesting that efficient low-density EEG online decoding is within reach.

SIGNIFICANCE

This study also marks an important step towards the practical implementation of ASAD in real life applications.

Auditory Attention Detection with EEG Channel Attention

Auditory attention detection (AAD) seeks to detect the attended speech from EEG signals in a multi-talker scenario, i.e. cocktail party. As the EEG channels reflect the activities of different brain areas, a task-oriented channel selection technique improves the performance of brain-computer interface applications. In this study, we propose a soft channel attention mechanism, instead of hard channel selection, that derives an EEG channel mask by optimizing the auditory attention detection task. The neural AAD system consists of a neural channel attention mechanism and a convolutional neural network (CNN) classifier. We evaluate the proposed framework on a publicly available database. We achieve 88.3% and 77.2% for 2-second and 0.1-second decision windows with 64-channel EEG; and 86.1% and 83.9% for 2-second decision windows with 32-channel and 16-channel EEG, respectively. The proposed framework outperforms other competitive models by a large margin across all test cases.

Learning Brain Dynamics With Coupled Low-Dimensional Nonlinear Oscillators and Deep Recurrent Networks

Many natural systems, especially biological ones, exhibit complex multivariate nonlinear dynamical behaviors that can be hard to capture by linear autoregressive models. On the other hand, generic nonlinear models such as deep recurrent neural networks often require large amounts of training data, not always available in domains such as brain imaging; also, they often lack interpretability. Domain knowledge about the types of dynamics typically observed in such systems, such as a certain type of dynamical systems models, could complement purely data-driven techniques by providing a good prior. In this work, we consider a class of ordinary differential equation (ODE) models known as van der Pol (VDP) oscil lators and evaluate their ability to capture a low-dimensional representation of neural activity measured by different brain imaging modalities, such as calcium imaging (CaI) and fMRI, in different living organisms: larval zebrafish, rat, and human. We develop a novel and efficient approach to the nontrivial problem of parameters estimation for a network of coupled dynamical systems from multivariate data and demonstrate that the resulting VDP models are both accurate and interpretable, as VDP's coupling matrix reveals anatomically meaningful excitatory and inhibitory interactions across different brain subsystems. VDP outperforms linear autoregressive models (VAR) in terms of both the data fit accuracy and the quality of insight provided by the coupling matrices and often tends to generalize better to unseen data when predicting future brain activity, being comparable to and sometimes better than the recurrent neural networks (LSTMs). Finally, we demonstrate that our (generative) VDP model can also serve as a data-augmentation tool leading to marked improvements in predictive accuracy of recurrent neural networks. Thus, our work contributes to both basic and applied dimensions of neuroimaging: gaining scientific insights and improving brain-based predictive models, an area of potentially high practical importance in clinical diagnosis and neurotechnology.

When Noise meets Chaos: Stochastic Resonance in Neurochaos Learning

Chaos and Noise are ubiquitous in the Brain. Inspired by the chaotic firing of neurons and the constructive role of noise in neuronal models, we for the first time connect chaos, noise and learning. In this paper, we demonstrate Stochastic Resonance (SR) phenomenon in Neurochaos Learning (NL). SR manifests at the level of a single neuron of NL and enables efficient subthreshold signal detection. Furthermore, SR is shown to occur in single and multiple neuronal NL architecture for classification tasks - both on simulated and real-world spoken digit datasets, and in architectures with 1D chaotic maps as well as Hindmarsh-Rose spiking neurons. Intermediate levels of noise in neurochaos learning enable peak performance in classification tasks thus highlighting the role of SR in AI applications, especially in brain inspired learning architectures.

Impacts of autapse on chaotic resonance in single neurons and small-world neuronal networks

Chaotic resonance (CR) is a new phenomenon induced by an intermediate level of chaotic signal intensity in neuronal systems. In the current study, we investigated the effects of autapse on the CR phenomenon in single neurons and small-world (SW) neuronal networks. In single neurons, we assume that the neuron has only one autapse modelled as electrical, excitatory chemical and inhibitory chemical synapse, respectively. Then, we analysed the effects of each one on the CR, separately. Obtained results revealed that, regardless of its type, autapse significantly increases the chaotic resonance of the appropriate autaptic parameter's values. It is also observed that, at the optimal chaotic current intensity, the multiple CR emerges depending on autaptic time delay for all the autapse types when the autaptic delay time or its integer multiples match the half period or period of the weak signal. In SW networks, we investigated the effects of chaotic activity on the prorogation of pacemaker activity, where pacemaker neurons have different kinds of autapse as considered in single neuron cases. Obtained results revealed that excitatory and electrical autapses prominently increase the prorogation of pacemaker activity, whereas inhibitory autapse reduces or does not change it. Also, the best propagation was obtained when the autapse was excitatory. This article is part of the theme issue 'Vibrational and stochastic resonance in driven nonlinear systems (part 2)'.

Recent advances in evolutionary and bio-inspired adaptive robotics: Exploiting embodied dynamics

This paper explores current developments in evolutionary and bio-inspired approaches to autonomous robotics, concentrating on research from our group at the University of Sussex. These developments are discussed in the context of advances in the wider fields of adaptive and evolutionary approaches to AI and robotics, focusing on the exploitation of embodied dynamics to create behaviour. Four case studies highlight various aspects of such exploitation. The first exploits the dynamical properties of a physical electronic substrate, demonstrating for the first time how component-level analog electronic circuits can be evolved directly in hardware to act as robot controllers. The second develops novel, effective and highly parsimonious navigation methods inspired by the way insects exploit the embodied dynamics of innate behaviours. Combining biological experiments with robotic modeling, it is shown how rapid route learning can be achieved with the aid of navigation-specific visual information that is provided and exploited by the innate behaviours. The third study focuses on the exploitation of neuromechanical chaos in the generation of robust motor behaviours. It is demonstrated how chaotic dynamics can be exploited to power a goal-driven search for desired motor behaviours in embodied systems using a particular control architecture based around neural oscillators. The dynamics are shown to be chaotic at all levels in the system, from the neural to the embodied mechanical. The final study explores the exploitation of the dynamics of brain-body-environment interactions for efficient, agile flapping winged flight. It is shown how a multi-objective evolutionary algorithm can be used to evolved dynamical neural controllers for a simulated flapping wing robot with feathered wings. Results demonstrate robust, stable, agile flight is achieved in the face of random wind gusts by exploiting complex asymmetric dynamics partly enabled by continually changing wing and tail morphologies.

The Refractory Period Matters: Unifying Mechanisms of Macroscopic Brain Waves

The relationship between complex brain oscillations and the dynamics of individual neurons is poorly understood. Here we utilize maximum caliber, a dynamical inference principle, to build a minimal yet general model of the collective (mean field) dynamics of large populations of neurons. In agreement with previous experimental observations, we describe a simple, testable mechanism, involving only a single type of neuron, by which many of these complex oscillatory patterns may emerge. Our model predicts that the refractory period of neurons, which has often been neglected, is essential for these behaviors.

Order in chaos: Structure of chaotic invariant sets of square-wave neuron models

Bursting phenomena and, in particular, square-wave or fold/hom bursting, are found in a wide variety of mathematical neuron models. These systems have different behavior regimes depending on the parameters, whether spiking, bursting, or chaotic. We study the topological structure of chaotic invariant sets present in square-wave bursting neuron models, first detailed using the Hindmarsh-Rose neuron model and later exemplary in the more realistic model of a leech heart neuron. We show that the unstable periodic orbits that form the skeleton of the chaotic invariant sets are deeply related to the spike-adding phenomena, typical from these models, and how there are specific symbolic sequences and a symbolic grammar that organize how and where the periodic orbits appear. Linking this information with the topological template analysis permits us to understand how the internal structure of the chaotic invariants is modified and how more symbolic sequences are allowed. Furthermore, the results allow us to conjecture that, for these systems, the limit template when the small parameter ε, which controls the slow gating variable, tends to zero is the complete Smale topological template.

A tale of two rhythms: Locked clocks and chaos in biology

The fundamental mechanisms that control and regulate biological organisms exhibit a surprising level of complexity. Oscillators are perhaps the simplest motifs that produce time-varying dynamics and are ubiquitous in biological systems. It is also known that such biological oscillators interact with each other-for instance, circadian oscillators affect the cell cycle, and somitogenesis clock proteins in adjacent cells affect each other in developing embryos. Therefore, it is vital to understand the effects that can emerge from non-linear interaction between oscillations. Here, we show how oscillations typically arise in biology and take the reader on a tour through the great variety in dynamics that can emerge even from a single pair of coupled oscillators. We explain how chaotic dynamics can emerge and outline the methods of detecting this in experimental time traces. Finally, we discuss the potential role of such complex dynamical features in biological systems.

A Functional Spiking Neural Network of Ultra Compact Neurons

We demonstrate that recently introduced ultra-compact neurons (UCN) with a minimal number of components can be interconnected to implement a functional spiking neural network. For concreteness we focus on the Jeffress model, which is a classic neuro-computational model proposed in the 40’s to explain the sound directionality detection by animals and humans. In addition, we introduce a long-axon neuron, whose architecture is inspired by the Hodgkin-Huxley axon delay-line and where the UCNs implement the nodes of Ranvier. We then interconnect two of those neurons to an output layer of UCNs, which detect coincidences between spikes propagating down the long-axons. This functional spiking neural neuron circuit with biological relevance is built from identical UCN blocks, which are simple enough to be made with off-the-shelf electronic components. Our work realizes a new, accessible and affordable physical model platform, where neuroscientists can construct arbitrary mid-size spiking neuronal networks in a lego-block like fashion that work in continuous time. This should enable them to address in a novel experimental manner fundamental questions about the nature of the neural code and to test predictions from mathematical models and algorithms of basic neurobiology research. The present work aims at opening a new experimental field of basic research in Spiking Neural Networks to a potentially large community, which is at the crossroads of neurobiology, dynamical systems, theoretical neuroscience, condensed matter physics, neuromorphic engineering, artificial intelligence, and complex systems.

Dynamics of a multiplex neural network with delayed couplings

Multiplex networks have drawn much attention since they have been observed in many systems, e.g., brain, transport, and social relationships. In this paper, the nonlinear dynamics of a multiplex network with three neural groups and delayed interactions is studied. The stability and bifurcation of the network equilibrium are discussed, and interesting neural activities of the network are explored. Based on the neuron circuit, transfer function circuit, and time delay circuit, a circuit platform of the network is constructed. It is shown that delayed couplings play crucial roles in the network dynamics, e.g., the enhancement and suppression of the stability, the patterns of the synchronization between networks, and the generation of complicated attractors and multi-stability coexistence.

Noise-driven multistability vs deterministic chaos in phenomenological semi-empirical models of whole-brain activity

An outstanding open problem in neuroscience is to understand how neural systems are capable of producing and sustaining complex spatiotemporal dynamics. Computational models that combine local dynamics with in vivo measurements of anatomical and functional connectivity can be used to test potential mechanisms underlying this complexity. We compared two conceptually different mechanisms: noise-driven switching between equilibrium solutions (modeled by coupled Stuart-Landau oscillators) and deterministic chaos (modeled by coupled Rossler oscillators). We found that both models struggled to simultaneously reproduce multiple observables computed from the empirical data. This issue was especially manifested in the case of noise-driven dynamics close to a bifurcation, which imposed overly strong constraints on the optimal model parameters. In contrast, the chaotic model could produce complex behavior over a range of parameters, thus being capable of capturing multiple observables at the same time with good performance. Our observations support the view of the brain as a non-equilibrium system able to produce endogenous variability. We presented a simple model capable of jointly reproducing functional connectivity computed at different temporal scales. Besides adding to our conceptual understanding of brain complexity, our results inform and constrain the future development of biophysically realistic large-scale models.

Evolution of novel activation functions in neural network training for astronomy data: habitability classification of exoplanets

Quantification of habitability is a complex task. Previous attempts at measuring habitability are well documented. Classification of exoplanets, on the other hand, is a different approach and depends on quality of training data available in habitable exoplanet catalogs. Classification is the task of predicting labels of newly discovered planets based on available class labels in the catalog. We present analytical exploration of novel activation functions as consequence of integration of several ideas leading to implementation and subsequent use in habitability classification of exoplanets. Neural networks, although a powerful engine in supervised methods, often require expensive tuning efforts for optimized performance. Habitability classes are hard to discriminate, especially when attributes used as hard markers of separation are removed from the data set. The solution is approached from the point of investigating analytical properties of the proposed activation functions. The theory of ordinary differential equations and fixed point are exploited to justify the "lack of tuning efforts" to achieve optimal performance compared to traditional activation functions. Additionally, the relationship between the proposed activation functions and the more popular ones is established through extensive analytical and empirical evidence. Finally, the activation functions have been implemented in plain vanilla feed-forward neural network to classify exoplanets. The mathematical exercise supplements the grand idea of classifying exoplanets, computing habitability scores/indices and automatic grouping of the exoplanets converging at some level.

Designing spontaneous behavioral switching via chaotic itinerancy

Chaotic itinerancy is a frequently observed phenomenon in high-dimensional nonlinear dynamical systems and is characterized by itinerant transitions among multiple quasi-attractors. Several studies have pointed out that high-dimensional activity in animal brains can be observed to exhibit chaotic itinerancy, which is considered to play a critical role in the spontaneous behavior generation of animals. Thus, how to design desired chaotic itinerancy is a topic of great interest, particularly for neurorobotics researchers who wish to understand and implement autonomous behavioral controls. However, it is generally difficult to gain control over high-dimensional nonlinear dynamical systems. In this study, we propose a method for implementing chaotic itinerancy reproducibly in a high-dimensional chaotic neural network. We demonstrate that our method enables us to easily design both the trajectories of quasi-attractors and the transition rules among them simply by adjusting the limited number of system parameters and by using the intrinsic high-dimensional chaos.

Inertial Neural Networks with Unpredictable Oscillations

In this paper, inertial neural networks are under investigation, that is, the second order differential equations. The recently introduced new type of motions, unpredictable oscillations, are considered for the models. The motions continue a line of periodic and almost periodic oscillations. The research is of very strong importance for neuroscience, since the existence of unpredictable solutions proves Poincaré chaos. Sufficient conditions have been determined for the existence, uniqueness, and exponential stability of unpredictable solutions. The results can significantly extend the role of oscillations for artificial neural networks exploitation, since they provide strong new theoretical and practical opportunities for implementation of methods of chaos extension, synchronization, stabilization, and control of periodic motions in various types of neural networks. Numerical simulations are presented to demonstrate the validity of the theoretical results.

Genomic Chaos Begets Psychiatric Disorder

The processes that created the primordial genome are inextricably linked to current day vulnerability to developing a psychiatric disorder as summarized in this review article. Chaos and dynamic forces including duplication, transposition, and recombination generated the protogenome. To survive early stages of genome evolution, self-organization emerged to curb chaos. Eventually, the human genome evolved through a delicate balance of chaos/instability and organization/stability. However, recombination coldspots, silencing of transposable elements, and other measures to limit chaos also led to retention of variants that increase risk for disease. Moreover, ongoing dynamics in the genome creates various new mutations that determine liability for psychiatric disorders. Homologous recombination, long-range gene regulation, and gene interactions were all guided by spooky action-at-a-distance, which increased variability in the system. A probabilistic system of life was required to deal with a changing environment. This ensured the generation of outliers in the population, which enhanced the probability that some members would survive unfavorable environmental impacts. Some of the outliers produced through this process in man are ill suited to cope with the complex demands of modern life. Genomic chaos and mental distress from the psychological challenges of modern living will inevitably converge to produce psychiatric disorders in man.

Behavioral and physiological correlates of kinetically tracking a chaotic target

Humans can innately track a moving target by anticipating its future position from a brief history of observations. While ballistic trajectories can be readily extrapolated, many natural and artificial systems are governed by more general nonlinear dynamics and, therefore, can produce highly irregular motion. Yet, relatively little is known regarding the behavioral and physiological underpinnings of prediction and tracking in the presence of chaos. Here, we investigated in lab settings whether participants could manually follow the orbit of a paradigmatic chaotic system, the Rössler equations, on the (x,y) plane under different settings of a control parameter, which determined the prominence of transients in the target position. Tracking accuracy was negatively related to the level of unpredictability and folding. Nevertheless, while participants initially reacted to the transients, they gradually learned to anticipate it. This was accompanied by a decrease in muscular co-contraction, alongside enhanced activity in the theta and beta EEG bands for the highest levels of chaoticity. Furthermore, greater phase synchronization of breathing was observed. Taken together, these findings point to the possible ability of the nervous system to implicitly learn topological regularities even in the context of highly irregular motion, reflecting in multiple observables at the physiological level.

A Review of the Serrated-Flow Phenomenon and Its Role in the Deformation Behavior of High-Entropy Alloys

High-entropy alloys (HEAs) are a novel class of alloys that have many desirable properties. The serrated flow that occurs in high-entropy alloys during mechanical deformation is an important phenomenon since it can lead to significant changes in the microstructure of the alloy. In this article, we review the recent findings on the serration behavior in a variety of high-entropy alloys. Relationships among the serrated flow behavior, composition, microstructure, and testing condition are explored. Importantly, the mechanical-testing type (compression/tension), testing temperature, applied strain rate, and serration type for certain high-entropy alloys are summarized. The literature reveals that the serrated flow can be affected by experimental conditions such as the strain rate and test temperature. Furthermore, this type of phenomenon has been successfully modeled and analyzed, using several different types of analytical methods, including the mean-field theory formalism and the complexity-analysis technique. Importantly, the results of the analyses show that the serrated flow in HEAs consists of complex dynamical behavior. It is anticipated that this review will provide some useful and clarifying information regarding the serrated-flow mechanisms in this material system. Finally, suggestions for future research directions in this field are proposed, such as the effects of irradiation, additives (such as C and Al), the presence of nanoparticles, and twinning on the serrated flow behavior in HEAs.

Homoclinic organization in the Hindmarsh-Rose model: A three parameter study

Bursting phenomena are found in a wide variety of fast-slow systems. In this article, we consider the Hindmarsh-Rose neuron model, where, as it is known in the literature, there are homoclinic bifurcations involved in the bursting dynamics. However, the global homoclinic structure is far from being fully understood. Working in a three-parameter space, the results of our numerical analysis show a complex atlas of bifurcations, which extends from the singular limit to regions where a fast-slow perspective no longer applies. Based on this information, we propose a global theoretical description. Surfaces of codimension-one homoclinic bifurcations are exponentially close to each other in the fast-slow regime. Remarkably, explained by the specific properties of these surfaces, we show how the Hindmarsh-Rose model exhibits isolas of homoclinic bifurcations when appropriate two-dimensional slices are considered in the three-parameter space. On the other hand, these homoclinic bifurcation surfaces contain curves corresponding to parameter values where additional degeneracies are exhibited. These codimension-two bifurcation curves organize the bifurcations associated with the spike-adding process and they behave like the "spines-of-a-book," gathering "pages" of bifurcations of periodic orbits. Depending on how the parameter space is explored, homoclinic phenomena may be absent or far away, but their organizing role in the bursting dynamics is beyond doubt, since the involved bifurcations are generated in them. This is shown in the global analysis and in the proposed theoretical scheme.

Dynamic behaviors of hyperbolic-type memristor-based Hopfield neural network considering synaptic crosstalk

Crosstalk phenomena taking place between synapses can influence signal transmission and, in some cases, brain functions. It is thus important to discover the dynamic behaviors of the neural network infected by synaptic crosstalk. To achieve this, in this paper, a new circuit is structured to emulate the Coupled Hyperbolic Memristors, which is then utilized to simulate the synaptic crosstalk of a Hopfield Neural Network (HNN). Thereafter, the HNN's multi-stability, asymmetry attractors, and anti-monotonicity are observed with various crosstalk strengths. The dynamic behaviors of the HNN are presented using bifurcation diagrams, dynamic maps, and Lyapunov exponent spectrums, considering different levels of crosstalk strengths. Simulation results also reveal that different crosstalk strengths can lead to wide-ranging nonlinear behaviors in the HNN systems.

A simple method for detecting chaos in nature

Chaos, or exponential sensitivity to small perturbations, appears everywhere in nature. Moreover, chaos is predicted to play diverse functional roles in living systems. A method for detecting chaos from empirical measurements should therefore be a key component of the biologist's toolkit. But, classic chaos-detection tools are highly sensitive to measurement noise and break down for common edge cases, making it difficult to detect chaos in domains, like biology, where measurements are noisy. However, newer tools promise to overcome these limitations. Here, we combine several such tools into an automated processing pipeline, and show that our pipeline can detect the presence (or absence) of chaos in noisy recordings, even for difficult edge cases. As a first-pass application of our pipeline, we show that heart rate variability is not chaotic as some have proposed, and instead reflects a stochastic process in both health and disease. Our tool is easy-to-use and freely available.