Inference of a nonlinear stochastic model of the cardiorespiratory interaction

Delta-alpha cross-frequency coupling for different brain regions

Neural interactions occur on different levels and scales. It is of particular importance to understand how they are distributed among different neuroanatomical and physiological relevant brain regions. We investigated neural cross-frequency couplings between different brain regions according to the Desikan-Killiany brain parcellation. The adaptive dynamic Bayesian inference method was applied to EEG measurements of healthy resting subjects in order to reconstruct the coupling functions. It was found that even after averaging over all subjects, the mean coupling function showed a characteristic waveform, confirming the direct influence of the delta-phase on the alpha-phase dynamics in certain brain regions and that the shape of the coupling function changes for different regions. While the averaged coupling function within a region was of similar form, the region-averaged coupling function was averaged out, which implies that there is a common dependence within separate regions across the subjects. It was also found that for certain regions the influence of delta on alpha oscillations is more pronounced and that oscillations that influence other are more evenly distributed across brain regions than the influenced oscillations. When presenting the information on brain lobes, it was shown that the influence of delta emanating from the brain as a whole is greatest on the alpha oscillations of the cingulate frontal lobe, and at the same time the influence of delta from the cingulate parietal brain lobe is greatest on the alpha oscillations of the whole brain.

Neural Cross-Frequency Coupling Functions in Sleep

The human brain presents a heavily connected complex system. From a relatively fixed anatomy, it can enable a vast repertoire of functions. One important brain function is the process of natural sleep, which alters consciousness and voluntary muscle activity. On neural level, these alterations are accompanied by changes of the brain connectivity. In order to reveal the changes of connectivity associated with sleep, we present a methodological framework for reconstruction and assessment of functional interaction mechanisms. By analyzing EEG (electroencephalogram) recordings from human whole night sleep, first, we applied a time-frequency wavelet transform to study the existence and strength of brainwave oscillations. Then we applied a dynamical Bayesian inference on the phase dynamics in the presence of noise. With this method we reconstructed the cross-frequency coupling functions, which revealed the mechanism of how the interactions occur and manifest. We focus our analysis on the delta-alpha coupling function and observe how this cross-frequency coupling changes during the different sleep stages. The results demonstrated that the delta-alpha coupling function was increasing gradually from Awake to NREM3 (non-rapid eye movement), but only during NREM2 and NREM3 deep sleep it was significant in respect of surrogate data testing. The analysis on the spatially distributed connections showed that this significance is strong only for within the single electrode region and in the front-to-back direction. The presented methodological framework is for the whole-night sleep recordings, but it also carries general implications for other global neural states.

Multiscale Time-resolved Analysis Reveals Remaining Behavioral Rhythms in Mice Without Canonical Circadian Clocks

Circadian rhythms are internal processes repeating approximately every 24 hours in living organisms. The dominant circadian pacemaker is synchronized to the environmental light-dark cycle. Other circadian pacemakers, which can have noncanonical circadian mechanisms, are revealed by arousing stimuli, such as scheduled feeding, palatable meals and running wheel access, or methamphetamine administration. Organisms also have ultradian rhythms, which have periods shorter than circadian rhythms. However, the biological mechanism, origin, and functional significance of ultradian rhythms are not well-elucidated. The dominant circadian rhythm often masks ultradian rhythms; therefore, we disabled the canonical circadian clock of mice by knocking out Per1/2/3 genes, where Per1 and Per2 are essential components of the mammalian light-sensitive circadian mechanism. Furthermore, we recorded wheel-running activity every minute under constant darkness for 272 days. We then investigated rhythmic components in the absence of external influences, applying unique multiscale time-resolved methods to analyze the oscillatory dynamics with time-varying frequencies. We found four rhythmic components with periods of ∼17 h, ∼8 h, ∼4 h, and ∼20 min. When the ∼17-h rhythm was prominent, the ∼8-h rhythm was of low amplitude. This phenomenon occurred periodically approximately every 2-3 weeks. We found that the ∼4-h and ∼20-min rhythms were harmonics of the ∼8-h rhythm. Coupling analysis of the ridge-extracted instantaneous frequencies revealed strong and stable phase coupling from the slower oscillations (∼17, ∼8, and ∼4 h) to the faster oscillations (∼20 min), and weak and less stable phase coupling in the reverse direction and between the slower oscillations. Together, this study elucidated the relationship between the oscillators in the absence of the canonical circadian clock, which is critical for understanding their functional significance. These studies are essential as disruption of circadian rhythms contributes to diseases, such as cancer and obesity, as well as mood disorders.

Average beta burst duration profiles provide a signature of dynamical changes between the ON and OFF medication states in Parkinson's disease

Parkinson's disease motor symptoms are associated with an increase in subthalamic nucleus beta band oscillatory power. However, these oscillations are phasic, and there is a growing body of evidence suggesting that beta burst duration may be of critical importance to motor symptoms. This makes insights into the dynamics of beta bursting generation valuable, in particular to refine closed-loop deep brain stimulation in Parkinson's disease. In this study, we ask the question "Can average burst duration reveal how dynamics change between the ON and OFF medication states?". Our analysis of local field potentials from the subthalamic nucleus demonstrates using linear surrogates that the system generating beta oscillations is more likely to act in a non-linear regime OFF medication and that the change in a non-linearity measure is correlated with motor impairment. In addition, we pinpoint the simplest dynamical changes that could be responsible for changes in the temporal patterning of beta oscillations between medication states by fitting to data biologically inspired models, and simpler beta envelope models. Finally, we show that the non-linearity can be directly extracted from average burst duration profiles under the assumption of constant noise in envelope models. This reveals that average burst duration profiles provide a window into burst dynamics, which may underlie the success of burst duration as a biomarker. In summary, we demonstrate a relationship between average burst duration profiles, dynamics of the system generating beta oscillations, and motor impairment, which puts us in a better position to understand the pathology and improve therapies such as deep brain stimulation.

Coupling between Blood Pressure and Subarachnoid Space Width Oscillations during Slow Breathing

The precise mechanisms connecting the cardiovascular system and the cerebrospinal fluid (CSF) are not well understood in detail. This paper investigates the couplings between the cardiac and respiratory components, as extracted from blood pressure (BP) signals and oscillations of the subarachnoid space width (SAS), collected during slow ventilation and ventilation against inspiration resistance. The experiment was performed on a group of 20 healthy volunteers (12 females and 8 males; BMI =22.1±3.2 kg/m2; age 25.3±7.9 years). We analysed the recorded signals with a wavelet transform. For the first time, a method based on dynamical Bayesian inference was used to detect the effective phase connectivity and the underlying coupling functions between the SAS and BP signals. There are several new findings. Slow breathing with or without resistance increases the strength of the coupling between the respiratory and cardiac components of both measured signals. We also observed increases in the strength of the coupling between the respiratory component of the BP and the cardiac component of the SAS and vice versa. Slow breathing synchronises the SAS oscillations, between the brain hemispheres. It also diminishes the similarity of the coupling between all analysed pairs of oscillators, while inspiratory resistance partially reverses this phenomenon. BP–SAS and SAS–BP interactions may reflect changes in the overall biomechanical characteristics of the brain.

Directed Connectivity Analysis of the Neuro-Cardio- and Respiratory Systems Reveals Novel Biomarkers of Susceptibility to SUDEP

Goal: Sudden unexpected death in epilepsy (SUDEP) is the leading cause of epilepsy-related mortality and its pathophysiological mechanisms remain unknown. We set to record and analyze for the first time concurrent electroencephalographic (EEG), electrocardiographic (ECG), and unrestrained whole-body plethysmographic (Pleth) signals from control (WT - wild type) and SUDEP-prone mice (KO- knockout Kcna1 animal model). Employing multivariate autoregressive models (MVAR) we measured all tri-organ effective directional interactions by the generalized partial directed coherence (GPDC) in the frequency domain over time (hours). When compared to the control (WT) animals, the SUDEP-prone (KO) animals exhibited (p < 0.001) reduced afferent and efferent interactions between the heart and the brain over the full frequency spectrum (0-200Hz), enhanced efferent interactions from the brain to the lungs and from the heart to the lungs at high (>90 Hz) frequencies (especially during periods with seizure activity), and decreased feedback from the lungs to the brain at low (<40 Hz) frequencies. These results show that impairment in the afferent and efferent pathways in the holistic neuro-cardio-respiratory network could lead to SUDEP, and effective connectivity measures and their dynamics could serve as novel biomarkers of susceptibility to SUDEP and seizures respectively.

Time Window Determination for Inference of Time-Varying Dynamics: Application to Cardiorespiratory Interaction

Interacting dynamical systems abound in nature, with examples ranging from biology and population dynamics, through physics and chemistry, to communications and climate. Often their states, parameters and functions are time-varying, because such systems interact with other systems and the environment, exchanging information and matter. A common problem when analysing time-series data from dynamical systems is how to determine the length of the time window for the analysis. When one needs to follow the time-variability of the dynamics, or the dynamical parameters and functions, the time window needs to be resolved first. We tackled this problem by introducing a method for adaptive determination of the time window for interacting oscillators, as modeled and scaled for the cardiorespiratory interaction. By investigating a system of coupled phase oscillators and utilizing the Dynamical Bayesian Inference method, we propose a procedure to determine the time window and the propagation parameter of the covariance matrix. The optimal values are determined so that the inferred parameters follow the dynamics of the actual ones and at the same time the error of the inference represented by the covariance matrix is minimal. The effectiveness of the methodology is presented on a system of coupled limit-cycle oscillators and on the cardiorespiratory interaction. Three cases of cardiorespiratory interaction were considered-measurement with spontaneous free breathing, one with periodic sine breathing and one with a-periodic time-varying breathing. The results showed that the cardiorespiratory coupling strength and similarity of form of coupling functions have greater values for slower breathing, and this variability follows continuously the change of the breathing frequency. The method can be applied effectively to other time-varying oscillatory interactions and carries important implications for analysis of general dynamical systems.

Detecting network structures from measurable data produced by dynamics with hidden variables

Depicting network structures from measurable data is of significance. In real-world situations, it is common that some variables of networks are unavailable or even unknown. These unavailable and unknown variables, i.e., hidden variables, will lead to much reconstruction error, even make reconstruction methods useless. In this paper, to solve hidden variable problems, we propose three reconstruction methods, respectively, based on the following conditions: statistical characteristics of hidden variables, linearizable hidden variables, and white noise injection. Among them, the method based on white noise injection is active and invasive. In our framework, theoretic analyses of these three methods are given at first, and, furthermore, the validity of theoretical derivations and the robustness of these methods are fully verified through numerical results. Our work may be, therefore, helpful for practical experiments.

Synchronization transitions caused by time-varying coupling functions

Interacting dynamical systems are widespread in nature. The influence that one such system exerts on another is described by a coupling function; and the coupling functions extracted from the time-series of interacting dynamical systems are often found to be time-varying. Although much effort has been devoted to the analysis of coupling functions, the influence of time-variability on the associated dynamics remains largely unexplored. Motivated especially by coupling functions in biology, including the cardiorespiratory and neural delta-alpha coupling functions, this paper offers a contribution to the understanding of effects due to time-varying interactions. Through both numerics and mathematically rigorous theoretical consideration, we show that for time-variable coupling functions with time-independent net coupling strength, transitions into and out of phase- synchronization can occur, even though the frozen coupling functions determine phase-synchronization solely by virtue of their net coupling strength. Thus the information about interactions provided by the shape of coupling functions plays a greater role in determining behaviour when these coupling functions are time-variable. This article is part of the theme issue 'Coupling functions: dynamical interaction mechanisms in the physical, biological and social sciences'.

Limb linkage rehabilitation training-related changes in cortical activation and effective connectivity after stroke: A functional near-infrared spectroscopy study

Stroke remains the leading cause of long-term disability worldwide. Rehabilitation training is essential for motor function recovery following stroke. Specifically, limb linkage rehabilitation training can stimulate motor function in the upper and lower limbs simultaneously. This study aimed to investigate limb linkage rehabilitation task-related changes in cortical activation and effective connectivity (EC) within a functional brain network after stroke by using functional near-infrared spectroscopy (fNIRS) imaging. Thirteen stroke patients with either left hemiparesis (L-H group, n = 6) and or right hemiparesis (R-H group, n = 7) and 16 healthy individuals (control group) participated in this study. A multichannel fNIRS system was used to measure changes in cerebral oxygenated hemoglobin (delta HbO2) and deoxygenated hemoglobin (delta HHb) in the bilateral prefrontal cortices (PFCs), motor cortices (MCs), and occipital lobes (OLs) during (1) the resting state and (2) a motor rehabilitation task with upper and lower limb linkage (first 10 min [task_S1], last 10 min [task_S2]). The frequency-specific EC among the brain regions was calculated based on coupling functions and dynamic Bayesian inference in frequency intervals: high-frequency I (0.6-2 Hz) and II (0.145-0.6 Hz), low-frequency III (0.052-0.145 Hz), and very-low-frequency IV (0.021-0.052 Hz). The results showed that the stroke patients exhibited an asymmetric (greater activation in the contralesional versus ipsilesional motor region) cortical activation pattern versus healthy controls. Compared with the healthy controls, the stroke patients showed significantly lower EC (p < 0.025) in intervals I and II in the resting and task states. The EC from the MC and OL to the right PFC in interval IV was significantly higher in the R-H group than in the control group during the resting and task states (p < 0.025). Furthermore, the L-H group showed significantly higher EC from the MC and OL to the left PFC in intervals III and IV during the task states compared with the control group (p < 0.025). The significantly increased influence of the MC and OL on the contralesional PFC in low- and very-low-frequency bands suggested that plastic reorganization of cognitive resources severed to compensate for impairment in stroke patients during the motor rehabilitation task. This study can serve as a basis for understanding task-related reorganization of functional brain networks and developing novel assessment techniques for stroke rehabilitation.

Alterations in the coupling functions between cerebral oxyhaemoglobin and arterial blood pressure signals in post-stroke subjects

Cerebral autoregulation (CA) is the complex homeostatic regulatory relationship between blood pressure (BP) and cerebral blood flow (CBF). This study aimed to analyze the frequency-specific coupling function between cerebral oxyhemoglobin concentrations (delta [HbO₂]) and mean arterial pressure (MAP) signals based on a model of coupled phase oscillators and dynamical Bayesian inference. Delta [HbO₂] was measured by 24-channel near-infrared spectroscopy (NIRS) and arterial BP signals were obtained by simultaneous resting-state measurements in patients with stroke, that is, 9 with left hemiparesis (L–H group), 8 with right hemiparesis (R–H group), and 17 age-matched healthy individuals as control (healthy group). The coupling functions from MAP to delta [HbO₂] oscillators were identified and analyzed in four frequency intervals (I, 0.6–2 Hz; II, 0.145–0.6 Hz; III, 0.052–0.145 Hz; and IV, 0.021–0.052 Hz). In L–H group, the CS from MAP to delta [HbO₂] in interval III in channel 8 was significantly higher than that in healthy group (p = 0.003). Compared with the healthy controls, the coupling in MAP→delta [HbO₂] showed higher amplitude in interval I and IV in patients with stroke. The increased CS and coupling amplitude may be an evidence of impairment in CA, thereby confirming the presence of impaired CA in patients with stroke. In interval III, the CS in L–H group from MAP to delta [HbO₂] in channel 16 (p = 0.001) was significantly lower than that in healthy controls, which might indicate the compensatory mechanism in CA of the unaffected side in patients with stroke. No significant difference in region-wise CS between affected and unaffected sides was observed in stroke groups, indicating an evidence of globally impaired CA. These findings provide a method for the assessment of CA and will contribute to the development of therapeutic interventions in stroke patients.

Coherence and Coupling Functions Reveal Microvascular Impairment in Treated Hypertension

The complex interactions that give rise to heart rate variability (HRV) involve coupled physiological oscillators operating over a wide range of different frequencies and length-scales. Based on the premise that interactions are key to the functioning of complex systems, the time-dependent deterministic coupling parameters underlying cardiac, respiratory and vascular regulation have been investigated at both the central and microvascular levels. Hypertension was considered as an example of a globally altered state of the complex dynamics of the cardiovascular system. Its effects were established through analysis of simultaneous recordings of the electrocardiogram (ECG), respiratory effort, and microvascular blood flow [by laser Doppler flowmetry (LDF)]. The signals were analyzed by methods developed to capture time-dependent dynamics, including the wavelet transform, wavelet-based phase coherence, non-linear mode decomposition, and dynamical Bayesian inference, all of which can encompass the inherent frequency and coupling variability of living systems. Phases of oscillatory modes corresponding to the cardiac (around 1.0 Hz), respiratory (around 0.25 Hz), and vascular myogenic activities (around 0.1 Hz) were extracted and combined into two coupled networks describing the central and peripheral systems, respectively. The corresponding spectral powers and coupling functions were computed. The same measurements and analyses were performed for three groups of subjects: healthy young (Y group, 24.4 ± 3.4 y), healthy aged (A group, 71.1 ± 6.6 y), and aged treated hypertensive patients (ATH group, 70.3 ± 6.7 y). It was established that the degree of coherence between low-frequency oscillations near 0.1 Hz in blood flow and in HRV time series differs markedly between the groups, declining with age and nearly disappearing in treated hypertension. Comparing the two healthy groups it was found that the couplings to the cardiac rhythm from both respiration and vascular myogenic activity decrease significantly in aging. Comparing the data from A and ATH groups it was found that the coupling from the vascular myogenic activity is significantly weaker in treated hypertension subjects, implying that the mechanisms of microcirculation are not completely restored by current anti-hypertension medications.

Combining random walk and regression models to understand solvation in multi-component solvent systems

Polysaccharides, such as cellulose, are often processed by dissolution in solvent mixtures, e.g. an ionic liquid (IL) combined with a dipolar aprotic co-solvent (CS) that the polymer does not dissolve in. A multi-walker, discrete-time, discrete-space 1-dimensional random walk can be applied to model solvation of a polymer in a multi-component solvent mixture. The number of IL pairs in a solvent mixture and the number of solvent shells formable, x, is associated with n, the model time-step, and N, the number of random walkers. The mean number of distinct sites visited is proportional to the amount of polymer soluble in a solution. By also fitting a polynomial regression model to the data, we can associate the random walk terms with chemical interactions between components and probe where the system deviates from a 1-D random walk. The 'frustration' between solvents shells is given as ln x in the random walk model and as a negative IL:IL interaction term in the regression model. This frustration appears in regime II of the random walk model (high volume fractions of IL) where walkers interfere with each other, and the system tends to its limiting behaviour. In the low concentration regime, (regime I) the solvent shells do not interact, and the system depends only on IL and CS terms. In both models (and both regimes), the system is almost entirely controlled by the volume available to solvation shells, and thus is a counting/space-filling problem, where the molar volume of the CS is important. Small deviations are observed when there is an IL-CS interaction. The use of two models, built on separate approaches, confirm these findings, demonstrating that this is a real effect and offering a route to identifying such systems. Specifically, the majority of CSs - such as dimethylformide - follow the random walk model, whilst 1-methylimidazole, dimethyl sulfoxide, 1,3-dimethyl-2-imidazolidinone and tetramethylurea offer a CS-mediated improvement and propylene carbonate results in a CS-mediated hindrance. It is shown here that systems, which are very complex at a molecular level, may, nonetheless, be effectively modelled as a simple random walk in phase-space. The 1-D random walk model allows prediction of the ability of solvent mixtures to dissolve cellulose based on only two dissolution measurements (one in neat IL) and molar volume.

Neural Cross-Frequency Coupling Functions

Although neural interactions are usually characterized only by their coupling strength and directionality, there is often a need to go beyond this by establishing the functional mechanisms of the interaction. We introduce the use of dynamical Bayesian inference for estimation of the coupling functions of neural oscillations in the presence of noise. By grouping the partial functional contributions, the coupling is decomposed into its functional components and its most important characteristics-strength and form-are quantified. The method is applied to characterize the δ-to-α phase-to-phase neural coupling functions from electroencephalographic (EEG) data of the human resting state, and the differences that arise when the eyes are either open (EO) or closed (EC) are evaluated. The δ-to-α phase-to-phase coupling functions were reconstructed, quantified, compared, and followed as they evolved in time. Using phase-shuffled surrogates to test for significance, we show how the strength of the direct coupling, and the similarity and variability of the coupling functions, characterize the EO and EC states for different regions of the brain. We confirm an earlier observation that the direct coupling is stronger during EC, and we show for the first time that the coupling function is significantly less variable. Given the current understanding of the effects of e.g., aging and dementia on δ-waves, as well as the effect of cognitive and emotional tasks on α-waves, one may expect that new insights into the neural mechanisms underlying certain diseases will be obtained from studies of coupling functions. In principle, any pair of coupled oscillations could be studied in the same way as those shown here.

Reconstruction of noise-driven nonlinear networks from node outputs by using high-order correlations

Many practical systems can be described by dynamic networks, for which modern technique can measure their outputs, and accumulate extremely rich data. Nevertheless, the network structures producing these data are often deeply hidden in the data. The problem of inferring network structures by analyzing the available data, turns to be of great significance. On one hand, networks are often driven by various unknown facts, such as noises. On the other hand, network structures of practical systems are commonly nonlinear, and different nonlinearities can provide rich dynamic features and meaningful functions of realistic networks. Although many works have considered each fact in studying network reconstructions, much less papers have been found to systematically treat both difficulties together. Here we propose to use high-order correlation computations (HOCC) to treat nonlinear dynamics; use two-time correlations to decorrelate effects of network dynamics and noise driving; and use suitable basis and correlator vectors to unifiedly infer all dynamic nonlinearities, topological interaction links and noise statistical structures. All the above theoretical frameworks are constructed in a closed form and numerical simulations fully verify the validity of theoretical predictions.

Time-varying coupling functions: Dynamical inference and cause of synchronization transitions

Interactions in nature can be described by their coupling strength, direction of coupling, and coupling function. The coupling strength and directionality are relatively well understood and studied, at least for two interacting systems; however, there can be a complexity in the interactions uniquely dependent on the coupling functions. Such a special case is studied here: synchronization transition occurs only due to the time variability of the coupling functions, while the net coupling strength is constant throughout the observation time. To motivate the investigation, an example is used to present an analysis of cross-frequency coupling functions between delta and alpha brain waves extracted from the electroencephalography recording of a healthy human subject in a free-running resting state. The results indicate that time-varying coupling functions are a reality for biological interactions. A model of phase oscillators is used to demonstrate and detect the synchronization transition caused by the varying coupling functions during an invariant coupling strength. The ability to detect this phenomenon is discussed with the method of dynamical Bayesian inference, which was able to infer the time-varying coupling functions. The form of the coupling function acts as an additional dimension for the interactions, and it should be taken into account when detecting biological or other interactions from data.

Coupling strength versus coupling impact in nonidentical bidirectionally coupled dynamics

The understanding of interacting dynamics is important for the characterization of real-world networks. In general, real-world networks are heterogeneous in the sense that each node of the network is a dynamics with different properties. For coupled nonidentical dynamics symmetric interactions are not straightforwardly defined from the coupling strength values. Thus, a challenging issue is whether we can define a symmetric interaction in this asymmetric setting. To address this problem we introduce the notion of the coupling impact. The coupling impact considers not only the coupling strength but also the energy of the individual dynamics, which is conveyed via the coupling. To illustrate this concept, we follow a data-driven approach by analyzing signals from pairs of coupled model dynamics using two different connectivity measures. We find that the coupling impact, but not the coupling strength, correctly detects a symmetric interaction between pairs of coupled dynamics regardless of their degree of asymmetry. Therefore, this approach allows us to reveal the real impact that one dynamics has on the other and hence to define symmetric interactions in pairs of nonidentical dynamics.

Dynamical inference: where phase synchronization and generalized synchronization meet

Synchronization is a widespread phenomenon that occurs among interacting oscillatory systems. It facilitates their temporal coordination and can lead to the emergence of spontaneous order. The detection of synchronization from the time series of such systems is of great importance for the understanding and prediction of their dynamics, and several methods for doing so have been introduced. However, the common case where the interacting systems have time-variable characteristic frequencies and coupling parameters, and may also be subject to continuous external perturbation and noise, still presents a major challenge. Here we apply recent developments in dynamical Bayesian inference to tackle these problems. In particular, we discuss how to detect phase slips and the existence of deterministic coupling from measured data, and we unify the concepts of phase synchronization and general synchronization. Starting from phase or state observables, we present methods for the detection of both phase and generalized synchronization. The consistency and equivalence of phase and generalized synchronization are further demonstrated, by the analysis of time series from analog electronic simulations of coupled nonautonomous van der Pol oscillators. We demonstrate that the detection methods work equally well on numerically simulated chaotic systems. In all the cases considered, we show that dynamical Bayesian inference can clearly identify noise-induced phase slips and distinguish coherence from intrinsic coupling-induced synchronization.

Inverse approach to chronotaxic systems for single-variable time series

Following the development of a new class of self-sustained oscillators with a time-varying but stable frequency, the inverse approach to these systems is now formulated. We show how observed data arranged in a single-variable time series can be used to recognize such systems. This approach makes use of time-frequency domain information using the wavelet transform as well as the recently developed method of Bayesian-based inference. In addition, a set of methods, named phase fluctuation analysis, is introduced to detect the defining properties of the new class of systems by directly analyzing the statistics of the observed perturbations.We apply these methods to numerical examples but also elaborate further on the cardiac system.

Evolution of cardiorespiratory interactions with age

We describe an analysis of cardiac and respiratory time series recorded from 189 subjects of both genders aged 16-90. By application of the synchrosqueezed wavelet transform, we extract the respiratory and cardiac frequencies and phases with better time resolution than is possible with the marked events procedure. By treating the heart and respiration as coupled oscillators, we then apply a method based on Bayesian inference to find the underlying coupling parameters and their time dependence, deriving from them measures such as synchronization, coupling directionality and the relative contributions of different mechanisms. We report a detailed analysis of the reconstructed cardiorespiratory coupling function, its time evolution and age dependence. We show that the direct and indirect respiratory modulations of the heart rate both decrease with age, and that the cardiorespiratory coupling becomes less stable and more time-variable.

Topology and random-walk network representation of cardiac dynamics for localization of myocardial infarction

While detection of acute cardiac disorders such as myocardial infarction (MI) from electrocardiogram (ECG) and vectorcardiogram (VCG) has been widely reported, identification of MI locations from these signals, pivotal for timely therapeutic and prognostic interventions, remains a standing issue. We present an approach for MI localization based on representing complex spatiotemporal patterns of cardiac dynamics as a random-walk network reconstructed from the evolution of VCG signals across a 3-D state space. Extensive tests with signals from the PTB database of the PhysioNet databank suggest that locations of MI can be determined accurately (sensitivity of ∼88% and specificity of ∼92%) from tracking certain consistently estimated invariants of this random-walk representation.

Transfer function for vital infrasound pressures between the carotid artery and the tympanic membrane

While occupational injury is associated with numerous individual and work-related risk factors, including long working hours and short sleep duration, the complex mechanisms causing such injuries are not yet fully understood. The relationship between the infrasound pressures of the tympanic membrane [ear canal pressure (ECP)], detected using an earplug embedded with a low-frequency microphone, and the carotid artery [carotid artery pressure (CAP)], detected using a stethoscope fitted with the same microphone, can be quantitatively characterized using systems analysis. The transfer functions of 40 normal workers (19 to 57 years old) were characterized, involving the analysis of 446 data points. The ECP waveform exhibits a pulsatile character with a slow respiratory component, which is superimposed on a biphasic recording that is synchronous with the cardiac cycle. The respiratory ECP waveform correlates with the instantaneous heart rate. The results also revealed that various fatigue-related risk factors may affect the mean magnitudes of the measured pressures and the delay transfer functions between CAP and ECP in the study population; these factors include systolic blood pressure, salivary amylase activity, age, sleep duration, postural changes, chronic fatigue, and pulse rate.

Dynamical Bayesian inference of time-evolving interactions: from a pair of coupled oscillators to networks of oscillators

Living systems have time-evolving interactions that, until recently, could not be identified accurately from recorded time series in the presence of noise. Stankovski et al. [Phys. Rev. Lett. 109, 024101 (2012)] introduced a method based on dynamical Bayesian inference that facilitates the simultaneous detection of time-varying synchronization, directionality of influence, and coupling functions. It can distinguish unsynchronized dynamics from noise-induced phase slips. The method is based on phase dynamics, with Bayesian inference of the time-evolving parameters being achieved by shaping the prior densities to incorporate knowledge of previous samples. We now present the method in detail using numerically generated data, data from an analog electronic circuit, and cardiorespiratory data. We also generalize the method to encompass networks of interacting oscillators and thus demonstrate its applicability to small-scale networks.

Inference of time-evolving coupled dynamical systems in the presence of noise

A new method is introduced for analysis of interactions between time-dependent coupled oscillators, based on the signals they generate. It distinguishes unsynchronized dynamics from noise-induced phase slips and enables the evolution of the coupling functions and other parameters to be followed. It is based on phase dynamics, with Bayesian inference of the time-evolving parameters achieved by shaping the prior densities to incorporate knowledge of previous samples. The method is tested numerically and applied to reveal and quantify the time-varying nature of cardiorespiratory interactions.

Oscillatory dynamics of vasoconstriction and vasodilation identified by time-localized phase coherence

We apply wavelet-based time-localized phase coherence to investigate the relationship between blood flow and skin temperature, and between blood flow and instantaneous heart rate (IHR), during vasoconstriction and vasodilation provoked by local cooling or heating of the skin. A temperature-controlled metal plate (approximately 10 cm2) placed on the volar side of the left arm was used to provide the heating and cooling. Beneath the plate, the blood flow was measured by laser Doppler flowmetry and the adjacent skin temperature by a thermistor. Two 1 h datasets were collected from each of the ten subjects. In each case a 30 min basal recording was followed by a step change in plate temperature, to either 24 °C or 42 °C. The IHR was derived from simultaneously recorded ECG. We confirm the changes in the energy and frequency of blood flow oscillations during cooling and heating reported earlier. That is, during cooling, there was a significant decrease in the average frequency of myogenic blood flow oscillations (p < 0.05) and the myogenic spectral peak became more prominent. During heating, there was a significant (p < 0.05) general increase in spectral energy, associated with vasodilation, except in the myogenic interval. Weak phase coherence between temperature and blood flow was observed for unperturbed skin, but it increased in all frequency intervals as a result of heating. It was not significantly affected by cooling. We also show that significant (p < 0.05) phase coherence exists between blood flow and IHR in the respiratory and myogenic frequency intervals. Cooling did not affect this phase coherence in any of the frequency intervals, whereas heating enhanced the phase coherence in the respiratory and myogenic intervals. This can be explained by the reduction in vascular resistance produced by heating, a process where myogenic mechanisms play a key role. We conclude that the mechanisms of vasodilation and vasoconstriction, in response to temperature change, are oscillatory in nature and are independent of central sources of variability.

Detecting couplings between interacting oscillators with time-varying basic frequencies: instantaneous wavelet bispectrum and information theoretic approach

In the natural world, the properties of interacting oscillatory systems are not constant, but evolve or fluctuating continuously in time. Thus, the basic frequencies of the interacting oscillators are time varying, which makes the system analysis complex. For studying their interactions we propose a complementary approach combining wavelet bispectral analysis and information theory. We show how these methods uncover the interacting properties and reveal the nature, strength, and direction of coupling. Wavelet bispectral analysis is generalized as a technique for detecting instantaneous phase-time dependence for the case of two or more coupled nonlinear oscillators whereas the information theory approach can uncover the directionality of coupling and extract driver-response relationships in complex systems. We generate bivariate time-series numerically to mimic typical situations that occur in real measured data, apply both methods to the same time-series and discuss the results. The approach is applicable quite generally to any system of coupled nonlinear oscillators.

Physics of brain dynamics: Fokker-Planck analysis reveals changes in EEG delta and theta activity during anaesthesia

We use drift and diffusion coefficients to reveal interactions between different oscillatory processes underlying a complex signal and apply the method to EEG delta and theta frequencies in the brain. By analysis of data recorded from rats during anaesthesia we consider the stability and basins of attraction of fixed points in the phase portrait of the deterministic part of the retrieved stochastic process. We show that different classes of dynamics are associated with deep and light anaesthesia, and we demonstrate that the predominant directionality of the interaction is such that theta drives delta.

Automated synchrogram analysis applied to heartbeat and reconstructed respiration

Phase synchronization between two weakly coupled oscillators has been studied in chaotic systems for a long time. However, it is difficult to unambiguously detect such synchronization in experimental data from complex physiological systems. In this paper we review our study of phase synchronization between heartbeat and respiration in 150 healthy subjects during sleep using an automated procedure for screening the synchrograms. We found that this synchronization is significantly enhanced during non-rapid-eye-movement (non-REM) sleep (deep sleep and light sleep) and is reduced during REM sleep. In addition, we show that the respiration signal can be reconstructed from the heartbeat recordings in many subjects. Our reconstruction procedure, which works particularly well during non-REM sleep, allows the detection of cardiorespiratory synchronization even if only heartbeat intervals were recorded.

The effect of low-frequency oscillations on cardio-respiratory synchronization: Observations during rest and exercise

We show that the transitions which occur between close orders of synchronization in the cardio-respiratory system are mainly due to modulation of the cardiac and respiratory processes by low-frequency components. The experimental evidence is derived from recordings on healthy subjects at rest and during exercise. Exercise acts as a perturbation of the system that alters the mean cardiac and respiratory frequencies and changes the amount of their modulation by low-frequency oscillations. The conclusion is supported by numerical evidence based on a model of phase-coupled oscillators, with white noise and low-frequency noise. Both the experimental and numerical approaches confirm that low-frequency oscillations play a significant role in the transitional behavior between close orders of synchronization.

Inferential framework for nonstationary dynamics. I. Theory

A general Bayesian framework is introduced for the inference of time-varying parameters in nonstationary, nonlinear, stochastic dynamical systems. Its convergence is discussed. The performance of the method is analyzed in the context of detecting signaling in a system of neurons modeled as FitzHugh-Nagumo (FHN) oscillators. It is assumed that only fast action potentials for each oscillator mixed by an unknown measurement matrix can be detected. It is shown that the proposed approach is able to reconstruct unmeasured (hidden) variables of the FHN oscillators, to determine the model parameters, to detect stepwise changes of control parameters for each oscillator, and to follow continuous evolution of the control parameters in the adiabatic limit.

High-order synchronization, transitions, and competition among Arnold tongues in a rotator under harmonic forcing

We consider a rotator whose equation of motion for the angle theta consists of the zeroth and first Fourier modes. Numerical analysis based on the trailing of saddle-node bifurcations is used to locate the n:1 Arnold tongues where synchronization occurs. Several of them are wide enough for high-order synchronization to be seen in passive observations. By sweeping the system parameters within a certain range, we find that the stronger the dependence of theta[over ] on theta , the wider the regions of synchronization. Use of a synchronization index reveals a vast number of very narrow n:m Arnold tongues. A competition phenomenon among the tongues is observed, in that they "push" and "squeeze" one another: as some tongues widen, others narrow. Two mechanisms for transitions between different n:m synchronization states are considered: slow variation of the driving frequency, and the influence of low-frequency noise on the rotator.

Phase coupling in the cardiorespiratory interaction

Markovian analysis is applied to derive nonlinear stochastic equations for the reconstruction of heart rate and respiration rate variability data. A model of their 'phase' interactions is obtained for the first time, thereby gaining new insights into the strength and direction of the cardiorespiratory phase coupling. The reconstructed model can reproduce synchronisation phenomena between the cardiac and the respiratory systems, including switches in synchronisation ratio. The technique is equally applicable to the extraction of the multi-dimensional couplings between many interacting subsystems.

Coupled oscillators: complex but not complicated cardiovascular and brain interactions

Contemporary measurement techniques enable noninvasive observations of cardiovascular functions, both from the central and peripheral points of view. Cardiovascular dynamics is found to be characterised by several distinct frequency components, and these are present at each site of the system. The corresponding oscillatory processes are mutually dependent via couplings that lead to amplitude/frequency fluctuations of the characteristic peaks. New studies have been initiated to determine the interactions between the cardiovascular oscillations and some of the brain waves. The work will be reviewed and causal relations will be discussed with a special emphasis on detection of the depth of anesthesia.

Harmonics tracking of intracranial and arterial blood pressure waves

Considering cardiorespiratory interaction and heart rate variability, a new approach is proposed to decompose intracranial pressure and arterial blood pressure to their different harmonics. The method is based on tracking the amplitudes of the harmonics by a Kalman filter based tracking algorithm. The algorithm takes benefit of combined frequency estimation technique which uses both Fast Fourier Transform and RR-interval detection. The result would be of use in intracranial pressure and arterial blood pressure waveform analysis as well as other investigations which need to estimate contribution of specific harmonic in above mentioned signals such as Pressure-Volume Compensatory Reserve assessment.

Seidel-Herzel model of human baroreflex in cardiorespiratory system with stochastic delays

The stochastic versus deterministic solution of the Seidel-Herzel model describing the baroreceptor control loop (which regulates the short-time heart rate) are compared with the aim of exploring the heart rate variability. The deterministic model solutions are known to bifurcate from the stable to sustained oscillatory solutions if time delays in transfer of signals by sympathetic nervous system to the heart and vasculature are changed. Oscillations in the heart rate and blood pressure are physiologically crucial since they are recognized as Mayer waves. We test the role of delays of the sympathetic stimulation in reconstruction of the known features of the heart rate. It appears that realistic histograms and return plots are attainable if sympathetic time delays are stochastically perturbed, namely, we consider a perturbation by a white noise. Moreover, in the case of stochastic model the bifurcation points vanish and Mayer oscillations in heart period and blood pressure are observed for whole considered space of sympathetic time delays.

A variational approach to the stochastic aspects of cellular signal transduction

Cellular signaling networks have evolved to cope with intrinsic fluctuations, coming from the small numbers of constituents, and the environmental noise. Stochastic chemical kinetics equations govern the way biochemical networks process noisy signals. The essential difficulty associated with the master equation approach to solving the stochastic chemical kinetics problem is the enormous number of ordinary differential equations involved. In this work, we show how to achieve tremendous reduction in the dimensionality of specific reaction cascade dynamics by solving variationally an equivalent quantum field theoretic formulation of stochastic chemical kinetics. The present formulation avoids cumbersome commutator computations in the derivation of evolution equations, making the physical significance of the variational method more transparent. We propose novel time-dependent basis functions which work well over a wide range of rate parameters. We apply the new basis functions to describe stochastic signaling in several enzymatic cascades and compare the results so obtained with those from alternative solution techniques. The variational Ansatz gives probability distributions that agree well with the exact ones, even when fluctuations are large and discreteness and nonlinearity are important. A numerical implementation of our technique is many orders of magnitude more efficient computationally compared with the traditional Monte Carlo simulation algorithms or the Langevin simulations.

The interplay between discrete noise and nonlinear chemical kinetics in a signal amplification cascade

We used various analytical and numerical techniques to elucidate signal propagation in a small enzymatic cascade which is subjected to external and internal noises. The nonlinear character of catalytic reactions, which underlie protein signal transduction cascades, renders stochastic signaling dynamics in cytosol biochemical networks distinct from the usual description of stochastic dynamics in gene regulatory networks. For a simple two-step enzymatic cascade which underlies many important protein signaling pathways, we demonstrated that the commonly used techniques such as the linear noise approximation and the Langevin equation become inadequate when the number of proteins becomes too low. Consequently, we developed a new analytical approximation, based on mixing the generating function and distribution function approaches, to the solution of the master equation that describes nonlinear chemical signaling kinetics for this important class of biochemical reactions. Our techniques work in a much wider range of protein number fluctuations than the methods used previously. We found that under certain conditions the burst phase noise may be injected into the downstream signaling network dynamics, resulting possibly in unusually large macroscopic fluctuations. In addition to computing first and second moments, which is the goal of commonly used analytical techniques, our new approach provides the full time-dependent probability distributions of the colored non-Gaussian processes in a nonlinear signal transduction cascade.

Experimental evidence for phase synchronization transitions in the human cardiorespiratory system

Transitions in the dynamics of complex systems can be characterized by changes in the synchronization behavior of their components. Taking the human cardiorespiratory system as an example and using an automated procedure for screening the synchrograms of 112 healthy subjects we study the frequency and the distribution of synchronization episodes under different physiological conditions that occur during sleep. We find that phase synchronization between heartbeat and breathing is significantly enhanced during non-rapid-eye-movement (non-REM) sleep (deep sleep and light sleep) and reduced during REM sleep. Our results suggest that the synchronization is mainly due to a weak influence of the breathing oscillator upon the heartbeat oscillator, which is disturbed in the presence of long-term correlated noise, superimposed by the activity of higher brain regions during REM sleep.

The cardio-respiratory couplings observed in the LDF signal using wavelet bispectrum

Bispectral analysis, introduced recently as a technique for revealing time-phase relationships among interacting noisy oscillators, has been used to study the nature of the coupling between cardiac and respiratory activity. Univariate blood flow signals recorded simultaneously by laser-Doppler flowmetry (LDF) on both legs and arms were analysed. Coupling between cardiac and respiratory activity was also checked by use of bivariate data and computation of the cross-bispectrum between simultaneously recorded ECG, blood pressure and respiratory signals. Recordings were taken during spontaneous breathing and paced respiration. It is shown that cardiorespiratory coupling exists during spontaneous as well as during paced respiration and that coupling information among cardiac and respiratory processes in young, healthy subjects is spatially invariant, but can be expected to change with cardiovascular diseases.

Nonlinear statistical modeling and model discovery for cardiorespiratory data

We present a Bayesian dynamical inference method for characterizing cardiorespiratory (CR) dynamics in humans by inverse modeling from blood pressure time-series data. The technique is applicable to a broad range of stochastic dynamical models and can be implemented without severe computational demands. A simple nonlinear dynamical model is found that describes a measured blood pressure time series in the primary frequency band of the CR dynamics. The accuracy of the method is investigated using model-generated data with parameters close to the parameters inferred in the experiment. The connection of the inferred model to a well-known beat-to-beat model of the baroreflex is discussed.

Reconstruction of stochastic nonlinear dynamical models from trajectory measurements

An algorithm is presented for reconstructing stochastic nonlinear dynamical models from noisy time-series data. The approach is analytical; consequently, the resulting algorithm does not require an extensive global search for the model parameters, provides optimal compensation for the effects of dynamical noise, and is robust for a broad range of dynamical models. The strengths of the algorithm are illustrated by inferring the parameters of the stochastic Lorenz system and comparing the results with those of earlier research. The efficiency and accuracy of the algorithm are further demonstrated by inferring a model for a system of five globally and locally coupled noisy oscillators.