Compensated Transfer Entropy as a Tool for Reliably Estimating Information Transfer in Physiological Time Series

A framework based on the information domain to measure coupling changes in electrophysiological signals

Objectives.In this paper, the features of physiological signals of healthy dataset are extracted using the linear and non-linear techniques, and a comparison has been made on healthy young and old subjects to study the aging and gender-related changes in the contribution of Heart Rate (HR), Blood Pressure (BP), and Respiration (RESP).Methods. To quantify the coupling changes in cardiovascular, cardiorespiratory, and vasculorespiratory complexity, an information domain approach based on compensated transfer entropy (cTE) is proposed.Result. The results show that there is a substantial decrease in the flow of information from BP tro the time interval between successive R-peaks (RR) and from RR to BP. There is also a significant decrease in the flow of information from RESP to BP and RESP to RR but there is no significant change in the information flow from BP to RESP and RR to RESP.Conclusion. We have done linear and non-linear analysis on the healthy datasets of young and old subjects. As already existed techniques lacks in studying complex behaviours of electrophysiological signals so to overcome these limitations, we have proposed compensated transfer entropy (cTE). We conducted an investigation to determine the degree to which recordings of RESP, BP, and HR can be utilized to predict changes in the other parameters. Specifically, the proposed analysis examined the relationship between these variables and assessed their consistency across different age groups and genders. By analyzing the data, we aimed to gain insights into the interdependencies and predictive potential of these physiological measures in relation to each other.

Information-Theoretic Analysis of Cardio-Respiratory Interactions in Heart Failure Patients: Effects of Arrhythmias and Cardiac Resynchronization Therapy

The properties of cardio-respiratory coupling (CRC) are affected by various pathological conditions related to the cardiovascular and/or respiratory systems. In heart failure, one of the most common cardiac pathological conditions, the degree of CRC changes primarily depend on the type of heart-rhythm alterations. In this work, we investigated CRC in heart-failure patients, applying measures from information theory, i.e., Granger Causality (GC), Transfer Entropy (TE) and Cross Entropy (CE), to quantify the directed coupling and causality between cardiac (RR interval) and respiratory (Resp) time series. Patients were divided into three groups depending on their heart rhythm (sinus rhythm and presence of low/high number of ventricular extrasystoles) and were studied also after cardiac resynchronization therapy (CRT), distinguishing responders and non-responders to the therapy. The information-theoretic analysis of bidirectional cardio-respiratory interactions in HF patients revealed the strong effect of nonlinear components in the RR (high number of ventricular extrasystoles) and in the Resp time series (respiratory sinus arrhythmia) as well as in their causal interactions. We showed that GC as a linear model measure is not sensitive to both nonlinear components and only model free measures as TE and CE may quantify them. CRT responders mainly exhibit unchanged asymmetry in the TE values, with statistically significant dominance of the information flow from Resp to RR over the opposite flow from RR to Resp, before and after CRT. In non-responders this asymmetry was statistically significant only after CRT. Our results indicate that the success of CRT is related to corresponding information transfer between the cardiac and respiratory signal quantified at baseline measurements, which could contribute to a better selection of patients for this type of therapy.

Extending the spectral decomposition of Granger causality to include instantaneous influences: application to the control mechanisms of heart rate variability

Assessing Granger causality (GC) intended as the influence, in terms of reduction of variance of surprise, that a driver variable exerts on a given target, requires a suitable treatment of 'instantaneous' effects, i.e. influences due to interactions whose time scale is much faster than the time resolution of the measurements, due to unobserved confounders or insufficient sampling rate that cannot be increased because the mechanism of generation of the variable is inherently slow (e.g. the heartbeat). We exploit a recently proposed framework for the estimation of causal influences in the spectral domain and include instantaneous interactions in the modelling, thus obtaining (i) a novel index of undirected instantaneous causality and (ii) a novel measure of GC including instantaneous effects. An effective procedure to speed up the optimization of parameters in this frame is also presented. After illustrating the proposed formalism in a theoretical example, we apply it to two datasets of cardiovascular and respiratory time series and compare the values obtained within the frequency bands of physiological interest by the proposed total measure of causality with those derived from the standard GC analysis. We find that the inclusion of instantaneous causality allows us to correctly disentangle the baroreflex mechanism from the effects related to cardiorespiratory interactions. Moreover, studying how controlling the respiratory rhythm acts on cardiovascular interactions, we document an increase of the direct (non-baroreflex mediated) influence of respiration on the heart rate in the respiratory frequency band when switching from spontaneous to paced breathing. This article is part of the theme issue 'Advanced computation in cardiovascular physiology: new challenges and opportunities'.

Connectivity Analysis for Multivariate Time Series: Correlation vs. Causality

The study of the interdependence relationships of the variables of an examined system is of great importance and remains a challenging task. There are two distinct cases of interdependence. In the first case, the variables evolve in synchrony, connections are undirected and the connectivity is examined based on symmetric measures, such as correlation. In the second case, a variable drives another one and they are connected with a causal relationship. Therefore, directed connections entail the determination of the interrelationships based on causality measures. The main open question that arises is the following: can symmetric correlation measures or directional causality measures be applied to infer the connectivity network of an examined system? Using simulations, we demonstrate the performance of different connectivity measures in case of contemporaneous or/and temporal dependencies. Results suggest the sensitivity of correlation measures when temporal dependencies exist in the data. On the other hand, causality measures do not spuriously indicate causal effects when data present only contemporaneous dependencies. Finally, the necessity of introducing effective instantaneous causality measures is highlighted since they are able to handle both contemporaneous and causal effects at the same time. Results based on instantaneous causality measures are promising; however, further investigation is required in order to achieve an overall satisfactory performance.

EEG Fractal Analysis Reflects Brain Impairment after Stroke

Stroke is the commonest cause of disability. Novel treatments require an improved understanding of the underlying mechanisms of recovery. Fractal approaches have demonstrated that a single metric can describe the complexity of seemingly random fluctuations of physiological signals. We hypothesize that fractal algorithms applied to electroencephalographic (EEG) signals may track brain impairment after stroke. Sixteen stroke survivors were studied in the hyperacute (<48 h) and in the acute phase (∼1 week after stroke), and 35 stroke survivors during the early subacute phase (from 8 days to 32 days and after ∼2 months after stroke): We compared resting-state EEG fractal changes using fractal measures (i.e., Higuchi Index, Tortuosity) with 11 healthy controls. Both Higuchi index and Tortuosity values were significantly lower after a stroke throughout the acute and early subacute stage compared to healthy subjects, reflecting a brain activity which is significantly less complex. These indices may be promising metrics to track behavioral changes in the very early stage after stroke. Our findings might contribute to the neurorehabilitation quest in identifying reliable biomarkers for a better tailoring of rehabilitation pathways.

Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy

Neural oscillations reflect rhythmic fluctuations in the synchronization of neuronal populations and play a significant role in neural processing. To further understand the dynamic interactions between different regions in the brain, it is necessary to estimate the coupling direction between neural oscillations. Here, we developed a novel method, termed weighted symbolic transfer entropy (WSTE), that combines symbolic transfer entropy (STE) and weighted probability distribution to measure the directionality between two neuronal populations. The traditional STE ignores the degree of difference between the amplitude values of a time series. In our proposed WSTE method, this information is picked up by utilizing a weighted probability distribution. The simulation analysis shows that the WSTE method can effectively estimate the coupling direction between two neural oscillations. In comparison with STE, the new method is more sensitive to the coupling strength and is more robust against noise. When applied to epileptic electrocorticography data, a significant coupling direction from the anterior nucleus of thalamus (ANT) to the seizure onset zone (SOZ) was detected during seizures. Considering the superiorities of the WSTE method, it is greatly advantageous to measure the coupling direction between neural oscillations and consequently characterize the information flow between different brain regions.

Estimating Conditional Transfer Entropy in Time Series Using Mutual Information and Nonlinear Prediction

We propose a new estimator to measure directed dependencies in time series. The dimensionality of data is first reduced using a new non-uniform embedding technique, where the variables are ranked according to a weighted sum of the amount of new information and improvement of the prediction accuracy provided by the variables. Then, using a greedy approach, the most informative subsets are selected in an iterative way. The algorithm terminates, when the highest ranked variable is not able to significantly improve the accuracy of the prediction as compared to that obtained using the existing selected subsets. In a simulation study, we compare our estimator to existing state-of-the-art methods at different data lengths and directed dependencies strengths. It is demonstrated that the proposed estimator has a significantly higher accuracy than that of existing methods, especially for the difficult case, where the data are highly correlated and coupled. Moreover, we show its false detection of directed dependencies due to instantaneous couplings effect is lower than that of existing measures. We also show applicability of the proposed estimator on real intracranial electroencephalography data.

The extended Granger causality analysis for Hodgkin-Huxley neuronal models

How to extract directions of information flow in dynamical systems based on empirical data remains a key challenge. The Granger causality (GC) analysis has been identified as a powerful method to achieve this capability. However, the framework of the GC theory requires that the dynamics of the investigated system can be statistically linearized; i.e., the dynamics can be effectively modeled by linear regressive processes. Under such conditions, the causal connectivity can be directly mapped to the structural connectivity that mediates physical interactions within the system. However, for nonlinear dynamical systems such as the Hodgkin-Huxley (HH) neuronal circuit, the validity of the GC analysis has yet been addressed; namely, whether the constructed causal connectivity is still identical to the synaptic connectivity between neurons remains unknown. In this work, we apply the nonlinear extension of the GC analysis, i.e., the extended GC analysis, to the voltage time series obtained by evolving the HH neuronal network. In addition, we add a certain amount of measurement or observational noise to the time series to take into account the realistic situation in data acquisition in the experiment. Our numerical results indicate that the causal connectivity obtained through the extended GC analysis is consistent with the underlying synaptic connectivity of the system. This consistency is also insensitive to dynamical regimes, e.g., a chaotic or non-chaotic regime. Since the extended GC analysis could in principle be applied to any nonlinear dynamical system as long as its attractor is low dimensional, our results may potentially be extended to the GC analysis in other settings.

A Framework to Assess the Information Dynamics of Source EEG Activity and Its Application to Epileptic Brain Networks

This study introduces a framework for the information-theoretic analysis of brain functional connectivity performed at the level of electroencephalogram (EEG) sources. The framework combines the use of common spatial patterns to select the EEG components which maximize the variance between two experimental conditions, simultaneous implementation of vector autoregressive modeling (VAR) with independent component analysis to describe the joint source dynamics and their projection to the scalp, and computation of information dynamics measures (information storage, information transfer, statistically significant network links) from the source VAR parameters. The proposed framework was tested on simulated EEGs obtained mixing source signals generated under different coupling conditions, showing its ability to retrieve source information dynamics from the scalp signals. Then, it was applied to investigate scalp and source brain connectivity in a group of children manifesting episodes of focal and generalized epilepsy; the analysis was performed on EEG signals lasting 5 s, collected in two consecutive windows preceding and one window following each ictal episode. Our results show that generalized seizures are associated with a significant decrease from pre-ictal to post-ictal periods of the information stored in the signals and of the information transferred among them, reflecting reduced self-predictability and causal connectivity at the level of both scalp and source brain dynamics. On the contrary, in the case of focal seizures the scalp EEG activity was not discriminated across conditions by any information measure, while source analysis revealed a tendency of the measures of information transfer to increase just before seizures and to decrease just after seizures. These results suggest that focal epileptic seizures are associated with a reorganization of the topology of EEG brain networks which is only visible analyzing connectivity among the brain sources. Our findings emphasize the importance of EEG modeling approaches able to deal with the adverse effects of volume conduction on brain connectivity analysis, and their potential relevance to the development of strategies for prediction and clinical treatment of epilepsy.

Sleep-Dependent Directional Interactions of the Central Nervous System-Cardiorespiratory Network

OBJECTIVE

We investigated the nature of interactions between the central nervous system (CNS) and the cardiorespiratory system during sleep.

METHODS

Overnight polysomnography recordings were obtained from 33 healthy individuals. The relative spectral powers of five frequency bands, three ECG morphological features and respiratory rate were obtained from six EEG channels, ECG, and oronasal airflow, respectively. The synchronous feature series were interpolated to 1 Hz to retain the high time-resolution required to detect rapid physiological variations. CNS-cardiorespiratory interaction networks were built for each EEG channel and a directionality analysis was conducted using multivariate transfer entropy. Finally, the difference in interaction between Deep, Light, and REM sleep (DS, LS, and REM) was studied.

RESULTS

Bidirectional interactions existed in central-cardiorespiratory networks, and the dominant direction was from the cardiorespiratory system to the brain during all sleep stages. Sleep stages had evident influence on these interactions, with the strength of information transfer from heart rate and respiration rate to the brain gradually increasing with the sequence of REM, LS, and DS. Furthermore, the occipital lobe appeared to receive the most input from the cardiorespiratory system during LS. Finally, different ECG morphological features were found to be involved with various central-cardiac and cardiac-respiratory interactions.

CONCLUSION

These findings reveal detailed information regarding CNS-cardiorespiratory interactions during sleep and provide new insights into understanding of sleep control mechanisms.

SIGNIFICANCE

Our approach may facilitate the investigation of the pathological cardiorespiratory complications of sleep disorders.

The impact of financial contagion on real economy-An empirical research based on combination of complex network technology and spatial econometrics model

This study presents financial network indicators that can be applied to inspect the financial contagion on real economy, as well as the spatial spillover and industry aggregation effects. We propose to design both a directed and undirected networks of financial sectors of top 20 countries in GDP based on symbolized transfer entropy and Pearson correlation coefficients. We examine the effect and usefulness of the network indicators by newly using them instead of the original Dow Jones financial sector as explanatory variables to construct the higher-order information spatial econometric models. The results demonstrate that the estimated accuracies obtained from both the two networks are improved significantly compared with the spatial econometric model using the original data. It indicates that the network indictors are more effective to capture the dynamic information of financial systems. And meanwhile, the accuracy based on the directed network is a little higher than the undirected network, which indicates the symbolized transfer entropy, i.e. the directed and weighted network, is more suitable and effective to reflect relationships in the financial field. In addition, the results also show that under the global financial crisis, the co-movement between financial sectors of a country/region and the global financial sector as well as between financial sectors and real economy sectors is increased. However, some sectors in particular Utilities and Healthcare are impacted slightly. This study tries to use the financial network indicators in modeling to study contagion channels on the real economy and the industry aggregation effects and suggest how network indicators can be practically used in financial fields.

Identification of Hidden Sources by Estimating Instantaneous Causality in High-Dimensional Biomedical Time Series

The study of connectivity patterns of a system’s variables, such as multi-channel electroencephalograms (EEG), is of utmost importance towards a better understanding of its internal evolutionary mechanisms. Here, the problem of estimating the connectivity network from multivariate time series in the presence of prominent unobserved variables is addressed. The causality measure of partial mutual information from mixed embedding (PMIME), designed to estimate direct lag-causal effects in the presence of many observed variables, is adapted to estimate also zero-lag effects, the so-called instantaneous causality. We term the proposed advanced method, PMIME0. The estimation of instantaneous causality by PMIME0 is a signature of the presence of hidden source in the observed system, as demonstrated analytically in a toy model. It is further demonstrated that the PMIME0 identifies the true instantaneous with great accuracy in a variety of high-dimensional dynamical systems. The method is applied to EEG data with epileptiform discharges (EDs), and the results imply a strong impact of unobserved confounders during the EDs. This finding comes as a possible explanation for the increased levels of causality during epileptic seizures estimated by some measures affected by the presence of a common source.

Transfer Information Assessment in Diagnosis of Vasovagal Syncope Using Transfer Entropy

The paper presents an application of Transfer Entropy (TE) to the analysis of information transfer between biosignals (heart rate expressed as R-R intervals (RRI), blood pressure (sBP, dBP) and stroke volume (SV)) measured during head up tilt testing (HUTT) in patients with suspected vasovagal syndrome. The study group comprised of 80 patients who were divided into two groups: the HUTT(+) group consisting of 57 patients who developed syncope during the passive phase of the test and HUTT(-) group consisting of 23 patients who had a negative result of the passive phase and experienced syncope after provocation with nitroglycerin. In both groups the information transfer depends on the phase of the tilt test. In supine position the highest transfer occurred between driver RRI and other components. In upright position it is the driver sBP that plays the crucial role. The pre-syncope phase features the highest information transfer from driver SV to blood pressure components. In each group the comparisons of TE between different phases of HUT test showed significant differences for RRI and SV as drivers.

The Understanding Capacity and Information Dynamics in the Human Brain

This article proposes a theory of neuronal processes underlying cognition, focusing on the mechanisms of understanding in the human brain. Understanding is a product of mental modeling. The paper argues that mental modeling is a form of information production inside the neuronal system extending the reach of human cognition "beyond the information given" (Bruner, J.S., Beyond the Information Given, 1973). Mental modeling enables forms of learning and prediction (learning with understanding and prediction via explanation) that are unique to humans, allowing robust performance under unfamiliar conditions having no precedents in the past history. The proposed theory centers on the notions of self-organization and emergent properties of collective behavior in the neuronal substrate. The theory motivates new approaches in the design of intelligent artifacts (machine understanding) that are complementary to those underlying the technology of machine learning.

Cardiorespiratory Temporal Causal Links and the Differences by Sport or Lack Thereof

Fitness level, fatigue and adaptation are important factors for determining the optimal training schedule and predicting future performance. We think that adding analysis of the mutual relationships between cardiac and respiratory activity enables better athlete profiling and feedback for improving training. Therefore, the main objectives were (1) to apply several methods for temporal causality analysis to cardiorespiratory data; (2) to establish causal links between the signals; and (3) to determine how parameterized connections differed across various subgroups. One hundred elite athletes (31 female) and a control group of 20 healthy students (6 female) took part in the study. All were asked to follow a protocol comprising two 5-min sessions of free breathing - once supine, once standing. The data were collected using Pneumonitor 2. Respiratory-related curves were obtained through impedance pneumography, along with a single-lead ECG. Several signals (e.g., tidal volume, instantaneous respiratory rate, and instantaneous heart rate) were derived and stored as: (1) raw data down-sampled to 25Hz; (2) further down-sampled to 2.5Hz; and (3) beat-by-beat sequences. Granger causality frameworks (pairwise-conditional, spectral or extended), along with Time Series Models with Independent Noise (TiMINo), were studied. The connections enabling the best distinctions were found using recursive feature elimination with a random forest kernel. Temporal causal links are the most evident between tidal volume and instantaneous heart rate signals. Predictions of the “effect” variable were improved by adding preceding “cause” samples, by medians of 20.3% for supine and 14.2% for standing body positions. Parameterized causal link structures and directions distinguish athletes from non-athletes with 83.3% accuracy on average. They may also be used to supplement standard analysis and enable classification into groups exhibiting different static and dynamic components during performance. Physiological markers of training may be extended to include cardiorespiratory data, and causality analysis may improve the resolution of training profiling and the precision of outcome prediction.

Learning Entropy as a Learning-Based Information Concept

Recently, a novel concept of a non-probabilistic novelty detection measure, based on a multi-scale quantification of unusually large learning efforts of machine learning systems, was introduced as learning entropy (LE). The key finding with LE is that the learning effort of learning systems is quantifiable as a novelty measure for each individually observed data point of otherwise complex dynamic systems, while the model accuracy is not a necessary requirement for novelty detection. This brief paper extends the explanation of LE from the point of an informatics approach towards a cognitive (learning-based) information measure emphasizing the distinction from Shannon’s concept of probabilistic information. Fundamental derivations of learning entropy and of its practical estimations are recalled and further extended. The potentials, limitations, and, thus, the current challenges of LE are discussed.

Coupling of local muscle deoxygenation and autonomic control depends on exercise intensity-insights from transfer entropy analysis

OBJECTIVE

We analyzed the driving component between the periods of adjacent heartbeats (R-R intervals) and vastus lateralis-deoxygenation (%HHb) during incremental cycling. Considering a tight matching of local metabolism with systemic and local perfusion, a coupling between indices of cardiovascular control (R-R variability) and %HHb is suggested. Further, an intensity-dependent coupling between R-R variability and %HHb was hypothesized, because a multitude of feedback and feedforward mechanisms to autonomic cardiovascular control as well as local vasodilating mechanisms are associated with muscle metabolism and thus exercise intensity.

APPROACH

Ten male triathletes (age: 34  ±  8 years) completed a test, including baseline (BAS, 50 W), a 25 W * min^-1 ramp incremental phase until exhaustion and a recovery period (REC, 50 W). R-R intervals, %HHb and respiratory responses were simultaneously recorded. Five corresponding data segments were selected: BAS, before the first ventilatory threshold (preGET), between GET and the respiratory compensation point (preRCP), above RCP (postRCP), and REC. Bivariate transfer entropy (BTE) was applied to determine the signal coupling between R-R and %HHb.

MAIN RESULTS

During preGET and preRCP, the analysis yielded the dominating direction from %HHb to R-R intervals, while for postRCP the direction was reversed. No significant signal coupling was detectable for the BAS and REC segments.

SIGNIFICANCE

Assuming that %HHb is related to the metabolic state of the working muscle, BTE results support the role of metaboreceptors in the systemic blood flow regulation at lower exercise intensities, while other mechanisms (e.g. baroreceptor and mechanoreceptor feedback, central command) that modulate cardiovascular control may override this coupling at higher intensities.

The Interaction Analysis between the Sympathetic and Parasympathetic Systems in CHF by Using Transfer Entropy Method

Congestive heart failure (CHF) is a cardiovascular disease associated with autonomic dysfunction, where sympathovagal imbalance was reported in many studies using heart rate variability (HRV). To learn more about the dynamic interaction in the autonomic nervous system (ANS), we explored the directed interaction between the sympathetic nervous system (SNS) and the parasympathetic nervous system (PNS) with the help of transfer entropy (TE). This article included 24-h RR interval signals of 54 healthy subjects (31 males and 23 females, 61.38 ± 11.63 years old) and 44 CHF subjects (8 males and 2 females, 19 subjects' gender were unknown, 55.51 ± 11.44 years old, 4 in class I, 8 in class II and 32 in class III~IV, according to the New York Heart Association Function Classification), obtained from the PhysioNet database and then segmented into 5-min non-overlapping epochs using cubic spline interpolation. For each segment in the normal group and CHF group, frequency-domain features included low-frequency (LF) power, high-frequency (HF) power and LF/HF ratio were extracted as classical estimators of autonomic activity. In the nonlinear domain, TE between LF and HF were calculated to quantify the information exchanging between SNS and PNS. Compared with the normal group, an extreme decrease in LF/HF ratio (p = 0.000) and extreme increases in both TE(LF→HF) (p = 0.000) and TE(HF→LF) (p = 0.000) in the CHF group were observed. Moreover, both in normal and CHF groups, TE(LF→HF) was a lot greater than TE(HF→LF) (p = 0.000), revealing that TE was able to distinguish the difference in the amount of directed information transfer among ANS. Extracted features were further applied in discriminating CHF using IBM SPSS Statistics discriminant analysis. The combination of the LF/HF ratio, TE(LF→HF) and TE(HF→LF) reached the highest screening accuracy (83.7%). Our results suggested that TE could serve as a complement to traditional index LF/HF in CHF screening.

Dynamical Pattern Representation of Cardiovascular Couplings Evoked by Head-up Tilt Test

Shannon entropy (ShE) is a recognised tool for the quantization of the temporal organization of time series. Transfer entropy (TE) provides insight into the dependence between coupled systems. Here, signals are analysed that were produced by the cardiovascular system when a healthy human underwent a provocation test using the head-up tilt (HUT) protocol. The information provided by ShE and TE is evaluated from two aspects: that of the algorithmic stability and that of the recognised physiology of the cardiovascular response to the HUT test. To address both of these aspects, two types of symbolization of three-element subsequent values of a signal are considered: one, well established in heart rate research, referring to the variability in a signal, and a novel one, revealing primarily the dynamical trends. The interpretation of ShE shows a strong dependence on the method that was used in signal pre-processing. In particular, results obtained from normalized signals turn out to be less conclusive than results obtained from non-normalized signals. Systematic investigations based on surrogate data tests are employed to discriminate between genuine properties—in particular inter-system coupling—and random, incidental fluctuations. These properties appear to determine the occurrence of a high percentage of zero values of TE, which strongly limits the reliability of the couplings measured. Nevertheless, supported by statistical corroboration, we identify distinct timings when: (i) evoking cardiac impact on the vascular system, and (ii) evoking vascular impact on the cardiac system, within both the principal sub-systems of the baroreflex loop.

Enhanced Brain Network Activity in Complex Movement Rhythms: A Simultaneous Functional Magnetic Resonance Imaging and Electroencephalography Study

Generating movement rhythms is known to involve a network of distributed brain regions associated with motor planning, control, execution, and perception of timing for the repertoire of motor actions. What brain areas are bound in the network and how the network activity is modulated by rhythmic complexity have not been completely explored. To contribute to answering these questions, we designed a study in which nine healthy participants performed simple to complex rhythmic finger movement tasks while undergoing simultaneous functional magnetic resonance imaging and electroencephalography (fMRI-EEG) recordings of their brain activity during the tasks and rest. From fMRI blood oxygenation-level-dependent (BOLD) measurements, we found that the complexity of rhythms was associated with brain activations in the primary motor cortex (PMC), supplementary motor area (SMA), and cerebellum (Cb), and with network interactions from these cortical regions to the cerebellum. The spectral analysis of single-trial EEG source waveforms at the cortical regions further showed that there were bidirectional interactions between PMC and SMA, and the complexity of rhythms was associated with power spectra and Granger causality spectra in the beta (13-30 Hz) frequency band, not in the alpha (8-12 Hz) and gamma (30-58 Hz) bands. These results provide us new insights into the mechanisms for movement rhythm complexity.

Instantaneous Transfer Entropy for the Study of Cardiovascular and Cardiorespiratory Nonstationary Dynamics

OBJECTIVE

Measures of transfer entropy (TE) quantify the direction and strength of coupling between two complex systems. Standard approaches assume stationarity of the observations, and therefore are unable to track time-varying changes in nonlinear information transfer with high temporal resolution. In this study, we aim to define and validate novel instantaneous measures of TE to provide an improved assessment of complex nonstationary cardiorespiratory interactions.

METHODS

We here propose a novel instantaneous point-process TE (ipTE) and validate its assessment as applied to cardiovascular and cardiorespiratory dynamics. In particular, heartbeat and respiratory dynamics are characterized through discrete time series, and modeled with probability density functions predicting the time of the next physiological event as a function of the past history. Likewise, nonstationary interactions between heartbeat and blood pressure dynamics are characterized as well. Furthermore, we propose a new measure of information transfer, the instantaneous point-process information transfer (ipInfTr), which is directly derived from point-process-based definitions of the Kolmogorov-Smirnov distance.

RESULTS AND CONCLUSION

Analysis on synthetic data, as well as on experimental data gathered from healthy subjects undergoing postural changes confirms that ipTE, as well as ipInfTr measures are able to dynamically track changes in physiological systems coupling.

SIGNIFICANCE

This novel approach opens new avenues in the study of hidden, transient, nonstationary physiological states involving multivariate autonomic dynamics in cardiovascular health and disease. The proposed method can also be tailored for the study of complex multisystem physiology (e.g., brain-heart or, more in general, brain-body interactions).

Analysis of causal cardio-postural interaction under orthostatic stress using convergent cross mapping

Knowledge of a cause-and-effect relationship between different physiological systems is helpful in predicting their performance under perturbations, such as orthostatic challenge. The causal coupling between representative signals of the cardiovascular and postural systems under orthostatic challenge remains unknown. Understanding the causal relationship between these two systems is critical, as their interplay is vital to maintain stable upright posture of the human body during quiet standing. In this research, convergent cross mapping (CCM) method was applied to study the causal relationship between the cardiovascular and postural systems previously shown to have coherent activity during quiet standing. Causality was studied between Systolic blood pressure (SBP)-EMG (calf muscles), EMG-COPr (resultant center of pressure), and COPr-SBP signal pairs. These signals were simultaneously recorded in a 5-minute sit-to-stand test from five young healthy participants. Strength of causality was obtained between the signal pairs in a 30-second time segments. The results from this study indicate that there exists a bidirectional causal relationship between the cardio-postural signal pairs, indicating a system level interaction to counter perturbation due to orthostatic challenge. Skeletal muscle pump was found to be driving control of SBP and COPr as the value of EMG→SBP (0.54±0.09) and EMG→COPr (0.52±0.07) were higher than the reverse causality of SBP→EMG (0.19±0.16) and COPr→EMG (0.29±0.16).

An Information-Theoretic Framework to Map the Spatiotemporal Dynamics of the Scalp Electroencephalogram

We present the first application of the emerging framework of information dynamics to the characterization of the electroencephalography (EEG) activity. The framework provides entropy-based measures of information storage (self entropy, SE) and information transfer (joint transfer entropy (TE) and partial TE), which are applied here to detect complex dynamics of individual EEG sensors and causal interactions between different sensors. The measures are implemented according to a model-free and fully multivariate formulation of the framework, allowing the detection of nonlinear dynamics and direct links. Moreover, to deal with the issue of volume conduction, a compensation for instantaneous effects is introduced in the computation of joint and partial TE. The framework is applied to resting state EEG measured from healthy subjects in the eyes open (EO) and eyes closed (EC) conditions, evidencing condition-dependent patterns indicative of how information is distributed in the EEG sensor space. The SE was uniformly low during EO and significantly higher in the posterior areas during EC. The joint and partial TE were saturated by instantaneous effects, documenting how volume conduction blurs the detection of information flow in the EEG. However, the use of compensated TE measures led us to evidence meaningful patterns like the presence of local sinks of information flow and propagation motifs, and the emergence of prevalent front-to-back EEG propagation during EC. These findings support the feasibility of our information-theoretic approach to assess the spatiotemporal dynamics of the scalp EEG in different conditions.

Inferring time-varying brain connectivity graph based on a new method for link estimation

Causal interaction estimation among neuronal groups plays an important role in the assessment of brain functions. These directional relations can be best illustrated by means of graphical modeling which is a mathematical representation of a network. Here, we propose an efficient framework to derive a graphical model for the statistical analysis of multivariate processes from observed time series in a data-driven pipeline to explore the interregional brain interactions. A major part of this analysis is devoted to the graph link estimation, which is a measure capable of dealing with the multivariate analysis obstacles. In this paper, we use the Transfer Entropy (TE) measure and focus on its calculation that requires efficient estimation of high dimensional conditional probability distributions. Our method is based on the simplification of high dimensional parts of the conventional TE definition and especially devoted to the reduction of estimation dimension through searching for the most informative contents of the high dimensional parts. To this end, we exploit the causal Markov properties for time series graphs and prove that only a specified subset of involved variables plays an important role in multivariate TE estimation. We demonstrate the performance of our method for stationary processes using some numerical simulated examples as well as real neurophysiological data.

Identifying changes in EEG information transfer during drowsy driving by transfer entropy

Drowsy driving is a major cause of automobile accidents. Previous studies used neuroimaging based approaches such as analysis of electroencephalogram (EEG) activities to understand the brain dynamics of different cortical regions during drowsy driving. However, the coupling between brain regions responding to this vigilance change is still unclear. To have a comprehensive understanding of neural mechanisms underlying drowsy driving, in this study we use transfer entropy, a model-free measure of effective connectivity based on information theory. We investigate the pattern of information transfer between brain regions when the vigilance level, which is derived from the driving performance, changes from alertness to drowsiness. Results show that the couplings between pairs of frontal, central, and parietal areas increased at the intermediate level of vigilance, which suggests that an enhancement of the cortico-cortical interaction is necessary to maintain the task performance and prevent behavioral lapses. Additionally, the occipital-related connectivity magnitudes monotonically decreases as the vigilance level declines, which further supports the cortical gating of sensory stimuli during drowsiness. Neurophysiological evidence of mutual relationships between brain regions measured by transfer entropy might enhance the understanding of cortico-cortical communication during drowsy driving.

Long-Range Reduced Predictive Information Transfers of Autistic Youths in EEG Sensor-Space During Face Processing

The majority of previous functional/effective connectivity studies conducted on the autistic patients converged to the underconnectivity theory of ASD: "long-range underconnectivity and sometimes short-rang overconnectivity". However, to the best of our knowledge the total (linear and nonlinear) predictive information transfers (PITs) of autistic patients have not been investigated yet. Also, EEG data have rarely been used for exploring the information processing deficits in autistic subjects. This study is aimed at comparing the total (linear and nonlinear) PITs of autistic and typically developing healthy youths during human face processing by using EEG data. The ERPs of 12 autistic youths and 19 age-matched healthy control (HC) subjects were recorded while they were watching upright and inverted human face images. The PITs among EEG channels were quantified using two measures separately: transfer entropy with self-prediction optimality (TESPO), and modified transfer entropy with self-prediction optimality (MTESPO). Afterwards, the directed differential connectivity graphs (dDCGs) were constructed to characterize the significant changes in the estimated PITs of autistic subjects compared with HC ones. By using both TESPO and MTESPO, long-range reduction of PITs of ASD group during face processing was revealed (particularly from frontal channels to right temporal channels). Also, it seemed the orientation of face images (upright or upside down) did not modulate the binary pattern of PIT-based dDCGs, significantly. Moreover, compared with TESPO, the results of MTESPO were more compatible with the underconnectivity theory of ASD in the sense that MTESPO showed no long-range increase in PIT. It is also noteworthy that to the best of our knowledge it is the first time that a version of MTE is applied for patients (here ASD) and it is also its first use for EEG data analysis.

Estimating the decomposition of predictive information in multivariate systems

In the study of complex systems from observed multivariate time series, insight into the evolution of one system may be under investigation, which can be explained by the information storage of the system and the information transfer from other interacting systems. We present a framework for the model-free estimation of information storage and information transfer computed as the terms composing the predictive information about the target of a multivariate dynamical process. The approach tackles the curse of dimensionality employing a nonuniform embedding scheme that selects progressively, among the past components of the multivariate process, only those that contribute most, in terms of conditional mutual information, to the present target process. Moreover, it computes all information-theoretic quantities using a nearest-neighbor technique designed to compensate the bias due to the different dimensionality of individual entropy terms. The resulting estimators of prediction entropy, storage entropy, transfer entropy, and partial transfer entropy are tested on simulations of coupled linear stochastic and nonlinear deterministic dynamic processes, demonstrating the superiority of the proposed approach over the traditional estimators based on uniform embedding. The framework is then applied to multivariate physiologic time series, resulting in physiologically well-interpretable information decompositions of cardiovascular and cardiorespiratory interactions during head-up tilt and of joint brain-heart dynamics during sleep.

Assessing levels of consciousness with symbolic analysis

'Covert consciousness' is a state in which consciousness is present without the capacity for behavioural response, and it can occur in patients with intraoperative awareness or unresponsive wakefulness syndrome. To detect and prevent this undesirable state, it is critical to develop a reliable neurobiological assessment of an individual's level of consciousness that is independent of behaviour. One such approach that shows potential is measuring surrogates of cortical communication in the brain using electroencephalography (EEG). EEG is practicable in clinical application, but involves many fundamental signal processing problems, including signal-to-noise ratio and high dimensional complexity. Symbolic analysis of EEG can mitigate these problems, improving the measurement of brain connectivity and the ability to successfully assess levels of consciousness. In this article, we review the problem of covert consciousness, basic neurobiological principles of consciousness, current methods of measuring brain connectivity and the advantages of symbolic processing, with a focus on symbolic transfer entropy (STE). Finally, we discuss recent advances and clinical applications of STE and other symbolic analyses to assess levels of consciousness.

Efficient transfer entropy analysis of non-stationary neural time series

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these necessary observations, available estimators typically assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble of realizations is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that is suitable for the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method for transfer entropy estimation. We test the performance and robustness of our implementation on data from numerical simulations of stochastic processes. We also demonstrate the applicability of the ensemble method to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscience data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems.

Oscillatory activity in neocortical networks during tactile discrimination near the limit of spatial acuity

Oscillatory interactions within functionally specialized but distributed brain regions are believed to be central to perceptual and cognitive functions. Here, using human scalp electroencephalography (EEG) recordings combined with source reconstruction techniques, we study how oscillatory activity functionally organizes different neocortical regions during a tactile discrimination task near the limit of spatial acuity. While undergoing EEG recordings, blindfolded participants felt a linear three-dot array presented electromechanically, under computer control, and reported whether the central dot was offset to the left or right. The average brain response differed significantly for trials with correct and incorrect perceptual responses in the timeframe approximately between 130 and 175ms. During trials with correct responses, source-level peak activity appeared in the left primary somatosensory cortex (SI) at around 45ms, in the right lateral occipital complex (LOC) at 130ms, in the right posterior intraparietal sulcus (pIPS) at 160ms, and finally in the left dorsolateral prefrontal cortex (dlPFC) at 175ms. Spectral interdependency analysis of activity in these nodes showed two distinct distributed networks, a dominantly feedforward network in the beta band (12-30Hz) that included all four nodes and a recurrent network in the gamma band (30-100Hz) that linked SI, pIPS and dlPFC. Measures of network activity in both bands were correlated with the accuracy of task performance. These findings suggest that beta and gamma band oscillatory networks coordinate activity between neocortical regions mediating sensory and cognitive processing to arrive at tactile perceptual decisions.

Decomposing the transfer entropy to quantify lag-specific Granger causality in cardiovascular variability

We present a modification of the well known transfer entropy (TE) which makes it able to detect, besides the direction and strength of the information transfer between coupled processes, its exact timing. The approach follows a decomposition strategy which identifies--according to a lag-specific formulation of the concept of Granger causality--the set of time delays carrying significant information, and then assigns to each of these delays an amount of information transfer such that the total contribution yields the overall TE. We propose also a procedure for the practical estimation from time series data of the relevant delays and lag-specific TE in both bivariate and multivariate settings. The proposed approach is tested in simulations and in real cardiovascular time series, showing the feasibility of lag-specific TE estimation, the ability to reflect expected mechanisms of cardiovascular regulation, and the necessity of using the multivariate TE to properly assess time-lagged information transfer in the presence of multiple interacting systems.