Model driven EEG/fMRI fusion of brain oscillations

In-vivo neuronal dysfunction by Aβ and tau overlaps with brain-wide inflammatory mechanisms in Alzheimer's disease

The molecular mechanisms underlying neuronal dysfunction in Alzheimer's disease (AD) remain uncharacterized. Here, we identify genes, molecular pathways and cellular components associated with whole-brain dysregulation caused by amyloid-beta (Aβ) and tau deposits in the living human brain. We obtained in-vivo resting-state functional MRI (rs-fMRI), Aβ- and tau-PET for 47 cognitively unimpaired and 16 AD participants from the Translational Biomarkers in Aging and Dementia cohort. Adverse neuronal activity impacts by Aβ and tau were quantified with personalized dynamical models by fitting pathology-mediated computational signals to the participant's real rs-fMRIs. Then, we detected robust brain-wide associations between the spatial profiles of Aβ-tau impacts and gene expression in the neurotypical transcriptome (Allen Human Brain Atlas). Within the obtained distinctive signature of in-vivo neuronal dysfunction, several genes have prominent roles in microglial activation and in interactions with Aβ and tau. Moreover, cellular vulnerability estimations revealed strong association of microglial expression patterns with Aβ and tau's synergistic impact on neuronal activity (q < 0.001). These results further support the central role of the immune system and neuroinflammatory pathways in AD pathogenesis. Neuronal dysregulation by AD pathologies also associated with neurotypical synaptic and developmental processes. In addition, we identified drug candidates from the vast LINCS library to halt or reduce the observed Aβ-tau effects on neuronal activity. Top-ranked pharmacological interventions target inflammatory, cancer and cardiovascular pathways, including specific medications undergoing clinical evaluation in AD. Our findings, based on the examination of molecular-pathological-functional interactions in humans, may accelerate the process of bringing effective therapies into clinical practice.

Personalized whole-brain neural mass models reveal combined Aβ and tau hyperexcitable influences in Alzheimer's disease

Neuronal dysfunction and cognitive deterioration in Alzheimer's disease (AD) are likely caused by multiple pathophysiological factors. However, mechanistic evidence in humans remains scarce, requiring improved non-invasive techniques and integrative models. We introduce personalized AD computational models built on whole-brain Wilson-Cowan oscillators and incorporating resting-state functional MRI, amyloid-β (Aβ) and tau-PET from 132 individuals in the AD spectrum to evaluate the direct impact of toxic protein deposition on neuronal activity. This subject-specific approach uncovers key patho-mechanistic interactions, including synergistic Aβ and tau effects on cognitive impairment and neuronal excitability increases with disease progression. The data-derived neuronal excitability values strongly predict clinically relevant AD plasma biomarker concentrations (p-tau217, p-tau231, p-tau181, GFAP) and grey matter atrophy obtained through voxel-based morphometry. Furthermore, reconstructed EEG proxy quantities show the hallmark AD electrophysiological alterations (theta band activity enhancement and alpha reductions) which occur with Aβ-positivity and after limbic tau involvement. Microglial activation influences on neuronal activity are less definitive, potentially due to neuroimaging limitations in mapping neuroprotective vs detrimental activation phenotypes. Mechanistic brain activity models can further clarify intricate neurodegenerative processes and accelerate preventive/treatment interventions.

Solving large-scale MEG/EEG source localisation and functional connectivity problems simultaneously using state-space models

State-space models are widely employed across various research disciplines to study unobserved dynamics. Conventional estimation techniques, such as Kalman filtering and expectation maximisation, offer valuable insights but incur high computational costs in large-scale analyses. Sparse inverse covariance estimators can mitigate these costs, but at the expense of a trade-off between enforced sparsity and increased estimation bias, necessitating careful assessment in low signal-to-noise ratio (SNR) situations. To address these challenges, we propose a three-fold solution: (1) Introducing multiple penalised state-space (MPSS) models that leverage data-driven regularisation; (2) Developing novel algorithms derived from backpropagation, gradient descent, and alternating least squares to solve MPSS models; (3) Presenting a K-fold cross-validation extension for evaluating regularisation parameters. We validate this MPSS regularisation framework through lower and more complex simulations under varying SNR conditions, including a large-scale synthetic magneto- and electro-encephalography (MEG/EEG) data analysis. In addition, we apply MPSS models to concurrently solve brain source localisation and functional connectivity problems for real event-related MEG/EEG data, encompassing thousands of sources on the cortical surface. The proposed methodology overcomes the limitations of existing approaches, such as constraints to small-scale and region-of-interest analyses. Thus, it may enable a more accurate and detailed exploration of cognitive brain functions.

Two is better? combining EEG and fMRI for BCI and neurofeedback: a systematic review

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are two commonly used non-invasive techniques for measuring brain activity in neuroscience and brain-computer interfaces (BCI).Objective. In this review, we focus on the use of EEG and fMRI in neurofeedback (NF) and discuss the challenges of combining the two modalities to improve understanding of brain activity and achieve more effective clinical outcomes. Advanced technologies have been developed to simultaneously record EEG and fMRI signals to provide a better understanding of the relationship between the two modalities. However, the complexity of brain processes and the heterogeneous nature of EEG and fMRI present challenges in extracting useful information from the combined data.Approach. We will survey existing EEG-fMRI combinations and recent studies that exploit EEG-fMRI in NF, highlighting the experimental and technical challenges.Main results. We made a classification of the different combination of EEG-fMRI for NF, we provide a review of multimodal analysis methods for EEG-fMRI features. We also survey the current state of research on EEG-fMRI in the different existing NF paradigms. Finally, we also identify some of the remaining challenges in this field.Significance. By exploring EEG-fMRI combinations in NF, we are advancing our knowledge of brain function and its applications in clinical settings. As such, this review serves as a valuable resource for researchers, clinicians, and engineers working in the field of neural engineering and rehabilitation, highlighting the promising future of EEG-fMRI-based NF.

Functional neuroimaging as a catalyst for integrated neuroscience

Functional magnetic resonance imaging (fMRI) enables non-invasive access to the awake, behaving human brain. By tracking whole-brain signals across a diverse range of cognitive and behavioural states or mapping differences associated with specific traits or clinical conditions, fMRI has advanced our understanding of brain function and its links to both normal and atypical behaviour. Despite this headway, progress in human cognitive neuroscience that uses fMRI has been relatively isolated from rapid advances in other subdomains of neuroscience, which themselves are also somewhat siloed from one another. In this Perspective, we argue that fMRI is well-placed to integrate the diverse subfields of systems, cognitive, computational and clinical neuroscience. We first summarize the strengths and weaknesses of fMRI as an imaging tool, then highlight examples of studies that have successfully used fMRI in each subdomain of neuroscience. We then provide a roadmap for the future advances that will be needed to realize this integrative vision. In this way, we hope to demonstrate how fMRI can help usher in a new era of interdisciplinary coherence in neuroscience.

Development and validation of an fMRI-informed EEG model of reward-related ventral striatum activation

Reward processing is essential for our mental-health and well-being. In the current study, we developed and validated a scalable, fMRI-informed EEG model for monitoring reward processing related to activation in the ventral-striatum (VS), a significant node in the brain's reward system. To develop this EEG-based model of VS-related activation, we collected simultaneous EEG/fMRI data from 17 healthy individuals while listening to individually-tailored pleasurable music - a highly rewarding stimulus known to engage the VS. Using these cross-modal data, we constructed a generic regression model for predicting the concurrently acquired Blood-Oxygen-Level-Dependent (BOLD) signal from the VS using spectro-temporal features from the EEG signal (termed hereby VS-related-Electrical Finger Print; VS-EFP). The performance of the extracted model was examined using a series of tests that were applied on the original dataset and, importantly, an external validation dataset collected from a different group of 14 healthy individuals who underwent the same EEG/FMRI procedure. Our results showed that the VS-EFP model, as measured by simultaneous EEG, predicted BOLD activation in the VS and additional functionally relevant regions to a greater extent than an EFP model derived from a different anatomical region. The developed VS-EFP was also modulated by musical pleasure and predictive of the VS-BOLD during a monetary reward task, further indicating its functional relevance. These findings provide compelling evidence for the feasibility of using EEG alone to model neural activation related to the VS, paving the way for future use of this scalable neural probing approach in neural monitoring and self-guided neuromodulation.

Revealing the combined roles of Aβ and tau in Alzheimer's disease via a pathophysiological activity decoder

Neuronal dysfunction and cognitive deterioration in Alzheimer's disease (AD) are likely caused by multiple pathophysiological factors. However, evidence in humans remains scarce, necessitating improved non-invasive techniques and integrative mechanistic models. Here, we introduce personalized brain activity models incorporating functional MRI, amyloid-β (Aβ) and tau-PET from AD-related participants ( N = 132 ) . Within the model assumptions, electrophysiological activity is mediated by toxic protein deposition. Our integrative subject-specific approach uncovers key patho-mechanistic interactions, including synergistic Aβ and tau effects on cognitive impairment and neuronal excitability increases with disease progression. The data-derived neuronal excitability values strongly predict clinically relevant AD plasma biomarker concentrations (p-tau217, p-tau231, p-tau181, GFAP). Furthermore, our results reproduce hallmark AD electrophysiological alterations (theta band activity enhancement and alpha reductions) which occur with Aβ-positivity and after limbic tau involvement. Microglial activation influences on neuronal activity are less definitive, potentially due to neuroimaging limitations in mapping neuroprotective vs detrimental phenotypes. Mechanistic brain activity models can further clarify intricate neurodegenerative processes and accelerate preventive/treatment interventions.

Identifying oscillatory brain networks with hidden Gaussian graphical spectral models of MEEG

Identifying the functional networks underpinning indirectly observed processes poses an inverse problem for neurosciences or other fields. A solution of such inverse problems estimates as a first step the activity emerging within functional networks from EEG or MEG data. These EEG or MEG estimates are a direct reflection of functional brain network activity with a temporal resolution that no other in vivo neuroimage may provide. A second step estimating functional connectivity from such activity pseudodata unveil the oscillatory brain networks that strongly correlate with all cognition and behavior. Simulations of such MEG or EEG inverse problem also reveal estimation errors of the functional connectivity determined by any of the state-of-the-art inverse solutions. We disclose a significant cause of estimation errors originating from misspecification of the functional network model incorporated into either inverse solution steps. We introduce the Bayesian identification of a Hidden Gaussian Graphical Spectral (HIGGS) model specifying such oscillatory brain networks model. In human EEG alpha rhythm simulations, the estimation errors measured as ROC performance do not surpass 2% in our HIGGS inverse solution and reach 20% in state-of-the-art methods. Macaque simultaneous EEG/ECoG recordings provide experimental confirmation for our results with 1/3 times larger congruence according to Riemannian distances than state-of-the-art methods.

A revisit of the amygdala theory of autism: Twenty years after

The human amygdala has long been implicated to play a key role in autism spectrum disorder (ASD). Yet it remains unclear to what extent the amygdala accounts for the social dysfunctions in ASD. Here, we review studies that investigate the relationship between amygdala function and ASD. We focus on studies that employ the same task and stimuli to directly compare people with ASD and patients with focal amygdala lesions, and we also discuss functional data associated with these studies. We show that the amygdala can only account for a limited number of deficits in ASD (primarily face perception tasks but not social attention tasks), a network view is, therefore, more appropriate. We next discuss atypical brain connectivity in ASD, factors that can explain such atypical brain connectivity, and novel tools to analyze brain connectivity. Lastly, we discuss new opportunities from multimodal neuroimaging with data fusion and human single-neuron recordings that can enable us to better understand the neural underpinnings of social dysfunctions in ASD. Together, the influential amygdala theory of autism should be extended with emerging data-driven scientific discoveries such as machine learning-based surrogate models to a broader framework that considers brain connectivity at the global scale.

Accurate and Efficient Simulation of Very High-Dimensional Neural Mass Models with Distributed-Delay Connectome Tensors

This paper introduces methods and a novel toolbox that efficiently integrates high-dimensional Neural Mass Models (NMMs) specified by two essential components. The first is the set of nonlinear Random Differential Equations (RDEs) of the dynamics of each neural mass. The second is the highly sparse three-dimensional Connectome Tensor (CT) that encodes the strength of the connections and the delays of information transfer along the axons of each connection. To date, simplistic assumptions prevail about delays in the CT, often assumed to be Dirac-delta functions. In reality, delays are distributed due to heterogeneous conduction velocities of the axons connecting neural masses. These distributed-delay CTs are challenging to model. Our approach implements these models by leveraging several innovations. Semi-analytical integration of RDEs is done with the Local Linearization (LL) scheme for each neural mass model, ensuring dynamical fidelity to the original continuous-time nonlinear dynamic. This semi-analytic LL integration is highly computationally-efficient. In addition, a tensor representation of the CT facilitates parallel computation. It also seamlessly allows modeling distributed delays CT with any level of complexity or realism. This ease of implementation includes models with distributed-delay CTs. Consequently, our algorithm scales linearly with the number of neural masses and the number of equations they are represented with, contrasting with more traditional methods that scale quadratically at best. To illustrate the toolbox's usefulness, we simulate a single Zetterberg-Jansen-Rit (ZJR) cortical column, a single thalmo-cortical unit, and a toy example comprising 1000 interconnected ZJR columns. These simulations demonstrate the consequences of modifying the CT, especially by introducing distributed delays. The examples illustrate the complexity of explaining EEG oscillations, e.g., split alpha peaks, since they only appear for distinct neural masses. We provide an open-source Script for the toolbox.

Automatic Quality Control of the numerical accuracy of EEG Lead fields

Precise individualized EEG source localization is predicated on having accurate subject-specific Lead Fields (LFs) obtained from their Magnetic Resonance Images (MRI). LF calculation is a complex process involving several error-prone steps that start with obtaining a realistic head model from the MRI and finalizing with computationally expensive solvers such as the Boundary Element Method (BEM) or Finite Element Method (FEM). Current Big-Data applications require the calculation of batches of hundreds or thousands of LFs. LF. Quality Control is conventionally checked subjectively by experts, a procedure not feasible in practice for larger batches. To facilitate this step, we introduce the Lead Field Automatic-Quality Control Index (LF-AQI) that flags LF with potential errors. We base our LF-AQI on the assumption that LFs obtained from simpler head models, i.e., the homogeneous head model LF (HHM-LF) or spherical head model LF (SHM-LF), deviate only moderately from a "good" realistic test LF. Since these simpler LFs are easier to compute and check for errors, they may serve as "reference LF" to detect anomalous realistic test LF. We investigated this assumption by comparing correlation-based channel ρ_min(ref,test)and source τ_min(ref,test) similarity indices (SI) between "gold standards," i.e., very accurate FEM and BEM LFs, and the proposed references (HHM-LF and SHM-LF). Surprisingly we found that the most uncomplicated possible reference, HHM-LF had high SI values with the gold standards-leading us to explore further use of the channel ρ_min(HHM-LF,test)and source τ_min(HHM-LF,test)_{SI as a basis for} our LF-AQI. Indeed, these SI successfully detected five simulated scenarios of LFs artifacts. This result encouraged us to evaluate the SI on a large dataset and thus define our LF-AQI. We thus computed the SI of 1251 LFs obtained from the Child Mind Institute (CMI) MRI dataset. When ρ_min(HHM-LF,test)and source τ_min(HHM-LF,test) were plotted for all test subjects on a 2D space, most were tightly clustered around the median of a high similarity centroid (HSC), except for a smaller proportion of outliers. We define the LF-AQI for a given LF as the log Euclidean distance between its SI and the HSC median. To automatically detect outliers, the threshold is at the 90^th percentile of the CMI LF-AQIs (-0.9755). LF-AQI greater than this threshold flag individual LF to be checked. The robustness of this LF-AQI screening was checked by repeated out-of-sample validation. Strikingly, minor corrections in re-processing the flagged cases eliminated their status as outliers. Furthermore, the "doubtful" labels assigned by LF-AQI were validated by neuroscience students using a Likert scale questionnaire designed to manually check the LF's quality. Item Response Theory (IRT) analysis was applied to the questionnaire results to compute an optimized model and a latent variable θ for that model. A linear mixed model (LMM) between the θ and LF-AQI resulted in an effect with a Cohen's d value of 1.3 and a p-value <0.001, thus validating the correspondence of LF-AQI with the visual quality control. We provide an open-source pipeline to implement both LF calculation and its quality control to allow further evaluation of our index.

Minimizing the distortions in electrophysiological source imaging of cortical oscillatory activity via Spectral Structured Sparse Bayesian Learning

Oscillatory processes at all spatial scales and on all frequencies underpin brain function. Electrophysiological Source Imaging (ESI) is the data-driven brain imaging modality that provides the inverse solutions to the source processes of the EEG, MEG, or ECoG data. This study aimed to carry out an ESI of the source cross-spectrum while controlling common distortions of the estimates. As with all ESI-related problems under realistic settings, the main obstacle we faced is a severely ill-conditioned and high-dimensional inverse problem. Therefore, we opted for Bayesian inverse solutions that posited a priori probabilities on the source process. Indeed, rigorously specifying both the likelihoods and a priori probabilities of the problem leads to the proper Bayesian inverse problem of cross-spectral matrices. These inverse solutions are our formal definition for cross-spectral ESI (cESI), which requires a priori of the source cross-spectrum to counter the severe ill-condition and high-dimensionality of matrices. However, inverse solutions for this problem were NP-hard to tackle or approximated within iterations with bad-conditioned matrices in the standard ESI setup. We introduce cESI with a joint a priori probability upon the source cross-spectrum to avoid these problems. cESI inverse solutions are low-dimensional ones for the set of random vector instances and not random matrices. We achieved cESI inverse solutions through the variational approximations via our Spectral Structured Sparse Bayesian Learning (ssSBL) algorithm https://github.com/CCC-members/Spectral-Structured-Sparse-Bayesian-Learning. We compared low-density EEG (10-20 system) ssSBL inverse solutions with reference cESIs for two experiments: (a) high-density MEG that were used to simulate EEG and (b) high-density macaque ECoG that were recorded simultaneously with EEG. The ssSBL resulted in two orders of magnitude with less distortion than the state-of-the-art ESI methods. Our cESI toolbox, including the ssSBL method, is available at https://github.com/CCC-members/BC-VARETA_Toolbox.

Neural evidence suggests phonological acceptability judgments reflect similarity, not constraint evaluation

Acceptability judgments are a primary source of evidence in formal linguistic research. Within the generative linguistic tradition, these judgments are attributed to evaluation of novel forms based on implicit knowledge of rules or constraints governing well-formedness. In the domain of phonological acceptability judgments, other factors including ease of articulation and similarity to known forms have been hypothesized to influence evaluation. We used data-driven neural techniques to identify the relative contributions of these factors. Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data revealed patterns of interaction between brain regions that support explicit judgments of the phonological acceptability of spoken nonwords. Comparisons of data obtained with nonwords that varied in terms of onset consonant cluster attestation and acceptability revealed different cortical regions and effective connectivity patterns associated with phonological acceptability judgments. Attested forms produced stronger influences of brain regions implicated in lexical representation and sensorimotor simulation on acoustic-phonetic regions, whereas unattested forms produced stronger influence of phonological control mechanisms on acoustic-phonetic processing. Unacceptable forms produced widespread patterns of interaction consistent with attempted search or repair. Together, these results suggest that speakers' phonological acceptability judgments reflect lexical and sensorimotor factors.

Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review

Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.

Simultaneous EEG-fMRI: What Have We Learned and What Does the Future Hold?

Simultaneous EEG-fMRI has developed into a mature measurement technique in the past 25 years. During this time considerable technical and analytical advances have been made, enabling valuable scientific contributions to a range of research fields. This review will begin with an introduction to the measurement principles involved in EEG and fMRI and the advantages of combining these methods. The challenges faced when combining the two techniques will then be considered. An overview of the leading application fields where EEG-fMRI has made a significant contribution to the scientific literature and emerging applications in EEG-fMRI research trends is then presented.

Machine learning approaches for parsing comorbidity/heterogeneity in antisociality and substance use disorders: A primer

By some accounts, as many as 93% of individuals diagnosed with antisocial personality disorder (ASPD) or psychopathy also meet criteria for some form of substance use disorder (SUD). This high level of comorbidity, combined with an overlapping biopsychosocial profile, and potentially interacting features, has made it difficult to delineate the shared/unique characteristics of each disorder. Moreover, while rarely acknowledged, both SUD and antisociality exist as highly heterogeneous disorders in need of more targeted parcellation. While emerging data-driven nosology for psychiatric disorders (e.g., Research Domain Criteria (RDoC), Hierarchical Taxonomy of Psychopathology (HiTOP)) offers the opportunity for a more systematic delineation of the externalizing spectrum, the interrogation of large, complex neuroimaging-based datasets may require data-driven approaches that are not yet widely employed in psychiatric neuroscience. With this in mind, the proposed article sets out to provide an introduction into machine learning methods for neuroimaging that can help parse comorbid, heterogeneous externalizing samples. The modest machine learning work conducted to date within the externalizing domain demonstrates the potential utility of the approach but remains highly nascent. Within the paper, we make suggestions for how future work can make use of machine learning methods, in combination with emerging psychiatric nosology systems, to further diagnostic and etiological understandings of the externalizing spectrum. Finally, we briefly consider some challenges that will need to be overcome to encourage further progress in the field.

Patient-Specific Network Connectivity Combined With a Next Generation Neural Mass Model to Test Clinical Hypothesis of Seizure Propagation

Dynamics underlying epileptic seizures span multiple scales in space and time, therefore, understanding seizure mechanisms requires identifying the relations between seizure components within and across these scales, together with the analysis of their dynamical repertoire. In this view, mathematical models have been developed, ranging from single neuron to neural population. In this study, we consider a neural mass model able to exactly reproduce the dynamics of heterogeneous spiking neural networks. We combine mathematical modeling with structural information from non invasive brain imaging, thus building large-scale brain network models to explore emergent dynamics and test the clinical hypothesis. We provide a comprehensive study on the effect of external drives on neuronal networks exhibiting multistability, in order to investigate the role played by the neuroanatomical connectivity matrices in shaping the emergent dynamics. In particular, we systematically investigate the conditions under which the network displays a transition from a low activity regime to a high activity state, which we identify with a seizure-like event. This approach allows us to study the biophysical parameters and variables leading to multiple recruitment events at the network level. We further exploit topological network measures in order to explain the differences and the analogies among the subjects and their brain regions, in showing recruitment events at different parameter values. We demonstrate, along with the example of diffusion-weighted magnetic resonance imaging (dMRI) connectomes of 20 healthy subjects and 15 epileptic patients, that individual variations in structural connectivity, when linked with mathematical dynamic models, have the capacity to explain changes in spatiotemporal organization of brain dynamics, as observed in network-based brain disorders. In particular, for epileptic patients, by means of the integration of the clinical hypotheses on the epileptogenic zone (EZ), i.e., the local network where highly synchronous seizures originate, we have identified the sequence of recruitment events and discussed their links with the topological properties of the specific connectomes. The predictions made on the basis of the implemented set of exact mean-field equations turn out to be in line with the clinical pre-surgical evaluation on recruited secondary networks.

Bridging M/EEG Source Imaging and Independent Component Analysis Frameworks Using Biologically Inspired Sparsity Priors

Electromagnetic source imaging (ESI) and independent component analysis (ICA) are two popular and apparently dissimilar frameworks for M/EEG analysis. This letter shows that the two frameworks can be linked by choosing biologically inspired source sparsity priors. We demonstrate that ESI carried out by the sparse Bayesian learning (SBL) algorithm yields source configurations composed of a few active regions that are also maximally independent from one another. In addition, we extend the standard SBL approach to source imaging in two important directions. First, we augment the generative model of M/EEG to include artifactual sources. Second, we modify SBL to allow for efficient model inversion with sequential data. We refer to this new algorithm as recursive SBL (RSBL), a source estimation filter with potential for online and offline imaging applications. We use simulated data to verify that RSBL can accurately estimate and demix cortical and artifactual sources under different noise conditions. Finally, we show that on real error-related EEG data, RSBL can yield single-trial source estimates in agreement with the experimental literature. Overall, by demonstrating that ESI can produce maximally independent sources while simultaneously localizing them in cortical space, we bridge the gap between the ESI and ICA frameworks for M/EEG analysis.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Modeling Temporal Biomarkers With Semiparametric Nonlinear Dynamical Systems

Dynamical systems based on differential equations are useful for modeling the temporal evolution of biomarkers. These systems can characterize the temporal patterns of biomarkers and inform the detection of interactions among biomarkers. Existing statistical methods for dynamical systems mostly target single time-course data based on a linear model or generalized additive model. Hence, they cannot adequately capture the complex interactions among biomarkers; neither can they take into account the heterogeneity between systems or subjects. in this work, we propose a semiparametric dynamical system based on multi-index models for multiple subjects time-course data. Our model accounts for between-subject heterogeneity by introducing system-level or subject-level covariates to dynamic systems, and it allows for nonlinear relationship and interaction between the combined biomarkers and the temporal rate of each biomarker. For estimation and inference, we consider a two-step procedure based on integral equations from the proposed model. We propose an algorithm that iterates between the estimation of the link function through splines and the estimation of index parameters and that allows for regularization to achieve sparsity. We prove model identifiability and derive the asymptotic properties of the estimated model parameters. A benefit of our approach is to pool information from multiple subjects to identify the interaction among biomarkers. We apply the method to analyze electroencephalogram (EEG) data for patients affected by alcohol dependence. The results reveal new insight on patients' brain activities and demonstrate differential interaction patterns in patients compared to health control subjects.

The Locus Coeruleus- Norepinephrine System in Stress and Arousal: Unraveling Historical, Current, and Future Perspectives

Arousal may be understood on a spectrum, with excessive sleepiness, cognitive dysfunction, and inattention on one side, a wakeful state in the middle, and hypervigilance, panic, and psychosis on the other side. However, historically, the concepts of arousal and stress have been challenging to define as measurable experimental variables. Divergent efforts to study these subjects have given rise to several disciplines, including neurobiology, neuroendocrinology, and cognitive neuroscience. We discuss technological advancements that chronologically led to our current understanding of the arousal system, focusing on the multifaceted nucleus locus coeruleus. We share our contemporary perspective and the hypotheses of others in the context of our current technological capabilities and future developments that will be required to move forward in this area of research.

Enhanced spatiotemporal resolution imaging of neuronal activity using joint electroencephalography and diffuse optical tomography

Significance: Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) are both commonly used methodologies for neuronal source reconstruction. While EEG has high temporal resolution (millisecond-scale), its spatial resolution is on the order of centimeters. On the other hand, in comparison to EEG, fNIRS, or diffuse optical tomography (DOT), when used for source reconstruction, can achieve relatively high spatial resolution (millimeter-scale), but its temporal resolution is poor because the hemodynamics that it measures evolve on the order of several seconds. This has important neuroscientific implications: e.g., if two spatially close neuronal sources are activated sequentially with only a small temporal separation, single-modal measurements using either EEG or DOT alone would fail to resolve them correctly. Aim: We attempt to address this issue by performing joint EEG and DOT neuronal source reconstruction. Approach: We propose an algorithm that utilizes DOT reconstruction as the spatial prior of EEG reconstruction, and demonstrate the improvements using simulations based on the ICBM152 brain atlas. Results: We show that neuronal sources can be reconstructed with higher spatiotemporal resolution using our algorithm than using either modality individually. Further, we study how the performance of the proposed algorithm can be affected by the locations of the neuronal sources, and how the performance can be enhanced by improving the placement of EEG electrodes and DOT optodes. Conclusions: We demonstrate using simulations that two sources separated by 2.3-3.3 cm and 50 ms can be recovered accurately using the proposed algorithm by suitably combining EEG and DOT, but not by either in isolation. We also show that the performance can be enhanced by optimizing the electrode and optode placement according to the locations of the neuronal sources.

Augmenting interictal mapping with neurovascular coupling biomarkers by structured factorization of epileptic EEG and fMRI data

EEG-correlated fMRI analysis is widely used to detect regional BOLD fluctuations that are synchronized to interictal epileptic discharges, which can provide evidence for localizing the ictal onset zone. However, the typical, asymmetrical and mass-univariate approach cannot capture the inherent, higher order structure in the EEG data, nor multivariate relations in the fMRI data, and it is nontrivial to accurately handle varying neurovascular coupling over patients and brain regions. We aim to overcome these drawbacks in a data-driven manner by means of a novel structured matrix-tensor factorization: the single-subject EEG data (represented as a third-order spectrogram tensor) and fMRI data (represented as a spatiotemporal BOLD signal matrix) are jointly decomposed into a superposition of several sources, characterized by space-time-frequency profiles. In the shared temporal mode, Toeplitz-structured factors account for a spatially specific, neurovascular 'bridge' between the EEG and fMRI temporal fluctuations, capturing the hemodynamic response's variability over brain regions. By analyzing interictal data from twelve patients, we show that the extracted source signatures provide a sensitive localization of the ictal onset zone (10/12). Moreover, complementary parts of the IOZ can be uncovered by inspecting those regions with the most deviant neurovascular coupling, as quantified by two entropy-like metrics of the hemodynamic response function waveforms (9/12). Hence, this multivariate, multimodal factorization provides two useful sets of EEG-fMRI biomarkers, which can assist the presurgical evaluation of epilepsy. We make all code required to perform the computations available at https://github.com/svaneynd/structured-cmtf.

Nonparametric filtering for stochastic nonlinear oscillations

This paper proposes a method of nonparametric filtering for stochastic nonlinear oscillations with particular interest in their derivative estimation. Based on a second-order ordinary differential equation, a stochastic oscillation is modeled by a two-variate stochastic differential equation without specifying the function form of the drift function, where the first variable is assumed to be observable but not the other. Given the discrete time series with observation error, the proposed method enables us to estimate the values of the drift function and its derivatives including those of the unobservable variable. According to the results of numerical experiments to compare estimation accuracy with a parametric method, the proposed method shows better performance in the estimation of nonlinear models.

Detecting brain network communities: Considering the role of information flow and its different temporal scales

The identification of community structure in graphs continues to attract great interest in several fields. Network neuroscience is particularly concerned with this problem considering the key roles communities play in brain processes and functionality. Most methods used for community detection in brain graphs are based on the maximization of a parameter-dependent modularity function that often obscures the physical meaning and hierarchical organization of the partitions of network nodes. In this work, we present a new method able to detect communities at different scales in a natural, unrestricted way. First, to obtain an estimation of the information flow in the network we release random walkers to freely move over it. The activity of the walkers is separated into oscillatory modes by using empirical mode decomposition. After grouping nodes by their co-occurrence at each time scale, k-modes clustering returns the desired partitions. Our algorithm was first tested on benchmark graphs with favorable performance. Next, it was applied to real and simulated anatomical and/or functional connectomes in the macaque and human brains. We found a clear hierarchical repertoire of community structures in both the anatomical and the functional networks. The observed partitions range from the evident division in two hemispheres -in which all processes are managed globally- to specialized communities seemingly shaped by physical proximity and shared function. Additionally, the spatial scales of a network's community structure (characterized by a measure we term within-communities path length) appear inversely proportional to the oscillatory modes' average frequencies. The proportionality constant may constitute a network-specific propagation velocity for the information flow. Our results stimulate the research of hierarchical community organization in terms of temporal scales of information flow in the brain network.

Concurrent electrophysiological and hemodynamic measurements of evoked neural oscillations in human visual cortex using sparsely interleaved fast fMRI and EEG

Electroencephalography (EEG) concurrently collected with functional magnetic resonance imaging (fMRI) is heavily distorted by the repetitive gradient coil switching during the fMRI acquisition. The performance of the typical template-based gradient artifact suppression method can be suboptimal because the artifact changes over time. Gradient artifact residuals also impede the subsequent suppression of ballistocardiography artifacts. Here we propose recording continuous EEG with temporally sparse fast fMRI (fast fMRI-EEG) to minimize the EEG artifacts caused by MRI gradient coil switching without significantly compromising the field-of-view and spatiotemporal resolution of fMRI. Using simultaneous multi-slice inverse imaging to achieve whole-brain fMRI with isotropic 5-mm resolution in 0.1 ​s, and performing these acquisitions once every 2 ​s, we have 95% of the duty cycle available to record EEG with substantially less gradient artifact. We found that the standard deviation of EEG signals over the entire acquisition period in fast fMRI-EEG was reduced to 54% of that in conventional concurrent echo-planar imaging (EPI) and EEG recordings (EPI-EEG) across participants. When measuring 15-Hz steady-state visual evoked potentials (SSVEPs), the baseline-normalized oscillatory neural response in fast fMRI-EEG was 2.5-fold of that in EPI-EEG. The functional MRI responses associated with the SSVEP delineated by EPI and fast fMRI were similar in the spatial distribution, the elicited waveform, and detection power. Sparsely interleaved fast fMRI-EEG provides high-quality EEG without substantially compromising the quality of fMRI in evoked response measurements, and has the potential utility for applications where the onset of the target stimulus cannot be precisely determined, such as epilepsy.

Extraction of Common Task Features in EEG-fMRI Data Using Coupled Tensor-Tensor Decomposition

The fusion of simultaneously recorded EEG and fMRI data is of great value to neuroscience research due to the complementary properties of the individual modalities. Traditionally, techniques such as PCA and ICA, which rely on strong non-physiological assumptions such as orthogonality and statistical independence, have been used for this purpose. Recently, tensor decomposition techniques such as parallel factor analysis have gained more popularity in neuroimaging applications as they are able to inherently contain the multidimensionality of neuroimaging data and achieve uniqueness in decomposition without making strong assumptions. Previously, the coupled matrix-tensor decomposition (CMTD) has been applied for the fusion of the EEG and fMRI. Only recently the coupled tensor-tensor decomposition (CTTD) has been proposed. Here for the first time, we propose the use of CTTD of a 4th order EEG tensor (space, time, frequency, and participant) and 3rd order fMRI tensor (space, time, participant), coupled partially in time and participant domains, for the extraction of the task related features in both modalities. We used both the sensor-level and source-level EEG for the coupling. The phase shifted paradigm signals were incorporated as the temporal initializers of the CTTD to extract the task related features. The validation of the approach is demonstrated on simultaneous EEG-fMRI recordings from six participants performing an N-Back memory task. The EEG and fMRI tensors were coupled in 9 components out of which seven components had a high correlation (more than 0.85) with the task. The result of the fusion recapitulates the well-known attention network as being positively, and the default mode network working negatively time-locked to the memory task.

Neurophysiological Hallmarks of Neurodegenerative Cognitive Decline: The Study of Brain Connectivity as A Biomarker of Early Dementia

Neurodegenerative processes of various types of dementia start years before symptoms, but the presence of a "neural reserve", which continuously feeds and supports neuroplastic mechanisms, helps the aging brain to preserve most of its functions within the "normality" frame. Mild cognitive impairment (MCI) is an intermediate stage between dementia and normal brain aging. About 50% of MCI subjects are already in a stage that is prodromal-to-dementia and during the following 3 to 5 years will develop clinically evident symptoms, while the other 50% remains at MCI or returns to normal. If the risk factors favoring degenerative mechanisms are modified during early stages (i.e., in the prodromal), the degenerative process and the loss of abilities in daily living activities will be delayed. It is therefore extremely important to have biomarkers able to identify-in association with neuropsychological tests-prodromal-to-dementia MCI subjects as early as possible. MCI is a large (i.e., several million in EU) and substantially healthy population; therefore, biomarkers should be financially affordable, largely available and non-invasive, but still accurate in their diagnostic prediction. Neurodegeneration initially affects synaptic transmission and brain connectivity; methods exploring them would represent a 1st line screening. Neurophysiological techniques able to evaluate mechanisms of synaptic function and brain connectivity are attracting general interest and are described here. Results are quite encouraging and suggest that by the application of artificial intelligence (i.e., learning-machine), neurophysiological techniques represent valid biomarkers for screening campaigns of the MCI population.

Modeling functional resting-state brain networks through neural message passing on the human connectome

In this work, we propose a natural model for information flow in the brain through a neural message-passing dynamics on a structural network of macroscopic regions, such as the human connectome (HC). In our model, each brain region is assumed to have a binary behavior (active or not), the strengths of interactions among them are encoded in the anatomical connectivity matrix defined by the HC, and the dynamics of the system is defined by the Belief Propagation (BP) algorithm, working near the critical point of the network. We show that in the absence of direct external stimuli the BP algorithm converges to a spatial map of activations that is similar to the Default Mode Network (DMN) of the brain, which has been defined from the analysis of functional MRI data. Moreover, we use Susceptibility Propagation (SP) to compute the matrix of long-range correlations between the different regions and show that the modules defined by a clustering of this matrix resemble several Resting State Networks (RSN) determined experimentally. Both results suggest that the functional DMN and RSNs can be seen as simple consequences of the anatomical structure of the brain and a neural message-passing dynamics between macroscopic regions. With the new model, we explore predictions on how functional maps change when the anatomical brain network suffers structural alterations, like in Alzheimer's disease and in lesions of the Corpus Callosum. The implications and novel interpretations suggested by the model, as well as the role of criticality, are discussed.

An Age-Adjusted EEG Source Classifier Accurately Detects School-Aged Barbadian Children That Had Protein Energy Malnutrition in the First Year of Life

We have identified an electroencephalographic (EEG) based statistical classifier that correctly distinguishes children with histories of Protein Energy Malnutrition (PEM) in the first year of life from healthy controls with 0.82% accuracy (area under the ROC curve). Our previous study achieved similar accuracy but was based on scalp quantitative EEG features that precluded anatomical interpretation. We have now employed BC-VARETA, a novel high-resolution EEG source imaging method with minimal leakage and maximal sparseness, which allowed us to identify a classifier in the source space. The EEGs were recorded in 1978 in a sample of 108 children who were 5-11 years old and were participants in the 45+ year longitudinal Barbados Nutrition Study. The PEM cohort experienced moderate-severe PEM limited to the first year of life and were age, handedness and gender-matched with healthy classmates who served as controls. In the current study, we utilized a machine learning approach based on the elastic net to create a stable sparse classifier. Interestingly, the classifier was driven predominantly by nutrition group differences in alpha activity in the lingual gyrus. This structure is part of the pathway associated with generating alpha rhythms that increase with normal maturation. Our findings indicate that the PEM group showed a significant decrease in alpha activity, suggestive of a delay in brain development. Childhood malnutrition is still a serious worldwide public health problem and its consequences are particularly severe when present during early life. Deficits during this critical period are permanent and predict impaired cognitive and behavioral functioning later in life. Our EEG source classifier may provide a functionally interpretable diagnostic technology to study the effects of early childhood malnutrition on the brain, and may have far-reaching applicability in low resource settings.

Next-generation neural mass and field modeling

The Wilson-Cowan population model of neural activity has greatly influenced our understanding of the mechanisms for the generation of brain rhythms and the emergence of structured brain activity. As well as the many insights that have been obtained from its mathematical analysis, it is now widely used in the computational neuroscience community for building large-scale in silico brain networks that can incorporate the increasing amount of knowledge from the Human Connectome Project. Here, we consider a neural population model in the spirit of that originally developed by Wilson and Cowan, albeit with the added advantage that it can account for the phenomena of event-related synchronization and desynchronization. This derived mean-field model provides a dynamic description for the evolution of synchrony, as measured by the Kuramoto order parameter, in a large population of quadratic integrate-and-fire model neurons. As in the original Wilson-Cowan framework, the population firing rate is at the heart of our new model; however, in a significant departure from the sigmoidal firing rate function approach, the population firing rate is now obtained as a real-valued function of the complex-valued population synchrony measure. To highlight the usefulness of this next-generation Wilson-Cowan style model, we deploy it in a number of neurobiological contexts, providing understanding of the changes in power spectra observed in electro- and magnetoencephalography neuroimaging studies of motor cortex during movement, insights into patterns of functional connectivity observed during rest and their disruption by transcranial magnetic stimulation, and to describe wave propagation across cortex.

Multimodal Neuroimaging: Basic Concepts and Classification of Neuropsychiatric Diseases

Neuroimaging techniques are widely used in neuroscience to visualize neural activity, to improve our understanding of brain mechanisms, and to identify biomarkers-especially for psychiatric diseases; however, each neuroimaging technique has several limitations. These limitations led to the development of multimodal neuroimaging (MN), which combines data obtained from multiple neuroimaging techniques, such as electroencephalography, functional magnetic resonance imaging, and yields more detailed information about brain dynamics. There are several types of MN, including visual inspection, data integration, and data fusion. This literature review aimed to provide a brief summary and basic information about MN techniques (data fusion approaches in particular) and classification approaches. Data fusion approaches are generally categorized as asymmetric and symmetric. The present review focused exclusively on studies based on symmetric data fusion methods (data-driven methods), such as independent component analysis and principal component analysis. Machine learning techniques have recently been introduced for use in identifying diseases and biomarkers of disease. The machine learning technique most widely used by neuroscientists is classification-especially support vector machine classification. Several studies differentiated patients with psychiatric diseases and healthy controls with using combined datasets. The common conclusion among these studies is that the prediction of diseases increases when combining data via MN techniques; however, there remain a few challenges associated with MN, such as sample size. Perhaps in the future N-way fusion can be used to combine multiple neuroimaging techniques or nonimaging predictors (eg, cognitive ability) to overcome the limitations of MN.

Integrating Space, Time, and Orientation in Spiking Neural Networks: A Case Study on Multimodal Brain Data Modeling

Recent progress in a noninvasive brain data sampling technology has facilitated simultaneous sampling of multiple modalities of brain data, such as functional magnetic resonance imaging, electroencephalography, diffusion tensor imaging, and so on. In spite of the potential benefits from integrating predictive modeling of multiple modality brain data, this area of research remains mostly unexplored due to a lack of methodological advancements. The difficulty in fusing multiple modalities of brain data within a single model lies in the heterogeneous temporal and spatial characteristics of the data sources. Recent advances in spiking neural network systems, however, provide the flexibility to incorporate multidimensional information within the model. This paper proposes a novel, unsupervised learning algorithm for fusing temporal, spatial, and orientation information in a spiking neural network architecture that could potentially be used to understand and perform predictive modeling using multimodal data. The proposed algorithm is evaluated both qualitatively and quantitatively using synthetically generated data to characterize its behavior and its ability to utilize spatial, temporal, and orientation information within the model. This leads to improved pattern recognition capabilities and performance along with robust interpretability of the brain data. Furthermore, a case study is presented, which aims to build a computational model that discriminates between people with schizophrenia who respond or do not respond to monotherapy with the antipsychotic clozapine.

Adaptive and Wireless Recordings of Electrophysiological Signals During Concurrent Magnetic Resonance Imaging

Strong electromagnetic fields that occur during functional magnetic resonance imaging (fMRI) presents a challenging environment for concurrent electrophysiological recordings. Here, we present a miniaturized, wireless platform-"MR-Link" (Multimodal Recording Link) that provides a hardware solution for simultaneous electrophysiological and fMRI signal acquisition. The device detects the changes in the electromagnetic field during fMRI to synchronize amplification and sampling of electrophysiological signals with minimal artifacts. It wirelessly transmits the recorded data at a frequency detectable by the MR-receiver coil. The transmitted data is readily separable from MRI in the frequency domain. To demonstrate its efficacy, we used this device to record electrocardiograms and somatosensory evoked potential during concurrent fMRI scans. The device minimized the fMRI-induced artifacts in electrophysiological data and wirelessly transmitted the data back to the receiver coil without compromising the fMRI signal quality. The device is compact (22 mm dia., 2 gms) and can be placed within the MRI bore to precisely synchronize with fMRI. Therefore, MR-Link offers an inexpensive system by eliminating the need for amplifiers with a high dynamic range, high-speed sampling, additional storage, or synchronization hardware for electrophysiological signal acquisition. It is expected to enable a broader range of applications of simultaneous fMRI and electrophysiology in animals and humans.

Spectrum of connectivity fluctuations including the effect of activity-dependent feedback

The spatiotemporal spectrum of feedback-driven fluctuations of brain connectivity is investigated using nonlinear neural field theory of the corticothalamic system. Weakly nonlinear dynamics of neural feedbacks are expanded in terms of first order perturbations of neural activity relative to a fixed point. Susceptibilities are used to quantify the change in connectivity per unit change in presynaptic or postsynaptic activity caused by nonlinear feedbacks such as facilitation, depression, sensitization, potentiation, and the effects of discrete eigenmode structure are included for a spherical brain geometry. Spectral signatures such as resonances are identified that allow the presence of particular presynaptic and postsynaptic feedback effects to be inferred. These include additional resonances at high frequencies and shifts of existing spectral peaks, mostly visible in the lowest spatial modes of the response.

Neuroscience Information Toolbox: An Open Source Toolbox for EEG-fMRI Multimodal Fusion Analysis

Recently, scalp electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) multimodal fusion has been pursued in an effort to study human brain function and dysfunction to obtain more comprehensive information on brain activity in which the spatial and temporal resolutions are both satisfactory. However, a more flexible and easy-to-use toolbox for EEG–fMRI multimodal fusion is still lacking. In this study, we therefore developed a freely available and open-source MATLAB graphical user interface toolbox, known as the Neuroscience Information Toolbox (NIT), for EEG–fMRI multimodal fusion analysis. The NIT consists of three modules: (1) the fMRI module, which has batch fMRI preprocessing, nuisance signal removal, bandpass filtering, and calculation of resting-state measures; (2) the EEG module, which includes artifact removal, extracting EEG features (event onset, power, and amplitude), and marking interesting events; and (3) the fusion module, in which fMRI-informed EEG analysis and EEG-informed fMRI analysis are included. The NIT was designed to provide a convenient and easy-to-use toolbox for researchers, especially for novice users. The NIT can be downloaded for free at http://www.neuro.uestc.edu.cn/NIT.html, and detailed information, including the introduction of NIT, user’s manual and example data sets, can also be observed on this website. We hope that the NIT is a promising toolbox for exploring brain information in various EEG and fMRI studies.

Design of optimal nonlinear network controllers for Alzheimer's disease

Brain stimulation can modulate the activity of neural circuits impaired by Alzheimer’s disease (AD), having promising clinical benefit. However, all individuals with the same condition currently receive identical brain stimulation, with limited theoretical basis for this generic approach. In this study, we introduce a control theory framework for obtaining exogenous signals that revert pathological electroencephalographic activity in AD at a minimal energetic cost, while reflecting patients’ biological variability. We used anatomical networks obtained from diffusion magnetic resonance images acquired by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) as mediators for the interaction between Duffing oscillators. The nonlinear nature of the brain dynamics is preserved, given that we extend the so-called state-dependent Riccati equation control to reflect the stimulation objective in the high-dimensional neural system. By considering nonlinearities in our model, we identified regions for which control inputs fail to correct abnormal activity. There are changes to the way stimulated regions are ranked in terms of the energetic cost of controlling the entire network, from a linear to a nonlinear approach. We also found that limbic system and basal ganglia structures constitute the top target locations for stimulation in AD. Patients with highly integrated anatomical networks–namely, networks having low average shortest path length, high global efficiency–are the most suitable candidates for the propagation of stimuli and consequent success on the control task. Other diseases associated with alterations in brain dynamics and the self-control mechanisms of the brain can be addressed through our framework.

This work aims to close the knowledge gap between theory and experiment in brain stimulation. Previous modeling approaches for stimulation have overlooked the nonlinear dynamical nature of the brain and failed to shed light on efficient mechanisms for the exogenous control of the brain. Amid the current efforts for developing personalized medicine, we introduce a framework for producing tailored stimulation signals, based on individual neuroimaging data and innovative modeling. This is the first time, to our knowledge, that brain stimulation for the most common cause of dementia, Alzheimer’s disease, is theoretically addressed. Our approach leads to the identification of potential target regions and subjects to successfully respond to brain stimulation therapies and yields various disease-reverting signals. Although focused on Alzheimer’s in this study, our methodology could be applied to other clinical conditions characterized by abnormalities in brain dynamics, like epilepsy and Parkinson’s, the treatment of which can benefit from the use of optimal control strategies.

Adaptive optimal input design and parametric estimation of nonlinear dynamical systems: application to neuronal modeling

OBJECTIVE

Many physical models of biological processes including neural systems are characterized by parametric nonlinear dynamical relations between driving inputs, internal states, and measured outputs of the process. Fitting such models using experimental data (data assimilation) is a challenging task since the physical process often operates in a noisy, possibly non-stationary environment; moreover, conducting multiple experiments under controlled and repeatable conditions can be impractical, time consuming or costly. The accuracy of model identification, therefore, is dictated principally by the quality and dynamic richness of collected data over single or few experimental sessions. Accordingly, it is highly desirable to design efficient experiments that, by exciting the physical process with smart inputs, yields fast convergence and increased accuracy of the model.

APPROACH

We herein introduce an adaptive framework in which optimal input design is integrated with square root cubature Kalman filters (OID-SCKF) to develop an online estimation procedure that first, converges significantly quicker, thereby permitting model fitting over shorter time windows, and second, enhances model accuracy when only few process outputs are accessible. The methodology is demonstrated on common nonlinear models and on a four-area neural mass model with noisy and limited measurements. Estimation quality (speed and accuracy) is benchmarked against high-performance SCKF-based methods that commonly employ dynamically rich informed inputs for accurate model identification.

MAIN RESULTS

For all the tested models, simulated single-trial and ensemble averages showed that OID-SCKF exhibited (i) faster convergence of parameter estimates and (ii) lower dependence on inter-trial noise variability with gains up to around 1000 ms in speed and 81% increase in variability for the neural mass models. In terms of accuracy, OID-SCKF estimation was superior, and exhibited considerably less variability across experiments, in identifying model parameters of (a) systems with challenging model inversion dynamics and (b) systems with fewer measurable outputs that directly relate to the underlying processes.

SIGNIFICANCE

Fast and accurate identification therefore carries particular promise for modeling of transient (short-lived) neuronal network dynamics using a spatially under-sampled set of noisy measurements, as is commonly encountered in neural engineering applications.

Multimodal approaches to functional connectivity in autism spectrum disorders: An integrative perspective

Atypical functional connectivity has been implicated in autism spectrum disorders (ASDs). However, the literature to date has been largely inconsistent, with mixed and conflicting reports of hypo- and hyper-connectivity. These discrepancies are partly due to differences between various neuroimaging modalities. Functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and magnetoencephalography (MEG) measure distinct indices of functional connectivity (e.g., blood-oxygenation level-dependent [BOLD] signal vs. electrical activity). Furthermore, each method has unique benefits and disadvantages with respect to spatial and temporal resolution, vulnerability to specific artifacts, and practical implementation. Thus far, functional connectivity research on ASDs has remained almost exclusively unimodal; therefore, interpreting findings across modalities remains a challenge. Multimodal integration of fMRI, EEG, and MEG data is critical in resolving discrepancies in the literature, and working toward a unifying framework for interpreting past and future findings. This review aims to provide a theoretical foundation for future multimodal research on ASDs. First, we will discuss the merits and shortcomings of several popular theories in ASD functional connectivity research, using examples from the literature to date. Next, the neurophysiological relationships between imaging modalities, including their relationship with invasive neural recordings, will be reviewed. Finally, methodological approaches to multimodal data integration will be presented, and their future application to ASDs will be discussed. Analyses relating transient patterns of neural activity ("states") are particularly promising. This strategy provides a comparable measure across modalities, captures complex spatiotemporal patterns, and is a natural extension of recent dynamic fMRI research in ASDs. © 2017 Wiley Periodicals, Inc. Develop Neurobiol 78: 456-473, 2018.

EEG-Informed fMRI: A Review of Data Analysis Methods

The simultaneous acquisition of electroencephalography (EEG) with functional magnetic resonance imaging (fMRI) is a very promising non-invasive technique for the study of human brain function. Despite continuous improvements, it remains a challenging technique, and a standard methodology for data analysis is yet to be established. Here we review the methodologies that are currently available to address the challenges at each step of the data analysis pipeline. We start by surveying methods for pre-processing both EEG and fMRI data. On the EEG side, we focus on the correction for several MR-induced artifacts, particularly the gradient and pulse artifacts, as well as other sources of EEG artifacts. On the fMRI side, we consider image artifacts induced by the presence of EEG hardware inside the MR scanner, and the contamination of the fMRI signal by physiological noise of non-neuronal origin, including a review of several approaches to model and remove it. We then provide an overview of the approaches specifically employed for the integration of EEG and fMRI when using EEG to predict the blood oxygenation level dependent (BOLD) fMRI signal, the so-called EEG-informed fMRI integration strategy, the most commonly used strategy in EEG-fMRI research. Finally, we systematically review methods used for the extraction of EEG features reflecting neuronal phenomena of interest.

Inferring multi-scale neural mechanisms with brain network modelling

The neurophysiological processes underlying non-invasive brain activity measurements are incompletely understood. Here, we developed a connectome-based brain network model that integrates individual structural and functional data with neural population dynamics to support multi-scale neurophysiological inference. Simulated populations were linked by structural connectivity and, as a novelty, driven by electroencephalography (EEG) source activity. Simulations not only predicted subjects' individual resting-state functional magnetic resonance imaging (fMRI) time series and spatial network topologies over 20 minutes of activity, but more importantly, they also revealed precise neurophysiological mechanisms that underlie and link six empirical observations from different scales and modalities: (1) resting-state fMRI oscillations, (2) functional connectivity networks, (3) excitation-inhibition balance, (4, 5) inverse relationships between α-rhythms, spike-firing and fMRI on short and long time scales, and (6) fMRI power-law scaling. These findings underscore the potential of this new modelling framework for general inference and integration of neurophysiological knowledge to complement empirical studies.

Neuroscientists can use various techniques to measure activity within the brain without opening up the skull. One of the most common is electroencephalography, or EEG for short. A net of electrodes is attached to the scalp and reveals the patterns of electrical activity occurring in brain tissue. But while EEG is good at revealing electrical activity across the surface of the scalp, it is less effective at linking the observed activity to specific locations in the brain.

Another widely used technique is functional magnetic resonance imaging, or fMRI. A patient, or healthy volunteer, lies inside a scanner containing a large magnet. The scanner tracks changes in the level of oxygen at different regions of the brain to provide a measure of how the activity of these regions changes over time. In contrast to EEG, fMRI is good at pinpointing the location of brain activity, but it is an indirect measure of brain activity as it depends on blood flow and several other factors. In terms of understanding how the brain works, EEG and fMRI thus provide different pieces of the puzzle. But there is no easy way to fit these pieces together.

Other areas of science have used computer models to merge different sources of data to obtain new insights into complex processes. Schirner et al. now adopt this approach to reveal the workings of the brain that underly signals like EEG and fMRI.

After recording structural MRI data from healthy volunteers, Schirner et al. built a computer model of each person’s brain. They then ran simulations with each individual model stimulating it with the person’s EEG to predict the fMRI activity of the same individual. Comparing these predictions with real fMRI data collected at the same time as the EEG confirmed that the predictions were accurate. Importantly, the brain models also displayed many features of neural activity that previously could only be measured by implanting electrodes into the brain.

This new approach provides a way of combining experimental data with theories about how the nervous system works. The resulting models can help generate and test ideas about the mechanisms underlying brain activity. Building models of different brains based on data from individual people could also help reveal the biological basis of differences between individuals. This could in turn provide insights into why some individuals are more vulnerable to certain brain diseases and open up new ways to treat these diseases.

Determining Excitatory and Inhibitory Neuronal Activity from Multimodal fMRI Data Using a Generative Hemodynamic Model

Hemodynamic responses, in general, and the blood oxygenation level-dependent (BOLD) fMRI signal, in particular, provide an indirect measure of neuronal activity. There is strong evidence that the BOLD response correlates well with post-synaptic changes, induced by changes in the excitatory and inhibitory (E-I) balance between active neuronal populations. Typical BOLD responses exhibit transients, such as the early-overshoot and post-stimulus undershoot, that can be linked to transients in neuronal activity, but they can also result from vascular uncoupling between cerebral blood flow (CBF) and venous cerebral blood volume (venous CBV). Recently, we have proposed a novel generative hemodynamic model of the BOLD signal within the dynamic causal modeling framework, inspired by physiological observations, called P-DCM (Havlicek et al., 2015). We demonstrated the generative model's ability to more accurately model commonly observed neuronal and vascular transients in single regions but also effective connectivity between multiple brain areas (Havlicek et al., 2017b). In this paper, we additionally demonstrate the versatility of the generative model to jointly explain dynamic relationships between neuronal and hemodynamic physiological variables underlying the BOLD signal using multi-modal data. For this purpose, we utilized three distinct data-sets of experimentally induced responses in the primary visual areas measured in human, cat, and monkey brain, respectively: (1) CBF and BOLD responses; (2) CBF, total CBV, and BOLD responses (Jin and Kim, 2008); and (3) positive and negative neuronal and BOLD responses (Shmuel et al., 2006). By fitting the generative model to the three multi-modal experimental data-sets, we showed that the presence or absence of dynamic features in the BOLD signal is not an unambiguous indication of presence or absence of those features on the neuronal level. Nevertheless, the generative model that takes into account the dynamics of the physiological mechanisms underlying the BOLD response allowed dissociating neuronal from vascular transients and deducing excitatory and inhibitory neuronal activity time-courses from BOLD data alone and from multi-modal data.

Quantifying the Interaction and Contribution of Multiple Datasets in Fusion: Application to the Detection of Schizophrenia

The extraction of information from multiple sets of data is a problem inherent to many disciplines. This is possible by either analyzing the data sets jointly as in data fusion or separately and then combining as in data integration. However, selecting the optimal method to combine and analyze multiset data is an ever-present challenge. The primary reason for this is the difficulty in determining the optimal contribution of each data set to an analysis as well as the amount of potentially exploitable complementary information among data sets. In this paper, we propose a novel classification rate-based technique to unambiguously quantify the contribution of each data set to a fusion result as well as facilitate direct comparisons of fusion methods on real data and apply a new method, independent vector analysis (IVA), to multiset fusion. This classification rate-based technique is used on functional magnetic resonance imaging data collected from 121 patients with schizophrenia and 150 healthy controls during the performance of three tasks. Through this application, we find that though optimal performance is achieved by exploiting all tasks, each task does not contribute equally to the result and this framework enables effective quantification of the value added by each task. Our results also demonstrate that data fusion methods are more powerful than data integration methods, with the former achieving a classification rate of 73.5 % and the latter achieving one of 70.9 %, a difference which we show is significant when all three tasks are analyzed together. Finally, we show that IVA, due to its flexibility, has equivalent or superior performance compared with the popular data fusion method, joint independent component analysis.