Incorporating priors for EEG source imaging and connectivity analysis

The applied principles of EEG analysis methods in neuroscience and clinical neurology

Electroencephalography (EEG) is a non-invasive measurement method for brain activity. Due to its safety, high resolution, and hypersensitivity to dynamic changes in brain neural signals, EEG has aroused much interest in scientific research and medical fields. This article reviews the types of EEG signals, multiple EEG signal analysis methods, and the application of relevant methods in the neuroscience field and for diagnosing neurological diseases. First, three types of EEG signals, including time-invariant EEG, accurate event-related EEG, and random event-related EEG, are introduced. Second, five main directions for the methods of EEG analysis, including power spectrum analysis, time-frequency analysis, connectivity analysis, source localization methods, and machine learning methods, are described in the main section, along with different sub-methods and effect evaluations for solving the same problem. Finally, the application scenarios of different EEG analysis methods are emphasized, and the advantages and disadvantages of similar methods are distinguished. This article is expected to assist researchers in selecting suitable EEG analysis methods based on their research objectives, provide references for subsequent research, and summarize current issues and prospects for the future.

High-dimensional multivariate autoregressive model estimation of human electrophysiological data using fMRI priors

Multivariate autoregressive (MVAR) model estimation enables assessment of causal interactions in brain networks. However, accurately estimating MVAR models for high-dimensional electrophysiological recordings is challenging due to the extensive data requirements. Hence, the applicability of MVAR models for study of brain behavior over hundreds of recording sites has been very limited. Prior work has focused on different strategies for selecting a subset of important MVAR coefficients in the model to reduce the data requirements of conventional least-squares estimation algorithms. Here we propose incorporating prior information, such as resting state functional connectivity derived from functional magnetic resonance imaging, into MVAR model estimation using a weighted group least absolute shrinkage and selection operator (LASSO) regularization strategy. The proposed approach is shown to reduce data requirements by a factor of two relative to the recently proposed group LASSO method of Endemann et al (Neuroimage 254:119057, 2022) while resulting in models that are both more parsimonious and more accurate. The effectiveness of the method is demonstrated using simulation studies of physiologically realistic MVAR models derived from intracranial electroencephalography (iEEG) data. The robustness of the approach to deviations between the conditions under which the prior information and iEEG data is obtained is illustrated using models from data collected in different sleep stages. This approach allows accurate effective connectivity analyses over short time scales, facilitating investigations of causal interactions in the brain underlying perception and cognition during rapid transitions in behavioral state.

A revisit of the amygdala theory of autism: Twenty years after

The human amygdala has long been implicated to play a key role in autism spectrum disorder (ASD). Yet it remains unclear to what extent the amygdala accounts for the social dysfunctions in ASD. Here, we review studies that investigate the relationship between amygdala function and ASD. We focus on studies that employ the same task and stimuli to directly compare people with ASD and patients with focal amygdala lesions, and we also discuss functional data associated with these studies. We show that the amygdala can only account for a limited number of deficits in ASD (primarily face perception tasks but not social attention tasks), a network view is, therefore, more appropriate. We next discuss atypical brain connectivity in ASD, factors that can explain such atypical brain connectivity, and novel tools to analyze brain connectivity. Lastly, we discuss new opportunities from multimodal neuroimaging with data fusion and human single-neuron recordings that can enable us to better understand the neural underpinnings of social dysfunctions in ASD. Together, the influential amygdala theory of autism should be extended with emerging data-driven scientific discoveries such as machine learning-based surrogate models to a broader framework that considers brain connectivity at the global scale.

Simultaneous electroencephalography-functional magnetic resonance imaging for assessment of human brain function

Electroencephalography (EEG) and functional Magnetic Resonance Imaging (MRI) have long been used as tools to examine brain activity. Since both methods are very sensitive to changes of synaptic activity, simultaneous recording of EEG and fMRI can provide both high temporal and spatial resolution. Therefore, the two modalities are now integrated into a hybrid tool, EEG-fMRI, which encapsulates the useful properties of the two. Among other benefits, EEG-fMRI can contribute to a better understanding of brain connectivity and networks. This review lays its focus on the methodologies applied in performing EEG-fMRI studies, namely techniques used for the recording of EEG inside the scanner, artifact removal, and statistical analysis of the fMRI signal. We will investigate simultaneous resting-state and task-based EEG-fMRI studies and discuss their clinical and technological perspectives. Moreover, it is established that the brain regions affected by a task-based neural activity might not be limited to the regions in which they have been initiated. Advanced methods can help reveal the regions responsible for or affected by a developed neural network. Therefore, we have also looked into studies related to characterization of structure and dynamics of brain networks. The reviewed literature suggests that EEG-fMRI can provide valuable complementary information about brain neural networks and functions.

Granger Causality Inference in EEG Source Connectivity Analysis: A State-Space Approach

This article addresses the problem of estimating brain effective connectivity from electroencephalogram (EEG) signals using a Granger causality (GC) characterized on state-space models, extended from the conventional vector autoregressive (VAR) process. The scheme involves two main steps: model estimation and model inference to estimate brain connectivity. The model estimation performs a subspace identification and active source selection based on group-norm regularized least-squares. The model inference relies on the concept of state-space GC that requires solving a Riccati equation for the covariance of estimation error. We verify the performance on simulated datasets that represent realistic human brain activities under several conditions, including percentages and location of active sources, and the number of EEG electrodes. Our model's accuracy in estimating connectivity is compared with a two-stage approach using source reconstructions and a VAR-based Granger analysis. Our method achieved better performances than the two-stage approach under the assumptions that the true source dynamics are sparse and generated from state-space models. When the method was applied to a real EEG SSVEP dataset, the temporal lobe was found to be a mediating connection between the temporal and occipital areas, which agreed with findings in previous studies.

Optimizing EEG Source Reconstruction with Concurrent fMRI-Derived Spatial Priors

Reconstructing EEG sources involves a complex pipeline, with the inverse problem being the most challenging. Multiple inversion algorithms are being continuously developed, aiming to tackle the non-uniqueness of this problem, which has been shown to be partially circumvented by including prior information in the inverse models. Despite a few efforts, there are still current and persistent controversies regarding the inversion algorithm of choice and the optimal set of spatial priors to be included in the inversion models. The use of simultaneous EEG-fMRI data is one approach to tackle this problem. The spatial resolution of fMRI makes fMRI derived spatial priors very convenient for EEG reconstruction, however, only task activation maps and resting-state networks (RSNs) have been explored so far, overlooking the recent, but already accepted, notion that brain networks exhibit dynamic functional connectivity fluctuations. The lack of a systematic comparison between different source reconstruction algorithms, considering potentially more brain-informative priors such as fMRI, motivates the search for better reconstruction models. Using simultaneous EEG-fMRI data, here we compared four different inversion algorithms (minimum norm, MN; low resolution electromagnetic tomography, LORETA; empirical Bayes beamformer, EBB; and multiple sparse priors, MSP) under a Bayesian framework (as implemented in SPM), each with three different sets of priors consisting of: (1) those specific to the algorithm; (2) those specific to the algorithm plus fMRI task activation maps and RSNs; and (3) those specific to the algorithm plus fMRI task activation maps and RSNs and network modules of task-related dFC states estimated from the dFC fluctuations. The quality of the reconstructed EEG sources was quantified in terms of model-based metrics, namely the expectation of the posterior probability P(model|data) and variance explained of the inversion models, and the overlap/proportion of brain regions known to be involved in the visual perception tasks that the participants were submitted to, and RSN templates, with/within EEG source components. Model-based metrics suggested that model parsimony is preferred, with the combination MSP and priors specific to this algorithm exhibiting the best performance. However, optimal overlap/proportion values were found using EBB and priors specific to this algorithm and fMRI task activation maps and RSNs or MSP and considering all the priors (algorithm priors, fMRI task activation maps and RSNs and dFC state modules), respectively, indicating that fMRI spatial priors, including dFC state modules, might contain useful information to recover EEG source components reflecting neuronal activity of interest. Our main results show that providing fMRI spatial derived priors that reflect the dynamics of the brain might be useful to map neuronal activity more accurately from EEG-fMRI. Furthermore, this work paves the way towards a more informative selection of the optimal EEG source reconstruction approach, which may be critical in future studies.

Structure supports function: Informing directed and dynamic functional connectivity with anatomical priors

The dynamic repertoire of functional brain networks is constrained by the underlying topology of structural connections. Despite this intrinsic relationship between structural connectivity (SC) and functional connectivity (FC), integrative and multimodal approaches to combine the two remain limited. Here, we propose a new adaptive filter for estimating dynamic and directed FC using structural connectivity information as priors. We tested the filter in rat epicranial recordings and human event-related EEG data, using SC priors from a meta-analysis of tracer studies and diffusion tensor imaging metrics, respectively. We show that, particularly under conditions of low signal-to-noise ratio, SC priors can help to refine estimates of directed FC, promoting sparse functional networks that combine information from structure and function. In addition, the proposed filter provides intrinsic protection against SC-related false negatives, as well as robustness against false positives, representing a valuable new tool for multimodal imaging in the context of dynamic and directed FC analysis.

Bridging M/EEG Source Imaging and Independent Component Analysis Frameworks Using Biologically Inspired Sparsity Priors

Electromagnetic source imaging (ESI) and independent component analysis (ICA) are two popular and apparently dissimilar frameworks for M/EEG analysis. This letter shows that the two frameworks can be linked by choosing biologically inspired source sparsity priors. We demonstrate that ESI carried out by the sparse Bayesian learning (SBL) algorithm yields source configurations composed of a few active regions that are also maximally independent from one another. In addition, we extend the standard SBL approach to source imaging in two important directions. First, we augment the generative model of M/EEG to include artifactual sources. Second, we modify SBL to allow for efficient model inversion with sequential data. We refer to this new algorithm as recursive SBL (RSBL), a source estimation filter with potential for online and offline imaging applications. We use simulated data to verify that RSBL can accurately estimate and demix cortical and artifactual sources under different noise conditions. Finally, we show that on real error-related EEG data, RSBL can yield single-trial source estimates in agreement with the experimental literature. Overall, by demonstrating that ESI can produce maximally independent sources while simultaneously localizing them in cortical space, we bridge the gap between the ESI and ICA frameworks for M/EEG analysis.

EEG hyperscanning in motor rehabilitation: a position paper

Studying the human brain during interpersonal interaction allows us to answer many questions related to motor control and cognition. For instance, what happens in the brain when two people walking side by side begin to change their gait and match cadences? Adapted from the neuroimaging techniques used in single-brain measurements, hyperscanning (HS) is a technique used to measure brain activity from two or more individuals simultaneously. Thus far, HS has primarily focused on healthy participants during social interactions in order to characterize inter-brain dynamics. Here, we advocate for expanding the use of this electroencephalography hyperscanning (EEG-HS) technique to rehabilitation paradigms in individuals with neurological diagnoses, namely stroke, spinal cord injury (SCI), Parkinson's disease (PD), and traumatic brain injury (TBI). We claim that EEG-HS in patient populations with impaired motor function is particularly relevant and could provide additional insight on neural dynamics, optimizing rehabilitation strategies for each individual patient. In addition, we discuss future technologies related to EEG-HS that could be developed for use in the clinic as well as technical limitations to be considered in these proposed settings.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Source imaging of deep-brain activity using the regional spatiotemporal Kalman filter

BACKGROUND AND OBJECTIVE

The human brain displays rich and complex patterns of interaction within and among brain networks that involve both cortical and subcortical brain regions. Due to the limited spatial resolution of surface electroencephalography (EEG), EEG source imaging is used to reconstruct brain sources and investigate their spatial and temporal dynamics. The majority of EEG source imaging methods fail to detect activity from subcortical brain structures. The reconstruction of subcortical sources is a challenging task because the signal from these sources is weakened and mixed with artifacts and other signals from cortical sources. In this proof-of-principle study we present a novel EEG source imaging method, the regional spatiotemporal Kalman filter (RSTKF), that can detect deep brain activity.

METHODS

The regional spatiotemporal Kalman filter (RSTKF) is a generalization of the spatiotemporal Kalman filter (STKF), which allows for the characterization of different regional dynamics in the brain. It is based on state-space modeling with spatially heterogeneous dynamical noise variances, since models with spatial and temporal homogeneity fail to describe the dynamical complexity of brain activity. First, RSTKF is tested using simulated EEG data from sources in the frontal lobe, putamen, and thalamus. After that, it is applied to non-averaged interictal epileptic spikes from a presurgical epilepsy patient with focal epileptic activity in the amygdalo-hippocampal complex. The results of RSTKF are compared to those of low-resolution brain electromagnetic tomography (LORETA) and of standard STKF.

RESULTS

Only RSTKF is successful in consistently and accurately localizing the sources in deep brain regions. Additionally, RSTKF shows improved spatial resolution compared to LORETA and STKF.

CONCLUSIONS

RSTKF is a generalization of STKF that allows for accurate, focal, and consistent localization of sources, especially in the deeper brain areas. In contrast to standard source imaging methods, RSTKF may find application in the localization of the epileptogenic zone in deeper brain structures, such as mesial frontal and temporal lobe epilepsies, especially in EEG recordings for which no reliable averaged spike shape can be obtained due to lack of the necessary number of spikes required to reach a certain signal-to-noise ratio level after averaging.

Structural templates for imaging EEG cortical sources in infants

Electroencephalographic (EEG) source reconstruction is a powerful approach that allows anatomical localization of electrophysiological brain activity. Algorithms used to estimate cortical sources require an anatomical model of the head and the brain, generally reconstructed using magnetic resonance imaging (MRI). When such scans are unavailable, a population average can be used for adults, but no average surface template is available for cortical source imaging in infants. To address this issue, we introduce a new series of 13 anatomical models for subjects between zero and 24 months of age. These templates are built from MRI averages and boundary element method (BEM) segmentation of head tissues available as part of the Neurodevelopmental MRI Database. Surfaces separating the pia mater, the gray matter, and the white matter were estimated using the Infant FreeSurfer pipeline. The surface of the skin as well as the outer and inner skull surfaces were extracted using a cube marching algorithm followed by Laplacian smoothing and mesh decimation. We post-processed these meshes to correct topological errors and ensure watertight meshes. Source reconstruction with these templates is demonstrated and validated using 100 high-density EEG recordings from 7-month-old infants. Hopefully, these templates will support future studies on EEG-based neuroimaging and functional connectivity in healthy infants as well as in clinical pediatric populations.

Semi-Automated and Direct Localization and Labeling of EEG Electrodes Using MR Structural Images for Simultaneous fMRI-EEG

Electroencephalography (EEG) source reconstruction estimates spatial information from the brain’s electrical activity acquired using EEG. This method requires accurate identification of the EEG electrodes in a three-dimensional (3D) space and involves spatial localization and labeling of EEG electrodes. Here, we propose a new approach to tackle this two-step problem based on the simultaneous acquisition of EEG and magnetic resonance imaging (MRI). For the step of spatial localization of electrodes, we extract the electrode coordinates from the curvature of the protrusions formed in the high-resolution T1-weighted brain scans. In the next step, we assign labels to each electrode based on the distinguishing feature of the electrode’s distance profile in relation to other electrodes. We then compare the subject’s electrode data with template-based models of prelabeled distance profiles of correctly labeled subjects. Based on this approach, we could localize EEG electrodes in 26 head models with over 90% accuracy in the 3D localization of electrodes. Next, we performed electrode labeling of the subjects’ data with progressive improvements in accuracy: with ∼58% accuracy based on a single EEG-template, with ∼71% accuracy based on 3 EEG-templates, and with ∼76% accuracy using 5 EEG-templates. The proposed semi-automated method provides a simple alternative for the rapid localization and labeling of electrodes without the requirement of any additional equipment than what is already used in an EEG-fMRI setup.

Comparison of Causality Network Estimation in the Sensor and Source Space: Simulation and Application on EEG

The usage of methods for the estimation of the true underlying connectivity among the observed variables of a system is increasing, especially in the domain of neuroscience. Granger causality and similar concepts are employed for the estimation of the brain network from electroencephalogram (EEG) data. Also source localization techniques, such as the standardized low resolution electromagnetic tomography (sLORETA), are widely used for obtaining more reliable data in the source space. In this work, connectivity structures are estimated in the sensor and in the source space making use of the sLORETA transformation for simulated and for EEG data with episodes of spontaneous epileptiform discharges (ED). From the comparative simulation study on high-dimensional coupled stochastic and deterministic systems originating in the sensor space, we conclude that the structure of the estimated causality networks differs in the sensor space and in the source space. Moreover, different network types, such as random, small-world and scale-free, can be better discriminated on the basis of the data in the original sensor space than on the transformed data in the source space. Similarly, in EEG epochs containing epileptiform discharges, the discriminative ability of network topological indices was significantly better in the sensor compared to the source level. In conclusion, causality networks constructed at the sensor and source level, for both simulated and empirical data, exhibit significant structural differences. These observations indicate that further studies are warranted in order to clarify the exact relationship between data registered in the sensor and source space.

Characteristic Increases in EEG Connectivity Correlate With Changes of Structural MRI in Amyotrophic Lateral Sclerosis

Amyotrophic lateral sclerosis (ALS) is a terminal progressive adult-onset neurodegeneration of the motor system. Although originally considered a pure motor degeneration, there is increasing evidence of disease heterogeneity with varying degrees of extra-motor involvement. How the combined motor and nonmotor degeneration occurs in the context of broader disruption in neural communication across brain networks has not been well characterized. Here, we have performed high-density crossectional and longitudinal resting-state electroencephalography (EEG) recordings on 100 ALS patients and 34 matched controls, and have identified characteristic patterns of altered EEG connectivity that have persisted in longitudinal analyses. These include strongly increased EEG coherence between parietal-frontal scalp regions (in γ-band) and between bilateral regions over motor areas (in θ-band). Correlation with structural MRI from the same patients shows that disease-specific structural degeneration in motor areas and corticospinal tracts parallels a decrease in neural activity over scalp motor areas, while the EEG over the scalp regions associated with less extensively involved extra-motor regions on MRI exhibit significantly increased neural communication. Our findings demonstrate that EEG-based connectivity mapping can provide novel insights into progressive network decline in ALS. These data pave the way for development of validated cost-effective spectral EEG-based biomarkers that parallel changes in structural imaging.

Taking the EEG Back Into the Brain: The Power of Multiple Discrete Sources

Background: In contrast to many neuroimaging modalities, clinical interpretation of EEG does not take advantage of post-processing and digital signal analysis. In most centers, EEG is still interpreted at sensor level, exactly as half a century ago. A major task in clinical EEG interpretation is the identification of interictal epileptiform discharges (IEDs). However, due to the overlap of background activity, IEDs can be hard to detect in the scalp EEG. Since traditional montages, like bipolar and average reference, are linear transformations of the recorded channels, the question is whether we can provide linear transformations of the digital EEG to take it back into the brain, at least on a macroscopic level. The goal is to improve visibility of epileptiform activities and to separate out most of the overlap. Methods: Multiple discrete sources provide a stable linear inverse to transform the EEG into source space with little cross-talk between source regions. The model can be based on a few dipoles or regional sources, adapted to the individual EEG and MRI data, or on selected standard sources evenly distributed throughout the brain, e.g. below the 25 EEG standard electrodes. Results: Auditory and somatosensory evoked potentials serve as teaching examples to show how various source spaces can reveal the underlying source components including their loss or alteration due to lesions. Source spaces were able to reveal the propagation of source activities in frontal IEDs and the sequential activation of the major nodes of the underlying epileptic network in myoclonic epilepsy. The power of multiple discrete sources in separating the activities of different brain regions was also evident in the ongoing EEG of cases with frontal cortical dysplasia and bitemporal lobe epilepsy. The new source space 25 made IEDs more clearly visible over the EEG background signals. The more focal nature of source vs. scalp space was quantitatively confirmed using a new measurement of focality. Conclusion: Multiple discrete sources have the power to transform the EEG back into the brain by defining new EEG traces in source space. Using standard source space 25, these can provide for improved clinical interpretation of EEG.

A Novel Noninvasive Approach Based on SPECT and EEG for the Location of the Epileptogenic Zone in Pharmacoresistant Non-Lesional Epilepsy

Background and objectives: The aim of this study is to propose a methodology that combines non-invasive functional modalities electroencephalography (EEG) and single photon emission computed tomography (SPECT) to estimate the location of the epileptogenic zone (EZ) for the presurgical evaluation of patients with drug-resistant non-lesional epilepsy. Materials and Methods: This methodology consists of: (i) Estimation of ictal EEG source imaging (ESI); (ii) application of the subtraction of ictal and interictal SPECT co-registered with MRI (SISCOM) methodology; and (iii) estimation of ESI but using the output of the SISCOM as a priori information for the estimation of the sources. The methodology was implemented in a case series as an example of the application of this novel approach for the presurgical evaluation. A gold standard and a coincidence analysis based on measures of sensitivity and specificity were used as a preliminary assessment of the proposed methodology to localize EZ. Results: In patients with good postoperative evolution, the estimated EZ presented a spatial coincidence with the resection site represented by high values of sensitivity and specificity. For the patient with poor postoperative evolution, the methodology showed a partial incoherence between the estimated EZ and the resection site. In cases of multifocal epilepsy, the method proposed spatially extensive epileptogenic zones. Conclusions: The results of the case series provide preliminary evidence of the methodology’s potential to epileptogenic zone localization in non-lesion drug-resistant epilepsy. The novelty of the article consists in estimating the sources of ictal EEG using SISCOM result as a prior for the inverse solution. Future studies are necessary in order to validate the described methodology. The results constitute a starting point for further studies in order to support the clinical reliability of the proposed methodology and advocate for their implementation in the presurgical evaluation of patients with intractable non-lesional epilepsy.

Simultaneous EEG-fMRI for Functional Neurological Assessment

The increasing incidence of neurodegenerative and psychiatric diseases requires increasingly sophisticated tools for their diagnosis and monitoring. Clinical assessment takes advantage of objective parameters extracted by electroencephalogram and magnetic resonance imaging (MRI) among others, to support clinical management of neurological diseases. The complementarity of these two tools can be now emphasized by the possibility of integrating the two technologies in a hybrid solution, allowing simultaneous acquisition of the two signals by the novel EEG-fMRI technology. This review will focus on simultaneous EEG-fMRI technology and related early studies, dealing about issues related to the acquisition and processing of simultaneous signals, and including critical discussion about clinical and technological perspectives.

Network Perspectives on Epilepsy Using EEG/MEG Source Connectivity

The evolution of EEG/MEG source connectivity is both, a promising, and controversial advance in the characterization of epileptic brain activity. In this narrative review we elucidate the potential of this technology to provide an intuitive view of the epileptic network at its origin, the different brain regions involved in the epilepsy, without the limitation of electrodes at the scalp level. Several studies have confirmed the added value of using source connectivity to localize the seizure onset zone and irritative zone or to quantify the propagation of epileptic activity over time. It has been shown in pilot studies that source connectivity has the potential to obtain prognostic correlates, to assist in the diagnosis of the epilepsy type even in the absence of visually noticeable epileptic activity in the EEG/MEG, and to predict treatment outcome. Nevertheless, prospective validation studies in large and heterogeneous patient cohorts are still lacking and are needed to bring these techniques into clinical use. Moreover, the methodological approach is challenging, with several poorly examined parameters that most likely impact the resulting network patterns. These fundamental challenges affect all potential applications of EEG/MEG source connectivity analysis, be it in a resting, spiking, or ictal state, and also its application to cognitive activation of the eloquent area in presurgical evaluation. However, such method can allow unique insights into physiological and pathological brain functions and have great potential in (clinical) neuroscience.

Neuroscience Information Toolbox: An Open Source Toolbox for EEG-fMRI Multimodal Fusion Analysis

Recently, scalp electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) multimodal fusion has been pursued in an effort to study human brain function and dysfunction to obtain more comprehensive information on brain activity in which the spatial and temporal resolutions are both satisfactory. However, a more flexible and easy-to-use toolbox for EEG–fMRI multimodal fusion is still lacking. In this study, we therefore developed a freely available and open-source MATLAB graphical user interface toolbox, known as the Neuroscience Information Toolbox (NIT), for EEG–fMRI multimodal fusion analysis. The NIT consists of three modules: (1) the fMRI module, which has batch fMRI preprocessing, nuisance signal removal, bandpass filtering, and calculation of resting-state measures; (2) the EEG module, which includes artifact removal, extracting EEG features (event onset, power, and amplitude), and marking interesting events; and (3) the fusion module, in which fMRI-informed EEG analysis and EEG-informed fMRI analysis are included. The NIT was designed to provide a convenient and easy-to-use toolbox for researchers, especially for novice users. The NIT can be downloaded for free at http://www.neuro.uestc.edu.cn/NIT.html, and detailed information, including the introduction of NIT, user’s manual and example data sets, can also be observed on this website. We hope that the NIT is a promising toolbox for exploring brain information in various EEG and fMRI studies.

EEG source space analysis of the supervised factor analytic approach for the classification of multi-directional arm movement

OBJECTIVE

In electroencephalography (EEG)-based brain-computer interface (BCI) systems for motor control tasks the conventional practice is to decode motor intentions by using scalp EEG. However, scalp EEG only reveals certain limited information about the complex tasks of movement with a higher degree of freedom. Therefore, our objective is to investigate the effectiveness of source-space EEG in extracting relevant features that discriminate arm movement in multiple directions.

APPROACH

We have proposed a novel feature extraction algorithm based on supervised factor analysis that models the data from source-space EEG. To this end, we computed the features from the source dipoles confined to Brodmann areas of interest (BA4a, BA4p and BA6). Further, we embedded class-wise labels of multi-direction (multi-class) source-space EEG to an unsupervised factor analysis to make it into a supervised learning method.

MAIN RESULTS

Our approach provided an average decoding accuracy of 71% for the classification of hand movement in four orthogonal directions, that is significantly higher (>10%) than the classification accuracy obtained using state-of-the-art spatial pattern features in sensor space. Also, the group analysis on the spectral characteristics of source-space EEG indicates that the slow cortical potentials from a set of cortical source dipoles reveal discriminative information regarding the movement parameter, direction.

SIGNIFICANCE

This study presents evidence that low-frequency components in the source space play an important role in movement kinematics, and thus it may lead to new strategies for BCI-based neurorehabilitation.

Multimodal approaches to functional connectivity in autism spectrum disorders: An integrative perspective

Atypical functional connectivity has been implicated in autism spectrum disorders (ASDs). However, the literature to date has been largely inconsistent, with mixed and conflicting reports of hypo- and hyper-connectivity. These discrepancies are partly due to differences between various neuroimaging modalities. Functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and magnetoencephalography (MEG) measure distinct indices of functional connectivity (e.g., blood-oxygenation level-dependent [BOLD] signal vs. electrical activity). Furthermore, each method has unique benefits and disadvantages with respect to spatial and temporal resolution, vulnerability to specific artifacts, and practical implementation. Thus far, functional connectivity research on ASDs has remained almost exclusively unimodal; therefore, interpreting findings across modalities remains a challenge. Multimodal integration of fMRI, EEG, and MEG data is critical in resolving discrepancies in the literature, and working toward a unifying framework for interpreting past and future findings. This review aims to provide a theoretical foundation for future multimodal research on ASDs. First, we will discuss the merits and shortcomings of several popular theories in ASD functional connectivity research, using examples from the literature to date. Next, the neurophysiological relationships between imaging modalities, including their relationship with invasive neural recordings, will be reviewed. Finally, methodological approaches to multimodal data integration will be presented, and their future application to ASDs will be discussed. Analyses relating transient patterns of neural activity ("states") are particularly promising. This strategy provides a comparable measure across modalities, captures complex spatiotemporal patterns, and is a natural extension of recent dynamic fMRI research in ASDs. © 2017 Wiley Periodicals, Inc. Develop Neurobiol 78: 456-473, 2018.

Effect of Different Movement Speed Modes on Human Action Observation: An EEG Study

Action observation (AO) generates event-related desynchronization (ERD) suppressions in the human brain by activating partial regions of the human mirror neuron system (hMNS). The activation of the hMNS response to AO remains controversial for several reasons. Therefore, this study investigated the activation of the hMNS response to a speed factor of AO by controlling the movement speed modes of a humanoid robot's arm movements. Since hMNS activation is reflected by ERD suppressions, electroencephalography (EEG) with BCI analysis methods for ERD suppressions were used as the recording and analysis modalities. Six healthy individuals were asked to participate in experiments comprising five different conditions. Four incremental-speed AO tasks and a motor imagery (MI) task involving imaging of the same movement were presented to the individuals. Occipital and sensorimotor regions were selected for BCI analyses. The experimental results showed that hMNS activation was higher in the occipital region but more robust in the sensorimotor region. Since the attended information impacts the activations of the hMNS during AO, the pattern of hMNS activations first rises and subsequently falls to a stable level during incremental-speed modes of AO. The discipline curves suggested that a moderate speed within a decent inter-stimulus interval (ISI) range produced the highest hMNS activations. Since a brain computer/machine interface (BCI) builds a path-way between human and computer/mahcine, the discipline curves will help to construct BCIs made by patterns of action observation (AO-BCI). Furthermore, a new method for constructing non-invasive brain machine brain interfaces (BMBIs) with moderate AO-BCI and motor imagery BCI (MI-BCI) was inspired by this paper.

Fast and robust Block-Sparse Bayesian learning for EEG source imaging

We propose a new Sparse Bayesian Learning (SBL) algorithm that can deliver fast, block-sparse, and robust solutions to the EEG source imaging (ESI) problem in the presence of noisy measurements. Current implementations of the SBL framework are computationally expensive and typically handle fluctuations in the measurement noise using different heuristics that are unsuitable for real-time imaging applications. We address these shortcomings by decoupling the estimation of the sensor noise covariance and the sparsity profile of the sources, thereby yielding an efficient two-stage algorithm. In the first stage, we optimize a simplified non-sparse generative model to get an estimate of the sensor noise covariance and a good initialization of the group-sparsity profile of the sources. Sources obtained at this stage are equivalent to those estimated with the popular inverse method LORETA. In the second stage, we apply a fast SBL algorithm with the noise covariance fixed to the value obtained in the first stage to efficiently shrink to zero groups of sources that are irrelevant for explaining the EEG measurements. In addition, we derive an initialization to the first stage of the algorithm that is optimal in the least squares sense, which prevents delays due to suboptimal initial conditions. We validate our method on both simulated and real EEG data. Simulations show that the method is robust to measurement noise and performs well in real-time, with faster performance than two state of the art SBL solvers. On real error-related negativity EEG data, we obtain source images in agreement with the experimental literature. The method shows promise for real-time neuroimaging and brain-machine interface applications.

EEG-Informed fMRI: A Review of Data Analysis Methods

The simultaneous acquisition of electroencephalography (EEG) with functional magnetic resonance imaging (fMRI) is a very promising non-invasive technique for the study of human brain function. Despite continuous improvements, it remains a challenging technique, and a standard methodology for data analysis is yet to be established. Here we review the methodologies that are currently available to address the challenges at each step of the data analysis pipeline. We start by surveying methods for pre-processing both EEG and fMRI data. On the EEG side, we focus on the correction for several MR-induced artifacts, particularly the gradient and pulse artifacts, as well as other sources of EEG artifacts. On the fMRI side, we consider image artifacts induced by the presence of EEG hardware inside the MR scanner, and the contamination of the fMRI signal by physiological noise of non-neuronal origin, including a review of several approaches to model and remove it. We then provide an overview of the approaches specifically employed for the integration of EEG and fMRI when using EEG to predict the blood oxygenation level dependent (BOLD) fMRI signal, the so-called EEG-informed fMRI integration strategy, the most commonly used strategy in EEG-fMRI research. Finally, we systematically review methods used for the extraction of EEG features reflecting neuronal phenomena of interest.

The Callosal Relay Model of Interhemispheric Communication: New Evidence from Effective Connectivity Analysis

Interhemispheric auditory connectivity via the corpus callosum has been demonstrated to be important for normal speech processing. According to the callosal relay model, directed information flow from the right to the left auditory cortex has been suggested, but this has not yet been proven. For this purpose, 33 healthy participants were investigated with 64-channel EEG while performing the dichotic listening task in which two different consonant–vowel syllables were presented simultaneously to the left (LE) and right ear (RE). eLORETA source estimation was used to investigate the functional (lagged phase synchronization/LPS) and effective (isolated effective coherence/ICoh) connectivity between right and left primary (PAC) and secondary auditory cortices (SAC) in the gamma-band (30–100 Hz) during right and left ear reports. The major finding was a significantly increased effective connectivity in the gamma-band from the right to the left SAC during conscious perception of LE stimuli. In addition, effective and functional connectivity was significantly enhanced during LE as compared to RE reports. These findings give novel insight into transcallosal information transfer during auditory perception by showing that LE performance requires causal interhemispheric inputs from the right to the left auditory cortices, and that this interaction is mediated by synchronized gamma-band oscillations.