A personalized history of EEG–fMRI integration

Quantitative signal quality assessment for large-scale continuous scalp electroencephalography from a big data perspective

Objective. Despite electroencephalography (EEG) being a widely used neuroimaging technique with an excellent temporal resolution, in practice, the signals are heavily contaminated by artifacts masking responses of interest in an experiment. It is thus essential to guarantee a prompt and effective detection of artifacts that provides quantitative quality assessment (QA) on raw EEG data. This type of pipeline is crucial for large-scale EEG studies. However, current EEG QA studies are still limited.Approach. In this study, combined from a big data perspective, we therefore describe a quantitative signal quality assessment pipeline, a stable and general threshold-based QA pipeline that automatically integrates artifact detection and new QA measures to assess continuous resting-state raw EEG data. One simulation dataset and two resting-state EEG datasets from 42 healthy subjects and 983 clinical patients were utilized to calibrate the QA pipeline.Main Results. The results demonstrate that (1) the QA indices selected are sensitive: they almost strictly and linearly decrease as the noise level increases; (2) stable, replicable QA thresholds are valid for other experimental and clinical EEG datasets; and (3) use of the QA pipeline on these datasets reveals that high-frequency noises are the most common noises in EEG practice. The QA pipeline is also deployed in the WeBrain cloud platform (https://webrain.uestc.edu.cn/, the Chinese EEG Brain Consortium portal).Significance. These findings suggest that the proposed QA pipeline may be a stable and promising approach for quantitative EEG signal quality assessment in large-scale EEG studies.

Preservation of EEG spectral power features during simultaneous EEG-fMRI

Introduction

Electroencephalographic (EEG) data quality is severely compromised when recorded inside the magnetic resonance (MR) environment. Here we characterized the impact of the ballistocardiographic (BCG) artifact on resting-state EEG spectral properties and compared the effectiveness of seven common BCG correction methods to preserve EEG spectral features. We also assessed if these methods retained posterior alpha power reactivity to an eyes closure-opening (EC-EO) task and compared the results from EEG-informed fMRI analysis using different BCG correction approaches.

Method

Electroencephalographic data from 20 healthy young adults were recorded outside the MR environment and during simultaneous fMRI acquisition. The gradient artifact was effectively removed from EEG-fMRI acquisitions using Average Artifact Subtraction (AAS). The BCG artifact was corrected with seven methods: AAS, Optimal Basis Set (OBS), Independent Component Analysis (ICA), OBS followed by ICA, AAS followed by ICA, PROJIC-AAS and PROJIC-OBS. EEG signal preservation was assessed by comparing the spectral power of traditional frequency bands from the corrected rs-EEG-fMRI data with the data recorded outside the scanner. We then assessed the preservation of posterior alpha functional reactivity by computing the ratio between the EC and EO conditions during the EC-EO task. EEG-informed fMRI analysis of the EC-EO task was performed using alpha power-derived BOLD signal predictors obtained from the EEG signals corrected with different methods.

Results

The BCG artifact caused significant distortions (increased absolute power, altered relative power) across all frequency bands. Artifact residuals/signal losses were present after applying all correction methods. The EEG reactivity to the EC-EO task was better preserved with ICA-based correction approaches, particularly when using ICA feature extraction to isolate alpha power fluctuations, which allowed to accurately predict hemodynamic signal fluctuations during the EEG-informed fMRI analysis.

Discussion

Current software solutions for the BCG artifact problem offer limited efficiency to preserve the EEG spectral power properties using this particular EEG setup. The state-of-the-art approaches tested here can be further refined and should be combined with hardware implementations to better preserve EEG signal properties during simultaneous EEG-fMRI. Existing and novel BCG artifact correction methods should be validated by evaluating signal preservation of both ERPs and spontaneous EEG spectral power.

A Transmissive Theory of Brain Function: Implications for Health, Disease, and Consciousness

Identifying a complete, accurate model of brain function would allow neuroscientists and clinicians to make powerful neuropsychological predictions and diagnoses as well as develop more effective treatments to mitigate or reverse neuropathology. The productive model of brain function, which has been dominant in the field for centuries, cannot easily accommodate some higher-order neural processes associated with consciousness and other neuropsychological phenomena. However, in recent years, it has become increasingly evident that the brain is highly receptive to and readily emits electromagnetic (EM) fields and light. Indeed, brain tissues can generate endogenous, complex EM fields and ultraweak photon emissions (UPEs) within the visible and near-visible EM spectra. EM-based neural mechanisms, such as ephaptic coupling and non-visual optical brain signaling, expand canonical neural signaling modalities and are beginning to disrupt conventional models of brain function. Here, we present an evidence-based argument for the existence of brain processes that are caused by the transmission of extracerebral, EM signals and recommend experimental strategies with which to test the hypothesis. We argue for a synthesis of productive and transmissive models of brain function and discuss implications for the study of consciousness, brain health, and disease.

EEG-fMRI: Ballistocardiogram Artifact Reduction by Surrogate Method for Improved Source Localization

For the analysis of simultaneous EEG-fMRI recordings, it is vital to use effective artifact removal tools. This applies in particular to the ballistocardiogram (BCG) artifact which is difficult to remove without distorting signals of interest related to brain activity. Here, we documented the use of surrogate source models to separate the artifact-related signals from brain signals with minimal distortion of the brain activity of interest. The artifact topographies used for surrogate separation were created automatically using principal components analysis (PCA-S) or by manual selection of artifact components utilizing independent components analysis (ICA-S). Using real resting-state data from 55 subjects superimposed with simulated auditory evoked potentials (AEP), both approaches were compared with three established BCG artifact removal methods: Blind Source Separation (BSS), Optimal Basis Set (OBS), and a mixture of both (OBS-ICA). Each method was evaluated for its applicability for ERP and source analysis using the following criteria: the number of events surviving artifact threshold scans, signal-to-noise ratio (SNR), error of source localization, and signal variance explained by the dipolar model. Using these criteria, PCA-S and ICA-S fared best overall, with highly significant differences to the established methods, especially in source localization. The PCA-S approach was also applied to a single subject Berger experiment performed in the MRI scanner. Overall, the removal of BCG artifacts by the surrogate methods provides a substantial improvement for the analysis of simultaneous EEG-fMRI data compared to the established methods.

WeBrain: A web-based brainformatics platform of computational ecosystem for EEG big data analysis

The current evolution of 'cloud neuroscience' leads to more efforts with the large-scale EEG applications, by using EEG pipelines to handle the rapidly accumulating EEG data. However, there are a few specific cloud platforms that seek to address the cloud computational challenges of EEG big data analysis to benefit the EEG community. In response to the challenges, a WeBrain cloud platform (https://webrain.uestc.edu.cn/) is designed as a web-based brainformatics platform and computational ecosystem to enable large-scale EEG data storage, exploration and analysis using cloud high-performance computing (HPC) facilities. WeBrain connects researchers from different fields to EEG and multimodal tools that have become the norm in the field and the cloud processing power required to handle those large EEG datasets. This platform provides an easy-to-use system for novice users (even no computer programming skills) and provides satisfactory maintainability, sustainability and flexibility for IT administrators and tool developers. A range of resources are also available on https://webrain.uestc.edu.cn/, including documents, manuals, example datasets related to WeBrain, and collected links to open EEG datasets and tools. It is not necessary for users or administrators to install any software or system, and all that is needed is a modern web browser, which reduces the technical expertise required to use or manage WeBrain. The WeBrain platform is sponsored and driven by the China-Canada-Cuba international brain cooperation project (CCC-Axis, http://ccc-axis.org/), and we hope that WeBrain will be a promising cloud brainformatics platform for exploring brain information in large-scale EEG applications in the EEG community.

Automated pipeline for EEG artifact reduction (APPEAR) recorded during fMRI

Objective.Simultaneous electroencephalography-functional magnetic resonance imaging (EEG-fMRI) recordings offer a high spatiotemporal resolution approach to study human brain and understand the underlying mechanisms mediating cognitive and behavioral processes. However, the high susceptibility of EEG to MRI-induced artifacts hinders a broad adaptation of this approach. More specifically, EEG data collected during fMRI acquisition are contaminated with MRI gradients and ballistocardiogram artifacts, in addition to artifacts of physiological origin. There have been several attempts for reducing these artifacts with manual and time-consuming pre-processing, which may result in biasing EEG data due to variations in selecting steps order, parameters, and classification of artifactual independent components. Thus, there is a strong urge to develop a fully automatic and comprehensive pipeline for reducing all major EEG artifacts. In this work, we introduced an open-access toolbox with a fully automatic pipeline for reducing artifacts from EEG data collected simultaneously with fMRI (refer to APPEAR).Approach.The pipeline integrates average template subtraction and independent component analysis to suppress both MRI-related and physiological artifacts. To validate our results, we tested APPEAR on EEG data recorded from healthy control subjects during resting-state (n= 48) and task-based (i.e. event-related-potentials (ERPs);n= 8) paradigms. The chosen gold standard is an expert manual review of the EEG database.Main results.We compared manually and automated corrected EEG data during resting-state using frequency analysis and continuous wavelet transformation and found no significant differences between the two corrections. A comparison between ERP data recorded during a so-called stop-signal task (e.g. amplitude measures and signal-to-noise ratio) also showed no differences between the manually and fully automatic fMRI-EEG-corrected data.Significance.APPEAR offers the first comprehensive open-source toolbox that can speed up advancement of EEG analysis and enhance replication by avoiding experimenters' preferences while allowing for processing large EEG-fMRI cohorts composed of hundreds of subjects with manageable researcher time and effort.

Screening Tools and Assessment Methods of Cognitive Decline Associated With Age-Related Hearing Loss: A Review

Strong links between hearing and cognitive function have been confirmed by a growing number of cross-sectional and longitudinal studies. Seniors with age-related hearing loss (ARHL) have a significantly higher cognitive impairment incidence than those with normal hearing. The correlation mechanism between ARHL and cognitive decline is not fully elucidated to date. However, auditory intervention for patients with ARHL may reduce the risk of cognitive decline, as early cognitive screening may improve related treatment strategies. Currently, clinical audiology examinations rarely include cognitive screening tests, partly due to the lack of objective quantitative indicators with high sensitivity and specificity. Questionnaires are currently widely used as a cognitive screening tool, but the subject's performance may be negatively affected by hearing loss. Numerous electroencephalogram (EEG) and magnetic resonance imaging (MRI) studies analyzed brain structure and function changes in patients with ARHL. These objective electrophysiological tools can be employed to reveal the association mechanism between auditory and cognitive functions, which may also find biological markers to be more extensively applied in assessing the progression towards cognitive decline and observing the effects of rehabilitation training for patients with ARHL. In this study, we reviewed clinical manifestations, pathological changes, and causes of ARHL and discussed their cognitive function effects. Specifically, we focused on current cognitive screening tools and assessment methods and analyzed their limitations and potential integration.

When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide non-invasive measures of brain activity at varying spatial and temporal scales, offering different views on brain function for both clinical and experimental applications. Simultaneous recording of these measures attempts to maximize the respective strengths of each method, while compensating for their weaknesses. However, combined recording is not necessary to address all research questions of interest, and experiments may have greater statistical power to detect effects by maximizing the signal-to-noise ratio in separate recording sessions. While several existing papers discuss the reasons for or against combined recording, this article aims to synthesize these arguments into a flow chart of questions that researchers can consider when deciding whether to record EEG and fMRI separately or simultaneously. Given the potential advantages of simultaneous EEG-fMRI, the aim is to provide an initial overview of the most important concepts and to direct readers to relevant literature that will aid them in this decision.

Neural Correlates of Motor Recovery after Robot-Assisted Training in Chronic Stroke: A Multimodal Neuroimaging Study

Stroke is a leading cause of motor disability worldwide, and robot-assisted therapies have been increasingly applied to facilitate the recovery process. However, the underlying mechanism and induced neuroplasticity change remain partially understood, and few studies have investigated this from a multimodality neuroimaging perspective. The current study adopted BCI-guided robot hand therapy as the training intervention and combined multiple neuroimaging modalities to comprehensively understand the potential association between motor function alteration and various neural correlates. We adopted EEG-informed fMRI technique to understand the functional regions sensitive to training intervention. Additionally, correlation analysis among training effects, nonlinear property change quantified by fractal dimension (FD), and integrity of M1-M1 (M1: primary motor cortex) anatomical connection were performed. EEG-informed fMRI analysis indicated that for iM1 (iM1: ipsilesional M1) regressors, regions with significantly increased partial correlation were mainly located in contralesional parietal, prefrontal, and sensorimotor areas and regions with significantly decreased partial correlation were mainly observed in the ipsilesional supramarginal gyrus and superior temporal gyrus. Pearson's correlations revealed that the interhemispheric asymmetry change significantly correlated with the training effect as well as the integrity of M1-M1 anatomical connection. In summary, our study suggested that multiple functional brain regions not limited to motor areas were involved during the recovery process from multimodality perspective. The correlation analyses suggested the essential role of interhemispheric interaction in motor rehabilitation. Besides, the underlying structural substrate of the bilateral M1-M1 connection might relate to the interhemispheric change. This study might give some insights in understanding the neuroplasticity induced by the integrated BCI-guided robot hand training intervention and further facilitate the design of therapies for chronic stroke patients.

Data-driven beamforming technique to attenuate ballistocardiogram artefacts in electroencephalography-functional magnetic resonance imaging without detecting cardiac pulses in electrocardiography recordings

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a very promising non‐invasive neuroimaging technique. However, EEG data obtained from the simultaneous EEG–fMRI are strongly influenced by MRI‐related artefacts, namely gradient artefacts (GA) and ballistocardiogram (BCG) artefacts. When compared to the GA correction, the BCG correction is more challenging to remove due to its inherent variabilities and dynamic changes over time. The standard BCG correction (i.e., average artefact subtraction [AAS]), require detecting cardiac pulses from simultaneous electrocardiography (ECG) recording. However, ECG signals are also distorted and will become problematic for detecting reliable cardiac peaks. In this study, we focused on a beamforming spatial filtering technique to attenuate all unwanted source activities outside of the brain. Specifically, we applied the beamforming technique to attenuate the BCG artefact in EEG–fMRI, and also to recover meaningful task‐based neural signals during an attentional network task (ANT) which required participants to identify visual cues and respond accurately. We analysed EEG–fMRI data in 20 healthy participants during the ANT, and compared four different BCG corrections (non‐BCG corrected, AAS BCG corrected, beamforming + AAS BCG corrected, beamforming BCG corrected). We demonstrated that the beamforming approach did not only significantly reduce the BCG artefacts, but also significantly recovered the expected task‐based brain activity when compared to the standard AAS correction. This data‐driven beamforming technique appears promising especially for longer data acquisition of sleep and resting EEG–fMRI. Our findings extend previous work regarding the recovery of meaningful EEG signals by an optimized suppression of MRI‐related artefacts.

Reference Electrode Standardization Interpolation Technique (RESIT): A Novel Interpolation Method for Scalp EEG

“Bad channels” are common phenomena during scalp electroencephalography (EEG) recording that arise due to various technique-related reasons, and reconstructing signals from bad channels is an inevitable choice in EEG processing. However, current interpolation methods are all based on purely mathematical interpolation theory, ignoring the neurophysiological basis of the EEG signals, and their performance needs to be further improved, especially when there are many scattered or adjacent bad channels. Therefore, a new interpolation method, named the reference electrode standardization interpolation technique (RESIT), was developed for interpolating scalp EEG channels. Resting-state and event-related EEG datasets were used to investigate the performance of the RESIT. The main results showed that (1) assuming 10% bad channels, RESIT can reconstruct the bad channels well; (2) as the percentage of bad channels increased (from 2% to 85%), the absolute and relative errors between the true and RESIT-reconstructed signals generally increased, and the correlations between the true and RESIT signals decreased; (3) for a range of bad channel percentages (2% ~ 85%), the RESIT had lower absolute error (approximately 2.39% ~ 33.5% reduction), lower relative errors (approximately 1.3% ~ 35.7% reduction) and higher correlations (approximately 2% ~ 690% increase) than traditional interpolation methods, including neighbor interpolation (NI) and spherical spline interpolation (SSI). In addition, the RESIT was integrated into the EEG preprocessing pipeline on the WeBrain cloud platform (https://webrain.uestc.edu.cn/). These results suggest that the RESIT is a promising interpolation method for both separate and simultaneous EEG preprocessing that benefits further EEG analysis, including event-related potential (ERP) analysis, EEG network analysis, and strict group-level statistics.

Characterizing the seizure onset zone and epileptic network using EEG-fMRI in a rat seizure model

Accurate epileptogenic zone (EZ) or seizure onset zone (SOZ) localization is crucial for epilepsy surgery optimization. Previous animal and human studies on epilepsy have reported that changes in blood oxygen level-dependent (BOLD) signals induced by epileptic events could be used as diagnostic markers for EZ or SOZ localization. Simultaneous electroencephalography and functional magnetic resonance imaging (EEG-fMRI) recording is gaining interest as a non-invasive tool for preoperative epilepsy evaluation. However, EEG-fMRI studies have reported inconsistent and ambiguous findings. Therefore, it remains unclear whether BOLD responses can be used for accurate EZ or SOZ localization. In this study, we used simultaneous EEG-fMRI recording in a rat model of 4-aminopyridine-induced acute focal seizures to assess the spatial concordance between individual BOLD responses and the SOZ. This was to determine the optimal use of simultaneous EEG-fMRI recording in the SOZ localization. We observed a high spatial consistency between BOLD responses and the SOZ. Further, dynamic BOLD responses were consistent with the regions where the seizures were propagated. These results suggested that simultaneous EEG-fMRI recording could be used as a noninvasive clinical diagnostic technique for localizing the EZ or SOZ and could be an effective tool for mapping epileptic networks.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation

Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.

On the Quality, Statistical Efficiency, and Safety of Simultaneously Recorded Multiband fMRI/EEG

The recent development of multiband functional magnetic resonance imaging (MB-fMRI) allows for the reduction of sampling period by simultaneously exciting multiple slices-the number of which is referred to as the multiband factor. Simultaneously recorded electroencephalography (EEG)/MB-fMRI has yet to be validated for data quality against conventional single band (SB)-fMRI. Pilot scans were conducted on phantoms twice and on a healthy volunteer to ensure no heating effects. In the main study, two thermometer probes were attached to 16 healthy individuals (ages 20-39, 9 females) whilst they completed two sets of 16-min resting-state and two sets of 9-min n-back task scans-each set consisting of one MB4 and one SB pulse sequence. No heating effects were reported and thermometer data showed mean increases of < 1.0 °C. Minimal differences between the two scan types were found in EEG channel variance and spectra. Expected decreases in MB4-fMRI tSNR were observed. In n-back task scans, little to no differences were detected in both EEG source analyses and fMRI local analyses for mixed effects. Resting-state posterior cingulate cortex seed-based analyses of the default mode network along with EEG-informed fMRI analysis of the occipital alpha anticorrelation effect showed improved statistical and spatial sensitivity at lower scan durations. Using EEG/MB4-fMRI for n-back tasks provided no statistical advantages nor disadvantages. However, for studying the resting-state, MB4-fMRI potentially allows for reduced scanning durations for equivalent statistical significance to be obtained or alternatively, larger effect sizes for the same scanning duration. As such, simultaneous EEG/MB4-fMRI is a viable alternative to EEG/SB-fMRI.

Identification of epileptic brain states by dynamic functional connectivity analysis of simultaneous EEG-fMRI: a dictionary learning approach

Most fMRI studies of the brain's intrinsic functional connectivity (FC) have assumed that this is static; however, it is now clear that it changes over time. This is particularly relevant in epilepsy, which is characterized by a continuous interchange between epileptic and normal brain states associated with the occurrence of epileptic activity. Interestingly, recurrent states of dynamic FC (dFC) have been found in fMRI data using unsupervised learning techniques, assuming either their sparse or non-sparse combination. Here, we propose an l₁-norm regularized dictionary learning (l₁-DL) approach for dFC state estimation, which allows an intermediate and flexible degree of sparsity in time, and demonstrate its application in the identification of epilepsy-related dFC states using simultaneous EEG-fMRI data. With this l₁-DL approach, we aim to accommodate a potentially varying degree of sparsity upon the interchange between epileptic and non-epileptic dFC states. The simultaneous recording of the EEG is used to extract time courses representative of epileptic activity, which are incorporated into the fMRI dFC state analysis to inform the selection of epilepsy-related dFC states. We found that the proposed l₁-DL method performed best at identifying epilepsy-related dFC states, when compared with two alternative methods of extreme sparsity (k-means clustering, maximum; and principal component analysis, minimum), as well as an l₀-norm regularization framework (l₀-DL), with a fixed amount of temporal sparsity. We further showed that epilepsy-related dFC states provide novel insights into the dynamics of epileptic networks, which go beyond the information provided by more conventional EEG-correlated fMRI analysis, and which were concordant with the clinical profile of each patient. In addition to its application in epilepsy, our study provides a new dFC state identification method of potential relevance for studying brain functional connectivity dynamics in general.

Quantitative Analyses Help in Choosing Between Simultaneous vs. Separate EEG and fMRI

Simultaneous registration of scalp electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is considered an attractive approach for studying brain function non-invasively. It combines the better spatial resolution of fMRI with the better temporal resolution of EEG, but comes at the cost of increased measurement artifact and the accompanying artifact preprocessing. This paper presents a study of the residual signal quality based on temporal signal to noise ratio (TSNR) for fMRI and fast Fourier transform (FFT) for EEG, after optimized conventional signal preprocessing. Measurements outside the magnetic resonance imaging scanner and inside the scanner prior to and during image acquisition were compared. For EEG, frequency and region dependent significant effects on FFT squared amplitudes were observed between separately vs. simultaneously recorded EEG and fMRI, with larger effects during image acquisition than without image acquisition inside the scanner bore. A graphical user interface was developed to aid in quality checking these measurements. For fMRI, separately recorded EEG-fMRI revealed relatively large areas with a significantly higher TSNR in right occipital and parietal regions and in the cingulum, compared to separately recorded EEG-fMRI. Simultaneously recorded EEG-fMRI showed significantly higher TSNR in inferior occipital cortex, diencephalon and brainstem, compared to separately recorded EEG-fMRI. Quantification of EEG and fMRI signals showed significant, but sometimes subtle, changes between separate compared to simultaneous EEG-fMRI measurements. To avoid interference with the experiment of interest in a simultaneous EEG-fMRI measurement, it seems warranted to perform a quantitative evaluation to ensure that there are no such uncorrectable effects present in regions or frequencies that are of special interest to the research question at hand.

Multimodal Neuroimaging: Basic Concepts and Classification of Neuropsychiatric Diseases

Neuroimaging techniques are widely used in neuroscience to visualize neural activity, to improve our understanding of brain mechanisms, and to identify biomarkers-especially for psychiatric diseases; however, each neuroimaging technique has several limitations. These limitations led to the development of multimodal neuroimaging (MN), which combines data obtained from multiple neuroimaging techniques, such as electroencephalography, functional magnetic resonance imaging, and yields more detailed information about brain dynamics. There are several types of MN, including visual inspection, data integration, and data fusion. This literature review aimed to provide a brief summary and basic information about MN techniques (data fusion approaches in particular) and classification approaches. Data fusion approaches are generally categorized as asymmetric and symmetric. The present review focused exclusively on studies based on symmetric data fusion methods (data-driven methods), such as independent component analysis and principal component analysis. Machine learning techniques have recently been introduced for use in identifying diseases and biomarkers of disease. The machine learning technique most widely used by neuroscientists is classification-especially support vector machine classification. Several studies differentiated patients with psychiatric diseases and healthy controls with using combined datasets. The common conclusion among these studies is that the prediction of diseases increases when combining data via MN techniques; however, there remain a few challenges associated with MN, such as sample size. Perhaps in the future N-way fusion can be used to combine multiple neuroimaging techniques or nonimaging predictors (eg, cognitive ability) to overcome the limitations of MN.

Artifacts in EEG of simultaneous EEG-fMRI: pulse artifact remainders in the gradient artifact template are a source of artifact residuals after average artifact subtraction

OBJECTIVE

The simultaneous application of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) opens up new ways to investigate the human brain. The EEG recordings of simultaneous EEG-fMRI, however, are overlaid to a great degree by fMRI related artifacts and an artifact reduction is mandatory before any EEG analysis. The most severe artifacts-the gradient artifact and the pulse artifact-are repetitive. Average artifact subtraction (AAS) technique exploits the repetitiveness and is presumably the most often used artifact reduction technique. In this method artifact templates are calculated by averaging over adjacent artifact epochs and subsequently the templates are subtracted to reduce the artifacts. Although the AAS technique is one of the best performing methods, artifact residuals are usually present in the resulting EEG after applying the AAS technique. This work aims at identifying sources of the artifact residuals.

APPROACH

Application of the AAS technique to artificial EEG that is contaminated with artificial fMRI related artifacts.

MAIN RESULTS

A new source of artifact residuals was identified. It was found that the AAS technique itself adds artifacts to the EEG during gradient artifact reduction, because the gradient artifact template is corrupted by pulse artifact remainders.

SIGNIFICANCE

This work shows that using a standard number of 25 epochs to calculate the gradient artifact template-as suggested by the inventors of AAS-results in substantial artifact residuals and consequently to a low EEG quality. Furthermore, the work discusses how potential solutions to this problem have serious side effects such as loss of adaptivity of the AAS technique. Hence, this problem must be considered carefully already in the design of simultaneous EEG-fMRI experiments.

Effects of the Phantom Shape on the Gradient Artefact of Electroencephalography (EEG) Data in Simultaneous EEG–fMRI

Electroencephalography (EEG) signals greatly suffer from gradient artefacts (GAs) due to the time-varying field gradients in the magnetic resonance (MR) scanner during the simultaneous acquisition of EEG and functional magnetic resonance imaging (fMRI) data. The GAs are the principal contributors of artefacts while recording EEG inside an MR scanner, and most of them come from the interaction of the EEG cap and the subject’s head. Many researchers have been using a spherical phantom to characterize the GA in EEG data in combined EEG–fMRI studies. In this study, we investigated how the phantom shape could affect the characterization of the GA. EEG data were recorded with a spherical phantom, a head-shaped phantom, and six human subjects, individually, during the execution of customized and standard echo-planar imaging (EPI) sequences. The spatial potential maps of the root-mean-square (RMS) voltage of the GA over EEG channels for the trials with a head-shaped phantom closely mimicked those related to the human head rather than those obtained for the spherical phantom. This was confirmed by measuring the average similarity index (0.85/0.68). Moreover, a paired t-test showed that the head-shaped phantom’s and the spherical phantom’s data were significantly different (p < 0.005) from the subjects’ data, whereas the difference between the head-shaped phantom’s and the spherical phantom’s data was not significant (p = 0.07). The results of this study strongly suggest that a head-shaped phantom should be used for GA characterization studies in concurrent EEG–fMRI.

Neuroscience Information Toolbox: An Open Source Toolbox for EEG-fMRI Multimodal Fusion Analysis

Recently, scalp electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) multimodal fusion has been pursued in an effort to study human brain function and dysfunction to obtain more comprehensive information on brain activity in which the spatial and temporal resolutions are both satisfactory. However, a more flexible and easy-to-use toolbox for EEG–fMRI multimodal fusion is still lacking. In this study, we therefore developed a freely available and open-source MATLAB graphical user interface toolbox, known as the Neuroscience Information Toolbox (NIT), for EEG–fMRI multimodal fusion analysis. The NIT consists of three modules: (1) the fMRI module, which has batch fMRI preprocessing, nuisance signal removal, bandpass filtering, and calculation of resting-state measures; (2) the EEG module, which includes artifact removal, extracting EEG features (event onset, power, and amplitude), and marking interesting events; and (3) the fusion module, in which fMRI-informed EEG analysis and EEG-informed fMRI analysis are included. The NIT was designed to provide a convenient and easy-to-use toolbox for researchers, especially for novice users. The NIT can be downloaded for free at http://www.neuro.uestc.edu.cn/NIT.html, and detailed information, including the introduction of NIT, user’s manual and example data sets, can also be observed on this website. We hope that the NIT is a promising toolbox for exploring brain information in various EEG and fMRI studies.

Adaptive optimal basis set for BCG artifact removal in simultaneous EEG-fMRI

Electroencephalography (EEG) signals recorded during simultaneous functional magnetic resonance imaging (fMRI) are contaminated by strong artifacts. Among these, the ballistocardiographic (BCG) artifact is the most challenging, due to its complex spatio-temporal dynamics associated with ongoing cardiac activity. The presence of BCG residuals in EEG data may hide true, or generate spurious correlations between EEG and fMRI time-courses. Here, we propose an adaptive Optimal Basis Set (aOBS) method for BCG artifact removal. Our method is adaptive, as it can estimate the delay between cardiac activity and BCG occurrence on a beat-to-beat basis. The effective creation of an optimal basis set by principal component analysis (PCA) is therefore ensured by a more accurate alignment of BCG occurrences. Furthermore, aOBS can automatically estimate which components produced by PCA are likely to be BCG artifact-related and therefore need to be removed. The aOBS performance was evaluated on high-density EEG data acquired with simultaneous fMRI in healthy subjects during visual stimulation. As aOBS enables effective reduction of BCG residuals while preserving brain signals, we suggest it may find wide application in simultaneous EEG-fMRI studies.

Cross multivariate correlation coefficients as screening tool for analysis of concurrent EEG-fMRI recordings

Over the past decade, the simultaneous recording of electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) data has garnered growing interest because it may provide an avenue towards combining the strengths of both imaging modalities. Given their pronounced differences in temporal and spatial statistics, the combination of EEG and fMRI data is however methodologically challenging. Here, we propose a novel screening approach that relies on a Cross Multivariate Correlation Coefficient (xMCC) framework. This approach accomplishes three tasks: (1) It provides a measure for testing multivariate correlation and multivariate uncorrelation of the two modalities; (2) it provides criterion for the selection of EEG features; (3) it performs a screening of relevant EEG information by grouping the EEG channels into clusters to improve efficiency and to reduce computational load when searching for the best predictors of the BOLD signal. The present report applies this approach to a data set with concurrent recordings of steady‐state‐visual evoked potentials (ssVEPs) and fMRI, recorded while observers viewed phase‐reversing Gabor patches. We test the hypothesis that fluctuations in visuo‐cortical mass potentials systematically covary with BOLD fluctuations not only in visual cortical, but also in anterior temporal and prefrontal areas. Results supported the hypothesis and showed that the xMCC‐based analysis provides straightforward identification of neurophysiological plausible brain regions with EEG‐fMRI covariance. Furthermore xMCC converged with other extant methods for EEG‐fMRI analysis.

EEG-Informed fMRI: A Review of Data Analysis Methods

The simultaneous acquisition of electroencephalography (EEG) with functional magnetic resonance imaging (fMRI) is a very promising non-invasive technique for the study of human brain function. Despite continuous improvements, it remains a challenging technique, and a standard methodology for data analysis is yet to be established. Here we review the methodologies that are currently available to address the challenges at each step of the data analysis pipeline. We start by surveying methods for pre-processing both EEG and fMRI data. On the EEG side, we focus on the correction for several MR-induced artifacts, particularly the gradient and pulse artifacts, as well as other sources of EEG artifacts. On the fMRI side, we consider image artifacts induced by the presence of EEG hardware inside the MR scanner, and the contamination of the fMRI signal by physiological noise of non-neuronal origin, including a review of several approaches to model and remove it. We then provide an overview of the approaches specifically employed for the integration of EEG and fMRI when using EEG to predict the blood oxygenation level dependent (BOLD) fMRI signal, the so-called EEG-informed fMRI integration strategy, the most commonly used strategy in EEG-fMRI research. Finally, we systematically review methods used for the extraction of EEG features reflecting neuronal phenomena of interest.

EEG synchronization measures predict epilepsy-related BOLD-fMRI fluctuations better than commonly used univariate metrics

OBJECTIVE

We hypothesize that the hypersynchronization associated with epileptic activity is best described by EEG synchronization measures, and propose to use these as predictors of epilepsy-related BOLD fluctuations.

METHODS

We computed the phase synchronization index (PSI) and global field synchronization (GFS), within two frequency bands, a broadband (1-45 Hz) and a narrower band focused on the presence of epileptic activity (3-10 Hz). The associated epileptic networks were compared with those obtained using conventional unitary regressors and two power-weighted metrics (total power and root mean square frequency), on nine simultaneous EEG-fMRI datasets from four epilepsy patients, exhibiting inter-ictal epileptiform discharges (IEDs).

RESULTS

The average PSI within 3-10 Hz achieved the best performance across several measures reflecting reliability in all datasets. The results were cross-validated through electrical source imaging of the IEDs. The applicability of PSI when no IEDs are recorded on the EEG was evaluated on three additional patients, yielding partially plausible networks in all cases.

CONCLUSIONS

Epileptic networks can be mapped based on the EEG PSI metric within an IED-specific frequency band, performing better than commonly used EEG metrics.

SIGNIFICANCE

This is the first study to investigate EEG synchronization measures as potential predictors of epilepsy-related BOLD fluctuations.

Online Reduction of Artifacts in EEG of Simultaneous EEG-fMRI Using Reference Layer Adaptive Filtering (RLAF)

Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) allow us to study the active human brain from two perspectives concurrently. Signal processing based artifact reduction techniques are mandatory for this, however, to obtain reasonable EEG quality in simultaneous EEG-fMRI. Current artifact reduction techniques like average artifact subtraction (AAS), typically become less effective when artifact reduction has to be performed on-the-fly. We thus present and evaluate a new technique to improve EEG quality online. This technique adds up with online AAS and combines a prototype EEG-cap for reference recordings of artifacts, with online adaptive filtering and is named reference layer adaptive filtering (RLAF). We found online AAS + RLAF to be highly effective in improving EEG quality. Online AAS + RLAF outperformed online AAS and did so in particular online in terms of the chosen performance metrics, these being specifically alpha rhythm amplitude ratio between closed and opened eyes (3-45% improvement), signal-to-noise-ratio of visual evoked potentials (VEP) (25-63% improvement), and VEPs variability (16-44% improvement). Further, we found that EEG quality after online AAS + RLAF is occasionally even comparable with the offline variant of AAS at a 3T MRI scanner. In conclusion RLAF is a very effective add-on tool to enable high quality EEG in simultaneous EEG-fMRI experiments, even when online artifact reduction is necessary.

MATLAB Toolboxes for Reference Electrode Standardization Technique (REST) of Scalp EEG

Reference electrode standardization technique (REST) has been increasingly acknowledged and applied as a re-reference technique to transform an actual multi-channels recordings to approximately zero reference ones in electroencephalography/event-related potentials (EEG/ERPs) community around the world in recent years. However, a more easy-to-use toolbox for re-referencing scalp EEG data to zero reference is still lacking. Here, we have therefore developed two open-source MATLAB toolboxes for REST of scalp EEG. One version of REST is closely integrated into EEGLAB, which is a popular MATLAB toolbox for processing the EEG data; and another is a batch version to make it more convenient and efficient for experienced users. Both of them are designed to provide an easy-to-use for novice researchers and flexibility for experienced researchers. All versions of the REST toolboxes can be freely downloaded at http://www.neuro.uestc.edu.cn/rest/Down.html, and the detailed information including publications, comments and documents on REST can also be found from this website. An example of usage is given with comparative results of REST and average reference. We hope these user-friendly REST toolboxes could make the relatively novel technique of REST easier to study, especially for applications in various EEG studies.

The Advents of Hybrid Imaging Modalities: A New Era in Neuroimaging Applications

Hybrid Imaging modalities have shown great potential in medical imaging and diagnosis. A more comprehensive and targeted view of neurological disorders can be achieved by blending the anatomical and functional perspectives through hybridization. With consistently improving technologies, there have been many developments in fused imaging techniques over the past few decades. This article provides an overview of various bimodal and trimodal hybrid imaging techniques being developed and explored for neuroimaging applications. Recent advancements and potentials are discussed for single photon emission computed tomography-computed tomography (SPECT-CT), positron emission tomography-CT (PET-CT), PET-magnetic resonance imaging (PET-MRI), electroencephalography-functional magnetic resonance imaging (EEG-fMRI), magnetoencephalography-fMRI (MEG-fMRI), EEG-near-infrared spectroscopy (EEG-NIRS), magnetic resonance-PET-EEG (MR-PET-EEG) and MR-PET-CT in the perspective of neuroimaging. A comparison of these hybrid approaches is provided on a single platform to analyze their performance on the basis of several common factors essential for imaging and analyzing neurological disorders and in vivo molecular processes. This article also provides an overview of recently developed advanced imaging technologies that are being hybridized with other imaging modalities and being explored as potential techniques for neuroscience. Novel approaches and clinical applications of hybrid neuroimaging are anticipated with inclusion of new technologies, better sensing capabilities, multimodal probes, and improved hybridization.

Reference layer adaptive filtering (RLAF) for EEG artifact reduction in simultaneous EEG-fMRI

OBJECTIVE

Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) combines advantages of both methods, namely high temporal resolution of EEG and high spatial resolution of fMRI. However, EEG quality is limited due to severe artifacts caused by fMRI scanners.

APPROACH

To improve EEG data quality substantially, we introduce methods that use a reusable reference layer EEG cap prototype in combination with adaptive filtering. The first method, reference layer adaptive filtering (RLAF), uses adaptive filtering with reference layer artifact data to optimize artifact subtraction from EEG. In the second method, multi band reference layer adaptive filtering (MBRLAF), adaptive filtering is performed on bandwidth limited sub-bands of the EEG and the reference channels.

MAIN RESULTS

The results suggests that RLAF outperforms the baseline method, average artifact subtraction, in all settings and also its direct predecessor, reference layer artifact subtraction (RLAS), in lower (<35 Hz) frequency ranges. MBRLAF is computationally more demanding than RLAF, but highly effective in all EEG frequency ranges. Effectivity is determined by visual inspection, as well as root-mean-square voltage reduction and power reduction of EEG provided that physiological EEG components such as occipital EEG alpha power and visual evoked potentials (VEP) are preserved. We demonstrate that both, RLAF and MBRLAF, improve VEP quality. For that, we calculate the mean-squared-distance of single trial VEP to the mean VEP and estimate single trial VEP classification accuracies. We found that the average mean-squared-distance is lowest and the average classification accuracy is highest after MBLAF. RLAF was second best.

SIGNIFICANCE

In conclusion, the results suggests that RLAF and MBRLAF are potentially very effective in improving EEG quality of simultaneous EEG-fMRI. Highlights We present a new and reusable reference layer cap prototype for simultaneous EEG-fMRI We introduce new algorithms for reducing EEG artifacts due to simultaneous fMRI The algorithms combine a reference layer and adaptive filtering Several evaluation criteria suggest superior effectivity in terms of artifact reduction We demonstrate that physiological EEG components are preserved.

Microstructural and functional correlates of glutamate concentration in the posterior cingulate cortex

Glutamate is the major excitatory neurotransmitter in the human brain and has a central role in both intrinsic and stimulus-induced activity. We conducted a study in a cohort of healthy, male volunteers in which glutamate levels were measured in the posterior cingulate cortex (PCC) using 1H magnetic resonance spectroscopy at 3T. The advantages of simultaneous electroencephalography and magnetic resonance imaging (EEG-MRI) were exploited and the subjects were measured in the same session and under the same physiological conditions. Diffusion tensor imaging (DTI), functional MRI (fMRI) and EEG were measured in order to investigate the functional and microstructural correlates of glutamate. The concentration of glutamate (institute units) was calculated and those values were tested for correlation with the metrics of resting state fMRI, DTI, and EEG electrical sources. Our results showed that the concentration of glutamate in the PCC had a significant negative correlation with the tissue mean diffusivity in the same area. The analysis of resting state networks did not show any relationship between the concentration of glutamate and the intrinsic activity of the resting state networks. The concentration of glutamate showed a positive correlation with the electrical generators of α-1 frequency and a negative correlation with the generators of α-2 and β-1 electrical generators. © 2017 Wiley Periodicals, Inc.

Multiway Array Decomposition of EEG Spectrum: Implications of Its Stability for the Exploration of Large-Scale Brain Networks

Multiway array decomposition methods have been shown to be promising statistical tools for identifying neural activity in the EEG spectrum. They blindly decompose the EEG spectrum into spatial-temporal-spectral patterns by taking into account inherent relationships among signals acquired at different frequencies and sensors. Our study evaluates the stability of spatial-temporal-spectral patterns derived by one particular method, parallel factor analysis (PARAFAC). We focused on patterns' stability over time and in population and divided the complete data set containing data from 50 healthy subjects into several subsets. Our results suggest that the patterns are highly stable in time, as well as among different subgroups of subjects. Further, we show with simultaneously acquired fMRI data that power fluctuations of some patterns have stable correspondence to hemodynamic fluctuations in large-scale brain networks. We did not find such correspondence for power fluctuations in standard frequency bands, the common way of dealing with EEG data. Altogether, our results suggest that PARAFAC is a suitable method for research in the field of large-scale brain networks and their manifestation in EEG signal.

Building an EEG-fMRI Multi-Modal Brain Graph: A Concurrent EEG-fMRI Study

The topological architecture of brain connectivity has been well-characterized by graph theory based analysis. However, previous studies have primarily built brain graphs based on a single modality of brain imaging data. Here we develop a framework to construct multi-modal brain graphs using concurrent EEG-fMRI data which are simultaneously collected during eyes open (EO) and eyes closed (EC) resting states. FMRI data are decomposed into independent components with associated time courses by group independent component analysis (ICA). EEG time series are segmented, and then spectral power time courses are computed and averaged within 5 frequency bands (delta; theta; alpha; beta; low gamma). EEG-fMRI brain graphs, with EEG electrodes and fMRI brain components serving as nodes, are built by computing correlations within and between fMRI ICA time courses and EEG spectral power time courses. Dynamic EEG-fMRI graphs are built using a sliding window method, versus static ones treating the entire time course as stationary. In global level, static graph measures and properties of dynamic graph measures are different across frequency bands and are mainly showing higher values in eyes closed than eyes open. Nodal level graph measures of a few brain components are also showing higher values during eyes closed in specific frequency bands. Overall, these findings incorporate fMRI spatial localization and EEG frequency information which could not be obtained by examining only one modality. This work provides a new approach to examine EEG-fMRI associations within a graph theoretic framework with potential application to many topics.

Prevalence of Complications in Intraoperative Magnetic Resonance Imaging Combined with Neurophysiologic Monitoring

BACKGROUND AND OBJECTIVE

High-field intraoperative magnetic resonance imaging (ioMRI) is becoming increasingly available in neurosurgery centers, where it has to be combined with intraoperative neurophysiologic monitoring (IONM). IONM needle electrodes remain on the patient during ioMRI and may cause image distortions and burns. We tested magnetic resonance (MR) -heating experimentally and investigated the prevalence of complications.

METHODS

We studied electrodes that are certified for IONM, but not "MR conditional." They consist of copper cables (length, 1.5 m) and needles made of either stainless steel (ferromagnetic) or paramagnetic platinum/iridium alloy. We simulated an ioMRI session with gel and measured the temperature increase with optical fibers. We measured the force that an electrode experiences in the magnetic field. Between 2013 and 2016, we prospectively documented subcutaneous needle electrodes that remained in the patient during intraoperative 3 Tesla ioMRI scans.

RESULTS

The in vitro testing of the electrodes produced a maximum heating (ΔT = 3.9°C) and force of 0.026 N. We placed 1237 subcutaneous needles in 57 surgical procedures with combined IONM and ioMRI, where needles remained in place during ioMRI. One patient suffered a skin burn on the shoulder. All other electrodes had no side effects.

CONCLUSIONS

We have corroborated the history of safe use for electrodes with 1.5 m cable in a 3T MRI scanner and demonstrated their use. Nevertheless, heating cannot be excluded, as it depends on location and cable placement. When leaving electrodes in place during ioMRI, risks and benefits have to be carefully evaluated for each patient.

A Rotational Cylindrical fMRI Phantom for Image Quality Control

Purpose

A novel phantom for image quality testing for functional magnetic resonance imaging (fMRI) scans is described.

Methods

The cylindrical, rotatable, ~4.5L phantom, with eight wedge-shaped compartments, is used to simulate rest and activated states. The compartments contain NiCl₂ doped agar gel with alternating concentrations of agar (1.4%, 1.6%) to produce T₁ and T₂ values approximating brain grey matter. The Jacard index was used to compare the image distortions for echo planar imaging (EPI) and gradient recalled echo (GRE) scans. Contrast to noise ratio (_CNR) was compared across the imaging volume for GRE and EPI.

Results

The mean T₂ for the two agar concentrations were found to be 106.5±4.8, 94.5±4.7 ms, and T₁ of 1500±40 and 1485±30 ms, respectively. The Jacard index for GRE was generally found to be higher than for EPI (0.95 versus 0.8). The CNR varied from 20 to 50 across the slices and echo times used for EPI scans, and from 20 to 40 across the slices for the GRE scans. The phantom provided a reproducible CNR over 25 days.

Conclusions

The phantom provides a quantifiable signal change over a head-size imaging volume with EPI and GRE sequences, which was used for image quality assessment.

EEG-MEG Integration Enhances the Characterization of Functional and Effective Connectivity in the Resting State Network

At the sensor level many aspects, such as spectral power, functional and effective connectivity as well as relative-power-ratio ratio (RPR) and spatial resolution have been comprehensively investigated through both electroencephalography (EEG) and magnetoencephalography (MEG). Despite this, differences between both modalities have not yet been systematically studied by direct comparison. It remains an open question as to whether the integration of EEG and MEG data would improve the information obtained from the above mentioned parameters. Here, EEG (64-channel system) and MEG (275 sensor system) were recorded simultaneously in conditions with eyes open (EO) and eyes closed (EC) in 29 healthy adults. Spectral power, functional and effective connectivity, RPR, and spatial resolution were analyzed at five different frequency bands (delta, theta, alpha, beta and gamma). Networks of functional and effective connectivity were described using a spatial filter approach called the dynamic imaging of coherent sources (DICS) followed by the renormalized partial directed coherence (RPDC). Absolute mean power at the sensor level was significantly higher in EEG than in MEG data in both EO and EC conditions. At the source level, there was a trend towards a better performance of the combined EEG+MEG analysis compared with separate EEG or MEG analyses for the source mean power, functional correlation, effective connectivity for both EO and EC. The network of coherent sources and the spatial resolution were similar for both the EEG and MEG data if they were analyzed separately. Results indicate that the combined approach has several advantages over the separate analyses of both EEG and MEG. Moreover, by a direct comparison of EEG and MEG, EEG was characterized by significantly higher values in all measured parameters in both sensor and source level. All the above conclusions are specific to the resting state task and the specific analysis used in this study to have general conclusion multi-center studies would be helpful.

Objective selection of epilepsy-related independent components from EEG data

BACKGROUND

Independent Component Analysis (ICA) is commonly used for the identification of sources of interest in electroencephalographic (EEG) data, but the selection of the relevant components remains an open issue depending on the specific application.

NEW METHOD

We propose a novel approach for the objective selection of epilepsy-related independent components (ICs) from EEG data collected during functional Magnetic Resonance Imaging (fMRI) acquisitions, called PROJection onto Independent Components (PROJIC). Inter-ictal epileptiform discharges (IEDs) are identified on a reference EEG dataset collected outside the MRI scanner by an expert neurophysiologist, and the resulting average IED is projected onto the IC space of the EEG data collected simultaneously with fMRI. The power of the IED projection is then used to inform a k-means clustering algorithm of the ICs, allowing for the classification of epilepsy-related ICs.

COMPARISON WITH EXISTING METHODS

The performance of PROJIC was compared with two methods previously proposed for the objective selection of EEG ICs of interest, which are based on the explicit similarity of the ICs with spatio-temporal templates of the events of interest, instead of the projection power.

RESULTS

The proposed PROJIC method outperformed the others for both artificial and real data (19 datasets collected from 6 patients with drug-refractory focal epilepsy), with an average accuracy of 98.6%.

CONCLUSIONS

The ability of our method to accurately and objectively select epilepsy-related ICs makes it an important contribution for simultaneous EEG-fMRI epilepsy studies, with potential applications in the analysis of event-related EEG activity more generally, and also in EEG artefact correction.

Time-frequency analysis of resting state and evoked EEG data recorded at higher magnetic fields up to 9.4 T

BACKGROUND

Combining both high temporal and spatial resolution by means of simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is of relevance to neuroscientists. This combination, however, leads to a distortion of the EEG signal by the so-called cardio-ballistic artefacts. The aim of the present study was developing an approach to restore meaningful physiological EEG data from recordings at different magnetic fields.

NEW METHODS

The distortions introduced by the magnetic field were corrected using a combination of concepts from independent component analysis (ICA) and mutual information (MI). Thus, the components were classified as either related to the cardio-ballistic artefacts or to the signals of interest. EEG data from two experimental paradigms recorded at different magnetic field strengths up to 9.4 T were analyzed: (i) spontaneous activity using an eyes-open/eyes-closed alternation, and (ii) responses to auditory stimuli, i.e. auditory evoked potentials.

RESULTS

Even at ultra-high magnetic fields up to 9.4 T the proposed artefact rejection approach restored the physiological time-frequency information contained in the signal of interest and the data were suitable for subsequent analyses.

COMPARISON WITH EXISTING METHODS

Blind source separation (BSS) has been used to retrieve information from EEG data recorded inside the MR scanner in previous studies. After applying the presented method on EEG data recorded at 4 T, 7 T, and 9.4 T, we could retrieve more information than from data cleaned with the BSS method.

CONCLUSIONS

The present work demonstrates that EEG data recorded at ultra-high magnetic fields can be used for studying neuroscientific research question related to oscillatory activity.

Methods and utility of EEG-fMRI in epilepsy

Brain activity data in general and more specifically in epilepsy can be represented as a matrix that includes measures of electrophysiology, anatomy and behaviour. Each of these sub-matrices has a complex interaction depending upon the brain state i.e., rest, cognition, seizures and interictal periods. This interaction presents significant challenges for interpretation but also potential for developing further insights into individual event types. Successful treatments in epilepsy hinge on unravelling these complexities, and also on the sensitivity and specificity of methods that characterize the nature and localization of underlying physiological and pathological networks. Limitations of pharmacological and surgical treatments call for refinement and elaboration of methods to improve our capability to localise the generators of seizure activity and our understanding of the neurobiology of epilepsy. Simultaneous electroencephalography and functional magnetic resonance imaging (EEG-fMRI), by potentially circumventing some of the limitations of EEG in terms of sensitivity, can allow the mapping of haemodynamic networks over the entire brain related to specific spontaneous and triggered epileptic events in humans, and thereby provide new localising information. In this work we review the published literature, and discuss the methods and utility of EEG-fMRI in localising the generators of epileptic activity. We draw on our experience and that of other groups, to summarise the spectrum of information provided by an increasing number of EEG-fMRI case-series, case studies and group studies in patients with epilepsy, for its potential role to elucidate epileptic generators and networks. We conclude that EEG-fMRI provides a multidimensional view that contributes valuable clinical information to localize the epileptic focus with potential important implications for the surgical treatment of some patients with drug-resistant epilepsy, and insights into the resting state and cognitive network dynamics.

Integrating Different Aspects of Resting Brain Activity: A Review of Electroencephalographic Signatures in Resting State Networks Derived from Functional Magnetic Resonance Imaging

Electroencephalography (EEG) is an established measure in the field of brain resting state with a range of quantitative methods (qEEG) that yield unique information about neuronal activation and synchronization. Meanwhile, in the last decade, functional magnetic resonance imaging (fMRI) studies have revealed the existence of more than a dozen resting state networks (RSNs), and combined qEEG and fMRI have allowed us to gain understanding about the relationship of qEEG and fMRI-RSNs. However, the overall picture is less clear because there is no a priori hypothesis about which EEG features correspond well to fMRI-RSNs. We reviewed the associations of several types of qEEG features to four RSNs considered as neurocognitive systems central for higher brain processes: the default mode network, dorsal and ventral frontoparietal networks, and the salience network. We could identify 12 papers correlating qEEG and RSNs in adult human subjects and employing a simultaneous design under a no-task resting state condition. A systematic overview investigates which qEEG features replicably relate to the chosen RSNs. This review article leads to the conclusion that spatially delimited θ and whole/local α may be the most promising measures, but the time domain methods add important additional information. © 2015 S. Karger AG, Basel.

Multimodal imaging of dynamic functional connectivity

The study of large-scale functional interactions in the human brain with functional magnetic resonance imaging (fMRI) extends almost to the first applications of this technology. Due to historical reasons and preconceptions about the limitations of this brain imaging method, most studies have focused on assessing connectivity over extended periods of time. It is now clear that fMRI can resolve the temporal dynamics of functional connectivity, like other faster imaging techniques such as electroencephalography and magnetoencephalography (albeit on a different temporal scale). However, the indirect nature of fMRI measurements can hinder the interpretability of the results. After briefly summarizing recent advances in the field, we discuss how the simultaneous combination of fMRI with electrophysiological activity measurements can contribute to a better understanding of dynamic functional connectivity in humans both during rest and task, wakefulness, and other brain states.

Electrophysiological correlates of the BOLD signal for EEG-informed fMRI

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are important tools in cognitive and clinical neuroscience. Combined EEG-fMRI has been shown to help to characterise brain networks involved in epileptic activity, as well as in different sensory, motor and cognitive functions. A good understanding of the electrophysiological correlates of the blood oxygen level-dependent (BOLD) signal is necessary to interpret fMRI maps, particularly when obtained in combination with EEG. We review the current understanding of electrophysiological-haemodynamic correlates, during different types of brain activity. We start by describing the basic mechanisms underlying EEG and BOLD signals and proceed by reviewing EEG-informed fMRI studies using fMRI to map specific EEG phenomena over the entire brain (EEG-fMRI mapping), or exploring a range of EEG-derived quantities to determine which best explain colocalised BOLD fluctuations (local EEG-fMRI coupling). While reviewing studies of different forms of brain activity (epileptic and nonepileptic spontaneous activity; cognitive, sensory and motor functions), a significant attention is given to epilepsy because the investigation of its haemodynamic correlates is the most common application of EEG-informed fMRI. Our review is focused on EEG-informed fMRI, an asymmetric approach of data integration. We give special attention to the invasiveness of electrophysiological measurements and the simultaneity of multimodal acquisitions because these methodological aspects determine the nature of the conclusions that can be drawn from EEG-informed fMRI studies. We emphasise the advantages of, and need for, simultaneous intracranial EEG-fMRI studies in humans, which recently became available and hold great potential to improve our understanding of the electrophysiological correlates of BOLD fluctuations.

The role of sub-second neural events in spontaneous brain activity

Human fMRI studies have identified well-reproducible resting-state networks (RSN) from spontaneous recordings. These networks are extracted from correlation metrics across the brain using several minutes of data. However, a majority of electrophysiological events occur at a sub-second time scale and their contribution to RSN generation is likely. According to recent fMRI studies RSNs separate into smaller networks when studied with higher temporal resolution. Moreover, using simultaneous electrophysiology and fMRI recordings it was shown that transient functional networks form around neural events. Therefore, considering neural events as sources of functional networks might improve the understanding of spontaneous brain activity. This endeavor will benefit from technical advances in simultaneous BOLD and electrophysiology recordings, as well as a more principled modeling of neurovascular coupling.

Simultaneous EEG-fMRI at ultra-high field: artifact prevention and safety assessment

The simultaneous recording of scalp electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) can provide unique insights into the dynamics of human brain function, and the increased functional sensitivity offered by ultra-high field fMRI opens exciting perspectives for the future of this multimodal approach. However, simultaneous recordings are susceptible to various types of artifacts, many of which scale with magnetic field strength and can seriously compromise both EEG and fMRI data quality in recordings above 3T. The aim of the present study was to implement and characterize an optimized setup for simultaneous EEG-fMRI in humans at 7 T. The effects of EEG cable length and geometry for signal transmission between the cap and amplifiers were assessed in a phantom model, with specific attention to noise contributions from the MR scanner coldheads. Cable shortening (down to 12 cm from cap to amplifiers) and bundling effectively reduced environment noise by up to 84% in average power and 91% in inter-channel power variability. Subject safety was assessed and confirmed via numerical simulations of RF power distribution and temperature measurements on a phantom model, building on the limited existing literature at ultra-high field. MRI data degradation effects due to the EEG system were characterized via B0 and B1(+) field mapping on a human volunteer, demonstrating important, although not prohibitive, B1 disruption effects. With the optimized setup, simultaneous EEG-fMRI acquisitions were performed on 5 healthy volunteers undergoing two visual paradigms: an eyes-open/eyes-closed task, and a visual evoked potential (VEP) paradigm using reversing-checkerboard stimulation. EEG data exhibited clear occipital alpha modulation and average VEPs, respectively, with concomitant BOLD signal changes. On a single-trial level, alpha power variations could be observed with relative confidence on all trials; VEP detection was more limited, although statistically significant responses could be detected in more than 50% of trials for every subject. Overall, we conclude that the proposed setup is well suited for simultaneous EEG-fMRI at 7 T.

Correspondence of electroencephalography and near-infrared spectroscopy sensitivities to the cerebral cortex using a high-density layout

This study investigates the correspondence of the cortical sensitivity of electroencephalography (EEG) and near-infrared spectroscopy (NIRS). EEG forward model sensitivity to the cerebral cortex was calculated for 329 EEG electrodes following the 10-5 EEG positioning system using a segmented structural magnetic resonance imaging scan of a human subject. NIRS forward model sensitivity was calculated for the same subject using 156 NIRS source-detector pairs selected from 32 source and 32 detector optodes positioned on the scalp using a subset of the 10-5 EEG positioning system. Sensitivity correlations between colocalized NIRS source-detector pair groups and EEG channels yielded R = 0.46 ± 0.08. Groups of NIRS source-detector pairs with maximum correlations to EEG electrode sensitivities are tabulated. The mean correlation between the point spread functions for EEG and NIRS regions of interest (ROI) was R = 0.43 ± 0.07. Spherical ROIs with radii of 26 mm yielded the maximum correlation between EEG and NIRS averaged across all cortical mesh nodes. These sensitivity correlations between EEG and NIRS should be taken into account when designing multimodal studies of neurovascular coupling and when using NIRS as a statistical prior for EEG source localization.

Synchronous multiscale neuroimaging environment for critically sampled physiological analysis of brain function: hepta-scan concept

Functional connectivity of the resting-state networks of the brain is thought to be mediated by very-low-frequency fluctuations (VLFFs <0.1 Hz) in neuronal activity. However, vasomotor waves and cardiorespiratory pulsations influence indirect measures of brain function, such as the functional magnetic resonance imaging blood-oxygen-level-dependent (BOLD) signal. How strongly physiological oscillations correlate with spontaneous BOLD signals is not known, partially due to differences in the data-sampling rates of different methods. Recent ultrafast inverse imaging sequences, including magnetic resonance encephalography (MREG), enable critical sampling of these signals. In this study, we describe a multimodal concept, referred to as Hepta-scan, which incorporates synchronous MREG with scalp electroencephalography, near-infrared spectroscopy, noninvasive blood pressure, and anesthesia monitoring. Our preliminary results support the idea that, in the absence of aliased cardiorespiratory signals, VLFFs in the BOLD signal are affected by vasomotor and electrophysiological sources. Further, MREG signals showed a high correlation coefficient between the ventromedial default mode network (DMNvmpf) and electrophysiological signals, especially in the VLF range. Also, oxy- and deoxyhemoglobin and vasomotor waves were found to correlate with DMNvmpf. Intriguingly, usage of shorter time windows in these correlation measurements produced significantly (p<0.05) higher positive and negative correlation coefficients, suggesting temporal nonstationary behavior between the measurements. Focus on the VLF range strongly increased correlation strength.