Methods for simultaneous EEG-fMRI: an introductory review

Simultaneous invasive and non-invasive recordings in humans: A novel Rosetta stone for deciphering brain activity

Simultaneous noninvasive and invasive electrophysiological recordings provide a unique opportunity to achieve a comprehensive understanding of human brain activity, much like a Rosetta stone for human neuroscience. In this review we focus on the increasingly-used powerful combination of intracranial electroencephalography (iEEG) with scalp electroencephalography (EEG) or magnetoencephalography (MEG). We first provide practical insight on how to achieve these technically challenging recordings. We then provide examples from clinical research on how simultaneous recordings are advancing our understanding of epilepsy. This is followed by the illustration of how human neuroscience and methodological advances could benefit from these simultaneous recordings. We conclude with a call for open data sharing and collaboration, while ensuring neuroethical approaches and argue that only with a true collaborative approach the promises of simultaneous recordings will be fulfilled.

Revealing the spatiotemporal brain dynamics of covert speech compared with overt speech: A simultaneous EEG-fMRI study

Covert speech (CS) refers to speaking internally to oneself without producing any sound or movement. CS is involved in multiple cognitive functions and disorders. Reconstructing CS content by brain-computer interface (BCI) is also an emerging technique. However, it is still controversial whether CS is a truncated neural process of overt speech (OS) or involves independent patterns. Here, we performed a word-speaking experiment with simultaneous EEG-fMRI. It involved 32 participants, who generated words both overtly and covertly. By integrating spatial constraints from fMRI into EEG source localization, we precisely estimated the spatiotemporal dynamics of neural activity. During CS, EEG source activity was localized in three regions: the left precentral gyrus, the left supplementary motor area, and the left putamen. Although OS involved more brain regions with stronger activations, CS was characterized by an earlier event-locked activation in the left putamen (peak at 262 ms versus 1170 ms). The left putamen was also identified as the only hub node within the functional connectivity (FC) networks of both OS and CS, while showing weaker FC strength towards speech-related regions in the dominant hemisphere during CS. Path analysis revealed significant multivariate associations, indicating an indirect association between the earlier activation in the left putamen and CS, which was mediated by reduced FC towards speech-related regions. These findings revealed the specific spatiotemporal dynamics of CS, offering insights into CS mechanisms that are potentially relevant for future treatment of self-regulation deficits, speech disorders, and development of BCI speech applications.

P1, N170, and N250 Event-related Potential Components Reflect Temporal Perception Processing in Face and Body Personal Identification

Human faces and bodies represent various socially important signals. Although adults encounter numerous new people in daily life, they can recognize hundreds to thousands of different individuals. However, the neural mechanisms that differentiate one person from another person are unclear. This study aimed to clarify the temporal dynamics of the cognitive processes of face and body personal identification using face-sensitive ERP components (P1, N170, and N250). The present study performed three blocks (face-face, face-body, and body-body) of different ERP adaptation paradigms. Furthermore, in the above three blocks, ERP components were used to compare brain biomarkers under three conditions (same person, different person of the same sex, and different person of the opposite sex). The results showed that the P1 amplitude for the face-face block was significantly greater than that for the body-body block, that the N170 amplitude for a different person of the same sex condition was greater than that for the same person condition in the right hemisphere only, and that the N250 amplitude gradually increased as the degree of face and body sex-social categorization grew closer (i.e., same person condition > different person of the same sex condition > different person of the opposite sex condition). These results suggest that early processing of the face and body processes the face and body separately and that structural encoding and personal identification of the face and body process the face and body collaboratively.

Insights from simultaneous EEG-fMRI and patient data illuminate the role of the anterior medial temporal lobe in N400 generation

The N400, a negative event-related potential (ERP) peaking approximately 400 ms after stimulus onset, is known to reflect the processing of semantic information. While scalp recordings have contributed to understanding the psychological processes underlying the N400, they have been limited in identifying its neural basis. However, recent intracranial ERP recordings and fMRI studies have shed light on the crucial role of the anterior medial temporal lobe (AMTL) in semantic information processing. These findings suggest that the N400 partially represents activity in the AMTL structures. To investigate the neural underpinnings of the N400 effect, we simultaneously recorded ERPs and event-related fMRI during a semantic priming paradigm in a sample of 12 young, healthy subjects. Additionally, we collected ERPs and structural brain data from older healthy adults and patients with amnestic mild cognitive impairment (aMCI), a population characterized by neurodegenerative changes in the AMTL. In our fMRI results, we identified bilateral loci in the AMTL as the global maxima. Employing an EEG-informed fMRI analysis, we explored trial-to-trial fluctuations in semantic processing by linking single-trial N400 amplitudes to the Blood Oxygen Level Dependent (BOLD) signal. This approach provided the first direct evidence linking the N400 recorded at the scalp level to the corresponding BOLD signal in the AMTL. Consistent with these findings, patients with aMCI exhibited a diminished N400 effect compared to healthy older adults. Furthermore, voxel-based morphometry analysis revealed a correlation between the magnitude of the N400 effect and the integrity of the AMTL. By integrating data from simultaneous EEG-fMRI, and patient studies, our research advances our understanding of the neural substrate of the N400 and highlights the critical involvement of the AMTL in semantic processing.

Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases

Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear. Specifically, it remains open whether motivational biases arise primarily from the architecture of subcortical regions or also reflect cortical influences, the latter being typically associated with increased behavioral flexibility and control beyond stereotyped behaviors. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (dorsal anterior and posterior cingulate cortices) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.

Neural mechanisms of attentional bias to emotional faces in patients with chronic insomnia disorder

OBJECTIVE

This study used event-related potential (ERP) and resting-state functional connectivity (rs-FC) approaches to investigate the neural mechanisms underlying the emotional attention bias in patients with chronic insomnia disorder (CID).

METHODS

Twenty-five patients with CID and thirty-three demographically matched healthy controls (HCs) completed clinical questionnaires and underwent electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) scans. EEG analysis examined the group differences in terms of reaction times, P3 amplitudes, event-related spectral perturbations, and inter-trial phase synchrony. Subsequently, seed-based rs-FC analysis of the amygdala nuclei (including the central-medial amygdala [CMA] and basolateral amygdala [BLA]) was performed. The relationship between P3 amplitude, rs-FC and clinical symptom severity in patients with CID was further investigated by correlation analysis.

RESULTS

CID patients exhibited shorter reaction times than HCs in both standard and deviant stimuli, with the abnormalities becoming more pronounced as attention allocation increased. Compared to HCs, ERP analysis revealed increased P3 amplitude, theta wave power, and inter-trial synchrony in CID patients. The rs-FC analysis showed increased connectivity of the BLA-occipital pole, CMA-precuneus, and CMA-angular gyrus and decreased connectivity of the CMA-thalamus in CID patients. Notably, correlation analysis of the EEG and fMRI measurements showed a significant positive correlation between the P3 amplitude and the rs-FC of the CMA-PCU.

CONCLUSION

This study confirms an emotional attention bias in CID, specifically in the neural mechanisms of attention processing that vary depending on the allocation of attentional resources. Abnormal connectivity in the emotion-cognition networks may constitute the neural basis of the abnormal scalp activation pattern.

Alterations of sleep initiation in NREM parasomnia after sleep deprivation - A multimodal pilot study

Objectives

NREM parasomnias also known as disorders of arousal (DOA) are characterised by abnormal motor and autonomic activation during arousals primarily from slow wave sleep. Dissociative state between sleep and wake is likely responsible for clinical symptoms of DOA. We therefore investigated potential dissociation outside of parasomnic events by using simultaneous 256-channel EEG (hdEEG) and functional magnetic resonance imaging (fMRI).

Methods

Eight DOA patients (3 women, mean age = 27.8; SD = 4.2) and 8 gender and age matched healthy volunteers (3 women, mean age = 26,5; SD = 4.0) were included into the study. They underwent 30-32 h of sleep deprivation followed by hdEEG and fMRI recording. We determined 2 conditions: falling asleep (FA) and arousal (A), that occurred outside of deep sleep and/or parasomnic event. We used multimodal approach using data obtained from EEG, fMRI and EEG-fMRI integration approach.

Results

DOA patients showed increase in delta and beta activity over postcentral gyrus and cuneus during awakening period. This group expressed increased connectivity between motor cortex and cingulate during arousals unrelated to parasomnic events in the beta frequency band. They also showed lower connectivity between different portions of cingulum. In contrast, the greater connectivity was found between thalamus and some cortical areas, such as occipital cortex.

Conclusion

Our findings suggest a complex alteration in falling asleep and arousal mechanisms at both subcortical and cortical levels in response to sleep deprivation. As this alteration is present also outside of slow wave sleep and/or parasomnic episodes we believe this could be a trait factor of DOA.

Variations on the theme: focus on cerebellum and emotional processing

The cerebellum operates exploiting a complex modular organization and a unified computational algorithm adapted to different behavioral contexts. Recent observations suggest that the cerebellum is involved not just in motor but also in emotional and cognitive processing. It is therefore critical to identify the specific regional connectivity and microcircuit properties of the emotional cerebellum. Recent studies are highlighting the differential regional localization of genes, molecules, and synaptic mechanisms and microcircuit wiring. However, the impact of these regional differences is not fully understood and will require experimental investigation and computational modeling. This review focuses on the cellular and circuit underpinnings of the cerebellar role in emotion. And since emotion involves an integration of cognitive, somatomotor, and autonomic activity, we elaborate on the tradeoff between segregation and distribution of these three main functions in the cerebellum.

Preservation of EEG spectral power features during simultaneous EEG-fMRI

Introduction

Electroencephalographic (EEG) data quality is severely compromised when recorded inside the magnetic resonance (MR) environment. Here we characterized the impact of the ballistocardiographic (BCG) artifact on resting-state EEG spectral properties and compared the effectiveness of seven common BCG correction methods to preserve EEG spectral features. We also assessed if these methods retained posterior alpha power reactivity to an eyes closure-opening (EC-EO) task and compared the results from EEG-informed fMRI analysis using different BCG correction approaches.

Method

Electroencephalographic data from 20 healthy young adults were recorded outside the MR environment and during simultaneous fMRI acquisition. The gradient artifact was effectively removed from EEG-fMRI acquisitions using Average Artifact Subtraction (AAS). The BCG artifact was corrected with seven methods: AAS, Optimal Basis Set (OBS), Independent Component Analysis (ICA), OBS followed by ICA, AAS followed by ICA, PROJIC-AAS and PROJIC-OBS. EEG signal preservation was assessed by comparing the spectral power of traditional frequency bands from the corrected rs-EEG-fMRI data with the data recorded outside the scanner. We then assessed the preservation of posterior alpha functional reactivity by computing the ratio between the EC and EO conditions during the EC-EO task. EEG-informed fMRI analysis of the EC-EO task was performed using alpha power-derived BOLD signal predictors obtained from the EEG signals corrected with different methods.

Results

The BCG artifact caused significant distortions (increased absolute power, altered relative power) across all frequency bands. Artifact residuals/signal losses were present after applying all correction methods. The EEG reactivity to the EC-EO task was better preserved with ICA-based correction approaches, particularly when using ICA feature extraction to isolate alpha power fluctuations, which allowed to accurately predict hemodynamic signal fluctuations during the EEG-informed fMRI analysis.

Discussion

Current software solutions for the BCG artifact problem offer limited efficiency to preserve the EEG spectral power properties using this particular EEG setup. The state-of-the-art approaches tested here can be further refined and should be combined with hardware implementations to better preserve EEG signal properties during simultaneous EEG-fMRI. Existing and novel BCG artifact correction methods should be validated by evaluating signal preservation of both ERPs and spontaneous EEG spectral power.

Hemodynamic functional connectivity optimization of frequency EEG microstates enables attention LSTM framework to classify distinct temporal cortical communications of different cognitive tasks

Temporal analysis of global cortical communication of cognitive tasks in coarse EEG information is still challenging due to the underlying complex neural mechanisms. This study proposes an attention-based time-series deep learning framework that processes fMRI functional connectivity optimized quasi-stable frequency microstates for classifying distinct temporal cortical communications of the cognitive task. Seventy volunteers were subjected to visual target detection tasks, and their electroencephalogram (EEG) and functional MRI (fMRI) were acquired simultaneously. At first, the acquired EEG information was preprocessed and bandpass to delta, theta, alpha, beta, and gamma bands and then subjected to quasi-stable frequency-microstate estimation. Subsequently, time-series elicitation of each frequency microstates is optimized with graph theory measures of simultaneously eliciting fMRI functional connectivity between frontal, parietal, and temporal cortices. The distinct neural mechanisms associated with each optimized frequency-microstate were analyzed using microstate-informed fMRI. Finally, these optimized, quasi-stable frequency microstates were employed to train and validate the attention-based Long Short-Term Memory (LSTM) time-series architecture for classifying distinct temporal cortical communications of the target from other cognitive tasks. The temporal, sliding input sampling windows were chosen between 180 to 750 ms/segment based on the stability of transition probabilities of the optimized microstates. The results revealed 12 distinct frequency microstates capable of deciphering target detections' temporal cortical communications from other task engagements. Particularly, fMRI functional connectivity measures of target engagement were observed significantly correlated with the right-diagonal delta (r = 0.31), anterior-posterior theta (r = 0.35), left-right theta (r = - 0.32), alpha (r = - 0.31) microstates. Further, neuro-vascular information of microstate-informed fMRI analysis revealed the association of delta/theta and alpha/beta microstates with cortical communications and local neural processing, respectively. The classification accuracies of the attention-based LSTM were higher than the traditional LSTM architectures, particularly the frameworks that sampled the EEG data with a temporal width of 300 ms/segment. In conclusion, the study demonstrates reliable temporal classifications of global cortical communication of distinct tasks using an attention-based LSTM utilizing fMRI functional connectivity optimized quasi-stable frequency microstates.

Anhedonia symptoms: The assessment of brain functional mechanism following music stimuli using functional magnetic resonance imaging

PURPOSE

This study aimed to investigate the effect of music stimulation on the brain functional mechanism of depressed patients with anhedonia symptoms using functional magnetic resonance imaging (fMRI).

METHODS

Participants in this study included 20 healthy subjects as the control group, 25 subjects with depression and no anhedonia as the intervention group A, and 24 subjects with depression and anhedonia as the intervention group B. The safely emotional stimulation was done by Iranian music. To investigate the effect of music therapy on the brain, a task including 50 tracks of 12 s Iranian music (traditional and pop) was used. Finally, the data were analyzed using SPM Toolbox in MATLAB software.

RESULTS

The results showed that brain patterns in depressed patients with and without anhedonia could be distinguished based on positive and negative musical stimuli (p < 0.05). Important fMRI biomarker such as effective connectivity strength related to the fronto-limbic network, including the supragenual ACC, subgenual ACC, AMYG, and FFG were evaluated in depressed patients with anhedonia.

CONCLUSION

This was the first study to investigate the neural circuits involved in music-related emotional processing in patients with anhedonia symptoms. These findings could help advance neurological understandings of anhedonia and suggest new treatments.

Visual Selective Attention P300 Source in Frontal-Parietal Lobe: ERP and fMRI Study

Visual selective attention can be achieved into bottom-up and top-down attention. Different selective attention tasks involve different attention control ways. The pop-out task requires more bottom-up attention, whereas the search task involves more top-down attention. P300, which is the positive potential generated by the brain in the latency of 300 ~ 600 ms after stimulus, reflects the processing of attention. There is no consensus on the P300 source. The aim of present study is to study the source of P300 elicited by different visual selective attention. We collected thirteen participants' P300 elicited by pop-out and search tasks with event-related potentials (ERP). We collected twenty-six participants' activation brain regions in pop-out and search tasks with functional magnetic resonance imaging (fMRI). And we analyzed the sources of P300 using the ERP and fMRI integration with high temporal resolution and high spatial resolution. ERP results indicated that the pop-out task induced larger P300 than the search task. P300 induced by the two tasks distributed at frontal and parietal lobes, with P300 induced by the pop-out task mainly at the parietal lobe and that induced by the search task mainly at the frontal lobe. Further ERP and fMRI integration analysis showed that neural difference sources of P300 were the right precentral gyrus, left superior frontal gyrus (medial orbital), left middle temporal gyrus, left rolandic operculum, right postcentral gyrus, and left angular gyrus. Our study suggests that the frontal and parietal lobes contribute to the P300 component of visual selective attention.

Neurofeedback for the Education of Children with ADHD and Specific Learning Disorders: A Review

Neurofeedback (NF) is a type of biofeedback in which an individual’s brain activity is measured and presented to them to support self-regulation of ongoing brain oscillations and achieve specific behavioral and neurophysiological outcomes. NF training induces changes in neurophysiological circuits that are associated with behavioral changes. Recent evidence suggests that the NF technique can be used to train electrical brain activity and facilitate learning among children with learning disorders. Toward this aim, this review first presents a generalized model for NF systems, and then studies involving NF training for children with disorders such as dyslexia, attention-deficit/hyperactivity disorder (ADHD), and other specific learning disorders such as dyscalculia and dysgraphia are reviewed. The discussion elaborates on the potential for translational applications of NF in educational and learning settings with details. This review also addresses some issues concerning the role of NF in education, and it concludes with some solutions and future directions. In order to provide the best learning environment for children with ADHD and other learning disorders, it is critical to better understand the role of NF in educational settings. The review provides the potential challenges of the current systems to aid in highlighting the issues undermining the efficacy of current systems and identifying solutions to address them. The review focuses on the use of NF technology in education for the development of adaptive teaching methods and the best learning environment for children with learning disabilities.

Simultaneous electroencephalography-functional magnetic resonance imaging for assessment of human brain function

Electroencephalography (EEG) and functional Magnetic Resonance Imaging (MRI) have long been used as tools to examine brain activity. Since both methods are very sensitive to changes of synaptic activity, simultaneous recording of EEG and fMRI can provide both high temporal and spatial resolution. Therefore, the two modalities are now integrated into a hybrid tool, EEG-fMRI, which encapsulates the useful properties of the two. Among other benefits, EEG-fMRI can contribute to a better understanding of brain connectivity and networks. This review lays its focus on the methodologies applied in performing EEG-fMRI studies, namely techniques used for the recording of EEG inside the scanner, artifact removal, and statistical analysis of the fMRI signal. We will investigate simultaneous resting-state and task-based EEG-fMRI studies and discuss their clinical and technological perspectives. Moreover, it is established that the brain regions affected by a task-based neural activity might not be limited to the regions in which they have been initiated. Advanced methods can help reveal the regions responsible for or affected by a developed neural network. Therefore, we have also looked into studies related to characterization of structure and dynamics of brain networks. The reviewed literature suggests that EEG-fMRI can provide valuable complementary information about brain neural networks and functions.

A Cumulants-Based Human Brain Decoding

Human cognition is influenced by the way the nervous system processes information and is linked to this mechanical explanation of the human body’s cognitive function. Accuracy is the key emphasis in neuroscience which may be enhanced by utilising new hardware, mathematical, statistical, and computational methodologies. Feature extraction and feature selection also play a crucial function in gaining improved accuracy since the proper characteristics can identify brain states efficiently. However, both feature extraction and selection procedures are dependent on mathematical and statistical techniques which implies that mathematical and statistical techniques have a direct or indirect influence on prediction accuracy. The forthcoming challenges of the brain-computer interface necessitate a thorough critical understanding of the complicated structure and uncertain behavior of the brain. It is impossible to upgrade hardware periodically, and thus, an option is necessary to collect maximum information from the brain against varied actions. The mathematical and statistical combination could be the ideal answer for neuroscientists which can be utilised for feature extraction, feature selection, and classification. That is why in this research a statistical technique is offered together with specialised feature extraction and selection methods to increase the accuracy. A score fusion function is changed utilising an enhanced cumulants-driven likelihood ratio test employing multivariate pattern analysis. Functional MRI data were acquired from 12 patients versus a visual test that comprises of pictures from five distinct categories. After cleaning the data, feature extraction and selection were done using mathematical approaches, and lastly, the best match of the projected class was established using the likelihood ratio test. To validate the suggested approach, it is compared with the current methods reported in recent research.

Ballistocardiogram suppression in concurrent EEG-MRI by dynamic modeling of heartbeats

The ballistocardiogram (BCG), the induced electric potentials by the head motion originating from heartbeats, is a prominent source of noise in electroencephalography (EEG) data during magnetic resonance imaging (MRI). Although methods have been proposed to suppress the BCG artifact, more work considering the variability of cardiac cycles and head motion across time and subjects is needed to provide highly robust correction. Here, a method called "dynamic modeling of heartbeats" (DMH) is proposed to reduce BCG artifacts in EEG data recorded inside an MRI system. The DMH method models BCG artifacts by combining EEG points at time instants with similar dynamics. The modeled BCG artifact is then subtracted from the EEG recording to suppress the BCG artifact. Performance of DMH was tested and specifically compared with the Optimal Basis Set (OBS) method on EEG data recorded inside a 3T MRI system with either no MRI acquisition (Inside-MRI), echo-planar imaging (EPI-EEG), or fast MRI acquisition using simultaneous multi-slice and inverse imaging methods (SMS-InI-EEG). In a steady-state visual evoked response (SSVEP) paradigm, the 15-Hz oscillatory neuronal activity at the visual cortex after DMH processing was about 130% of that achieved by OBS processing for Inside-MRI, SMS-InI-EEG, and EPI-EEG conditions. The DMH method is computationally efficient for suppressing BCG artifacts and in the future may help to improve the quality of EEG data recorded in high-field MRI systems for neuroscientific and clinical applications.

A Brief Summary of EEG Artifact Handling

There are various obstacles in the way of use of EEG. Among these, the major obstacles are the artifacts. While some artifacts are avoidable, due to the nature of the EEG techniques there are inevitable artifacts as well. Artifacts can be categorized as internal/physiological or external/non-physiological. The most common internal artifacts are ocular or muscular origins. Internal artifacts are difficult to detect and remove, because they contain signal information as well. For both resting state EEG and ERP studies, artifact handling needs to be carefully carried out in order to retain the maximal signal. Therefore, an effective management of these inevitable artifacts is critical for the EEG based researches. Many researchers from various fields studied this challenging phenomenon and came up with some solutions. However, the developed methods are not well known by the real practitioners of EEG as a tool because of their limited knowledge about these engineering approaches. They still use the traditional visual inspection of the EEG. This work aims to inform the researchers working in the field of EEG about the artifacts and artifact management options available in order to increase the awareness of the available tools such as EEG preprocessing pipelines.

High-Density Electroencephalography-Informed Multiband Functional Magnetic Resonance Imaging Reveals Rhythm-Specific Activations Within the Trigeminal Nociceptive Network

The interest in exploring trigeminal pain processing has grown in recent years, mainly due to various pathologies (such as migraine) related to this system. However, research efforts have mainly focused on understanding molecular mechanisms or studying pathological states. On the contrary, non-invasive imaging studies are limited by either spatial or temporal resolution depending on the modality used. This can be overcome by using multimodal imaging techniques such as simultaneous functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). Although this technique has already been applied to neuroscientific research areas and consequently gained insights into diverse sensory systems and pathologies, only a few studies have applied EEG-fMRI in the field of pain processing and none in the trigeminal system. Focusing on trigeminal nociception, we used a trigeminal pain paradigm, which has been well-studied in either modality. For validation, we first acquired stand-alone measures with each imaging modality before fusing them in a simultaneous session. Furthermore, we introduced a new, yet simple, non-parametric correlation technique, which exploits trial-to-trial variance of both measurement techniques with Spearman’s correlations, to consolidate the results gained by the two modalities. This new technique does not presume a linear relationship and needs a few repetitions per subject. We also showed cross-validation by analyzing visual stimulations. Using these techniques, we showed that EEG power changes in the theta-band induced by trigeminal pain correlate with fMRI activation within the brainstem, whereas those of gamma-band oscillations correlate with BOLD signals in higher cortical areas.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

Simultaneous EEG-fMRI: What Have We Learned and What Does the Future Hold?

Simultaneous EEG-fMRI has developed into a mature measurement technique in the past 25 years. During this time considerable technical and analytical advances have been made, enabling valuable scientific contributions to a range of research fields. This review will begin with an introduction to the measurement principles involved in EEG and fMRI and the advantages of combining these methods. The challenges faced when combining the two techniques will then be considered. An overview of the leading application fields where EEG-fMRI has made a significant contribution to the scientific literature and emerging applications in EEG-fMRI research trends is then presented.

Holo-Hilbert spectral-based noise removal method for EEG high-frequency bands

Simultaneous EEG-fMRI is a growing and promising field, as it has great potential to further our understanding of the spatiotemporal dynamics of brain function in health and disease. In particular, there is much interest in understanding the fMRI correlates of brain activity in the gamma band (> 30 Hz), as these frequencies are thought to be associated with cognitive processes involving perception, attention, and memory, as well as with disorders such as schizophrenia and autism. However, progress in this area has been limited due to issues such as MR-induced artifacts in EEG recordings, which seem to be more problematic for gamma frequencies. This paper presents a noise removal method for the gamma band of EEG that is based on the Holo-Hilbert spectral analysis (HHSA), but with a new implementation strategy. HHSA uses a nested empirical mode decomposition (EMD) to identify amplitude and frequency modulations (AM and FM, respectively) by averaging over frequencies with high and significant powers. Our method examines gamma band by applying two layers of EMD to the FM and AM components, removing components with very low power based on the power-instantaneous frequency spectrum, and subsequently reconstructs the denoised gamma-band signal from the remaining components. Simulations demonstrate that our proposed method efficiently reduces artifacts while preserving the original gamma signal which is especially critical for simultaneous EEG/fMRI studies.

Early soft and flexible fusion of electroencephalography and functional magnetic resonance imaging via double coupled matrix tensor factorization for multisubject group analysis

Data fusion refers to the joint analysis of multiple datasets that provide different (e.g., complementary) views of the same task. In general, it can extract more information than separate analyses can. Jointly analyzing electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) measurements has been proved to be highly beneficial to the study of the brain function, mainly because these neuroimaging modalities have complementary spatiotemporal resolution: EEG offers good temporal resolution while fMRI is better in its spatial resolution. The EEG–fMRI fusion methods that have been reported so far ignore the underlying multiway nature of the data in at least one of the modalities and/or rely on very strong assumptions concerning the relation of the respective datasets. For example, in multisubject analysis, it is commonly assumed that the hemodynamic response function is a priori known for all subjects and/or the coupling across corresponding modes is assumed to be exact (hard). In this article, these two limitations are overcome by adopting tensor models for both modalities and by following soft and flexible coupling approaches to implement the multimodal fusion. The obtained results are compared against those of parallel independent component analysis and hard coupling alternatives, with both synthetic and real data (epilepsy and visual oddball paradigm). Our results demonstrate the clear advantage of using soft and flexible coupled tensor decompositions in scenarios that do not conform with the hard coupling assumption.

Neurophysiological dynamics for psychological resilience: A view from the temporal axis

When an individual is faced with adversity, the brain and body work cooperatively to adapt to it. This adaptive process is termed psychological resilience, and recent studies have identified several neurophysiological factors ("neurophysiological resilience"), such as monoamines, oscillatory brain activity, hemodynamics, autonomic activity, stress hormones, and immune systems. Each factor is activated in an interactive manner during specific time windows after exposure to stress. Thus, the differences in psychological resilience levels among individuals can be characterized by differences in the temporal dynamics of neurophysiological resilience. In this review, after briefly introducing the frequently used approaches in this research field and the well-known factors of neurophysiological resilience, we summarize the temporal dynamics of neurophysiological resilience. This viewpoint clarifies an important time window, the more-than-one-hour scale, but the neurophysiological dynamics during this window remain elusive. To address this issue, we propose exploring brain-wide oscillatory activities using concurrent functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) techniques.

fMRI-Informed EEG for brain mapping of imagined lower limb movement: Feasibility of a brain computer interface

BACKGROUND

EEG and fMRI have contributed greatly to our understanding of brain activity and its link to behaviors by helping to identify both when and where the activity occurs. This is particularly important in the development of brain-computer interfaces (BCIs), where feed forward systems gather data from imagined brain activity and then send that information to an effector. The purpose of this study was to develop and evaluate a computational approach that enables an accurate mapping of spatial brain activity (fMRI) in relation to the temporal receptors (EEG electrodes) associated with imagined lower limb movement.

NEW METHOD

EEG and fMRI data from 16 healthy, male participants while imagining lower limb movement were used for this purpose. A combined analysis of fMRI data and EEG electrode locations was developed to identify EEG electrodes with a high likelihood of capturing imagined lower limb movement originating from various clusters of brain activity. This novel feature selection tool was used to develop an artificial neural network model to classify right and left lower limb movement.

RESULTS

Results showed that left versus right lower limb imagined movement could be classified with 66.5% accuracy using this approach. Comparison with existing methods: Adopting a purely data-driven approach for feature selection to use in the right/left classification task resulted in the same accuracy (66.6%) but with reduced interpretability.

CONCLUSIONS

The developed fMRI-informed EEG approach could pave the way towards improved brain computer interfaces for lower limb movement while also being applicable to other systems where fMRI could be helpful to inform EEG acquisition and processing.

Oscillatory Correlates of Intentional Forgetting: The Role of Theta and Alpha Power in Item-Method Directed Forgetting

Results from item-method directed forgetting suggest that individuals are able to intentionally forget processed information. Most research suggests that either selective rehearsal of to-be-remembered or inhibitory control of to-be-forgotten information is accountable for the effects of intentional forgetting. Some research, however, hypothesized that the time to process information mediates the underlying mechanism. To test this hypothesis, the current study investigated associations between oscillatory power in theta (3–7.5 Hz) and alpha frequencies (8–13 Hz) and intentional forgetting in human participants and explored whether or not these mechanisms depended on processing time. Previously, theta power was shown to be associated with the creation of episodic memory traces and alpha power with inhibition. We therefore expected to find associations between these neural signatures and behavioral effects. Consistent with our hypotheses, we revealed increased theta power for to-be-remembered and increased alpha power for to-be-forgotten information and that the effects of activity in both frequency bands were influenced by the time individuals were given for processing the memory cue. These results suggest that not one but two mechanisms, rehearsal and inhibitory control, are accountable for item-method directed forgetting, both with different temporal profiles.

Advanced Bioelectrical Signal Processing Methods: Past, Present and Future Approach-Part II: Brain Signals

As it was mentioned in the previous part of this work (Part I)-the advanced signal processing methods are one of the quickest and the most dynamically developing scientific areas of biomedical engineering with their increasing usage in current clinical practice. In this paper, which is a Part II work-various innovative methods for the analysis of brain bioelectrical signals were presented and compared. It also describes both classical and advanced approaches for noise contamination removal such as among the others digital adaptive and non-adaptive filtering, signal decomposition methods based on blind source separation, and wavelet transform.

Wearable, Integrated EEG-fNIRS Technologies: A Review

There has been considerable interest in applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) simultaneously for multimodal assessment of brain function. EEG–fNIRS can provide a comprehensive picture of brain electrical and hemodynamic function and has been applied across various fields of brain science. The development of wearable, mechanically and electrically integrated EEG–fNIRS technology is a critical next step in the evolution of this field. A suitable system design could significantly increase the data/image quality, the wearability, patient/subject comfort, and capability for long-term monitoring. Here, we present a concise, yet comprehensive, review of the progress that has been made toward achieving a wearable, integrated EEG–fNIRS system. Significant marks of progress include the development of both discrete component-based and microchip-based EEG–fNIRS technologies; modular systems; miniaturized, lightweight form factors; wireless capabilities; and shared analogue-to-digital converter (ADC) architecture between fNIRS and EEG data acquisitions. In describing the attributes, advantages, and disadvantages of current technologies, this review aims to provide a roadmap toward the next generation of wearable, integrated EEG–fNIRS systems.

Utilizing multimodal imaging to visualize potential mechanism for sudden death in epilepsy

Sudden death in epilepsy or SUDEP is a fatal condition that accounts for more than 4000 deaths each year. Limited clinical and preclinical data on sudden death suggest critical contributions from autonomic, cardiac, and respiratory pathways. A potential mechanism for such sudden and severe cardiorespiratory dysregulation may be linked to acid reflux-induced laryngospasm. Here, we expand on our previous investigations and utilize a novel multimodal approach to provide visual evidence of acid reflux-initiated cardiorespiratory distress and subsequent sudden death in seizing rats. We used systemic kainic acid to acutely induce seizure activity in Long Evans rats, under urethane anesthesia. We recorded electroencephalography (EEG), electrocardiography (ECG), chest plethysmography, and esophageal pH signals through a multimodal recording platform, during simultaneous fast MRI scans of the rat stomach and esophagus. MRI images, in correlation with electrophysiology data were used to identify seizure progression, stomach acid movement up the esophagus, cardiorespiratory changes, and sudden death. In all cases of sudden death, esophageal pH recordings alongside MRI images visualized stomach acid movement up the esophagus. Severe cardiac (ST segment elevation), respiratory (intermittent apnea) and brain activity (EEG narrowing due to hypoxia) changes were observed only after acid reached larynx, which strongly suggested onset of laryngospasm following acid reflux. The complementary information coming from electrophysiology and fast MRI scans provided insight into the mechanism of esophageal reflux, laryngospasm, obstructive apnea, and subsequent sudden death in seizing animals. The results carry clinical significance as it outlines a potential mechanism that may be relevant to SUDEP in humans.

Removal of physiological artifacts from simultaneous EEG and fMRI recordings

OBJECTIVE

Simultaneous recording of the electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) allows a combination of eletrophysiological and haemodynamic information to be used to form a more complete picture of cerebral dynamics. However, EEG recorded within the MRI scanner is contaminated by both imaging artifacts and physiological artifacts. The majority of the techniques used to pre-process such EEG focus on removal of the imaging and balistocardiogram artifacts, with some success, but don't remove all other physiological artifacts.

METHODS

We propose a new offline EEG artifact removal method based upon a combination of independent component analysis and fMRI-based head movement estimation to aid the removal of physiological artifacts from EEG recorded during EEG-fMRI recordings. Our method makes novel use of head movement trajectories estimated from the fMRI recording in order to assist with identifying physiological artifacts in the EEG and is designed to be used after removal of the fMRI imaging artifact from the EEG.

RESULTS

We evaluate our method on EEG recorded during a joint EEG-fMRI session from healthy adult participants. Our method significantly reduces the influence of all types of physiological artifacts on the EEG. We also compare our method with a state-of-the-art physiological artifact removal method and demonstrate superior performance removing physiological artifacts.

CONCLUSIONS

Our proposed method is able to remove significantly more physiological artifact components from the EEG, recorded during a joint EEG-fMRI session, than other state-of-the-art methods.

SIGNIFICANCE

Our proposed method represents a marked improvement over current processing pipelines for removing physiological noise from EEG recorded during a joint EEG-fMRI session.

Bilateral epileptic networks in congenital and acquired corpus callosum defects: EEG-fMRI study

OBJECTIVES

Electroencephalography-correlated functional magnetic resonance imaging (EEG-fMRI) allows imaging of brain-wide epileptic networks, and demonstrates that focal interictal epileptic activity is sometimes accompanied by bilateral functional activations. The corpus callosum (CC) facilitates bilateral spread of epileptic activity and at times targeted surgically for drug-resistant epilepsy (DRE). We hypothesized that focal epileptic networks are more unilateral in patients lacking intact CC.

METHODS

We included focal DRE patients who underwent pre-surgical EEG-fMRI and had CC agenesis (group A, n = 5), patients who previously underwent anterior callosotomy as treatment for drop attacks and continued having seizures (group B, n = 6), and control group of patients with focal epilepsy and intact CC (group C, n = 9). Blood-oxygenation-level-dependent (BOLD) signal maps were generated for interictal epileptic discharges. To quantify bi-hemispheric distribution of epileptic networks, laterality indices were compared between groups. Anatomical and diffusion-weighted imaging demonstrated white matter pathways.

RESULTS

96% of studies demonstrated bilateral activations. Laterality indices were similar in groups A and C, whereas group B demonstrated a more bilateral network than group C (p = 0.028). Diffusion-weighted and anatomical imaging showed aberrant white matter pathways and larger anterior commissure in groups A and B. 68% of studies showed maximal activation cluster concordant with the presumed epileptic focus, 28% showed non-maximal activation at presumed focus.

SIGNIFICANCE

Focal epileptic activity is associated with bilateral functional activations despite lack of intact CC, and is associated with stronger contralateral activation in patients after anterior callosotomy compared to controls. These findings disprove our initial hypothesis, and combined with white matter structural imaging, may indicate that the CC is not a sole route of propagation of epileptic activity, which might spread via anterior commissure. Our study demonstrates the utility of EEG-fMRI in assessing epileptic networks and potentially aiding in tailoring surgical treatments in DRE patients with callosal anomalies, and in callosal surgeries.

When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide non-invasive measures of brain activity at varying spatial and temporal scales, offering different views on brain function for both clinical and experimental applications. Simultaneous recording of these measures attempts to maximize the respective strengths of each method, while compensating for their weaknesses. However, combined recording is not necessary to address all research questions of interest, and experiments may have greater statistical power to detect effects by maximizing the signal-to-noise ratio in separate recording sessions. While several existing papers discuss the reasons for or against combined recording, this article aims to synthesize these arguments into a flow chart of questions that researchers can consider when deciding whether to record EEG and fMRI separately or simultaneously. Given the potential advantages of simultaneous EEG-fMRI, the aim is to provide an initial overview of the most important concepts and to direct readers to relevant literature that will aid them in this decision.

Neural Correlates of Motor Recovery after Robot-Assisted Training in Chronic Stroke: A Multimodal Neuroimaging Study

Stroke is a leading cause of motor disability worldwide, and robot-assisted therapies have been increasingly applied to facilitate the recovery process. However, the underlying mechanism and induced neuroplasticity change remain partially understood, and few studies have investigated this from a multimodality neuroimaging perspective. The current study adopted BCI-guided robot hand therapy as the training intervention and combined multiple neuroimaging modalities to comprehensively understand the potential association between motor function alteration and various neural correlates. We adopted EEG-informed fMRI technique to understand the functional regions sensitive to training intervention. Additionally, correlation analysis among training effects, nonlinear property change quantified by fractal dimension (FD), and integrity of M1-M1 (M1: primary motor cortex) anatomical connection were performed. EEG-informed fMRI analysis indicated that for iM1 (iM1: ipsilesional M1) regressors, regions with significantly increased partial correlation were mainly located in contralesional parietal, prefrontal, and sensorimotor areas and regions with significantly decreased partial correlation were mainly observed in the ipsilesional supramarginal gyrus and superior temporal gyrus. Pearson's correlations revealed that the interhemispheric asymmetry change significantly correlated with the training effect as well as the integrity of M1-M1 anatomical connection. In summary, our study suggested that multiple functional brain regions not limited to motor areas were involved during the recovery process from multimodality perspective. The correlation analyses suggested the essential role of interhemispheric interaction in motor rehabilitation. Besides, the underlying structural substrate of the bilateral M1-M1 connection might relate to the interhemispheric change. This study might give some insights in understanding the neuroplasticity induced by the integrated BCI-guided robot hand training intervention and further facilitate the design of therapies for chronic stroke patients.

Data-driven beamforming technique to attenuate ballistocardiogram artefacts in electroencephalography-functional magnetic resonance imaging without detecting cardiac pulses in electrocardiography recordings

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a very promising non‐invasive neuroimaging technique. However, EEG data obtained from the simultaneous EEG–fMRI are strongly influenced by MRI‐related artefacts, namely gradient artefacts (GA) and ballistocardiogram (BCG) artefacts. When compared to the GA correction, the BCG correction is more challenging to remove due to its inherent variabilities and dynamic changes over time. The standard BCG correction (i.e., average artefact subtraction [AAS]), require detecting cardiac pulses from simultaneous electrocardiography (ECG) recording. However, ECG signals are also distorted and will become problematic for detecting reliable cardiac peaks. In this study, we focused on a beamforming spatial filtering technique to attenuate all unwanted source activities outside of the brain. Specifically, we applied the beamforming technique to attenuate the BCG artefact in EEG–fMRI, and also to recover meaningful task‐based neural signals during an attentional network task (ANT) which required participants to identify visual cues and respond accurately. We analysed EEG–fMRI data in 20 healthy participants during the ANT, and compared four different BCG corrections (non‐BCG corrected, AAS BCG corrected, beamforming + AAS BCG corrected, beamforming BCG corrected). We demonstrated that the beamforming approach did not only significantly reduce the BCG artefacts, but also significantly recovered the expected task‐based brain activity when compared to the standard AAS correction. This data‐driven beamforming technique appears promising especially for longer data acquisition of sleep and resting EEG–fMRI. Our findings extend previous work regarding the recovery of meaningful EEG signals by an optimized suppression of MRI‐related artefacts.

Rupture, reconstruction, and rehabilitation: A multi-disciplinary review of mechanisms for central nervous system adaptations following anterior cruciate ligament injury

BACKGROUND

Despite surgical reconstruction and extensive rehabilitation, persistent quadriceps inhibition, gait asymmetry, and functional impairment remain prevalent in patients after anterior cruciate ligament (ACL) injury. A combination of reports have suggested underlying central nervous system adaptations in those after injury govern long-term neuromuscular impairments. The classic assumption has been to attribute neurophysiologic deficits to components of injury, but other factors across the continuum of care (e.g. surgery, perioperative analgesia, and rehabilitative strategies) have been largely overlooked.

OBJECTIVE

This review provides a multidisciplinary perspective to 1) provide a narrative review of studies reporting neuroplasticity following ACL injury in order to inform clinicians of the current state of literature and 2) provide a mechanistic framework of neurophysiologic deficits with potential clinical implications across all phases of injury and recovery (injury, surgery, and rehabilitation) RESULTS: Studies using a variety of neurophysiologic modalities have demonstrated peripheral and central nervous system adaptations in those with prior ACL injury. Longitudinal investigations suggest neurophysiologic changes at spinal-reflexive and corticospinal pathways follow a unique timecourse across injury, surgery, and rehabilitation.

CONCLUSION

Clinicians should consider the unique injury, surgery, anesthesia, and rehabilitation on central nervous system adaptations. Therapeutic strategies across the continuum of care may be beneficial to mitigate maladaptive neuroplasticity in those after ACL injury.

Tentative fMRI signatures of perceptual echoes in early visual cortex

The visual Impulse Response Function (IRF) can be estimated by cross-correlating random luminance sequences with concurrently recorded EEG. It typically contains a strong 10 Hz oscillatory component, suggesting that visual information reverberates in the human brain as a "perceptual echo". The neural origin of these echoes remains unknown. To address this question, we recorded EEG and fMRI in two separate sessions. In both sessions, a disk whose luminance followed a random (white noise) sequence was presented in the upper left quadrant. Individual IRFs were derived from the EEG session. These IRFs were then used as "response templates" to reconstruct an estimate of the EEG during the fMRI session, by convolution with the corresponding random luminance sequences. The 7-14 Hz (alpha, the main frequency component of the IRF) envelope of the reconstructed EEG was finally used as an fMRI regressor, to determine which brain voxels co-varied with the oscillations elicited by the luminance sequence, i.e., the "perceptual echoes". The reconstructed envelope of EEG alpha was significantly correlated with BOLD responses in V1 and V2. Surprisingly, this correlation was visible outside, but not within the directly (retinotopically) stimulated region. We tentatively interpret this lack of alpha modulation as a BOLD saturation effect, since the overall stimulus-induced BOLD response was inversely related, across voxels, to the signal variability over time. In conclusion, our results suggest that perceptual echoes originate in early visual cortex, driven by widespread activity in V1 and V2, not retinotopically restricted, but possibly reflecting the propagation of a travelling alpha wave.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Unexpected Sounds Nonselectively Inhibit Active Visual Stimulus Representations

The brain's capacity to process unexpected events is key to cognitive flexibility. The most well-known effect of unexpected events is the interruption of attentional engagement (distraction). We tested whether unexpected events interrupt attentional representations by activating a neural mechanism for inhibitory control. This mechanism is most well characterized within the motor system. However, recent work showed that it is automatically activated by unexpected events and can explain some of their nonmotor effects (e.g., on working memory representations). Here, human participants attended to lateralized flickering visual stimuli, producing steady-state visual evoked potentials (SSVEPs) in the scalp electroencephalogram. After unexpected sounds, the SSVEP was rapidly suppressed. Using a functional localizer (stop-signal) task and independent component analysis, we then identified a fronto-central EEG source whose activity indexes inhibitory motor control. Unexpected sounds in the SSVEP task also activated this source. Using single-trial analyses, we found that subcomponents of this source differentially relate to sound-induced SSVEP changes: While its N2 component predicted the subsequent suppression of the attended-stimulus SSVEP, the P3 component predicted the suppression of the SSVEP to the unattended stimulus. These results shed new light on the processes underlying fronto-central control signals and have implications for phenomena such as distraction and the attentional blink.

Thoughts on neurophysiological signal analysis and classification

Neurophysiological signals are crucial intermediaries, through which brain activity can be quantitatively measured and brain mechanisms are able to be revealed. In particular, non‐invasive neurophysiological signals, such as electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), are welcomed and frequently utilised in various studies since these signals can be non‐invasively recorded without harming the human brain while they convey abundant information pertaining to brain activity. The recorded neurophysiological signals are analysed to mine meaningful information for the understanding of brain mechanisms or are classified to distinguish different patterns (e.g., different cognitive states, brain diseases versus healthy controls). To date, remarkable progress has been made in both the analysis and classification of neurophysiological signals, but scholars are not feeling complacent. Consistent effort ought to be paid to advance the research of analysis and classification based on neurophysiological signals. In this paper, I express my thoughts regarding promising future directions in neurophysiological signal analysis and classification based on current developments and accomplishments. I will elucidate the thoughts after brief summaries of relevant backgrounds, accomplishments, and tendencies. According to my personal selection and preference, I mainly focus on brain connectivity, multidimensional array (tensor), multi‐modality, multiple task classification, deep learning, big data, and naturalistic experiment. Hopefully, my thoughts could give a little help to inspire new ideas and contribute to the research of the analysis and classification of neurophysiological signals in some way.

Semi-Automated and Direct Localization and Labeling of EEG Electrodes Using MR Structural Images for Simultaneous fMRI-EEG

Electroencephalography (EEG) source reconstruction estimates spatial information from the brain’s electrical activity acquired using EEG. This method requires accurate identification of the EEG electrodes in a three-dimensional (3D) space and involves spatial localization and labeling of EEG electrodes. Here, we propose a new approach to tackle this two-step problem based on the simultaneous acquisition of EEG and magnetic resonance imaging (MRI). For the step of spatial localization of electrodes, we extract the electrode coordinates from the curvature of the protrusions formed in the high-resolution T1-weighted brain scans. In the next step, we assign labels to each electrode based on the distinguishing feature of the electrode’s distance profile in relation to other electrodes. We then compare the subject’s electrode data with template-based models of prelabeled distance profiles of correctly labeled subjects. Based on this approach, we could localize EEG electrodes in 26 head models with over 90% accuracy in the 3D localization of electrodes. Next, we performed electrode labeling of the subjects’ data with progressive improvements in accuracy: with ∼58% accuracy based on a single EEG-template, with ∼71% accuracy based on 3 EEG-templates, and with ∼76% accuracy using 5 EEG-templates. The proposed semi-automated method provides a simple alternative for the rapid localization and labeling of electrodes without the requirement of any additional equipment than what is already used in an EEG-fMRI setup.

Ballistocardiogram Artifact Reduction in Simultaneous EEG-fMRI Using Deep Learning

OBJECTIVE

The concurrent recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a technique that has received much attention due to its potential for combined high temporal and spatial resolution. However, the ballistocardiogram (BCG), a large-amplitude artifact caused by cardiac induced movement contaminates the EEG during EEG-fMRI recordings. Removal of BCG in software has generally made use of linear decompositions of the corrupted EEG. This is not ideal as the BCG signal propagates in a manner which is non-linearly dependent on the electrocardiogram (ECG). In this paper, we present a novel method for BCG artifact suppression using recurrent neural networks (RNNs).

METHODS

EEG signals were recovered by training RNNs on the nonlinear mappings between ECG and the BCG corrupted EEG. We evaluated our model's performance against the commonly used Optimal Basis Set (OBS) method at the level of individual subjects, and investigated generalization across subjects.

RESULTS

We show that our algorithm can generate larger average power reduction of the BCG at critical frequencies, while simultaneously improving task relevant EEG based classification.

CONCLUSION

The presented deep learning architecture can be used to reduce BCG related artifacts in EEG-fMRI recordings.

SIGNIFICANCE

We present a deep learning approach that can be used to suppress the BCG artifact in EEG-fMRI without the use of additional hardware. This method may have scope to be combined with current hardware methods, operate in real-time and be used for direct modeling of the BCG.

The Effect of Transcranial Direct Current Stimulation in Changing Resting-State Functional Connectivity in Patients With Neurological Disorders: A Systematic Review

BACKGROUND

People with neurological disorders are found to have abnormal resting-state functional connectivity (rsFC), which is associated with the persistent functional impairment found in these patients. Recently, transcranial direct current stimulation (tDCS) has been shown to improve rsFC, although the results are inconsistent.

OBJECTIVE

We hope to explore whether tDCS induces rsFC changes among patients with neurological disorders, whether rsFC is clinically relevant and how different tDCS parameters affect rsFC outcome among these individuals.

METHODS

A systematic review was conducted according to PRISMA guidelines (systematic review registration number: CRD42020168654). Randomized controlled trials that studied the tDCS effects on rsFC between the experimental and sham-controlled groups using either electrophysiological or neuroimaging methods were included.

RESULTS

Active tDCS can induce changes in both localized (ie, brain regions under the transcranial electrodes) and diffused (ie, brain regions not directly influenced by the transcranial electrodes) rsFC. Interestingly, fMRI studies showed that the default mode network was enhanced regardless of patients' diagnoses, the stimulation paradigms used or the rsFC analytical methods employed. Second, stimulation intensity, but not total stimulation time, appeared to positively influence the effect of tDCS on rsFC.

LIMITATIONS AND CONCLUSION

Due to the inherent heterogeneity in rsFC analytical methods and tDCS protocols, meta-analysis was not conducted. We recommend that future studies may investigate the effect of tDCS on rsFC for repeated cathodal stimulation. For clinicians, we suggest anodal stimulation at a higher stimulation intensity within the safety limit may maximize tDCS effects in modulating aberrant functional connectivity of patients with neurological disorders.

Effects of Neural Mechanisms of Pretask Resting EEG Alpha Information on Situational Awareness: A Functional Connectivity Approach

OBJECTIVE

In this study, the influence of pretask resting neural mechanisms on situational awareness (SA)-task is studied.

BACKGROUND

Pretask electroencephalography (EEG) information and Stroop effect are known to influence task engagement independently. However, neural mechanisms of pretask resting absolute alpha (PRAA) and pretask resting alpha frontal asymmetry (PRAFA) in influencing SA-task which is undergoing Stroop effect is still not understood.

METHOD

The study involved pretask resting EEG measurements from 18 healthy individuals followed by functional magnetic resonance imaging (fMRI) acquisition during SA-task. To understand the effect of pretask alpha information and Stroop effect on SA, a robust correlation between mean reaction time, SA Index, PRAA, and PRAFA were assessed. Furthermore, neural underpinnings of PRAA, PRAFA in SA-task, and functional connectivity were analyzed through the EEG-informed fMRI approach.

RESULTS

Significant robust correlation of reaction time was observed with SA Index (Pearson: r = .50, pcorr = .05) and PRAFA (Pearson: r = .63; pcorr = .01), respectively. Similarly, SA Index significantly correlated with PRAFA (Pearson: r = .56, pcorr = .01; Spearman: r = .61, pcorr = .007), and PRAA (Pearson: r = .59, pcorr = .005; Spearman: r = .59, pcorr = .002). Neural underpinnings of SA-task revealed regions involved in visual-processing and higher-order cognition. PRAA was primarily underpinned at frontal-temporal areas and functionally connected to SA-task regions pertaining to the emotional regulation. PRAFA has correlated with limbic and parietal regions, which are involved in integration of visual, emotion, and memory information of SA-task.

CONCLUSION

The results suggest a strong association of reaction time with SA-task and PRAFA and strongly support the hypothesis that PRAFA, PRAA, and associated neural mechanisms significantly influence the outcome of SA-task.

APPLICATION

It is beneficial to study the effect of pretask resting information on SA-task to improve SA.

A Gaussian Process Model of Human Electrocorticographic Data

We present a model-based method for inferring full-brain neural activity at millimeter-scale spatial resolutions and millisecond-scale temporal resolutions using standard human intracranial recordings. Our approach makes the simplifying assumptions that different people's brains exhibit similar correlational structure, and that activity and correlation patterns vary smoothly over space. One can then ask, for an arbitrary individual's brain: given recordings from a limited set of locations in that individual's brain, along with the observed spatial correlations learned from other people's recordings, how much can be inferred about ongoing activity at other locations throughout that individual's brain? We show that our approach generalizes across people and tasks, thereby providing a person- and task-general means of inferring high spatiotemporal resolution full-brain neural dynamics from standard low-density intracranial recordings.

Concurrent electrophysiological and hemodynamic measurements of evoked neural oscillations in human visual cortex using sparsely interleaved fast fMRI and EEG

Electroencephalography (EEG) concurrently collected with functional magnetic resonance imaging (fMRI) is heavily distorted by the repetitive gradient coil switching during the fMRI acquisition. The performance of the typical template-based gradient artifact suppression method can be suboptimal because the artifact changes over time. Gradient artifact residuals also impede the subsequent suppression of ballistocardiography artifacts. Here we propose recording continuous EEG with temporally sparse fast fMRI (fast fMRI-EEG) to minimize the EEG artifacts caused by MRI gradient coil switching without significantly compromising the field-of-view and spatiotemporal resolution of fMRI. Using simultaneous multi-slice inverse imaging to achieve whole-brain fMRI with isotropic 5-mm resolution in 0.1 ​s, and performing these acquisitions once every 2 ​s, we have 95% of the duty cycle available to record EEG with substantially less gradient artifact. We found that the standard deviation of EEG signals over the entire acquisition period in fast fMRI-EEG was reduced to 54% of that in conventional concurrent echo-planar imaging (EPI) and EEG recordings (EPI-EEG) across participants. When measuring 15-Hz steady-state visual evoked potentials (SSVEPs), the baseline-normalized oscillatory neural response in fast fMRI-EEG was 2.5-fold of that in EPI-EEG. The functional MRI responses associated with the SSVEP delineated by EPI and fast fMRI were similar in the spatial distribution, the elicited waveform, and detection power. Sparsely interleaved fast fMRI-EEG provides high-quality EEG without substantially compromising the quality of fMRI in evoked response measurements, and has the potential utility for applications where the onset of the target stimulus cannot be precisely determined, such as epilepsy.

Altered relation of resting-state alpha rhythm with blood oxygen level dependent signal in healthy aging: Evidence by EEG-fMRI fusion analysis

OBJECTIVE

The goal of this study is to explore the changes of spatial correlates of alpha rhythm in the aged adults.

METHODS

Electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) data were simultaneously recorded from 27 young and 19 elderly adults at resting state with their eyes closed. Alpha rhythm power fluctuation was extracted from EEG signal of parietal-occipital region and was fused with fMRI data by correlating alpha rhythm with blood oxygen level dependent (BOLD) signal using general linear models.

RESULTS

For both young adults and the elderly, the regions correlated with alpha rhythm power were widely distributed in cortical and subcortical regions. However, compared to young adults, correlations between alpha rhythm and the activity of thalamus and frontal regions were significantly reduced in the elderly. In addition, an increased correlation with alpha rhythm was found in frontal, insula and cingulate gyrus regions in the elderly.

CONCLUSIONS

Changes in the roles of the above brain regions may be present in the generation or modulation of alpha rhythm due to age advancing.

SIGNIFICANCE

This study provides novel insight into the alteration of the spatial correlates of alpha rhythm in the elderly by using simultaneous EEG-fMRI data fusion analysis.

Are all behavioral reward benefits created equally? An EEG-fMRI study

Reward consistently boosts performance in cognitive tasks. Although many different reward manipulations exist, systematic comparisons are lacking. Reward effects on cognitive control are usually studied using monetary incentive delay (MID; cue-related reward information) or stimulus-reward association (SRA; target-related reward information) tasks. While for MID tasks, evidence clearly implicates reward-triggered global increases in proactive control, it is unclear how reward effects arise in SRA tasks, and in how far such mechanisms overlap during task preparation and target processing. Here, we address these questions with simultaneous EEG-fMRI using a Stroop task with four different block types. In addition to MID and SRA blocks, we used an SRA-task modification with reward-irrelevant cues (C-SRA) and regular reward-neutral Stroop-task blocks. Behaviorally, we observed superior performance for all reward conditions compared to Neutral, and more pronounced reward effects in the SRA and C-SRA blocks, compared to MID blocks. The fMRI data showed similar reward effects in value-related areas for events that signaled reward availability (MID cues and (C-)SRA targets), and comparable reward modulations in cognitive-control regions for all targets regardless of block type. This result pattern was echoed by the EEG data, showing clear markers of valuation and cognitive control, which only differed during task preparation, whereas reward-related modulations during target processing were again comparable across block types. Yet, considering only cue-related fMRI data, C-SRA cues triggered preparatory control processes beyond reward-unrelated MID cues, without simultaneous modulations in typical reward areas, implicating enhanced task preparation that is not directly driven by a concurrent neural reward-anticipation response.