Reference layer adaptive filtering (RLAF) for EEG artifact reduction in simultaneous EEG-fMRI

iCanClean Removes Motion, Muscle, Eye, and Line-Noise Artifacts from Phantom EEG

The goal of this study was to test a novel approach (iCanClean) to remove non-brain sources from scalp EEG data recorded in mobile conditions. We created an electrically conductive phantom head with 10 brain sources, 10 contaminating sources, scalp, and hair. We tested the ability of iCanClean to remove artifacts while preserving brain activity under six conditions: Brain, Brain + Eyes, Brain + Neck Muscles, Brain + Facial Muscles, Brain + Walking Motion, and Brain + All Artifacts. We compared iCanClean to three other methods: Artifact Subspace Reconstruction (ASR), Auto-CCA, and Adaptive Filtering. Before and after cleaning, we calculated a Data Quality Score (0-100%), based on the average correlation between brain sources and EEG channels. iCanClean consistently outperformed the other three methods, regardless of the type or number of artifacts present. The most striking result was for the condition with all artifacts simultaneously present. Starting from a Data Quality Score of 15.7% (before cleaning), the Brain + All Artifacts condition improved to 55.9% after iCanClean. Meanwhile, it only improved to 27.6%, 27.2%, and 32.9% after ASR, Auto-CCA, and Adaptive Filtering. For context, the Brain condition scored 57.2% without cleaning (reasonable target). We conclude that iCanClean offers the ability to clear multiple artifact sources in real time and could facilitate human mobile brain-imaging studies with EEG.

EEG-LLAMAS: A low-latency neurofeedback platform for artifact reduction in EEG-fMRI

Simultaneous EEG-fMRI is a powerful multimodal technique for imaging the brain, but its use in neurofeedback experiments has been limited by EEG noise caused by the MRI environment. Neurofeedback studies typically require analysis of EEG in real time, but EEG acquired inside the scanner is heavily contaminated with ballistocardiogram (BCG) artifact, a high-amplitude artifact locked to the cardiac cycle. Although techniques for removing BCG artifacts do exist, they are either not suited to real-time, low-latency applications, such as neurofeedback, or have limited efficacy. We propose and validate a new open-source artifact removal software called EEG-LLAMAS (Low Latency Artifact Mitigation Acquisition Software), which adapts and advances existing artifact removal techniques for low-latency experiments. We first used simulations to validate LLAMAS in data with known ground truth. We found that LLAMAS performed better than the best publicly-available real-time BCG removal technique, optimal basis sets (OBS), in terms of its ability to recover EEG waveforms, power spectra, and slow wave phase. To determine whether LLAMAS would be effective in practice, we then used it to conduct real-time EEG-fMRI recordings in healthy adults, using a steady state visual evoked potential (SSVEP) task. We found that LLAMAS was able to recover the SSVEP in real time, and recovered the power spectra collected outside the scanner better than OBS. We also measured the latency of LLAMAS during live recordings, and found that it introduced a lag of less than 50 ms on average. The low latency of LLAMAS, coupled with its improved artifact reduction, can thus be effectively used for EEG-fMRI neurofeedback. A limitation of the method is its use of a reference layer, a piece of EEG equipment which is not commercially available, but can be assembled in-house. This platform enables closed-loop experiments which previously would have been prohibitively difficult, such as those that target short-duration EEG events, and is shared openly with the neuroscience community.

Evaluation and comparison of most prevalent artifact reduction methods for EEG acquired simultaneously with fMRI

Multimodal neuroimaging using EEG and fMRI provides deeper insights into brain function by improving the spatial and temporal resolution of the acquired data. However, simultaneous EEG-fMRI inevitably compromises the quality of the EEG and fMRI signals due to the high degree of interaction between the two systems. Fluctuations in the magnetic flux flowing through the participant and the EEG system, whether due to movement within the magnetic field of the scanner or to changes in magnetic field strength, induce electrical potentials in the EEG recordings that mask the much weaker electrical activity of the neuronal populations. A number of different methods have been proposed to reduce MR artifacts. We present an overview of the most commonly used methods and an evaluation of the methods using three sets of diverse EEG data. We limited the evaluation to open-access and easy-to-use methods and a reference signal regression method using a set of six carbon-wire loops (CWL), which allowed evaluation of their added value. The evaluation was performed by comparing EEG signals recorded outside the MRI scanner with artifact-corrected EEG signals recorded simultaneously with fMRI. To quantify and evaluate the quality of artifact reduction methods in terms of the spectral content of the signal, we analyzed changes in oscillatory activity during a resting-state and a finger tapping motor task. The quality of artifact reduction in the time domain was assessed using data collected during a visual stimulation task. In the study we utilized hierarchical Bayesian probabilistic modeling for statistical inference and observed significant differences between the evaluated methods in the success of artifact reduction and associated signal quality in both the frequency and time domains. In particular, the CWL system proved superior to the other methods evaluated in improving spectral contrast in the alpha and beta bands and in recovering visual evoked responses. Based on the results of the evaluation study, we proposed guidelines for selecting the optimal method for MR artifact reduction.

Simultaneous EEG-fMRI: What Have We Learned and What Does the Future Hold?

Simultaneous EEG-fMRI has developed into a mature measurement technique in the past 25 years. During this time considerable technical and analytical advances have been made, enabling valuable scientific contributions to a range of research fields. This review will begin with an introduction to the measurement principles involved in EEG and fMRI and the advantages of combining these methods. The challenges faced when combining the two techniques will then be considered. An overview of the leading application fields where EEG-fMRI has made a significant contribution to the scientific literature and emerging applications in EEG-fMRI research trends is then presented.

Artifact Reduction in Simultaneous EEG-fMRI: A Systematic Review of Methods and Contemporary Usage

Simultaneous electroencephalography-functional MRI (EEG-fMRI) is a technique that combines temporal (largely from EEG) and spatial (largely from fMRI) indicators of brain dynamics. It is useful for understanding neuronal activity during many different event types, including spontaneous epileptic discharges, the activity of sleep stages, and activity evoked by external stimuli and decision-making tasks. However, EEG recorded during fMRI is subject to imaging, pulse, environment and motion artifact, causing noise many times greater than the neuronal signals of interest. Therefore, artifact removal methods are essential to ensure that artifacts are accurately removed, and EEG of interest is retained. This paper presents a systematic review of methods for artifact reduction in simultaneous EEG-fMRI from literature published since 1998, and an additional systematic review of EEG-fMRI studies published since 2016. The aim of the first review is to distill the literature into clear guidelines for use of simultaneous EEG-fMRI artifact reduction methods, and the aim of the second review is to determine the prevalence of artifact reduction method use in contemporary studies. We find that there are many published artifact reduction techniques available, including hardware, model based, and data-driven methods, but there are few studies published that adequately compare these methods. In contrast, recent EEG-fMRI studies show overwhelming use of just one or two artifact reduction methods based on literature published 15–20 years ago, with newer methods rarely gaining use outside the group that developed them. Surprisingly, almost 15% of EEG-fMRI studies published since 2016 fail to adequately describe the methods of artifact reduction utilized. We recommend minimum standards for reporting artifact reduction techniques in simultaneous EEG-fMRI studies and suggest that more needs to be done to make new artifact reduction techniques more accessible for the researchers and clinicians using simultaneous EEG-fMRI.

Ballistocardiogram Artifact Reduction in Simultaneous EEG-fMRI Using Deep Learning

OBJECTIVE

The concurrent recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a technique that has received much attention due to its potential for combined high temporal and spatial resolution. However, the ballistocardiogram (BCG), a large-amplitude artifact caused by cardiac induced movement contaminates the EEG during EEG-fMRI recordings. Removal of BCG in software has generally made use of linear decompositions of the corrupted EEG. This is not ideal as the BCG signal propagates in a manner which is non-linearly dependent on the electrocardiogram (ECG). In this paper, we present a novel method for BCG artifact suppression using recurrent neural networks (RNNs).

METHODS

EEG signals were recovered by training RNNs on the nonlinear mappings between ECG and the BCG corrupted EEG. We evaluated our model's performance against the commonly used Optimal Basis Set (OBS) method at the level of individual subjects, and investigated generalization across subjects.

RESULTS

We show that our algorithm can generate larger average power reduction of the BCG at critical frequencies, while simultaneously improving task relevant EEG based classification.

CONCLUSION

The presented deep learning architecture can be used to reduce BCG related artifacts in EEG-fMRI recordings.

SIGNIFICANCE

We present a deep learning approach that can be used to suppress the BCG artifact in EEG-fMRI without the use of additional hardware. This method may have scope to be combined with current hardware methods, operate in real-time and be used for direct modeling of the BCG.

Schrödinger filtering: a precise EEG despiking technique for EEG-fMRI gradient artifact

In EEG data acquired in the presence of fMRI, gradient-related spike artifacts contaminate the signal following the common preprocessing step of average artifact subtraction. Spike artifacts compromise EEG data quality since they overlap with the EEG signal in frequency, thereby confounding frequency-based inferences on activity. As well, spike artifacts can inflate or deflate correlations among time series, thereby confounding inferences on functional connectivity. We present Schrödinger filtering, which uses the Schrödinger equation to decompose the spike-containing input. The basis functions of the decomposition are localized and pulse-shaped, and selectively capture the various input peaks, with the spike components clustered at the beginning of the spectrum. Schrödinger filtering automatically subtracts the spike components from the data. On real and simulated data, we show that Schrödinger filtering (1) simultaneously accomplishes high spike removal and high signal preservation without affecting evoked activity, and (2) reduces spurious pairwise correlations in spontaneous activity. In these regards, Schrödinger filtering was significantly better than three other despiking techniques: median filtering, amplitude thresholding, and wavelet denoising. These results encourage the use of Schrödinger filtering in future EEG-fMRI pipelines, as well as in other spike-related applications (e.g., fMRI motion artifact removal or action potential extraction).

Design of TMS coils with reduced Lorentz forces: application to concurrent TMS-fMRI

OBJECTIVE

Interleaving TMS (transcranial magnetic stimulation) with fMRI (functional Magnetic Resonance Imaging) is a promising technique to study functional connectivity in the human brain, but its development is being restricted by technical limitations, such as that due to the interaction of the TMS current pulses with the magnetic fields of an MRI scanner. In this work, a TMS coil design method capable of controlling Lorentz forces experienced by the coil in the presence of static magnetic fields is presented.

APPROACH

The suggested approach is based on an existing inverse boundary element method (IBEM) for TMS coil design, in which new electromagnetic computational models of the Lorentz forces have been included to be controlled in the design process.

MAIN RESULTS

To demonstrate the validity of this technique, it has been used for the design and simulation of TMS coils wound on rectangular flat, spherical and hemispherical surfaces with improved mechanical stability. The obtained results confirm that TMS coils with reduced Lorentz forces inside the static main field of an MRI scanner can be produced, which is achieved to the detriment of other coil performance parameters.

SIGNIFICANCE

The proposed approach provides an efficient tool to design TMS stimulators of a wide range of coil geometries with improved mechanical stability, which can be extremely useful to overcome current limitations for interleaved TMS-fMRI.

Electroencephalography

The electroencephalogram (EEG) was invented almost 100 years ago and is still a method of choice for many research questions, even applications-from functional brain imaging in neuroscientific investigations during movement to real-time applications like brain-computer interfacing. This chapter gives some background information on the establishment and properties of the EEG. This chapter starts with a closer look at the sources of EEG at a micro or neuronal level, followed by recording techniques, types of electrodes, and common EEG artifacts. Then an overview on EEG phenomena, namely, spontaneous EEG and event-related potentials build the middle part of this chapter. The last part discusses brain signals, which are used in current BCI research, including short descriptions and examples of applications.

Direct modelling of gradient artifacts for EEG-fMRI denoising and motion tracking

OBJECTIVE

Simultaneous electroencephalography and functional magnetic resonance imaging recording (EEG-fMRI) has been widely used in neuroscientific and clinical research. The artifacts in the recorded EEG resulting from rapidly switching magnetic field gradients are usually corrected by average-artifact subtraction (AAS) due to their repetitive nature. But the performance of AAS is often disrupted by altered artifact waveforms across epochs, notably due to head motion.

APPROACH

Here, a method is proposed to make use of the known MR sequence gradient waveforms for a direct modelling of gradient artifacts. After accounting for filtering effects on the gradient artifacts, a continuous modulation of the gradient waveforms superimposed on the EEG signal is obtained.

MAIN RESULTS

Although a moving AAS template can adjust to slow drifts in gradient artifact variation, it fails to adapt to abrupt motion, resulting in residual noise. We demonstrate how this modelling approach can reduce motion-affected gradient artifacts without distorting the underlying neuronal signals. Moreover, the method provides useful head motion information highly correlated with motion tracked by an optical camera.

SIGNIFICANCE

Our work provides a novel way to improve gradient artifact removal in EEG-fMRI, and shows a potential to detect head motion without requiring additional hardware.

Simultaneous EEG-fMRI: Evaluating the Effect of the EEG Cap-Cabling Configuration on the Gradient Artifact

Electroencephalography (EEG) data recorded during simultaneous EEG-fMRI experiments are contaminated by large gradient artifacts (GA). The amplitude of the GA depends on the area of the wire loops formed by the EEG leads, as well as on the rate of switching of the magnetic field gradients, which are essential for MR imaging. Average artifact subtraction (AAS), the most commonly used method for GA correction, relies on the EEG amplifier having a large enough dynamic range to characterize the artifact voltages. Low-pass filtering (250 Hz cut-off) is generally used to attenuate the high-frequency voltage fluctuations of the GA, but even with this precaution channel saturation can occur, particularly during acquisition of high spatial resolution MRI data. Previous work has shown that the ribbon cable, used to connect the EEG cap and amplifier, makes a significant contribution to the GA, since the cable geometry produces large effective wire-loop areas. However, by appropriately connecting the wires of the ribbon cable to the EEG cap it should be possible to minimize the overall range and root mean square (RMS) amplitude of the GA by producing partial cancelation of the cap and cable contributions. Here by modifying the connections of the EEG cap to a 1 m ribbon cable we were able to reduce the range of the GA for a high-resolution coronal echo planar Imaging (EPI) acquisition by a factor of ∼ 1.6 and by a factor of ∼ 1.15 for a standard axial EPI acquisition. These changes could potentially be translated into a reduction in the required dynamic range, an increase in the EEG bandwidth or an increase in the achievable image resolution without saturation, all of which could be beneficially exploited in EEG-fMRI studies. The re-wiring could also prevent the system from saturating when small subject movements occur using the standard recording bandwidth.

Artifacts in EEG of simultaneous EEG-fMRI: pulse artifact remainders in the gradient artifact template are a source of artifact residuals after average artifact subtraction

OBJECTIVE

The simultaneous application of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) opens up new ways to investigate the human brain. The EEG recordings of simultaneous EEG-fMRI, however, are overlaid to a great degree by fMRI related artifacts and an artifact reduction is mandatory before any EEG analysis. The most severe artifacts-the gradient artifact and the pulse artifact-are repetitive. Average artifact subtraction (AAS) technique exploits the repetitiveness and is presumably the most often used artifact reduction technique. In this method artifact templates are calculated by averaging over adjacent artifact epochs and subsequently the templates are subtracted to reduce the artifacts. Although the AAS technique is one of the best performing methods, artifact residuals are usually present in the resulting EEG after applying the AAS technique. This work aims at identifying sources of the artifact residuals.

APPROACH

Application of the AAS technique to artificial EEG that is contaminated with artificial fMRI related artifacts.

MAIN RESULTS

A new source of artifact residuals was identified. It was found that the AAS technique itself adds artifacts to the EEG during gradient artifact reduction, because the gradient artifact template is corrupted by pulse artifact remainders.

SIGNIFICANCE

This work shows that using a standard number of 25 epochs to calculate the gradient artifact template-as suggested by the inventors of AAS-results in substantial artifact residuals and consequently to a low EEG quality. Furthermore, the work discusses how potential solutions to this problem have serious side effects such as loss of adaptivity of the AAS technique. Hence, this problem must be considered carefully already in the design of simultaneous EEG-fMRI experiments.

Exploring the relative efficacy of motion artefact correction techniques for EEG data acquired during simultaneous fMRI

Simultaneous EEG‐fMRI allows multiparametric characterisation of brain function, in principle enabling a more complete understanding of brain responses; unfortunately the hostile MRI environment severely reduces EEG data quality. Simply eliminating data segments containing gross motion artefacts [MAs] (generated by movement of the EEG system and head in the MRI scanner's static magnetic field) was previously believed sufficient. However recently the importance of removal of all MAs has been highlighted and new methods developed. A systematic comparison of the ability to remove MAs and retain underlying neuronal activity using different methods of MA detection and post‐processing algorithms is needed to guide the neuroscience community. Using a head phantom, we recorded MAs while simultaneously monitoring the motion using three different approaches: Reference Layer Artefact Subtraction (RLAS), Moiré Phase Tracker (MPT) markers and Wire Loop Motion Sensors (WLMS). These EEG recordings were combined with EEG responses to simple visual tasks acquired on a subject outside the MRI environment. MAs were then corrected using the motion information collected with each of the methods combined with different analysis pipelines. All tested methods retained the neuronal signal. However, often the MA was not removed sufficiently to allow accurate detection of the underlying neuronal signal. We show that the MA is best corrected using the RLAS combined with post‐processing using a multichannel, recursive least squares (M‐RLS) algorithm. This method needs to be developed further to enable practical utility; thus, WLMS combined with M‐RLS currently provides the best compromise between EEG data quality and practicalities of motion detection.

Effects of the Phantom Shape on the Gradient Artefact of Electroencephalography (EEG) Data in Simultaneous EEG–fMRI

Electroencephalography (EEG) signals greatly suffer from gradient artefacts (GAs) due to the time-varying field gradients in the magnetic resonance (MR) scanner during the simultaneous acquisition of EEG and functional magnetic resonance imaging (fMRI) data. The GAs are the principal contributors of artefacts while recording EEG inside an MR scanner, and most of them come from the interaction of the EEG cap and the subject’s head. Many researchers have been using a spherical phantom to characterize the GA in EEG data in combined EEG–fMRI studies. In this study, we investigated how the phantom shape could affect the characterization of the GA. EEG data were recorded with a spherical phantom, a head-shaped phantom, and six human subjects, individually, during the execution of customized and standard echo-planar imaging (EPI) sequences. The spatial potential maps of the root-mean-square (RMS) voltage of the GA over EEG channels for the trials with a head-shaped phantom closely mimicked those related to the human head rather than those obtained for the spherical phantom. This was confirmed by measuring the average similarity index (0.85/0.68). Moreover, a paired t-test showed that the head-shaped phantom’s and the spherical phantom’s data were significantly different (p < 0.005) from the subjects’ data, whereas the difference between the head-shaped phantom’s and the spherical phantom’s data was not significant (p = 0.07). The results of this study strongly suggest that a head-shaped phantom should be used for GA characterization studies in concurrent EEG–fMRI.

Exploring the origins of EEG motion artefacts during simultaneous fMRI acquisition: Implications for motion artefact correction

Motion artefacts (MAs) are induced within EEG data collected simultaneously with fMRI when the subject's head rotates relative to the magnetic field. The effects of these artefacts have generally been ameliorated by removing periods of data during which large artefact voltages appear in the EEG traces. However, even when combined with other standard post-processing methods, this strategy does not remove smaller MAs which can dominate the neuronal signals of interest. A number of methods are therefore being developed to characterise the MA by measuring reference signals and then using these in artefact correction. These methods generally assume that the head and EEG cap, plus any attached sensors, form a rigid body which can be characterised by a standard set of six motion parameters. Here we investigate the motion of the head/EEG cap system to provide a better understanding of MAs. We focus on the reference layer artefact subtraction (RLAS) approach, as this allows measurement of a separate reference signal for each electrode that is being used to measure brain activity.

Through a series of experiments on phantoms and subjects, we find that movement of the EEG cap relative to the phantom and skin on the forehead is relatively small and that this non-rigid body movement does not appear to cause considerable discrepancy in artefacts between the scalp and reference signals. However, differences in the amplitude of these signals is observed which may be due to differences in geometry of the system from which the reference signals are measured compared with the brain signals. In addition, we find that there is non-rigid body movement of the skull and skin which produces an additional MA component for a head shake, which is not present for a head nod. This results in a large discrepancy in the amplitude and temporal profile of the MA measured on the scalp and reference layer, reducing the efficacy of MA correction based on the reference signals.

Together our data suggest that the efficacy of the correction of MA using any reference-based system is likely to differ for different types of head movement with head shake being the hardest to correct. This provides new information to inform the development of hardware and post-processing methods for removing MAs from EEG data acquired simultaneously with fMRI data.

Online Reduction of Artifacts in EEG of Simultaneous EEG-fMRI Using Reference Layer Adaptive Filtering (RLAF)

Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) allow us to study the active human brain from two perspectives concurrently. Signal processing based artifact reduction techniques are mandatory for this, however, to obtain reasonable EEG quality in simultaneous EEG-fMRI. Current artifact reduction techniques like average artifact subtraction (AAS), typically become less effective when artifact reduction has to be performed on-the-fly. We thus present and evaluate a new technique to improve EEG quality online. This technique adds up with online AAS and combines a prototype EEG-cap for reference recordings of artifacts, with online adaptive filtering and is named reference layer adaptive filtering (RLAF). We found online AAS + RLAF to be highly effective in improving EEG quality. Online AAS + RLAF outperformed online AAS and did so in particular online in terms of the chosen performance metrics, these being specifically alpha rhythm amplitude ratio between closed and opened eyes (3-45% improvement), signal-to-noise-ratio of visual evoked potentials (VEP) (25-63% improvement), and VEPs variability (16-44% improvement). Further, we found that EEG quality after online AAS + RLAF is occasionally even comparable with the offline variant of AAS at a 3T MRI scanner. In conclusion RLAF is a very effective add-on tool to enable high quality EEG in simultaneous EEG-fMRI experiments, even when online artifact reduction is necessary.

Process-specific analysis in episodic memory retrieval using fast optical signals and hemodynamic signals in the right prefrontal cortex

OBJECTIVE

Memory is formed by the interaction of various brain functions at the item and task level. Revealing individual and combined effects of item- and task-related processes on retrieving episodic memory is an unsolved problem because of limitations in existing neuroimaging techniques. To investigate these issues, we analyze fast and slow optical signals measured from a custom-built continuous wave functional near-infrared spectroscopy (CW-fNIRS) system.

APPROACH

In our work, we visually encode the words to the subjects and let them recall the words after a short rest. The hemodynamic responses evoked by the episodic memory are compared with those evoked by the semantic memory in retrieval blocks. In the fast optical signal, we compare the effects of old and new items (previously seen and not seen) to investigate the item-related process in episodic memory. The Kalman filter is simultaneously applied to slow and fast optical signals in different time windows.

MAIN RESULTS

A significant task-related HbR decrease was observed in the episodic memory retrieval blocks. Mean amplitude and peak latency of a fast optical signal are dependent upon item types and reaction time, respectively. Moreover, task-related hemodynamic and item-related fast optical responses are correlated in the right prefrontal cortex.

SIGNIFICANCE

We demonstrate that episodic memory is retrieved from the right frontal area by a functional connectivity between the maintained mental state through retrieval and item-related transient activity. To the best of our knowledge, this demonstration of functional NIRS research is the first to examine the relationship between item- and task-related memory processes in the prefrontal area using single modality.