A unified canonical correlation analysis-based framework for removing gradient artifact in concurrent EEG/fMRI recording and motion artifact in walking recording from EEG signal

NeuXus open-source tool for real-time artifact reduction in simultaneous EEG-fMRI

The simultaneous acquisition of electroencephalography and functional magnetic resonance imaging (EEG-fMRI) allows the complementary study of the brain's electrophysiology and hemodynamics with high temporal and spatial resolution. One application with great potential is neurofeedback training of targeted brain activity, based on the real-time analysis of the EEG and/or fMRI signals. This depends on the ability to reduce in real time the severe artifacts affecting the EEG signal acquired with fMRI, mainly the gradient and pulse artifacts. A few methods have been proposed for this purpose, but they are either slow, hardware-dependent, publicly unavailable, or proprietary software. Here, we present a fully open-source and publicly available tool for real-time EEG artifact reduction in simultaneous EEG-fMRI recordings that is fast and applicable to any hardware. Our tool is integrated in the Python toolbox NeuXus for real-time EEG processing and adapts to a real-time scenario well-established artifact average subtraction methods combined with a long short-term memory network for R peak detection. We benchmarked NeuXus on three different datasets, in terms of artifact power reduction and background signal preservation in resting state, alpha-band power reactivity to eyes closure, and event-related desynchronization during motor imagery. We showed that NeuXus performed at least as well as the only available real-time tool for conventional hardware setups (BrainVision's RecView) and a well-established offline tool (EEGLAB's FMRIB plugin). We also demonstrated NeuXus' real-time ability by reporting execution times under 250 ms. In conclusion, we present and validate the first fully open-source and hardware-independent solution for real-time artifact reduction in simultaneous EEG-fMRI studies.

Effect of 3D paradigm synchronous motion for SSVEP-based hybrid BCI-VR system

A brain-computer interface (BCI) system and virtual reality (VR) are integrated as a more interactive hybrid system (BCI-VR) that allows the user to manipulate the car. A virtual scene in the VR system that is the same as the physical environment is built, and the object's movement can be observed in the VR scene. The four-class three-dimensional (3D) paradigm is designed and moves synchronously in virtual reality. The dynamic paradigm may affect their attention according to the experimenters' feedback. Fifteen subjects in our experiment steered the car according to a specified motion trajectory. According to our online experimental result, different motion trajectories of the paradigm have various effects on the system's performance, and training can mitigate this adverse effect. Moreover, the hybrid system using frequencies between 5 and 10 Hz indicates better performance than those using lower or higher stimulation frequencies. The experiment results show a maximum average accuracy of 0.956 and a maximum information transfer rate (ITR) of 41.033 bits/min. It suggests that a hybrid system provides a high-performance way of brain-computer interaction. This research could encourage more interesting applications involving BCI and VR technologies.

Removal of movement-induced EEG artifacts: current state of the art and guidelines

Electroencephalography (EEG) is a non-invasive technique used to record cortical neurons' electrical activity using electrodes placed on the scalp. It has become a promising avenue for research beyond state-of-the-art EEG research that is conducted under static conditions. EEG signals are always contaminated by artifacts and other physiological signals. Artifact contamination increases with the intensity of movement. In the last decade (since 2010), researchers have started to implement EEG measurements in dynamic setups to increase the overall ecological validity of the studies. Many different methods are used to remove non-brain activity from the EEG signal, and there are no clear guidelines on which method should be used in dynamic setups and for specific movement intensities. Currently, the most common methods for removing artifacts in movement studies are methods based on independent component analysis (ICA). However, the choice of method for artifact removal depends on the type and intensity of movement, which affects the characteristics of the artifacts and the EEG parameters of interest. When dealing with EEG under non-static conditions, special care must be taken already in the designing period of an experiment. Software and hardware solutions must be combined to achieve sufficient removal of unwanted signals from EEG measurements. We have provided recommendations for the use of each method depending on the intensity of the movement and highlighted the advantages and disadvantages of the methods. However, due to the current gap in the literature, further development and evaluation of methods for artifact removal in EEG data during locomotion is needed.

Progress and Challenges in Physiological Artifacts' Detection in Electroencephalographic Readings

BACKGROUND

Electroencephalographic (EEG) recordings are used to trace neural activity within the cortex to study brain functioning over time.

INTRODUCTION

During data acquisition, the unequivocal way to reduce artifact is to avoid artifact stimulating events. Though there are certain artifacts that make this task challenging due to their association with the internal human mechanism, in the human-computer interface, these physiological artifacts are of great assistance and act as a command signal for controlling a device or an application (communication). That is why pre-processing of electroencephalographic readings has been a progressive area of exploration, as none of the published work can be viewed as a benchmark for constructive artifact handling.

METHOD

This review offers a comprehensive insight into state of the art physiological artifact removal techniques listed so far. The study commences from the single-stage traditional techniques to the multistage techniques, examining the pros and cons of each discussed technique. Also, this review paper gives a general idea of various datasets available and briefs the topical trend in EEG signal processing.

RESULT

Comparing the state of the art techniques with hybrid ones on the basis of performance and computational complexity, it has been observed that the single-channel techniques save computational time but lack in effective artifact removal especially physiological artifacts. On the other hand, hybrid techniques merge the essential characteristics resulting in increased performance, but time consumption and complexity remain an issue.

CONCLUSION

Considering the high probability of the presence of multiple artifacts in EEG channels, a trade-off between performance, time and computational complexity is the only key for effective processing of artifacts in the time ahead. This paper is anticipated to facilitate upcoming researchers in enriching the contemporary artifact handling techniques to mitigate the expert's burden.

Artifact Reduction in Simultaneous EEG-fMRI: A Systematic Review of Methods and Contemporary Usage

Simultaneous electroencephalography-functional MRI (EEG-fMRI) is a technique that combines temporal (largely from EEG) and spatial (largely from fMRI) indicators of brain dynamics. It is useful for understanding neuronal activity during many different event types, including spontaneous epileptic discharges, the activity of sleep stages, and activity evoked by external stimuli and decision-making tasks. However, EEG recorded during fMRI is subject to imaging, pulse, environment and motion artifact, causing noise many times greater than the neuronal signals of interest. Therefore, artifact removal methods are essential to ensure that artifacts are accurately removed, and EEG of interest is retained. This paper presents a systematic review of methods for artifact reduction in simultaneous EEG-fMRI from literature published since 1998, and an additional systematic review of EEG-fMRI studies published since 2016. The aim of the first review is to distill the literature into clear guidelines for use of simultaneous EEG-fMRI artifact reduction methods, and the aim of the second review is to determine the prevalence of artifact reduction method use in contemporary studies. We find that there are many published artifact reduction techniques available, including hardware, model based, and data-driven methods, but there are few studies published that adequately compare these methods. In contrast, recent EEG-fMRI studies show overwhelming use of just one or two artifact reduction methods based on literature published 15–20 years ago, with newer methods rarely gaining use outside the group that developed them. Surprisingly, almost 15% of EEG-fMRI studies published since 2016 fail to adequately describe the methods of artifact reduction utilized. We recommend minimum standards for reporting artifact reduction techniques in simultaneous EEG-fMRI studies and suggest that more needs to be done to make new artifact reduction techniques more accessible for the researchers and clinicians using simultaneous EEG-fMRI.

Thoughts on neurophysiological signal analysis and classification

Neurophysiological signals are crucial intermediaries, through which brain activity can be quantitatively measured and brain mechanisms are able to be revealed. In particular, non‐invasive neurophysiological signals, such as electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), are welcomed and frequently utilised in various studies since these signals can be non‐invasively recorded without harming the human brain while they convey abundant information pertaining to brain activity. The recorded neurophysiological signals are analysed to mine meaningful information for the understanding of brain mechanisms or are classified to distinguish different patterns (e.g., different cognitive states, brain diseases versus healthy controls). To date, remarkable progress has been made in both the analysis and classification of neurophysiological signals, but scholars are not feeling complacent. Consistent effort ought to be paid to advance the research of analysis and classification based on neurophysiological signals. In this paper, I express my thoughts regarding promising future directions in neurophysiological signal analysis and classification based on current developments and accomplishments. I will elucidate the thoughts after brief summaries of relevant backgrounds, accomplishments, and tendencies. According to my personal selection and preference, I mainly focus on brain connectivity, multidimensional array (tensor), multi‐modality, multiple task classification, deep learning, big data, and naturalistic experiment. Hopefully, my thoughts could give a little help to inspire new ideas and contribute to the research of the analysis and classification of neurophysiological signals in some way.

A Real-Time Movement Artifact Removal Method for Ambulatory Brain-Computer Interfaces

Recently, practical brain-computer interfaces (BCIs) have been widely investigated for detecting human intentions in real world. However, performance differences still exist between the laboratory and the real world environments. One of the main reasons for such differences comes from the user's unstable physical states (e.g., human movements are not strictly controlled), which produce unexpected signal artifacts. Hence, to minimize the performance degradation of electroencephalography (EEG)-based BCIs, we present a novel artifact removal method named constrained independent component analysis with online learning (cIOL). The cIOL can find and reject the noise-like components related to human body movements (i.e., movement artifacts) in the EEG signals. To obtain movement information, isolated electrodes are used to block electrical signals from the brain using high-resistance materials. We estimate artifacts with movement information using constrained independent component analysis from EEG signals and then extract artifact-free signals using online learning in each sample. In addition, the cIOL is evaluated by signal processing under 16 different experimental conditions (two types of EEG devices × two BCI paradigms × four different walking speeds). The experimental results show that the cIOL has the highest accuracy in both scalp- and ear-EEG, and has the highest signal-to-noise ratio in scalp-EEG among the state-of-the-art methods, except for the case of steady-state visual evoked potential at 2.0 m/s with superposition problem.

A technical review of canonical correlation analysis for neuroscience applications

Collecting comprehensive data sets of the same subject has become a standard in neuroscience research and uncovering multivariate relationships among collected data sets have gained significant attentions in recent years. Canonical correlation analysis (CCA) is one of the powerful multivariate tools to jointly investigate relationships among multiple data sets, which can uncover disease or environmental effects in various modalities simultaneously and characterize changes during development, aging, and disease progressions comprehensively. In the past 10 years, despite an increasing number of studies have utilized CCA in multivariate analysis, simple conventional CCA dominates these applications. Multiple CCA-variant techniques have been proposed to improve the model performance; however, the complicated multivariate formulations and not well-known capabilities have delayed their wide applications. Therefore, in this study, a comprehensive review of CCA and its variant techniques is provided. Detailed technical formulation with analytical and numerical solutions, current applications in neuroscience research, and advantages and limitations of each CCA-related technique are discussed. Finally, a general guideline in how to select the most appropriate CCA-related technique based on the properties of available data sets and particularly targeted neuroscience questions is provided.

Brain Functional Connectivity in Unconstrained Walking With and Without an Exoskeleton

An exoskeleton is utilized to effectively restore the motor function of amputees' limbs and is frequently employed in motor rehabilitation training during convalescence. Understanding of exoskeleton impact on the brain is required in order to better and more efficiently use the exoskeleton. Almost all previous studies investigated the exoskeleton effect on the brain in a situation with constraints such as predefined walking speed, which could lead to findings differed from that obtained in an unconstrained situation. We, therefore, performed an experiment of unconstrained walking with and without an exoskeleton. Both individual connections and graph metrics were explored and compared among walking conditions. We found that low-order functional connections and associated high-order functional connections mainly between the left centroparietal region and right frontal region were significantly different among walking conditions. Generally speaking, connective strength was enhanced in LOFC and was decreased in aHOFC when assistant force was provided by the exoskeleton. Further, we proposed connection length investigation and revealed the large majority of these connections were long-distance connectivity. Graph metric investigation discovered higher connectivity clustering in the walking with low exoskeleton-aided force compared to the walking without the exoskeleton. This study expanded the existing knowledge of the effect of exoskeleton on the brain and is of implications on new exoskeleton development and exoskeleton-aided rehabilitation training.

Unilateral Exoskeleton Imposes Significantly Different Hemispherical Effect in Parietooccipital Region, but Not in Other Regions

In modern society, increasing people suffering from locomotor disabilities need an assistive exoskeleton to help them improve or restore ambulation. When walking is assisted by an exoskeleton, brain activities are altered as the closed-loop between brain and lower limbs is affected by the exoskeleton. Intuitively, a unilateral exoskeleton imposes differential effect on brain hemispheres (i.e., hemispherical effect) according to contralateral control mechanism. However, it is unclear whether hemispherical effect appears in whole hemisphere or particular region. To this end, we explored hemispherical effect on different brain regions using EEG data collected from 30 healthy participants during overground walking. The results showed that hemispherical effect was significantly different between regions when a unilateral exoskeleton was employed for walking assistance and no significance was observed for walking without the exoskeleton. Post-hoc t-test analysis revealed that hemispherical effect in the parietooccipital region significantly differed from other regions. In the parietooccipital region, a greater hemispherical effect was observed in beta band for exoskeleton-assisted walking compared to walking without exoskeleton, which was also found in the source analysis. These findings deepen the understanding of hemispherical effect of unilateral exoskeleton on brain and could aid the development of more efficient and suitable exoskeleton for walking assistance.