An EEG-fNIRS neurovascular coupling analysis method to investigate cognitive-motor interference

BACKGROUND AND OBJECTIVE

The simultaneous execution of a motor and cognitive dual task may lead to the deterioration of task performance in one or both tasks due to cognitive-motor interference (CMI). Neuroimaging techniques are promising ways to reveal the underlying neural mechanism of CMI. However, existing studies have only explored CMI from a single neuroimaging modality, which lack built-in validation and comparison of analysis results. This work is aimed to establish an effective analysis framework to comprehensively investigate the CMI by exploring the electrophysiological and hemodynamic activities as well as their neurovascular coupling.

METHODS

Experiments including an upper limb single motor task, single cognitive task, and cognitive-motor dual task were designed and performed with 16 healthy young participants. Bimodal signals of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were recorded simultaneously during the experiments. A novel bimodal signal analysis framework was proposed to extract the task-related components for EEG and fNIRS signals respectively and analyze their correlation. Indicators including within-class similarity and between-class distance were utilized to validate the effectiveness of the proposed analysis framework compared to the canonical channel-averaged method. Statistical analysis was performed to investigate the difference in the behavior and neural correlates between the single and dual tasks.

RESULTS

Our results revealed that the extra cognitive interference caused divided attention in the dual task, which led to the decreased neurovascular coupling between fNIRS and EEG in all theta, alpha, and beta rhythms. The proposed framework was demonstrated to have a better ability in characterizing the neural patterns than the canonical channel-averaged method with significantly higher within-class similarity and between-class distance indicators.

CONCLUSIONS

This study proposed a method to investigate CMI by exploring the task-related electrophysiological and hemodynamic activities as well as their neurovascular coupling. Our concurrent EEG-fNIRS study provides new insight into the EEG-fNIRS correlation analysis and novel evidence for the mechanism of neurovascular coupling in the CMI.

Multimodal motor imagery decoding method based on temporal spatial feature alignment and fusion

Objective. A motor imagery-based brain-computer interface (MI-BCI) translates spontaneous movement intention from the brain to outside devices. Multimodal MI-BCI that uses multiple neural signals contains rich common and complementary information and is promising for enhancing the decoding accuracy of MI-BCI. However, the heterogeneity of different modalities makes the multimodal decoding task difficult. How to effectively utilize multimodal information remains to be further studied.Approach. In this study, a multimodal MI decoding neural network was proposed. Spatial feature alignment losses were designed to enhance the feature representations extracted from the heterogeneous data and guide the fusion of features from different modalities. An attention-based modality fusion module was built to align and fuse the features in the temporal dimension. To evaluate the proposed decoding method, a five-class MI electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) dataset were constructed.Main results and significance. The comparison experimental results showed that the proposed decoding method achieved higher decoding accuracy than the compared methods on both the self-collected dataset and a public dataset. The ablation results verified the effectiveness of each part of the proposed method. Feature distribution visualization results showed that the proposed losses enhance the feature representation of EEG and fNIRS modalities. The proposed method based on EEG and fNIRS modalities has significant potential for improving decoding performance of MI tasks.

Word Structure Tunes Electrophysiological and Hemodynamic Responses in the Frontal Cortex

To date, it is still unclear how word structure might impact lexical processing in the brain for languages with an impoverished system of grammatical morphology such as Chinese. In this study, concurrent electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) recordings were performed to inspect the temporal and spatial brain activities that are related to Chinese word structure (compound vs. derivation vs. non-morphological) effects. A masked priming paradigm was utilized on three lexical conditions (compound constitute priming, derivation constitute priming, and non-morphological priming) to tap Chinese native speakers' structural sensitivity to differing word structures. The compound vs. derivation structure effect was revealed by the behavioral data as well as the temporal and spatial brain activation patterns. In the masked priming task, Chinese derivations exhibited significantly enhanced brain activation in the frontal cortex and involved broader brain networks as compared with lexicalized compounds. The results were interpreted by the differing connection patterns between constitute morphemes within a given word structure from a spreading activation perspective. More importantly, we demonstrated that the Chinese word structure effect showed a distinct brain activation pattern from that of the dual-route mechanism in alphabetic languages. Therefore, this work paved a new avenue for comprehensively understanding the underlying cognitive neural mechanisms associated with Chinese derivations and coordinate compounds.

Challenges and future trends in wearable closed-loop neuromodulation to efficiently treat methamphetamine addiction

Achieving abstinence from drugs is a long journey and can be particularly challenging in the case of methamphetamine, which has a higher relapse rate than other drugs. Therefore, real-time monitoring of patients' physiological conditions before and when cravings arise to reduce the chance of relapse might help to improve clinical outcomes. Conventional treatments, such as behavior therapy and peer support, often cannot provide timely intervention, reducing the efficiency of these therapies. To more effectively treat methamphetamine addiction in real-time, we propose an intelligent closed-loop transcranial magnetic stimulation (TMS) neuromodulation system based on multimodal electroencephalogram-functional near-infrared spectroscopy (EEG-fNIRS) measurements. This review summarizes the essential modules required for a wearable system to treat addiction efficiently. First, the advantages of neuroimaging over conventional techniques such as analysis of sweat, saliva, or urine for addiction detection are discussed. The knowledge to implement wearable, compact, and user-friendly closed-loop systems with EEG and fNIRS are reviewed. The features of EEG and fNIRS signals in patients with methamphetamine use disorder are summarized. EEG biomarkers are categorized into frequency and time domain and topography-related parameters, whereas for fNIRS, hemoglobin concentration variation and functional connectivity of cortices are described. Following this, the applications of two commonly used neuromodulation technologies, transcranial direct current stimulation and TMS, in patients with methamphetamine use disorder are introduced. The challenges of implementing intelligent closed-loop TMS modulation based on multimodal EEG-fNIRS are summarized, followed by a discussion of potential research directions and the promising future of this approach, including potential applications to other substance use disorders.

Multimodal Autoencoder Predicts fNIRS Resting State From EEG Signals

In this work, we introduce a deep learning architecture for evaluation on multimodal electroencephalographic (EEG) and functional near-infrared spectroscopy (fNIRS) recordings from 40 epileptic patients. Long short-term memory units and convolutional neural networks are integrated within a multimodal sequence-to-sequence autoencoder. The trained neural network predicts fNIRS signals from EEG, sans a priori, by hierarchically extracting deep features from EEG full spectra and specific EEG frequency bands. Results show that higher frequency EEG ranges are predictive of fNIRS signals with the gamma band inputs dominating fNIRS prediction as compared to other frequency envelopes. Seed based functional connectivity validates similar patterns between experimental fNIRS and our model's fNIRS reconstructions. This is the first study that shows it is possible to predict brain hemodynamics (fNIRS) from encoded neural data (EEG) in the resting human epileptic brain based on power spectrum amplitude modulation of frequency oscillations in the context of specific hypotheses about how EEG frequency bands decode fNIRS signals.

Hemodynamic changes during posterior epilepsies: an EEG-fNIRS study

Posterior epilepsies are mainly characterized clinically by visual symptoms. Functional near-infrared spectroscopy (fNIRS) is an emerging non-invasive imaging technique that has the potential to monitor hemodynamic changes during epileptic activity. Combined with electroencephalography (EEG), 9 patients with posterior epilepsies were recorded using EEG-fNIRS with large sampling (19 EEG electrodes and over 100 fNIRS channels). Spikes and seizures were carefully marked on EEG traces, and convolved with a standard hemodynamic response function for general linear model (GLM) analysis. GLM results for seizures (in 3 patients) and spikes (7 patients) were broadly sensitive to the epileptic focus in 7/9 patients, and specific in 5/9 patients with fNIRS deoxyhemoglobin responses lateralized to the correct lobe, and to plausible locations within the occipital or parietal lobes. This work provides evidence that EEG-fNIRS is a sensitive technique for monitoring posterior epileptic activity.