Hemodynamic correlates of spontaneous neural activity measured by human whole-head resting state EEG+fNIRS

Inter-brain entrainment (IBE) during interoception. A multimodal EEG-fNIRS coherence-based hyperscanning approach

This work examined the impact of interoceptive manipulation and the presence of a shared goal on inter-brain entrainment (IBE) during a motor synchronization task. A multimodal functional Near Infrared Spectroscopy - Electroencephalogram (fNIRS-EEG) system-based hyperscanning approach was applied to 13 dyads performing the motor synchrony task during an interoceptive (focus on the breath) and control condition. Additionally, two version of the motor task-one with and one without a clearly defined common goal-were presented to participants to emphasize the task's collaborative purpose. The multimodal approach was exploited to record the electrophysiological (EEG) cortical oscillation and hemodynamic (oxy-Hb and deoxy-Hb) levels. Results revealed significant correlations between EEG delta, theta, and alpha band and hemodynamic oxy-Hb in the left compared to right hemisphere for the interoceptive confronted with the control condition. This significant EEG/fNIRS IBE correlation was also found for delta and theta band whereas the task was presented with an explicit shared goal confronted with the no-social version. In addition to separate functional connectivity EEG and fNIRS analysis, this study proposed a novel analysis pipeline including statistical tests for examining the coherence between functional connectivity EEG-fNIRS signals within couples. Besides proposing methodological advancements on EEG-fNIRS signals hyperscanning analysis, this research demonstrated that, in dyads undertaking a motor synchronization task, both the interoceptive attention to respiration and an explicit joint intention activate left anterior regions.

Neurovascular coupling in the attention during visual working memory processes

Focusing attention in visual working memory (vWM) depends on the ability to filter distractors and expand the scope of targets. Although many properties of attention processes in vWM have been well documented, it remains unclear how the mechanisms of neurovascular coupling (NVC) function during attention processes in vWM. Here, we show simultaneous multimodal data that reveal the similar temporal and spatial features of attention processes during vWM. These similarities lead to common NVC outcomes across individuals. When filtering out distractors, the electroencephalography (EEG)-informed NVC displayed broader engagement across the frontoparietal network. A negative correlation may exist between behavioral metrics and EEG-informed NVC strength related to attention control. On a dynamic basis, NVC features exhibited higher discriminatory power in predicting behavior than other features alone. These results underscore how multimodal approaches can advance our understanding of the role of attention in vWM, and how NVC fluctuations are associated with actual behavior.

Investigation of electro-vascular phase-amplitude coupling during an auditory task

Multimodal neuroimaging using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides complementary views of cortical processes, including those related to auditory processing. However, current multimodal approaches often overlook potential insights that can be gained from nonlinear interactions between electrical and hemodynamic signals. Here, we explore electro-vascular phase-amplitude coupling (PAC) between low-frequency hemodynamic and high-frequency electrical oscillations during an auditory task. We further apply a temporally embedded canonical correlation analysis (tCCA)-general linear model (GLM)-based correction approach to reduce the possible effect of systemic physiology on fNIRS recordings. Before correction, we observed significant PAC between fNIRS and broadband EEG in the frontal region (p ≪ 0.05), β (p ≪ 0.05) and γ (p = 0.010) in the left temporal/temporoparietal (left auditory; LA) region, and γ (p = 0.032) in the right temporal/temporoparietal (right auditory; RA) region across the entire dataset. Significant differences in PAC across conditions (task versus silence) were observed in LA (p = 0.023) and RA (p = 0.049) γ sub-bands and in lower frequency (5-20 Hz) frontal activity (p = 0.005). After correction, significant fNIRS-γ-band PAC was observed in the frontal (p = 0.021) and LA (p = 0.025) regions, while fNIRS-α (p = 0.003) and fNIRS-β (p = 0.041) PAC were observed in RA. Decreased frontal γ-band (p = 0.008) and increased β-band (p ≪ 0.05) PAC were observed during the task. These outcomes represent the first characterization of electro-vascular PAC between fNIRS and EEG signals during an auditory task, providing insights into electro-vascular coupling in auditory processing.

A model of neurovascular coupling and its application to cortical spreading depolarization

Cortical spreading depolarization (CSD) is a neuropathological condition involving propagating waves of neuronal silence, and is related to multiple diseases, such as migraine aura, traumatic brain injury (TBI), stroke, and cardiac arrest, as well as poor outcome of patients. While CSDs of different severity share similar roots on the ion exchange level, they can lead to different vascular responses (namely spreading hyperemia and spreading ischemia). In this paper, we propose a mathematical model relating neuronal activities to predict vascular changes as measured with near-infrared spectroscopy (NIRS) and fMRI recordings, and apply it to the extreme case of CSD, where sustained near-complete neuronal depolarization is seen. We utilize three serially connected models (namely, ion exchange, neurovascular coupling, and hemodynamic model) which are described by differential equations. Propagating waves of ion concentrations, as well as the associated vasodynamics and hemodynamics, are simulated by solving these equations. Our proposed model predicts vasodynamics and hemodynamics that agree both qualitatively and quantitatively with experimental literature. Mathematical modeling and simulation offer a powerful tool to help understand the underlying mechanisms of CSD and help interpret the data. In addition, it helps develop novel monitoring techniques prior to data collection. Our simulated results strongly suggest that fMRI is unable to reliably distinguish between spreading hyperemia and spreading ischemia, while NIRS signals are substantially distinct in the two cases.

Diffuse Optical Tomography Spatial Prior for EEG Source Localization in Human Visual Cortex

Electroencephalography (EEG) and diffuse optical tomography (DOT) are imaging methods which are widely used for neuroimaging. While the temporal resolution of EEG is high, the spatial resolution is typically limited. DOT, on the other hand, has high spatial resolution, but the temporal resolution is inherently limited by the slow hemodynamics it measures. In our previous work, we showed using computer simulations that when using the results of DOT reconstruction as the spatial prior for EEG source reconstruction, high spatio-temporal resolution could be achieved. In this work, we experimentally validate the algorithm by alternatingly flashing two visual stimuli at a speed that is faster than the temporal resolution of DOT. We show that the joint reconstruction using both EEG and DOT clearly resolves the two stimuli temporally, and the spatial confinement is drastically improved in comparison to reconstruction using EEG alone.

An EEG-fNIRS neurovascular coupling analysis method to investigate cognitive-motor interference

BACKGROUND AND OBJECTIVE

The simultaneous execution of a motor and cognitive dual task may lead to the deterioration of task performance in one or both tasks due to cognitive-motor interference (CMI). Neuroimaging techniques are promising ways to reveal the underlying neural mechanism of CMI. However, existing studies have only explored CMI from a single neuroimaging modality, which lack built-in validation and comparison of analysis results. This work is aimed to establish an effective analysis framework to comprehensively investigate the CMI by exploring the electrophysiological and hemodynamic activities as well as their neurovascular coupling.

METHODS

Experiments including an upper limb single motor task, single cognitive task, and cognitive-motor dual task were designed and performed with 16 healthy young participants. Bimodal signals of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were recorded simultaneously during the experiments. A novel bimodal signal analysis framework was proposed to extract the task-related components for EEG and fNIRS signals respectively and analyze their correlation. Indicators including within-class similarity and between-class distance were utilized to validate the effectiveness of the proposed analysis framework compared to the canonical channel-averaged method. Statistical analysis was performed to investigate the difference in the behavior and neural correlates between the single and dual tasks.

RESULTS

Our results revealed that the extra cognitive interference caused divided attention in the dual task, which led to the decreased neurovascular coupling between fNIRS and EEG in all theta, alpha, and beta rhythms. The proposed framework was demonstrated to have a better ability in characterizing the neural patterns than the canonical channel-averaged method with significantly higher within-class similarity and between-class distance indicators.

CONCLUSIONS

This study proposed a method to investigate CMI by exploring the task-related electrophysiological and hemodynamic activities as well as their neurovascular coupling. Our concurrent EEG-fNIRS study provides new insight into the EEG-fNIRS correlation analysis and novel evidence for the mechanism of neurovascular coupling in the CMI.

Error-related brain state analysis using electroencephalography in conjunction with functional near-infrared spectroscopy during a complex surgical motor task

Error-based learning is one of the basic skill acquisition mechanisms that can be modeled as a perception-action system and investigated based on brain-behavior analysis during skill training. Here, the error-related chain of mental processes is postulated to depend on the skill level leading to a difference in the contextual switching of the brain states on error commission. Therefore, the objective of this paper was to compare error-related brain states, measured with multi-modal portable brain imaging, between experts and novices during the Fundamentals of Laparoscopic Surgery (FLS) "suturing and intracorporeal knot-tying" task (FLS complex task)-the most difficult among the five psychomotor FLS tasks. The multi-modal portable brain imaging combined functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) for brain-behavior analysis in thirteen right-handed novice medical students and nine expert surgeons. The brain state changes were defined by quasi-stable EEG scalp topography (called microstates) changes using 32-channel EEG data acquired at 250 Hz. Six microstate prototypes were identified from the combined EEG data from experts and novices during the FLS complex task that explained 77.14% of the global variance. Analysis of variance (ANOVA) found that the proportion of the total time spent in different microstates during the 10-s error epoch was significantly affected by the skill level (p < 0.01), the microstate type (p < 0.01), and the interaction between the skill level and the microstate type (p < 0.01). Brain activation based on the slower oxyhemoglobin (HbO) changes corresponding to the EEG band power (1-40 Hz) changes were found using the regularized temporally embedded Canonical Correlation Analysis of the simultaneously acquired fNIRS-EEG signals. The HbO signal from the overlying the left inferior frontal gyrus-opercular part, left superior frontal gyrus-medial orbital, left postcentral gyrus, left superior temporal gyrus, right superior frontal gyrus-medial orbital cortical areas showed significant (p < 0.05) difference between experts and novices in the 10-s error epoch. We conclude that the difference in the error-related chain of mental processes was the activation of cognitive top-down attention-related brain areas, including left dorsolateral prefrontal/frontal eye field and left frontopolar brain regions, along with a 'focusing' effect of global suppression of hemodynamic activation in the experts, while the novices had a widespread stimulus(error)-driven hemodynamic activation without the 'focusing' effect.

Screening for Alzheimer's disease using prefrontal resting-state functional near-infrared spectroscopy

INTRODUCTION

Alzheimer's disease (AD) is neurodegenerative dementia that causes neurovascular dysfunction and cognitive impairment. Currently, 50 million people live with dementia worldwide, and there are nearly 10 million new cases every year. There is a need for relatively less costly and more objective methods of screening and early diagnosis.

METHODS

Functional near-infrared spectroscopy (fNIRS) systems are a promising solution for the early Detection of AD. For a practical clinically relevant system, a smaller number of optimally placed channels are clearly preferable. In this study, we investigated the number and locations of the best-performing fNIRS channels measuring prefrontal cortex activations. Twenty-one subjects diagnosed with AD and eighteen healthy controls were recruited for the study.

RESULTS

We have shown that resting-state fNIRS recordings from a small number of prefrontal locations provide a promising methodology for detecting AD and monitoring its progression. A high-density continuous-wave fNIRS system was first used to verify the relatively lower hemodynamic activity in the prefrontal cortical areas observed in patients with AD. By using the episode averaged standard deviation of the oxyhemoglobin concentration changes as features that were fed into a Support Vector Machine; we then showed that the accuracy of subsets of optical channels in predicting the presence and severity of AD was significantly above chance. The results suggest that AD can be detected with a 0.76 sensitivity score and a 0.68 specificity score while the severity of AD could be detected with a 0.75 sensitivity score and a 0.72 specificity score with ≤5 channels.

DISCUSSION

These scores suggest that fNIRS is a viable technology for conveniently detecting and monitoring AD as well as investigating underlying mechanisms of disease progression.

The neurovascular couplings between electrophysiological and hemodynamic activities in anticipatory selective attention

Selective attention is thought to involve target enhancement and distractor inhibition processes. Here, we recorded simultaneous electroencephalographic (EEG) and functional near-infrared spectroscopy (fNIRS) data from human adults when they were pre-cued by the visual field of coming target, distractor, or both of them. From the EEG data, we found alpha power relatively decreased contralaterally to the to-be-attended target, as reflected by the positive-going alpha modulation index. Late alpha power relatively increased contralaterally to the to-be-suppressed distractor, as reflected by the negative-going alpha modulation index. From the fNIRS data, we found enhancements of hemodynamic activity over the contralateral hemisphere in response to both the target and the distractor anticipation but within nonoverlapping posterior brain regions. More importantly, we described the specific neurovascular modulation between alpha power and oxygenated hemoglobin signal, which showed a positive coupling effect during target anticipation and a negative coupling effect during distractor anticipation. Such flexible neurovascular couplings between EEG oscillation and hemodynamic activity seem to play an essential role in the final behavioral outcomes. These results provide unique neurovascular evidence for the dissociation of the mechanisms of target enhancement and distractor inhibition. Individual behavioral differences can be related to individual differences in neurovascular coupling.

Longitudinal investigation of executive function development employing task-based, teacher reports, and fNIRS multimethodology in 4- to 5-year-old children

Increased focus on resting-state functional connectivity (rsFC) and the use and accessibility of functional near-infrared spectroscopy (fNIRS) have advanced knowledge on the interconnected nature of neural substrates underlying executive function (EF) development in adults and clinical populations. Less is known about the relationship between rsFC and developmental changes in EF during preschool years in typically developing children, a gap the present study addresses employing task-based assessment, teacher reports, and fNIRS multimethodology. This preregistered study contributes to our understanding of the neural basis of EF development longitudinally with 41 children ages 4-5. Changes in prefrontal cortex (PFC) rsFC utilizing fNIRS, EF measured with a common task-based assessment (Day-Night task), and teacher reports of behavior (BRIEF-P) were monitored over multiple timepoints: Initial Assessment, 72 h follow-up, 1 Month Follow-up, and 4 Month Follow-up. Measures of rsFC were strongly correlated 72 h apart, providing evidence of high rsFC measurement reliability using fNIRS with preschool-aged children. PFC rsFC was positively correlated with performance on task-based and report-based EF assessments. Children's PFC functional connectivity at rest uniquely predicted later EF, controlling for verbal IQ, age, and sex. Functional connectivity at rest using fNIRS may potentially show the rapid changes in EF development in young children, not only neurophysiologically, but also as a correlate of task-based EF performance and ecologically-relevant teacher reports of EF in a classroom context.

Multimodal resting-state connectivity predicts affective neurofeedback performance

Neurofeedback has been suggested as a potential complementary therapy to different psychiatric disorders. Of interest for this approach is the prediction of individual performance and outcomes. In this study, we applied functional connectivity-based modeling using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) modalities to (i) investigate whether resting-state connectivity predicts performance during an affective neurofeedback task and (ii) evaluate the extent to which predictive connectivity profiles are correlated across EEG and fNIRS techniques. The fNIRS oxyhemoglobin and deoxyhemoglobin concentrations and the EEG beta and gamma bands modulated by the alpha frequency band (beta-m-alpha and gamma-m-alpha, respectively) recorded over the frontal cortex of healthy subjects were used to estimate functional connectivity from each neuroimaging modality. For each connectivity matrix, relevant edges were selected in a leave-one-subject-out procedure, summed into "connectivity summary scores" (CSS), and submitted as inputs to a support vector regressor (SVR). Then, the performance of the left-out-subject was predicted using the trained SVR model. Linear relationships between the CSS across both modalities were evaluated using Pearson's correlation. The predictive model showed a mean absolute error smaller than 20%, and the fNIRS oxyhemoglobin CSS was significantly correlated with the EEG gamma-m-alpha CSS (r = -0.456, p = 0.030). These results support that pre-task electrophysiological and hemodynamic resting-state connectivity are potential predictors of neurofeedback performance and are meaningfully coupled. This investigation motivates the use of joint EEG-fNIRS connectivity as outcome predictors, as well as a tool for functional connectivity coupling investigation.

The correlations between kinematic profiles and cerebral hemodynamics suggest changes of motor coordination in single and bilateral finger movement

Objective

The correlation between the performance of coordination movement and brain activity is still not fully understood. The current study aimed to identify activated brain regions and brain network connectivity changes for several coordinated finger movements with different difficulty levels and to correlate the brain hemodynamics and connectivity with kinematic performance.

Methods

Twenty-one right-dominant-handed subjects were recruited and asked to complete circular motions of single and bilateral fingers in the same direction (in-phase, IP) and in opposite directions (anti-phase, AP) on a plane. Kinematic data including radius and angular velocity at each task and synchronized blood oxygen concentration data using functional near-infrared spectroscopy (fNIRS) were recorded covering six brain regions including the prefrontal cortex, motor cortex, and occipital lobes. A general linear model was used to locate activated brain regions, and changes compared with baseline in blood oxygen concentration were used to evaluate the degree of brain region activation. Small-world properties, clustering coefficients, and efficiency were used to measure information interaction in brain activity during the movement.

Result

It was found that the radius error of the dominant hand was significantly lower than that of the non-dominant hand (p < 0.001) in both clockwise and counterclockwise movements. The fNIRS results confirmed that the contralateral brain region was activated during single finger movement and the dominant motor area was activated in IP movement, while both motor areas were activated simultaneously in AP movement. The Δhbo were weakly correlated with radius errors (p = 0.002). Brain information interaction in IP movement was significantly larger than that from AP movement in the brain network (p < 0.02) in the right prefrontal cortex. Brain activity in the right motor cortex reduces motor performance (p < 0.001), while the right prefrontal cortex region promotes it (p < 0.05).

Conclusion

Our results suggest there was a significant correlation between motion performance and brain activation level, as well as between motion deviation and brain functional connectivity. The findings may provide a basis for further exploration of the operation of complex brain networks.

Concurrent fNIRS and EEG for Brain Function Investigation: A Systematic, Methodology-Focused Review

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS-EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS-EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS-EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS-EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS-EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS-EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS-EEG data analyses in future research.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

rsHRF: A toolbox for resting-state HRF estimation and deconvolution

The hemodynamic response function (HRF) greatly influences the intra- and inter-subject variability of brain activation and connectivity, and might confound the estimation of temporal precedence in connectivity analyses, making its estimation necessary for a correct interpretation of neuroimaging studies. Additionally, the HRF shape itself is a useful local measure. However, most algorithms for HRF estimation are specific for task-related fMRI data, and only a few can be directly applied to resting-state protocols. Here we introduce rsHRF, a Matlab and Python toolbox that implements HRF estimation and deconvolution from the resting-state BOLD signal. We first provide an overview of the main algorithm, practical implementations, and then demonstrate the feasibility and usefulness of rsHRF by validation experiments with a publicly available resting-state fMRI dataset. We also provide tools for statistical analyses and visualization. We believe that this toolbox may significantly contribute to a better analysis and understanding of the components and variability of BOLD signals.

Acupuncture With deqi Modulates the Hemodynamic Response and Functional Connectivity of the Prefrontal-Motor Cortical Network

As a world intangible cultural heritage, acupuncture is considered an essential modality of complementary and alternative therapy to Western medicine. Despite acupuncture’s long history and public acceptance, how the cortical network is modulated by acupuncture remains largely unclear. Moreover, as the basic acupuncture unit for regulating the central nervous system, how the cortical network is modulated during acupuncture at the Hegu acupoint is mostly unclear. Here, multi-channel functional near-infrared spectroscopy (fNIRS) data were recorded from twenty healthy subjects for acupuncture manipulation, pre- and post-manipulation tactile controls, and pre- and post-acupuncture rest controls. Results showed that: (1) acupuncture manipulation caused significantly increased acupuncture behavioral deqi performance compared with tactile controls. (2) The bilateral prefrontal cortex (PFC) and motor cortex were significantly inhibited during acupuncture manipulation than controls, which was evidenced by the decreased power of oxygenated hemoglobin (HbO) concentration. (3) The bilateral PFC’s hemodynamic responses showed a positive correlation trend with acupuncture behavioral performance. (4) The network connections with bilateral PFC as nodes showed significantly increased functional connectivity during acupuncture manipulation compared with controls. (5) Meanwhile, the network’s efficiency was improved by acupuncture manipulation, evidenced by the increased global efficiency and decreased shortest path length. Taken together, these results reveal that a cooperative PFC-Motor functional network could be modulated by acupuncture manipulation at the Hegu acupoint. This study provides neuroimaging evidence that explains acupuncture’s neuromodulation effects on the cortical network.

Feasibility of combining functional near-infrared spectroscopy with electroencephalography to identify chronic stroke responders to cerebellar transcranial direct current stimulation-a computational modeling and portable neuroimaging methodological study

Feasibility of portable neuroimaging of cerebellar transcranial direct current stimulation (ctDCS) effects on the cerebral cortex has not been investigated vis-à-vis cerebellar lobular electric field strength. We studied functional near-infrared spectroscopy (fNIRS) in conjunction with electroencephalography (EEG) to measure changes in the brain activation at the prefrontal cortex (PFC) and the sensorimotor cortex (SMC) following ctDCS as well as virtual reality-based balance training (VBaT) before and after ctDCS treatment in 12 hemiparetic chronic stroke survivors. We performed general linear modeling (GLM) that putatively associated the lobular electric field strength with the changes in the fNIRS-EEG measures at the ipsilesional and contra-lesional PFC and SMC. Here, fNIRS-EEG measures were found in the latent space from canonical correlation analysis (CCA) between the changes in total hemoglobin (tHb) concentrations (0.01-0.07Hz and 0.07-0.13Hz bands) and log10-transformed EEG bandpower within 1-45 Hz where significant (Wilks' lambda>0.95) canonical correlations were found only for the 0.07-0.13-Hz band. Also, the first principal component (97.5% variance accounted for) of the mean lobular electric field strength was a good predictor of the latent variables of oxy-hemoglobin (O2Hb) concentrations and log10-transformed EEG bandpower. GLM also provided insights into non-responders to ctDCS who also performed poorly in the VBaT due to ideomotor apraxia. Future studies should investigate fNIRS-EEG joint-imaging in a larger cohort to identify non-responders based on GLM fitting to the fNIRS-EEG data.

Decreased connection density and modularity of functional brain networks during n-back working memory paradigm

INTRODUCTION

Investigating how the brain adapts to increased mental workload through large-scale functional reorganization appears as an important research question. Functional connectivity (FC) aims at capturing how disparate regions of the brain dynamically interact, while graph theory provides tools for the topological characterization of the reconstructed functional networks. Although numerous studies investigated how FC is altered in response to increased working memory (WM) demand, current results are still contradictory as few studies confirmed the robustness of these findings in a low-density setting.

METHODS

In this study, we utilized the n-back WM paradigm, in which subjects were presented stimuli (single digits) sequentially, and their task was to decide for each given stimulus if it matched the one presented n-times earlier. Electroencephalography recordings were performed under a control (0-back) and two task conditions of varying difficulty (2- and 3-back). We captured the characteristic connectivity patterns for each difficulty level by performing FC analysis and described the reconstructed functional networks with various graph theoretical measures.

RESULTS

We found a substantial decrease in FC when transitioning from the 0- to the 2- or 3-back conditions, however, no differences relating to task difficulty were identified. The observed changes in brain network topology could be attributed to the dissociation of two (frontal and occipitotemporal) functional modules that were only present during the control condition. Furthermore, behavioral and performance measures showed both positive and negative correlations to connectivity indices, although only in the higher frequency bands.

CONCLUSION

The marked decrease in FC may be due to temporarily abandoned connections that are redundant or irrelevant in solving the specific task. Our results indicate that FC analysis is a robust tool for investigating the response of the brain to increased cognitive workload.

Enhanced spatiotemporal resolution imaging of neuronal activity using joint electroencephalography and diffuse optical tomography

Significance: Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) are both commonly used methodologies for neuronal source reconstruction. While EEG has high temporal resolution (millisecond-scale), its spatial resolution is on the order of centimeters. On the other hand, in comparison to EEG, fNIRS, or diffuse optical tomography (DOT), when used for source reconstruction, can achieve relatively high spatial resolution (millimeter-scale), but its temporal resolution is poor because the hemodynamics that it measures evolve on the order of several seconds. This has important neuroscientific implications: e.g., if two spatially close neuronal sources are activated sequentially with only a small temporal separation, single-modal measurements using either EEG or DOT alone would fail to resolve them correctly. Aim: We attempt to address this issue by performing joint EEG and DOT neuronal source reconstruction. Approach: We propose an algorithm that utilizes DOT reconstruction as the spatial prior of EEG reconstruction, and demonstrate the improvements using simulations based on the ICBM152 brain atlas. Results: We show that neuronal sources can be reconstructed with higher spatiotemporal resolution using our algorithm than using either modality individually. Further, we study how the performance of the proposed algorithm can be affected by the locations of the neuronal sources, and how the performance can be enhanced by improving the placement of EEG electrodes and DOT optodes. Conclusions: We demonstrate using simulations that two sources separated by 2.3-3.3 cm and 50 ms can be recovered accurately using the proposed algorithm by suitably combining EEG and DOT, but not by either in isolation. We also show that the performance can be enhanced by optimizing the electrode and optode placement according to the locations of the neuronal sources.

Physiological correlates of cognitive load in laparoscopic surgery

Laparoscopic surgery can be exhausting and frustrating, and the cognitive load experienced by surgeons may have a major impact on patient safety as well as healthcare economics. As cognitive load decreases with increasing proficiency, its robust assessment through physiological data can help to develop more effective training and certification procedures in this area. We measured data from 31 novices during laparoscopic exercises to extract features based on cardiac and ocular variables. These were compared with traditional behavioural and subjective measures in a dual-task setting. We found significant correlations between the features and the traditional measures. The subjective task difficulty, reaction time, and completion time were well predicted by the physiology features. Reaction times to randomly timed auditory stimuli were correlated with the mean of the heart rate (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = - 0.29$$\end{document}r=-0.29) and heart rate variability (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = 0.4$$\end{document}r=0.4). Completion times were correlated with the physiologically predicted values with a correlation coefficient of 0.84. We found that the multi-modal set of physiology features was a better predictor than any individual feature and artificial neural networks performed better than linear regression. The physiological correlates studied in this paper, translated into technological products, could help develop standardised and more easily regulated frameworks for training and certification.

Enhancing fNIRS Analysis Using EEG Rhythmic Signatures: An EEG-Informed fNIRS Analysis Study

Neurovascular coupling represents the relationship between changes in neuronal activity and cerebral hemodynamics. Concurrent Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) recording and integration analysis has emerged as a promising multi-modal neuroimaging approach to study the neurovascular coupling as it provides complementary properties with regard to high temporal and moderate spatial resolution of brain activity. In this study we developed an EEG-informed-fNIRS analysis framework to investigate the neuro-correlate between neuronal activity and cerebral hemodynamics by identifying specific EEG rhythmic modulations which contribute to the improvement of the fNIRS-based general linear model (GLM) analysis. Specifically, frequency-specific regressors derived from EEG were used to construct design matrices to guide the GLM analysis of the fNIRS signals collected during a hand grasp task. Our results showed that the EEG-informed fNIRS GLM analysis, especially the alpha and beta band, revealed significantly higher sensitivity and specificity in localizing the task-evoked regions compared to the canonical boxcar model, demonstrating the strong correlations between hemodynamic response and EEG rhythmic modulations. Results also indicated that analysis based on the deoxygenated hemoglobin (HbR) signal slightly outperformed the oxygenated hemoglobin (HbO)-based analysis. The findings in our study not only validate the feasibility of enhancing fNIRS GLM analysis using simultaneously recorded EEG signals, but also provide a new perspective to study the neurovascular coupling of brain activity.

Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement

In a social world, observing the actions of others is fundamental to understanding what they are doing, as well as their intentions and feelings. Studies of the neural basis and decoding of action observation are important for understanding action-related processes and have implications for cognitive, social neuroscience, and human-machine interaction (HMI). In the current study, we first investigated temporal-spatial dynamics during action observation using a combined 64-channel electroencephalography (EEG) and 48-channel functional near-infrared spectroscopy (fNIRS) system. We measured brain activation while 16 healthy participants observed three action tasks: (1) grasping a cup with the intention of drinking; (2) grasping a cup with the intention of moving it; and (3) touching a cup with an unclear intention. The EEG and fNIRS source analysis results revealed the dynamic involvement of both the mirror neuron system (MNS) and the theory of mind (ToM)/mentalizing network during action observation. The source analysis results suggested that the extent to which these two systems were engaged was determined by the clarity of the intention of the observed action. Based on the difference in neural activity observed among different action-observation tasks in the first experiment, we conducted a second experiment to classify the neural processes underlying action observation using a feature classification method. We constructed complex brain networks based on the EEG and fNIRS data. Fusing features from both EEG and fNIRS complex brain networks resulted in a classification accuracy of 72.7% for the three action observation tasks. This study provides a theoretical and empirical basis for elucidating the neural mechanisms of action observation and intention understanding, and a feasible method for decoding the underlying neural processes.

Cognitive Behavior Classification From Scalp EEG Signals

Electroencephalography (EEG) has become increasingly valuable outside of its traditional use in neurology. EEG is now used for neuropsychiatric diagnosis, neurological evaluation of traumatic brain injury, neurotherapy, gaming, neurofeedback, mindfulness, and cognitive enhancement training. The trend to increase the number of EEG electrodes, the development of novel analytical methods, and the availability of large data sets has created a data analysis challenge to find the "signal of interest" that conveys the most information about ongoing cognitive effort. Accordingly, we compare three common types of neural synchrony measures that are applied to EEG-power analysis, phase locking, and phase-amplitude coupling to assess which analytical measure provides the best separation between EEG signals that were recorded, while healthy subjects performed eight cognitive tasks-Hopkins Verbal Learning Test and its delayed version, Stroop Test, Symbol Digit Modality Test, Controlled Oral Word Association Test, Trail Marking Test, Digit Span Test, and Benton Visual Retention Test. We find that of the three analytical methods, phase-amplitude coupling, specifically theta (4-7 Hz)-high gamma (70-90 Hz) obtained from frontal and parietal EEG electrodes provides both the largest separation between the EEG during cognitive tasks and also the highest classification accuracy between pairs of tasks. We also find that phase-locking analysis provides the most distinct clustering of tasks based on their utilization of long-term memory. Finally, we show that phase-amplitude coupling is the least sensitive to contamination by intense jaw-clenching muscle artifact.

Early Detection of Hemodynamic Responses Using EEG: A Hybrid EEG-fNIRS Study

Enhanced classification accuracy and a sufficient number of commands are highly demanding in brain computer interfaces (BCIs). For a successful BCI, early detection of brain commands in time is essential. In this paper, we propose a novel classifier using a modified vector phase diagram and the power of electroencephalography (EEG) signal for early prediction of hemodynamic responses. EEG and functional near-infrared spectroscopy (fNIRS) signals for a motor task (thumb tapping) were obtained concurrently. Upon the resting state threshold circle in the vector phase diagram that uses the maximum values of oxy- and deoxy-hemoglobin (ΔHbO and ΔHbR) during the resting state, we introduce a secondary (inner) threshold circle using the ΔHbO and ΔHbR magnitudes during the time window of 1 s where an EEG activity is noticeable. If the trajectory of ΔHbO and ΔHbR touches the resting state threshold circle after passing through the inner circle, this indicates that ΔHbO was increasing and ΔHbR was decreasing (i.e., the start of a hemodynamic response). It takes about 0.5 s for an fNIRS signal to cross the resting state threshold circle after crossing the EEG-based circle. Thus, an fNIRS-based BCI command can be generated in 1.5 s. We achieved an improved accuracy of 86.0% using the proposed method in comparison with the 63.8% accuracy obtained using linear discriminant analysis in a window of 0~1.5 s. Moreover, the active brain locations (identified using the proposed scheme) were spatially specific when a t-map was made after 10 s of stimulation. These results demonstrate the possibility of enhancing the classification accuracy for a brain-computer interface with a time window of 1.5 s using the proposed method.

Decoding human mental states by whole-head EEG+fNIRS during category fluency task performance

OBJECTIVE

Concurrent scalp electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), which we refer to as EEG+fNIRS, promises greater accuracy than the individual modalities while remaining nearly as convenient as EEG. We sought to quantify the hybrid system's ability to decode mental states and compare it with its unimodal components.

APPROACH

We recorded from healthy volunteers taking the category fluency test and applied machine learning techniques to the data.

MAIN RESULTS

EEG+fNIRS's decoding accuracy was greater than that of its subsystems, partly due to the new type of neurovascular features made available by hybrid data.

SIGNIFICANCE

Availability of an accurate and practical decoding method has potential implications for medical diagnosis, brain-computer interface design, and neuroergonomics.

Using Functional Near-Infrared Spectroscopy to Measure Effects of Delta 9-Tetrahydrocannabinol on Prefrontal Activity and Working Memory in Cannabis Users

Intoxication from cannabis impairs cognitive performance, in part due to the effects of Δ9-tetrahydrocannabinol (THC, the primary psychoactive compound in cannabis) on prefrontal cortex (PFC) function. However, a relationship between impairment in cognitive functioning with THC administration and THC-induced change in hemodynamic response has not been demonstrated. We explored the feasibility of using functional near-infrared spectroscopy (fNIRS) to examine the functional changes of the human PFC associated with cannabis intoxication and cognitive impairment. Eighteen adult regular cannabis users (final sample, n = 13) performed a working memory task (n-back) during fNIRS recordings, before and after receiving a single dose of oral synthetic THC (dronabinol; 20–50 mg). Functional data were collected using a continuous-wave NIRS device, in which 8 Sources and 7 detectors were placed on the forehead, resulting in 20 channels covering PFC regions. Physiological changes and subjective intoxication measures were collected. We found a significant increase in the oxygenated hemoglobin (HbO) concentration after THC administration in several channels on the PFC during both the high working memory load (2-back) and the low working memory load (0-back) condition. The increased HbO response was accompanied by a trend toward an increased number of omission errors after THC administration. The current study suggests that cannabis intoxication is associated with increases in hemodynamic blood flow to the PFC, and that this increase can be detected with fNIRS.

Simultaneous functional near-infrared spectroscopy and electroencephalography for monitoring of human brain activity and oxygenation: a review

Multimodal monitoring has become particularly common in the study of human brain function. In this context, combined, synchronous measurements of functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) are getting increased interest. Because of the absence of electro-optical interference, it is quite simple to integrate these two noninvasive recording procedures of brain activity. fNIRS and EEG are both scalp-located procedures. fNIRS estimates brain hemodynamic fluctuations relying on spectroscopic measurements, whereas EEG captures the macroscopic temporal dynamics of brain electrical activity through passive voltages evaluations. The "orthogonal" neurophysiological information provided by the two technologies and the increasing interest in the neurovascular coupling phenomenon further encourage their integration. This review provides, together with an introduction regarding the principles and future directions of the two technologies, an evaluation of major clinical and nonclinical applications of this flexible, low-cost combination of neuroimaging modalities. fNIRS-EEG systems exploit the ability of the two technologies to be conducted in an environment or experimental setting and/or on subjects that are generally not suited for other neuroimaging modalities, such as functional magnetic resonance imaging, positron emission tomography, and magnetoencephalography. fNIRS-EEG brain monitoring settles itself as a useful multimodal tool for brain electrical and hemodynamic activity investigation.

Hybrid Brain-Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review

In this article, non-invasive hybrid brain-computer interface (hBCI) technologies for improving classification accuracy and increasing the number of commands are reviewed. Hybridization combining more than two modalities is a new trend in brain imaging and prosthesis control. Electroencephalography (EEG), due to its easy use and fast temporal resolution, is most widely utilized in combination with other brain/non-brain signal acquisition modalities, for instance, functional near infrared spectroscopy (fNIRS), electromyography (EMG), electrooculography (EOG), and eye tracker. Three main purposes of hybridization are to increase the number of control commands, improve classification accuracy and reduce the signal detection time. Currently, such combinations of EEG + fNIRS and EEG + EOG are most commonly employed. Four principal components (i.e., hardware, paradigm, classifiers, and features) relevant to accuracy improvement are discussed. In the case of brain signals, motor imagination/movement tasks are combined with cognitive tasks to increase active brain-computer interface (BCI) accuracy. Active and reactive tasks sometimes are combined: motor imagination with steady-state evoked visual potentials (SSVEP) and motor imagination with P300. In the case of reactive tasks, SSVEP is most widely combined with P300 to increase the number of commands. Passive BCIs, however, are rare. After discussing the hardware and strategies involved in the development of hBCI, the second part examines the approaches used to increase the number of control commands and to enhance classification accuracy. The future prospects and the extension of hBCI in real-time applications for daily life scenarios are provided.

Measuring Mental Workload with EEG+fNIRS

We studied the capability of a Hybrid functional neuroimaging technique to quantify human mental workload (MWL). We have used electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) as imaging modalities with 17 healthy subjects performing the letter n-back task, a standard experimental paradigm related to working memory (WM). The level of MWL was parametrically changed by variation of n from 0 to 3. Nineteen EEG channels were covering the whole-head and 19 fNIRS channels were located on the forehead to cover the most dominant brain region involved in WM. Grand block averaging of recorded signals revealed specific behaviors of oxygenated-hemoglobin level during changes in the level of MWL. A machine learning approach has been utilized for detection of the level of MWL. We extracted different features from EEG, fNIRS, and EEG+fNIRS signals as the biomarkers of MWL and fed them to a linear support vector machine (SVM) as train and test sets. These features were selected based on their sensitivity to the changes in the level of MWL according to the literature. We introduced a new category of features within fNIRS and EEG+fNIRS systems. In addition, the performance level of each feature category was systematically assessed. We also assessed the effect of number of features and window size in classification performance. SVM classifier used in order to discriminate between different combinations of cognitive states from binary- and multi-class states. In addition to the cross-validated performance level of the classifier other metrics such as sensitivity, specificity, and predictive values were calculated for a comprehensive assessment of the classification system. The Hybrid (EEG+fNIRS) system had an accuracy that was significantly higher than that of either EEG or fNIRS. Our results suggest that EEG+fNIRS features combined with a classifier are capable of robustly discriminating among various levels of MWL. Results suggest that EEG+fNIRS should be preferred to only EEG or fNIRS, in developing passive BCIs and other applications which need to monitor users' MWL.

Characterization and correction of the false-discovery rates in resting state connectivity using functional near-infrared spectroscopy

Functional near-infrared spectroscopy (fNIRS) is a noninvasive neuroimaging technique that uses low levels of red to near-infrared light to measure changes in cerebral blood oxygenation. Spontaneous (resting state) functional connectivity (sFC) has become a critical tool for cognitive neuroscience for understanding task-independent neural networks, revealing pertinent details differentiating healthy from disordered brain function, and discovering fluctuations in the synchronization of interacting individuals during hyperscanning paradigms. Two of the main challenges to sFC-NIRS analysis are (i) the slow temporal structure of both systemic physiology and the response of blood vessels, which introduces false spurious correlations, and (ii) motion-related artifacts that result from movement of the fNIRS sensors on the participants’ head and can introduce non-normal and heavy-tailed noise structures. In this work, we systematically examine the false-discovery rates of several time- and frequency-domain metrics of functional connectivity for characterizing sFC-NIRS. Specifically, we detail the modifications to the statistical models of these methods needed to avoid high levels of false-discovery related to these two sources of noise in fNIRS. We compare these analysis procedures using both simulated and experimental resting-state fNIRS data. Our proposed robust correlation method has better performance in terms of being more reliable to the noise outliers due to the motion artifacts.