Correlation of visual-evoked hemodynamic responses and potentials in human brain

Open access dataset integrating EEG and fNIRS during Stroop tasks

Conflict monitoring and processing are crucial components of the human cognitive system, with significant implications for daily life and the diagnosis of cognitive disorders. The Stroop task, combined with brain function detection technology, has been widely employed as a classical paradigm for investigating conflict processing. However, there remains a lack of public datasets that integrate Electroencephalogram (EEG) and functional Near-infrared Spectroscopy (fNIRS) to simultaneously record brain activity during a Stroop task. We introduce a dual-modality Stroop task dataset incorporating 34-channel EEG (sampling frequency is 1000 Hz) and 20-channel high temporal resolution fNIRS (sampling frequency is 100 Hz) measurements covering the whole frontal cerebral cortex from 21 participants (9 females/12 males, aged 23.0 ± 2.3 years). Event-related potential analysis of EEG recordings and activation analysis of fNIRS recordings were performed to show the significant Stroop effect. We expected that the data provided would be utilized to investigate multimodal data processing algorithms during cognitive processing.

Lateralization difference in functional activity during Stroop tasks: a functional near-infrared spectroscopy and EEG simultaneous study

Introduction

Conflict monitoring and processing is an important part of the human cognitive system, it plays a key role in many studies of cognitive disorders.

Methods

Based on a Chinese word-color match Stroop task, which included incongruent and neutral stimuli, the Electroencephalogram (EEG) and functional Near-infrared Spectroscopy (fNIRS) signals were recorded simultaneously. The Pearson correlation coefficient matrix was calculated to analyze brain connectivity based on EEG signals. Granger Causality (GC) method was employed to analyze the effective connectivity of bilateral frontal lobes. Wavelet Transform Coherence (WTC) was used to analyze the functional connectivity of the bilateral hemisphere and ipsilateral hemisphere.

Results

Results indicated that brain connectivity analysis on EEG signals did not show any significant lateralization, while fNIRS analysis results showed the frontal lobes especially the left frontal lobe play the leading role in dealing with conflict tasks. The human brain shows leftward lateralization while processing the more complicated incongruent stimuli. This is demonstrated by the higher functional connectivity in the left frontal lobe and the information flow from the left frontal lobe to the right frontal lobe.

Discussion

Our findings in brain connectivity during cognitive conflict processing demonstrated that the dual modality method combining EEG and fNIRS is a valuable tool to excavate more information through cognitive and physiological studies.

Changes in neurovascular coupling with cerebral perfusion pressure indicate a link to cerebral autoregulation

Cerebral autoregulation ensures a stable average blood supply to brain tissue across steady state cerebral perfusion pressure (CPP) levels. Neurovascular coupling, in turn, relies on sufficient blood flow to meet neuronal demands during activation. These mechanisms break down in pathologies where extreme levels of CPP can cause dysregulation in cerebral blood flow. Here, we experimentally tested the influence of changes in CPP on neurovascular coupling in a hydrocephalus-type non-human primate model (n = 3). We recorded local neural and vascular evoked responses to a checkerboard visual stimulus, non-invasively, using electroencephalography and near-infrared spectroscopy respectively. The evoked signals showed changes in various waveform features in the visual evoked potentials and the hemodynamic responses, with CPP. We further used these signals to fit for a hemodynamic response function (HRF) to describe neurovascular coupling. We estimated n = 26 distinct HRFs at a subset of CPP values ranging from 40-120 mmHg across all subjects. The HRFs, when compared to a subject dependent healthy baseline (CPP 70-90 mmHg) HRF, showed significant changes in shape with increasing CPP (ρ_CPP = -0.55, p-value_CPP = 0.0049). Our study provides preliminary experimental evidence on the relationship between neurovascular coupling and CPP changes, especially when beyond the limits of static autoregulation.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

Bimodal Data Fusion of Simultaneous Measurements of EEG and fNIRS during Lower Limb Movements

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) have temporal and spatial characteristics that may complement each other and, therefore, pose an intriguing approach for brain-computer interaction (BCI). In this work, the relationship between the hemodynamic response and brain oscillation activity was investigated using the concurrent recording of fNIRS and EEG during ankle joint movements. Twenty subjects participated in this experiment. The EEG was recorded using 20 electrodes and hemodynamic responses were recorded using 32 optodes positioned over the motor cortex areas. The event-related desynchronization (ERD) feature was extracted from the EEG signal in the alpha band (8-11) Hz, and the concentration change of the oxy-hemoglobin (oxyHb) was evaluated from the hemodynamics response. During the motor execution of the ankle joint movements, a decrease in the alpha (8-11) Hz amplitude (desynchronization) was found to be correlated with an increase of the oxyHb (r = -0.64061, p < 0.00001) observed on the Cz electrode and the average of the fNIRS channels (ch28, ch25, ch32, ch35) close to the foot area representation. Then, the correlated channels in both modalities were used for ankle joint movement classification. The result demonstrates that the integrated modality based on the correlated channels provides a substantial enhancement in ankle joint classification accuracy of 93.01 ± 5.60% (p < 0.01) compared with single modality. These results highlight the potential of the bimodal fNIR-EEG approach for the development of future BCI for lower limb rehabilitation.

Depression Analysis and Recognition based on Functional Near-infrared Spectroscopy

Depression is the result of a complex interaction of social, psychological and physiological elements. It is now considered to be a major threat to people's physical health, and even as a threat to their lives. Research into the brain disorders of patients suffering from depression can help doctors to understand the pathogenesis of depression and facilitate its diagnosis and treatment. Functional near-infrared spectroscopy (fNIRS) is a non-invasive approach to the detection of brain functions and activities based on changes to the hemoglobin's oxygenation. In this paper, a comprehensive fNIRS-based depression-processing architecture, including the layers of source, feature and model, is first established to guide the deep modeling for fNIRS. In view of the complexity of depression, we propose a methodology in the time and frequency domains for feature extraction and deep neural networks for depression recognition and combining with current research. It is found that compared to non-depressed people, patients with depression have a weaker encephalic area connectivity and lower level of activation in the prefrontal lobe during brain activity. Finally, based on raw data, manual features and channel correlations, to recognize depression, the AlexNet model shows the best performance, especially in terms of the correlation features and presents an accuracy rate of 0.90 and a precision rate of 0.91, which is higher than ResNet18 and machine-learning algorithms on other data. Therefore, the correlation of brain regions can effectively recognize depression (from cases of non-depression), making it significant for the recognition of brain functions in the clinical diagnosis and treatment of depression.

Uncovering electrophysiological and vascular signatures of implicit emotional prosody

The capability of differentiating between various emotional states in speech displays a crucial prerequisite for successful social interactions. The aim of the present study was to investigate neural processes underlying this differentiating ability by applying a simultaneous neuroscientific approach in order to gain both electrophysiological (via electroencephalography, EEG) and vascular (via functional near-infrared-spectroscopy, fNIRS) responses. Pseudowords conforming to angry, happy, and neutral prosody were presented acoustically to participants using a passive listening paradigm in order to capture implicit mechanisms of emotional prosody processing. Event-related brain potentials (ERPs) revealed a larger P200 and an increased late positive potential (LPP) for happy prosody as well as larger negativities for angry and neutral prosody compared to happy prosody around 500 ms. FNIRS results showed increased activations for angry prosody at right fronto-temporal areas. Correlation between negativity in the EEG and activation in fNIRS for angry prosody suggests analogous underlying processes resembling a negativity bias. Overall, results indicate that mechanisms of emotional and phonological encoding (P200), emotional evaluation (increased negativities) as well as emotional arousal and relevance (LPP) are present during implicit processing of emotional prosody.

Simultaneous EEG-NIRS Measurement of the Inferior Parietal Lobule During a Reaching Task With Delayed Visual Feedback

We investigated whether the inferior parietal lobule (IPL) responds in real-time to multisensory inconsistency during movement. The IPL is thought to be involved in both the detection of inconsistencies in multisensory information obtained during movement and that obtained during self-other discrimination. However, because of the limited temporal resolution of conventional neuroimaging techniques, it is difficult to distinguish IPL activity during movement from that during self-other discrimination. We simultaneously conducted electroencephalography (EEG) and near-infrared spectroscopy (NIRS) with the goal of examining IPL activity with a high spatiotemporal resolution during single reaching movements. Under a visual feedback-delay condition, gamma event-related synchronization (γ-ERS), i.e., an increase in gamma (31–47 Hz) EEG power occurred during reaching movements. This γ-ERS is considered to reflect processing of information about prediction errors. To integrate this temporal information with spatial information from the NIRS signals, we developed a new analysis technique that enabled estimation of the regions that show a hemodynamic response characterized by EEG fluctuation present in the visual feedback-delay condition. As a result, IPL activity was explained by γ-ERS specific to visual feedback delay during movements. Thus, we succeeded in demonstrating real-time activation of the IPL in response to multisensory inconsistency. However, we did not find any correlation between either IPL activity or γ-ERS with the sense of agency. Therefore, our results suggest that while the IPL is influenced by prediction error signals, it does not engage in direct processing underlying the conscious experience of making a movement, which is the foundation of self-other discrimination.

Age-Related Changes in Global Motion Coherence: Conflicting Haemodynamic and Perceptual Responses

Our aim was to use both behavioural and neuroimaging data to identify indicators of perceptual decline in motion processing. We employed a global motion coherence task and functional Near Infrared Spectroscopy (fNIRS). Healthy adults (n = 72, 18-85) were recruited into the following groups: young (n = 28, mean age = 28), middle-aged (n = 22, mean age = 50), and older adults (n = 23, mean age = 70). Participants were assessed on their motion coherence thresholds at 3 different speeds using a psychophysical design. As expected, we report age group differences in motion processing as demonstrated by higher motion coherence thresholds in older adults. Crucially, we add correlational data showing that global motion perception declines linearly as a function of age. The associated fNIRS recordings provide a clear physiological correlate of global motion perception. The crux of this study lies in the robust linear correlation between age and haemodynamic response for both measures of oxygenation. We hypothesise that there is an increase in neural recruitment, necessitating an increase in metabolic need and blood flow, which presents as a higher oxygenated haemoglobin response. We report age-related changes in motion perception with poorer behavioural performance (high motion coherence thresholds) associated with an increased haemodynamic response.

Simultaneous acquisition of EEG and NIRS during cognitive tasks for an open access dataset

We provide an open access multimodal brain-imaging dataset of simultaneous electroencephalography (EEG) and near-infrared spectroscopy (NIRS) recordings. Twenty-six healthy participants performed three cognitive tasks: 1) n-back (0-, 2- and 3-back), 2) discrimination/selection response task (DSR) and 3) word generation (WG) tasks. The data provided includes: 1) measured data, 2) demographic data, and 3) basic analysis results. For n-back (dataset A) and DSR tasks (dataset B), event-related potential (ERP) analysis was performed, and spatiotemporal characteristics and classification results for 'target' versus 'non-target' (dataset A) and symbol 'O' versus symbol 'X' (dataset B) are provided. Time-frequency analysis was performed to show the EEG spectral power to differentiate the task-relevant activations. Spatiotemporal characteristics of hemodynamic responses are also shown. For the WG task (dataset C), the EEG spectral power and spatiotemporal characteristics of hemodynamic responses are analyzed, and the potential merit of hybrid EEG-NIRS BCIs was validated with respect to classification accuracy. We expect that the dataset provided will facilitate performance evaluation and comparison of many neuroimaging analysis techniques.

Effect of confounding variables on hemodynamic response function estimation using averaging and deconvolution analysis: An event-related NIRS study

Slow and rapid event-related designs are used in fMRI and functional near-infrared spectroscopy (fNIRS) experiments to temporally characterize the brain hemodynamic response to discrete events. Conventional averaging (CA) and the deconvolution method (DM) are the two techniques commonly used to estimate the Hemodynamic Response Function (HRF) profile in event-related designs. In this study, we conducted a series of simulations using synthetic and real NIRS data to examine the effect of the main confounding factors, including event sequence timing parameters, different types of noise, signal-to-noise ratio (SNR), temporal autocorrelation and temporal filtering on the performance of these techniques in slow and rapid event-related designs. We also compared systematic errors in the estimates of the fitted HRF amplitude, latency and duration for both techniques. We further compared the performance of deconvolution methods based on Finite Impulse Response (FIR) basis functions and gamma basis sets. Our results demonstrate that DM was much less sensitive to confounding factors than CA. Event timing was the main parameter largely affecting the accuracy of CA. In slow event-related designs, deconvolution methods provided similar results to those obtained by CA. In rapid event-related designs, our results showed that DM outperformed CA for all SNR, especially above -5 dB regardless of the event sequence timing and the dynamics of background NIRS activity. Our results also show that periodic low-frequency systemic hemodynamic fluctuations as well as phase-locked noise can markedly obscure hemodynamic evoked responses. Temporal autocorrelation also affected the performance of both techniques by inducing distortions in the time profile of the estimated hemodynamic response with inflated t-statistics, especially at low SNRs. We also found that high-pass temporal filtering could substantially affect the performance of both techniques by removing the low-frequency components of HRF profiles. Our results emphasize the importance of characterization of event timing, background noise and SNR when estimating HRF profiles using CA and DM in event-related designs.

Using Functional Near Infrared Spectroscopy (fNIRS) to Study Dynamic Stereoscopic Depth Perception

The parietal cortex has been widely implicated in the processing of depth perception by many neuroimaging studies, yet functional near infrared spectroscopy (fNIRS) has been an under-utilised tool to examine the relationship of oxy- ([HbO]) and de-oxyhaemoglobin ([HbR]) in perception. Here we examine the haemodynamic response (HDR) to the processing of induced depth stimulation using dynamic random-dot-stereograms (RDS). We used fNIRS to measure the HDR associated with depth perception in healthy young adults (n = 13, mean age 24). Using a blocked design, absolute values of [HbO] and [HbR] were recorded across parieto-occipital and occipital cortices, in response to dynamic RDS. Control and test images were identical except for the horizontal shift in pixels in the RDS that resulted in binocular disparity and induced the percept of a 3D sine wave that ‘popped out’ of the test stimulus. The control stimulus had zero disparity and induced a ‘flat’ percept. All participants had stereoacuity within normal clinical limits and successfully perceived the depth in the dynamic RDS. Results showed a significant effect of this complex visual stimulation in the right parieto-occipital cortex (p < 0.01, η² = 0.54). The test stimulus elicited a significant increase in [HbO] during depth perception compared to the control image (p < 0.001, 99.99 % CI [0.008–0.294]). The similarity between the two stimuli may have resulted in the HDR of the occipital cortex showing no significant increase or decrease of cerebral oxygenation levels during depth stimulation. Cerebral oxygenation measures of [HbO] confirmed the strong association of the right parieto-occipital cortex with processing depth perception. Our study demonstrates the validity of fNIRS to investigate [HbO] and [HbR] during high-level visual processing of complex stimuli.

Cross-Modal Functional Reorganization of Visual and Auditory Cortex in Adult Cochlear Implant Users Identified with fNIRS

Cochlear implant (CI) users show higher auditory-evoked activations in visual cortex and higher visual-evoked activation in auditory cortex compared to normal hearing (NH) controls, reflecting functional reorganization of both visual and auditory modalities. Visual-evoked activation in auditory cortex is a maladaptive functional reorganization whereas auditory-evoked activation in visual cortex is beneficial for speech recognition in CI users. We investigated their joint influence on CI users' speech recognition, by testing 20 postlingually deafened CI users and 20 NH controls with functional near-infrared spectroscopy (fNIRS). Optodes were placed over occipital and temporal areas to measure visual and auditory responses when presenting visual checkerboard and auditory word stimuli. Higher cross-modal activations were confirmed in both auditory and visual cortex for CI users compared to NH controls, demonstrating that functional reorganization of both auditory and visual cortex can be identified with fNIRS. Additionally, the combined reorganization of auditory and visual cortex was found to be associated with speech recognition performance. Speech performance was good as long as the beneficial auditory-evoked activation in visual cortex was higher than the visual-evoked activation in the auditory cortex. These results indicate the importance of considering cross-modal activations in both visual and auditory cortex for potential clinical outcome estimation.

Simultaneous measurement of electroencephalography and near-infrared spectroscopy during voluntary motor preparation

We investigated the relationship between electrophysiological activity and haemodynamic response during motor preparation by simultaneous recording of electroencephalography (EEG) and near-infrared spectroscopy (NIRS). It is still unknown how exactly EEG signals correlate with the haemodynamic response, although the activation in the premotor area during motor preparation has been captured by EEG and haemodynamic approaches separately. We conducted EEG-NIRS simultaneous recordings over the sensorimotor area with a self-paced button press task. Participants were instructed to press a button at their own pace after a cue was shown. The result showed that the readiness potential (RP), a negative slow potential shift occurring during motor preparation, on C3 in the extended 10–20 system occurred about 1000 ms before the movement onset. An increase in concentration of oxyhaemoglobin (oxyHb) in the premotor cortex during motor preparation was also confirmed by NIRS, which resulted in a significant correlation between the amplitude of the RP and the change in oxyHb concentration (Pearson’s correlation r² = 0.235, p = 0.03). We show that EEG-NIRS simultaneous recording can demonstrate the correlation between the RP and haemodynamic response in the premotor cortex contralateral to the performing hand.

A brain of two halves: insights into interhemispheric organization provided by near-infrared spectroscopy

The discovery of functional lateralization and localization of the brain marked the beginning of a new era in neuroscience. While the past 150 years of research have provided a great deal of knowledge of hemispheric differences and functional relationships, the precise organization of functional laterality remains a topic of intense debate. Here I will shed light on the functional organization of the two hemispheres by reviewing some of the most recent functional near-infrared spectroscopy (NIRS) studies that have reported hemispheric differences in activation patterns. Most NIRS studies using visual stimuli, which revealed functional differentiation between the hemispheres, have reported unilateral activation, i.e., significant levels of activation in only one hemisphere. Auditory stimuli, including speech sounds, elicited bilateral activation, while the limited number of studies on young infants revealed primarily unilateral activation. The stimulus modality and the age of the participants therefore determine whether the resulting cortical activation is unilateral or bilateral. By combining a review of the existing literature with NIRS results regarding homologous connectivity across hemispheres, I hypothesized that the origin of functional lateralization changes from the independence of each hemispheric region, to mutual inhibition between homologous regions during development. Future studies applying multi-modal measurements along with NIRS and spatiotemporal analyses will further deepen our understanding of the interhemispheric organization of brain function.

Experimental investigation of NIRS spatial sensitivity

Near infrared spectroscopy (NIRS) is regarded as a potential medical diagnostic technique for investigation of hemodynamic changes. However, uncertainties pertaining to the origin of NIRS signals have hampered its clinical interpretation. The uncertainities in NIRS measurements especially in case of living tissues are due to lack of rigorous combined theoretical-experimental studies resulting in clear understanding of the origin of NIRS signals. For their reliable interpretation it is important to understand the relationship between spatial changes in optical properties and corresponding changes in the NIRS signal. We investigated spatial sensitivity of near infrared optical measurements using an experimental approach. It uses a liquid optical phantom as tissue equivalent, which is explored under robot-control by a small, approximately point like perturbation of desired optical properties, and a NIRS instrument for trans-illumination/reflection measurements. The experimentally obtained sensitivity has been analyzed and compared with numerical simulations. In preliminary experiments we investigated the influence of various optical properties of the medium and of source/detector distances on the spatial sensitivity distribution. The acquired sensitivity maps can be used to define characteristic parameters. As an example, we used a 25% threshold to define a penetration depth measure which provides values in good accordance with published ones. To the best of our knowledge this is the first experimental study of NIRS spatial sensitivity. The presented method will allow in depth experimental investigation of the influence of various conditions pertaining to medium such as optical properties of tissue (scattering and absorption) and of the source/detector configuration.