Auditory cortex activity measured using functional near-infrared spectroscopy (fNIRS) appears to be susceptible to masking by cortical blood stealing

Cross-modal plasticity in children with cochlear implant: converging evidence from EEG and functional near-infrared spectroscopy

Over the first years of life, the brain undergoes substantial organization in response to environmental stimulation. In a silent world, it may promote vision by (i) recruiting resources from the auditory cortex and (ii) making the visual cortex more efficient. It is unclear when such changes occur and how adaptive they are, questions that children with cochlear implants can help address. Here, we examined 7-18 years old children: 50 had cochlear implants, with delayed or age-appropriate language abilities, and 25 had typical hearing and language. High-density electroencephalography and functional near-infrared spectroscopy were used to evaluate cortical responses to a low-level visual task. Evidence for a 'weaker visual cortex response' and 'less synchronized or less inhibitory activity of auditory association areas' in the implanted children with language delays suggests that cross-modal reorganization can be maladaptive and does not necessarily strengthen the dominant visual sense.

Investigation of electro-vascular phase-amplitude coupling during an auditory task

Multimodal neuroimaging using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides complementary views of cortical processes, including those related to auditory processing. However, current multimodal approaches often overlook potential insights that can be gained from nonlinear interactions between electrical and hemodynamic signals. Here, we explore electro-vascular phase-amplitude coupling (PAC) between low-frequency hemodynamic and high-frequency electrical oscillations during an auditory task. We further apply a temporally embedded canonical correlation analysis (tCCA)-general linear model (GLM)-based correction approach to reduce the possible effect of systemic physiology on fNIRS recordings. Before correction, we observed significant PAC between fNIRS and broadband EEG in the frontal region (p ≪ 0.05), β (p ≪ 0.05) and γ (p = 0.010) in the left temporal/temporoparietal (left auditory; LA) region, and γ (p = 0.032) in the right temporal/temporoparietal (right auditory; RA) region across the entire dataset. Significant differences in PAC across conditions (task versus silence) were observed in LA (p = 0.023) and RA (p = 0.049) γ sub-bands and in lower frequency (5-20 Hz) frontal activity (p = 0.005). After correction, significant fNIRS-γ-band PAC was observed in the frontal (p = 0.021) and LA (p = 0.025) regions, while fNIRS-α (p = 0.003) and fNIRS-β (p = 0.041) PAC were observed in RA. Decreased frontal γ-band (p = 0.008) and increased β-band (p ≪ 0.05) PAC were observed during the task. These outcomes represent the first characterization of electro-vascular PAC between fNIRS and EEG signals during an auditory task, providing insights into electro-vascular coupling in auditory processing.

fNIRS Dataset During Complex Scene Analysis

When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.

Audiovisual integration in children with cochlear implants revealed through EEG and fNIRS

Sensory deprivation can offset the balance of audio versus visual information in multimodal processing. Such a phenomenon could persist for children born deaf, even after they receive cochlear implants (CIs), and could potentially explain why one modality is given priority over the other. Here, we recorded cortical responses to a single speaker uttering two syllables, presented in audio-only (A), visual-only (V), and audio-visual (AV) modes. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were successively recorded in seventy-five school-aged children. Twenty-five were children with normal hearing (NH) and fifty wore CIs, among whom 26 had relatively high language abilities (HL) comparable to those of NH children, while 24 others had low language abilities (LL). In EEG data, visual-evoked potentials were captured in occipital regions, in response to V and AV stimuli, and they were accentuated in the HL group compared to the LL group (the NH group being intermediate). Close to the vertex, auditory-evoked potentials were captured in response to A and AV stimuli and reflected a differential treatment of the two syllables but only in the NH group. None of the EEG metrics revealed any interaction between group and modality. In fNIRS data, each modality induced a corresponding activity in visual or auditory regions, but no group difference was observed in A, V, or AV stimulation. The present study did not reveal any sign of abnormal AV integration in children with CI. An efficient multimodal integrative network (at least for rudimentary speech materials) is clearly not a sufficient condition to exhibit good language and literacy.

Neurovascular coupling during auditory stimulation: event-related potentials and fNIRS hemodynamic

Intensity-dependent amplitude changes (IDAP) have been extensively studied using event-related potentials (ERPs) and have been linked to several psychiatric disorders. This study aims to explore the application of functional near-infrared spectroscopy (fNIRS) in IDAP paradigms, which related to ERPs could indicate the existence of neurovascular coupling. Thirty-three and thirty-one subjects participated in two experiments, respectively. The first experiment consisted of the presentation of three-tone intensities (77.9 dB, 84.5 dB, and 89.5 dB) lasting 500 ms, each type randomly presented 54 times, while the second experiment consisted of the presentation of five-tone intensities (70.9 dB, 77.9 dB, 84.5 dB, 89.5 dB, and 94.5 dB) in trains of 8 tones lasting 70 ms each tone, the trains were presented 20 times. EEG was used to measure ERP components: N1, P2, and N1-P2 peak-to-peak amplitude. fNIRS allowed the analysis of the hemodynamic activity in the auditory, visual, and prefrontal cortices. The results showed an increase in N1, P2, and N1-P2 peak-to-peak amplitude with auditory intensity. Similarly, oxyhemoglobin and deoxyhemoglobin concentrations showed amplitude increases and decreases, respectively, with auditory intensity in the auditory and prefrontal cortices. Spearman correlation analysis showed a relationship between the left auditory cortex with N1 amplitude, and the right dorsolateral cortex with P2 amplitude, specifically for deoxyhemoglobin concentrations. These findings suggest that there is a brain response to auditory intensity changes that can be obtained by EEG and fNIRS, supporting the neurovascular coupling process. Overall, this study enhances our understanding of fNIRS application in auditory paradigms and highlights its potential as a complementary technique to ERPs.

Brightening the Study of Listening Effort with Functional Near-Infrared Spectroscopy: A Scoping Review

Listening effort is a long-standing area of interest in auditory cognitive neuroscience. Prior research has used multiple techniques to shed light on the neurophysiological mechanisms underlying listening during challenging conditions. Functional near-infrared spectroscopy (fNIRS) is growing in popularity as a tool for cognitive neuroscience research, and its recent advances offer many potential advantages over other neuroimaging modalities for research related to listening effort. This review introduces the basic science of fNIRS and its uses for auditory cognitive neuroscience. We also discuss its application in recently published studies on listening effort and consider future opportunities for studying effortful listening with fNIRS. After reading this article, the learner will know how fNIRS works and summarize its uses for listening effort research. The learner will also be able to apply this knowledge toward generation of future research in this area.

A direct comparison of voice pitch processing in acoustic and electric hearing

In single-sided deafness patients fitted with a cochlear implant (CI) in the affected ear and preserved normal hearing in the other ear, acoustic and electric hearing can be directly compared without the need for an external control group. Although poor pitch perception is a crucial limitation when listening through CIs, it remains unclear how exactly the cortical processing of pitch information differs between acoustic and electric hearing. Hence, we separately presented both ears of 20 of these patients with vowel sequences in which the pitch contours were either repetitive or variable, while simultaneously recording functional near-infrared spectroscopy (fNIRS) and EEG data. Overall, the results showed smaller and delayed auditory cortex activity in electric hearing, particularly for the P2 event-related potential component, which appears to reflect the processing of voice pitch information. Both the fNIRS data and EEG source reconstructions furthermore showed that vowel sequences with variable pitch contours evoked additional activity in posterior right auditory cortex in electric but not acoustic hearing. This surprising discrepancy demonstrates, firstly, that the acoustic detail transmitted by CIs is sufficient to distinguish between speech sounds that only vary regarding their pitch information. Secondly, the absence of a condition difference when stimulating the normal-hearing ears suggests a saturation of cortical activity levels following unilateral deafness. Taken together, these results provide strong evidence in favour of using CIs in this patient group.

Head hemodynamics and systemic responses during auditory stimulation

The present study aims to analyze the systemic response to auditory stimulation by means of hemodynamic (cephalic and peripheral) and autonomic responses in a broad range of auditory intensities (70.9, 77.9, 84.5, 89.5, 94.5 dBA). This approach could help to understand the possible influence of the autonomic nervous system on the cephalic blood flow. Twenty-five subjects were exposed to auditory stimulation while electrodermal activity (EDA), photoplethysmography (PPG), electrocardiogram, and functional near-infrared spectroscopy signals were recorded. Seven trials with 20 individual tones, each for the five intensities, were presented. The results showed a differentiated response to the higher intensity (94.5 dBA) with a decrease in some peripheral signals such as the heart rate (HR), the pulse signal, the pulse transit time (PTT), an increase of the LFnu power in PPG, and at the head level a decrease in oxygenated and total hemoglobin concentration. After the regression of the visual channel activity from the auditory channels, a decrease in deoxyhemoglobin in the auditory cortex was obtained, indicating a likely active response at the highest intensity. Nevertheless, other measures, such as EDA (Phasic and Tonic), and heart rate variability (Frequency and time domain) showed no significant differences between intensities. Altogether, these results suggest a systemic and complex response to high-intensity auditory stimuli. The results obtained in the decrease of the PTT and the increase in LFnu power of PPG suggest a possible vasoconstriction reflex by a sympathetic control of vascular tone, which could be related to the decrease in blood oxygenation at the head level.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

Functional Reorganization of the Central Auditory System in Children with Single-Sided Deafness: A Protocol Using fNIRS

In children, single-sided deafness (SSD) affects the development of linguistic and social skills and can impede educational progress. These difficulties may relate to cortical changes that occur following SSD, such as reduced inter-hemispheric functional asymmetry and maladaptive brain plasticity. To investigate these neuronal changes and their evolution in children, a non-invasive technique is required that is little affected by motion artifacts. Here, we present a research protocol that uses functional near-infrared spectroscopy (fNIRS) to evaluate the reorganization of cortical auditory asymmetry in children with SSD; it also examines how the cortical changes relate to auditory and language skills. The protocol is designed for children whose SSD has not been treated, because hearing restoration can alter both brain reorganization and behavioral performance. We propose a single-center, cross-sectional study that includes 30 children with SSD (congenital or acquired moderate-to-profound deafness) and 30 children with normal hearing (NH), all aged 5–16 years. The children undergo fNIRS during monaural and binaural stimulation, and the pattern of cortical activity is analyzed using measures of the peak amplitude and area under the curve for both oxy- and deoxyhemoglobin. These cortical measures can be compared between the two groups of children, and analyses can be run to determine whether they relate to binaural hearing (speech-in-noise and sound localization), speech perception and production, and quality of life (QoL). The results could be of relevance for developing individualized rehabilitation programs for SSD, which could reduce patients’ difficulties and prevent long-term neurofunctional and clinical consequences.

Functional neuroimaging in hearing research and audiology

The various methods of medical imaging are essential for many diagnostic issues in clinical routine, e.g., for the diagnostics and localisation of tumorous diseases, or for the clarification of other lesions in the central nervous system. In addition to these classical roles both positron emission tomography (PET) and magnetic resonance imaging (MRI) allow for the investigation of functional processes in the human brain, when used in a specific way. The last 25 years have seen great progress, especially with respect to functional MRI, in terms of the available experimental paradigms as well as the data analysis strategies, so that a directed investigation of neurophysiological correlates of psychoacoustic performance is possible. This covers fundamental measures of sound perception like loudness and pitch, specific audiological symptoms like tinnitus, which often accompanies hearing disorders, but it also includes experiments on speech perception or on virtual acoustic environments. One important aspect common to many auditory neuroimaging studies is the central question at what stage in the human auditory pathway the sensory coding of the incoming sound is transformed into a universal and context-dependent perceptual representation, which is the basis for what we hear. This overview summarises findings from the literature as well as a few studies from our lab, to discuss the possibilities and the limits of the adoption of functional neuroimaging methods in audiology. Up to this stage, most auditory neuroimaging studies have investigated basic processes in normal hearing listeners. However, the hitherto existing results suggest that the methods of auditory functional neuroimaging - possibly complemented by electrophysiological methods like EEG and MEG - have a great potential to contribute to a deeper understanding of the processes and the impact of hearing disorders.