Auditory cortex activity measured using functional near-infrared spectroscopy (fNIRS) appears to be susceptible to masking by cortical blood stealing

Brain activation patterns in normal hearing adults: An fNIRS Study using an adapted clinical speech comprehension task

OBJECTIVES

Understanding brain processing of auditory and visual speech is essential for advancing speech perception research and improving clinical interventions for individuals with hearing impairment. Functional near-infrared spectroscopy (fNIRS) is deemed to be highly suitable for measuring brain activity during language tasks. However, accurate data interpretation also requires validated stimuli and behavioral measures.

DESIGN

Twenty-six adults with normal hearing listened to sentences from the Oldenburg Sentence Test (OLSA), and brain activation in the temporal, occipital, and prefrontal areas was measured by fNIRS. The sentences were presented in one of the four different modalities: speech-in-quiet, speech-in-noise, audiovisual speech or visual speech (i.e., lipreading). To support the interpretation of our fNIRS data, and to obtain a more comprehensive understanding of the study population, we performed hearing tests (pure tone and speech audiometry) and collected behavioral data using validated questionnaires, in-task comprehension questions, and listening effort ratings.

RESULTS

In the auditory conditions (i.e., speech-in-quiet and speech-in-noise), we observed cortical activity in the temporal regions bilaterally. During the visual speech condition, we measured significant activation in the occipital area. Following the audiovisual condition, cortical activation was observed in both regions. Furthermore, we established a baseline for how individuals with normal hearing process visual cues during lipreading, and we found higher activity in the prefrontal cortex in noise conditions compared to quiet conditions, linked to higher listening effort.

CONCLUSIONS

We demonstrated the applicability of a clinically inspired audiovisual speech-comprehension task in participants with normal hearing. The measured brain activation patterns were supported and complemented by objective and behavioral parameters.

Speech-evoked cortical activities and speech recognition in adult cochlear implant listeners: a review of functional near-infrared spectroscopy studies

Cochlear implants (CIs) are the most successful neural prostheses, enabling individuals with severe to profound hearing loss to access sounds and understand speech. While CI has demonstrated success, speech perception outcomes vary largely among CI listeners, with significantly reduced performance in noise. This review paper summarizes prior findings on speech-evoked cortical activities in adult CI listeners using functional near-infrared spectroscopy (fNIRS) to understand (a) speech-evoked cortical processing in CI listeners compared to normal-hearing (NH) individuals, (b) the relationship between these activities and behavioral speech recognition scores, (c) the extent to which current fNIRS-measured speech-evoked cortical activities in CI listeners account for their differences in speech perception, and (d) challenges in using fNIRS for CI research. Compared to NH listeners, CI listeners had diminished speech-evoked activation in the middle temporal gyrus (MTG) and in the superior temporal gyrus (STG), except one study reporting an opposite pattern for STG. NH listeners exhibited higher inferior frontal gyrus (IFG) activity when listening to CI-simulated speech compared to natural speech. Among CI listeners, higher speech recognition scores correlated with lower speech-evoked activation in the STG, higher activation in the left IFG and left fusiform gyrus, with mixed findings in the MTG. fNIRS shows promise for enhancing our understanding of cortical processing of speech in CI listeners, though findings are mixed. Challenges include test-retest reliability, managing noise, replicating natural conditions, optimizing montage design, and standardizing methods to establish a strong predictive relationship between fNIRS-based cortical activities and speech perception in CI listeners.

The DLPFC is centrally involved in resolving Stroop conflicts, suppressing distracting sensory input within the auditory and visual system

Introduction

Cognitive control is a prerequisite for successful, goal-oriented behavior. The dorsolateral prefrontal cortex (DLPFC) is assumed to be a key player in applying cognitive control; however, the neural mechanisms by which this process is accomplished are still unclear.

Methods

To further address this question, an audiovisual Stroop task was used, comprising simultaneously presented pictures and spoken names of actors and politicians. Depending on the task block, participants had to indicate whether they saw the face or heard the name of a politician or an actor (visual vs. auditory blocks). In congruent trials, both stimuli (visual and auditory) belonged to the same response category (actor or politician); in incongruent trials, they belonged to different categories. During this task, activity in sensory target regions was measured via functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), respectively. Specifically, fNIRS was used to monitor activity levels within the auditory cortex, while the EEG-based event-related potential of the N170 was considered as a marker of FFA (fusiform face area) involvement. Additionally, we assessed the effects of inhibitory theta-burst stimulation-a specific protocol based on repetitive transcranial magnetic stimulation (rTMS)-over the right DLPFC. Non-invasive brain stimulation is one of the few means to draw causal conclusions in human neuroscience. In this case, rTMS was used to temporarily inhibit the right DLPFC as a presumed key player in solving Stroop conflicts in one of two measurement sessions; then, effects were examined on behavioral measures as well as neurophysiological signals reflecting task-related activity in the frontal lobes and sensory cortices.

Results

The results indicate a central role of the DLPFC in the implementation of cognitive control in terms of a suppression of distracting sensory input in both the auditory cortex and visual system (FFA) in high-conflict situations. Behavioral data confirm a reduced Stroop effect following previous incongruent trials ("Gratton effect") that was only accomplished with an intact DLPFC (i.e., following placebo stimulation).

Discussion

Because non-invasive brain stimulation is uniquely suited to causally test neuroscientific hypotheses in humans, these data give important insights into some of the mechanisms by which the DLPFC establishes conflict resolution across different sensory modalities.

Multivariate disturbance filtering in auditory fNIRS signals using maximum likelihood gradient estimation method: Feasibility study using sound quality indices

Functional near-infrared spectroscopy (fNIRS) technology has been widely used to analyze biomechanics and diagnose brain activity. Despite being a promising tool for assessing the brain cortex status, this system is susceptible to disturbances and noise from electrical instrumentation and basal metabolism. In this study, an alternative filtering method, maximum likelihood generalized extended stochastic gradient (ML-GESG) estimation, is proposed to overcome the limitations of these disturbance factors. The proposed algorithm was designed to reduce multiple disturbances originating from heartbeats, breathing, shivering, and instrumental noises as multivariate parameters. To evaluate the effectiveness of the algorithm in filtering involuntary signals, a comparative analysis was conducted with a conventional filtering method, using hemodynamic responses to auditory stimuli and psycho-acoustic factors as quality indices. Using auditory sound stimuli consisting of 12 voice sources (six males and six females), the fNIRS test was configured with 18 channels and conducted on 10 volunteers. The psycho-acoustic factors of loudness and sharpness were used to evaluate physiological responses to the stimuli. Applying the proposed filtering method, the oxygenated hemoglobin concentration correlated better with the psychoacoustic analysis of each auditory stimulus than that of the conventional filtering method.

Cross-modal plasticity in children with cochlear implant: converging evidence from EEG and functional near-infrared spectroscopy

Over the first years of life, the brain undergoes substantial organization in response to environmental stimulation. In a silent world, it may promote vision by (i) recruiting resources from the auditory cortex and (ii) making the visual cortex more efficient. It is unclear when such changes occur and how adaptive they are, questions that children with cochlear implants can help address. Here, we examined 7-18 years old children: 50 had cochlear implants, with delayed or age-appropriate language abilities, and 25 had typical hearing and language. High-density electroencephalography and functional near-infrared spectroscopy were used to evaluate cortical responses to a low-level visual task. Evidence for a 'weaker visual cortex response' and 'less synchronized or less inhibitory activity of auditory association areas' in the implanted children with language delays suggests that cross-modal reorganization can be maladaptive and does not necessarily strengthen the dominant visual sense.

Investigation of electro-vascular phase-amplitude coupling during an auditory task

Multimodal neuroimaging using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides complementary views of cortical processes, including those related to auditory processing. However, current multimodal approaches often overlook potential insights that can be gained from nonlinear interactions between electrical and hemodynamic signals. Here, we explore electro-vascular phase-amplitude coupling (PAC) between low-frequency hemodynamic and high-frequency electrical oscillations during an auditory task. We further apply a temporally embedded canonical correlation analysis (tCCA)-general linear model (GLM)-based correction approach to reduce the possible effect of systemic physiology on fNIRS recordings. Before correction, we observed significant PAC between fNIRS and broadband EEG in the frontal region (p ≪ 0.05), β (p ≪ 0.05) and γ (p = 0.010) in the left temporal/temporoparietal (left auditory; LA) region, and γ (p = 0.032) in the right temporal/temporoparietal (right auditory; RA) region across the entire dataset. Significant differences in PAC across conditions (task versus silence) were observed in LA (p = 0.023) and RA (p = 0.049) γ sub-bands and in lower frequency (5-20 Hz) frontal activity (p = 0.005). After correction, significant fNIRS-γ-band PAC was observed in the frontal (p = 0.021) and LA (p = 0.025) regions, while fNIRS-α (p = 0.003) and fNIRS-β (p = 0.041) PAC were observed in RA. Decreased frontal γ-band (p = 0.008) and increased β-band (p ≪ 0.05) PAC were observed during the task. These outcomes represent the first characterization of electro-vascular PAC between fNIRS and EEG signals during an auditory task, providing insights into electro-vascular coupling in auditory processing.

fNIRS Dataset During Complex Scene Analysis

When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.

Audiovisual integration in children with cochlear implants revealed through EEG and fNIRS

Sensory deprivation can offset the balance of audio versus visual information in multimodal processing. Such a phenomenon could persist for children born deaf, even after they receive cochlear implants (CIs), and could potentially explain why one modality is given priority over the other. Here, we recorded cortical responses to a single speaker uttering two syllables, presented in audio-only (A), visual-only (V), and audio-visual (AV) modes. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were successively recorded in seventy-five school-aged children. Twenty-five were children with normal hearing (NH) and fifty wore CIs, among whom 26 had relatively high language abilities (HL) comparable to those of NH children, while 24 others had low language abilities (LL). In EEG data, visual-evoked potentials were captured in occipital regions, in response to V and AV stimuli, and they were accentuated in the HL group compared to the LL group (the NH group being intermediate). Close to the vertex, auditory-evoked potentials were captured in response to A and AV stimuli and reflected a differential treatment of the two syllables but only in the NH group. None of the EEG metrics revealed any interaction between group and modality. In fNIRS data, each modality induced a corresponding activity in visual or auditory regions, but no group difference was observed in A, V, or AV stimulation. The present study did not reveal any sign of abnormal AV integration in children with CI. An efficient multimodal integrative network (at least for rudimentary speech materials) is clearly not a sufficient condition to exhibit good language and literacy.

Neurovascular coupling during auditory stimulation: event-related potentials and fNIRS hemodynamic

Intensity-dependent amplitude changes (IDAP) have been extensively studied using event-related potentials (ERPs) and have been linked to several psychiatric disorders. This study aims to explore the application of functional near-infrared spectroscopy (fNIRS) in IDAP paradigms, which related to ERPs could indicate the existence of neurovascular coupling. Thirty-three and thirty-one subjects participated in two experiments, respectively. The first experiment consisted of the presentation of three-tone intensities (77.9 dB, 84.5 dB, and 89.5 dB) lasting 500 ms, each type randomly presented 54 times, while the second experiment consisted of the presentation of five-tone intensities (70.9 dB, 77.9 dB, 84.5 dB, 89.5 dB, and 94.5 dB) in trains of 8 tones lasting 70 ms each tone, the trains were presented 20 times. EEG was used to measure ERP components: N1, P2, and N1-P2 peak-to-peak amplitude. fNIRS allowed the analysis of the hemodynamic activity in the auditory, visual, and prefrontal cortices. The results showed an increase in N1, P2, and N1-P2 peak-to-peak amplitude with auditory intensity. Similarly, oxyhemoglobin and deoxyhemoglobin concentrations showed amplitude increases and decreases, respectively, with auditory intensity in the auditory and prefrontal cortices. Spearman correlation analysis showed a relationship between the left auditory cortex with N1 amplitude, and the right dorsolateral cortex with P2 amplitude, specifically for deoxyhemoglobin concentrations. These findings suggest that there is a brain response to auditory intensity changes that can be obtained by EEG and fNIRS, supporting the neurovascular coupling process. Overall, this study enhances our understanding of fNIRS application in auditory paradigms and highlights its potential as a complementary technique to ERPs.

Brightening the Study of Listening Effort with Functional Near-Infrared Spectroscopy: A Scoping Review

Listening effort is a long-standing area of interest in auditory cognitive neuroscience. Prior research has used multiple techniques to shed light on the neurophysiological mechanisms underlying listening during challenging conditions. Functional near-infrared spectroscopy (fNIRS) is growing in popularity as a tool for cognitive neuroscience research, and its recent advances offer many potential advantages over other neuroimaging modalities for research related to listening effort. This review introduces the basic science of fNIRS and its uses for auditory cognitive neuroscience. We also discuss its application in recently published studies on listening effort and consider future opportunities for studying effortful listening with fNIRS. After reading this article, the learner will know how fNIRS works and summarize its uses for listening effort research. The learner will also be able to apply this knowledge toward generation of future research in this area.

A direct comparison of voice pitch processing in acoustic and electric hearing

In single-sided deafness patients fitted with a cochlear implant (CI) in the affected ear and preserved normal hearing in the other ear, acoustic and electric hearing can be directly compared without the need for an external control group. Although poor pitch perception is a crucial limitation when listening through CIs, it remains unclear how exactly the cortical processing of pitch information differs between acoustic and electric hearing. Hence, we separately presented both ears of 20 of these patients with vowel sequences in which the pitch contours were either repetitive or variable, while simultaneously recording functional near-infrared spectroscopy (fNIRS) and EEG data. Overall, the results showed smaller and delayed auditory cortex activity in electric hearing, particularly for the P2 event-related potential component, which appears to reflect the processing of voice pitch information. Both the fNIRS data and EEG source reconstructions furthermore showed that vowel sequences with variable pitch contours evoked additional activity in posterior right auditory cortex in electric but not acoustic hearing. This surprising discrepancy demonstrates, firstly, that the acoustic detail transmitted by CIs is sufficient to distinguish between speech sounds that only vary regarding their pitch information. Secondly, the absence of a condition difference when stimulating the normal-hearing ears suggests a saturation of cortical activity levels following unilateral deafness. Taken together, these results provide strong evidence in favour of using CIs in this patient group.

Head hemodynamics and systemic responses during auditory stimulation

The present study aims to analyze the systemic response to auditory stimulation by means of hemodynamic (cephalic and peripheral) and autonomic responses in a broad range of auditory intensities (70.9, 77.9, 84.5, 89.5, 94.5 dBA). This approach could help to understand the possible influence of the autonomic nervous system on the cephalic blood flow. Twenty-five subjects were exposed to auditory stimulation while electrodermal activity (EDA), photoplethysmography (PPG), electrocardiogram, and functional near-infrared spectroscopy signals were recorded. Seven trials with 20 individual tones, each for the five intensities, were presented. The results showed a differentiated response to the higher intensity (94.5 dBA) with a decrease in some peripheral signals such as the heart rate (HR), the pulse signal, the pulse transit time (PTT), an increase of the LFnu power in PPG, and at the head level a decrease in oxygenated and total hemoglobin concentration. After the regression of the visual channel activity from the auditory channels, a decrease in deoxyhemoglobin in the auditory cortex was obtained, indicating a likely active response at the highest intensity. Nevertheless, other measures, such as EDA (Phasic and Tonic), and heart rate variability (Frequency and time domain) showed no significant differences between intensities. Altogether, these results suggest a systemic and complex response to high-intensity auditory stimuli. The results obtained in the decrease of the PTT and the increase in LFnu power of PPG suggest a possible vasoconstriction reflex by a sympathetic control of vascular tone, which could be related to the decrease in blood oxygenation at the head level.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

Functional Reorganization of the Central Auditory System in Children with Single-Sided Deafness: A Protocol Using fNIRS

In children, single-sided deafness (SSD) affects the development of linguistic and social skills and can impede educational progress. These difficulties may relate to cortical changes that occur following SSD, such as reduced inter-hemispheric functional asymmetry and maladaptive brain plasticity. To investigate these neuronal changes and their evolution in children, a non-invasive technique is required that is little affected by motion artifacts. Here, we present a research protocol that uses functional near-infrared spectroscopy (fNIRS) to evaluate the reorganization of cortical auditory asymmetry in children with SSD; it also examines how the cortical changes relate to auditory and language skills. The protocol is designed for children whose SSD has not been treated, because hearing restoration can alter both brain reorganization and behavioral performance. We propose a single-center, cross-sectional study that includes 30 children with SSD (congenital or acquired moderate-to-profound deafness) and 30 children with normal hearing (NH), all aged 5–16 years. The children undergo fNIRS during monaural and binaural stimulation, and the pattern of cortical activity is analyzed using measures of the peak amplitude and area under the curve for both oxy- and deoxyhemoglobin. These cortical measures can be compared between the two groups of children, and analyses can be run to determine whether they relate to binaural hearing (speech-in-noise and sound localization), speech perception and production, and quality of life (QoL). The results could be of relevance for developing individualized rehabilitation programs for SSD, which could reduce patients’ difficulties and prevent long-term neurofunctional and clinical consequences.

Functional neuroimaging in hearing research and audiology

The various methods of medical imaging are essential for many diagnostic issues in clinical routine, e.g., for the diagnostics and localisation of tumorous diseases, or for the clarification of other lesions in the central nervous system. In addition to these classical roles both positron emission tomography (PET) and magnetic resonance imaging (MRI) allow for the investigation of functional processes in the human brain, when used in a specific way. The last 25 years have seen great progress, especially with respect to functional MRI, in terms of the available experimental paradigms as well as the data analysis strategies, so that a directed investigation of neurophysiological correlates of psychoacoustic performance is possible. This covers fundamental measures of sound perception like loudness and pitch, specific audiological symptoms like tinnitus, which often accompanies hearing disorders, but it also includes experiments on speech perception or on virtual acoustic environments. One important aspect common to many auditory neuroimaging studies is the central question at what stage in the human auditory pathway the sensory coding of the incoming sound is transformed into a universal and context-dependent perceptual representation, which is the basis for what we hear. This overview summarises findings from the literature as well as a few studies from our lab, to discuss the possibilities and the limits of the adoption of functional neuroimaging methods in audiology. Up to this stage, most auditory neuroimaging studies have investigated basic processes in normal hearing listeners. However, the hitherto existing results suggest that the methods of auditory functional neuroimaging - possibly complemented by electrophysiological methods like EEG and MEG - have a great potential to contribute to a deeper understanding of the processes and the impact of hearing disorders.