Neuroimaging with near-infrared spectroscopy demonstrates speech-evoked activity in the auditory cortex of deaf children following cochlear implantation

Effects of Age on the Auditory Cortex During Speech Perception in Noise: Evidence From Functional Near-Infrared Spectroscopy

OBJECTIVES

Age-related speech perception difficulties may be related to a decline in central auditory processing abilities, particularly in noisy or challenging environments. However, how the activation patterns related to speech stimulation in different noise situations change with normal aging has yet to be elucidated. In this study, we aimed to investigate the effects of noisy environments and aging on patterns of auditory cortical activation.

DESIGN

We analyzed the functional near-infrared spectroscopy signals of 20 young adults, 21 middle-aged adults, and 21 elderly adults, and evaluated their cortical response patterns to speech stimuli under five different signal to noise ratios (SNRs). In addition, we analyzed the behavior score, activation intensity, oxyhemoglobin variability, and dominant hemisphere, to investigate the effects of aging and noisy environments on auditory cortical activation.

RESULTS

Activation intensity and oxyhemoglobin variability both showed a decreasing trend with aging at an SNR of 0 dB; we also identified a strong correlation between activation intensity and age under this condition. However, we observed an inconsistent activation pattern when the SNR was 5 dB. Furthermore, our analysis revealed that the left hemisphere may be more susceptible to aging than the right hemisphere. Activation in the right hemisphere was more evident in older adults than in the left hemisphere; in contrast, younger adults showed leftward lateralization.

CONCLUSIONS

Our analysis showed that with aging, auditory cortical regions gradually become inflexible in noisy environments. Furthermore, changes in cortical activation patterns with aging may be related to SNR conditions, and that understandable speech with a low SNR ratio but still understandable may induce the highest level of activation. We also found that the left hemisphere was more affected by aging than the right hemisphere in speech perception tasks; the left-sided dominance observed in younger individuals gradually shifted to the right hemisphere with aging.

Early-stage use of hearing aids preserves auditory cortical structure in children with sensorineural hearing loss

Hearing is critical to spoken language, cognitive, and social development. Little is known about how early auditory experiences impact the brain structure of children with bilateral sensorineural hearing loss. This study examined the influence of hearing aid use and residual hearing on the auditory cortex of children with severe to profound congenital sensorineural hearing loss. We evaluated cortical preservation in 103 young pediatric cochlear implant candidates (55 females and 48 males) by comparing their multivoxel pattern similarity of auditory cortical structure with that of 78 age-matched children with typical hearing. The results demonstrated that early-stage hearing aid use preserved the auditory cortex of children with bilateral congenital sensorineural hearing loss. Children with less residual hearing experienced a more pronounced advantage from hearing aid use. However, this beneficial effect gradually diminished after 17 months of hearing aid use. These findings support timely fitting of hearing aids in conjunction with early implantation to take advantage of neural preservation to maximize auditory and spoken language development.

Features of the speech processing network in post- and prelingually deaf cochlear implant users

The onset of hearing loss can lead to altered brain structure and functions. However, hearing restoration may also result in distinct cortical reorganization. A differential pattern of functional remodeling was observed between post- and prelingual cochlear implant users, but it remains unclear how these speech processing networks are reorganized after cochlear implantation. To explore the impact of language acquisition and hearing restoration on speech perception in cochlear implant users, we conducted assessments of brain activation, functional connectivity, and graph theory-based analysis using functional near-infrared spectroscopy. We examined the effects of speech-in-noise stimuli on three groups: postlingual cochlear implant users (n = 12), prelingual cochlear implant users (n = 10), and age-matched individuals with hearing controls (HC) (n = 22). The activation of auditory-related areas in cochlear implant users showed a lower response compared with the HC group. Wernicke's area and Broca's area demonstrated differences network attributes in speech processing networks in post- and prelingual cochlear implant users. In addition, cochlear implant users maintain a high efficiency of the speech processing network to process speech information. Taken together, our results characterize the speech processing networks, in varying noise environments, in post- and prelingual cochlear implant users and provide new insights for theories of how implantation modes impact remodeling of the speech processing functional networks.

Audiovisual integration in children with cochlear implants revealed through EEG and fNIRS

Sensory deprivation can offset the balance of audio versus visual information in multimodal processing. Such a phenomenon could persist for children born deaf, even after they receive cochlear implants (CIs), and could potentially explain why one modality is given priority over the other. Here, we recorded cortical responses to a single speaker uttering two syllables, presented in audio-only (A), visual-only (V), and audio-visual (AV) modes. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were successively recorded in seventy-five school-aged children. Twenty-five were children with normal hearing (NH) and fifty wore CIs, among whom 26 had relatively high language abilities (HL) comparable to those of NH children, while 24 others had low language abilities (LL). In EEG data, visual-evoked potentials were captured in occipital regions, in response to V and AV stimuli, and they were accentuated in the HL group compared to the LL group (the NH group being intermediate). Close to the vertex, auditory-evoked potentials were captured in response to A and AV stimuli and reflected a differential treatment of the two syllables but only in the NH group. None of the EEG metrics revealed any interaction between group and modality. In fNIRS data, each modality induced a corresponding activity in visual or auditory regions, but no group difference was observed in A, V, or AV stimulation. The present study did not reveal any sign of abnormal AV integration in children with CI. An efficient multimodal integrative network (at least for rudimentary speech materials) is clearly not a sufficient condition to exhibit good language and literacy.

fNIRS Studies of Individuals with Speech and Language Impairment Underreport Sociodemographics: A Systematic Review

Functional near-infrared spectroscopy (fNIRS) is a promising tool for scientific discovery and clinical application. However, its utility depends upon replicable reporting. We evaluate reporting of sociodemographics in fNIRS studies of speech and language impairment and asked the following: (1) Do refereed fNIRS publications report participant sociodemographics? (2) For what reasons are participants excluded from analysis? This systematic review was preregistered with PROSPERO (CRD42022342959) and followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses protocol. Searches in August 2022 included the terms: (a) fNIRS or functional near-infrared spectroscopy or NIRS or near-infrared spectroscopy, (b) speech or language, and (c) disorder or impairment or delay. Searches yielded 38 qualifying studies from 1997 to present. Eight studies (5%) reported at least partial information on race or ethnicity. Few studies reported SES (26%) or language background (47%). Most studies reported geographic location (100%) and gender/sex (89%). Underreporting of sociodemographics in fNIRS studies of speech and language impairment hinders the generalizability of findings. Replicable reporting is imperative for advancing the utility of fNIRS.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output.

METHODS

Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded.

RESULTS

Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis.

CONCLUSIONS

These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Dynamic networks differentiate the language ability of children with cochlear implants

Background

Cochlear implantation (CI) in prelingually deafened children has been shown to be an effective intervention for developing language and reading skill. However, there is a substantial proportion of the children receiving CI who struggle with language and reading. The current study-one of the first to implement electrical source imaging in CI population was designed to identify the neural underpinnings in two groups of CI children with good and poor language and reading skill.

Methods

Data using high density electroencephalography (EEG) under a resting state condition was obtained from 75 children, 50 with CIs having good (HL) or poor language skills (LL) and 25 normal hearing (NH) children. We identified coherent sources using dynamic imaging of coherent sources (DICS) and their effective connectivity computing time-frequency causality estimation based on temporal partial directed coherence (TPDC) in the two CI groups compared to a cohort of age and gender matched NH children.

Findings

Sources with higher coherence amplitude were observed in three frequency bands (alpha, beta and gamma) for the CI groups when compared to normal hearing children. The two groups of CI children with good (HL) and poor (LL) language ability exhibited not only different cortical and subcortical source profiles but also distinct effective connectivity between them. Additionally, a support vector machine (SVM) algorithm using these sources and their connectivity patterns for each CI group across the three frequency bands was able to predict the language and reading scores with high accuracy.

Interpretation

Increased coherence in the CI groups suggest overall that the oscillatory activity in some brain areas become more strongly coupled compared to the NH group. Moreover, the different sources and their connectivity patterns and their association to language and reading skill in both groups, suggest a compensatory adaptation that either facilitated or impeded language and reading development. The neural differences in the two groups of CI children may reflect potential biomarkers for predicting outcome success in CI children.

Brightening the Study of Listening Effort with Functional Near-Infrared Spectroscopy: A Scoping Review

Listening effort is a long-standing area of interest in auditory cognitive neuroscience. Prior research has used multiple techniques to shed light on the neurophysiological mechanisms underlying listening during challenging conditions. Functional near-infrared spectroscopy (fNIRS) is growing in popularity as a tool for cognitive neuroscience research, and its recent advances offer many potential advantages over other neuroimaging modalities for research related to listening effort. This review introduces the basic science of fNIRS and its uses for auditory cognitive neuroscience. We also discuss its application in recently published studies on listening effort and consider future opportunities for studying effortful listening with fNIRS. After reading this article, the learner will know how fNIRS works and summarize its uses for listening effort research. The learner will also be able to apply this knowledge toward generation of future research in this area.

Functional near-infrared spectroscopy in pediatric clinical research: Different pathophysiologies and promising clinical applications

Over its 30 years of existence, functional near-infrared spectroscopy (fNIRS) has matured into a highly versatile tool to study brain function in infants and young children. Its advantages, amongst others, include its ease of application and portability, the option to combine it with electrophysiology, and its relatively good tolerance to movement. As shown by the impressive body of fNIRS literature in the field of cognitive developmental neuroscience, the method's strengths become even more relevant for (very) young individuals who suffer from neurological, behavioral, and/or cognitive impairment. Although a number of studies have been conducted with a clinical perspective, fNIRS cannot yet be considered as a truly clinical tool. The first step has been taken in this direction by studies exploring options in populations with well-defined clinical profiles. To foster further progress, here, we review several of these clinical approaches to identify the challenges and perspectives of fNIRS in the field of developmental disorders. We first outline the contributions of fNIRS in selected areas of pediatric clinical research: epilepsy, communicative and language disorders, and attention-deficit/hyperactivity disorder. We provide a scoping review as a framework to allow the highlighting of specific and general challenges of using fNIRS in pediatric research. We also discuss potential solutions and perspectives on the broader use of fNIRS in the clinical setting. This may be of use to future research, targeting clinical applications of fNIRS in children and adolescents.

Controlling jaw-related motion artifacts in functional near-infrared spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) as a non-invasive optical neuroimaging technique has demonstrated great potential in monitoring cerebral activity. Due to its portability and compatibility with medical implants, fNIRS has seen increasing applications in studying the hearing, language and cognitive functions. However, fNIRS is susceptible to artifacts related to jaw movements, such as teeth clenching, swallowing and speaking, which affect recordings over the temporal, parietal and frontal/prefrontal cortices.

NEW METHOD

We investigated two new approaches to control the jaw-related motion artifacts, an individually customized bite bar apparatus and a denoising algorithm namely PCA-GLM based on multi-channel fNIRS recordings from long-separation and short-separation montage. We first recorded data while subjects performed a clenching task, then an auditory task and a resting-state task with and without the bite bar.

RESULTS

Our results have shown that jaw clenching can introduce spurious, task-evoked-like responses in fNIRS signals. A bite bar customized for each participant effectively suppressed the movement-related activities in fNIRS, at both task and resting-state conditions. Moreover, the bite bar and the PCA-GLM denoising method are shown to improve auditory responses, by significantly reducing the within-subject standard deviation, increasing the task-related contrast-to-noise ratio, and yielding stronger activations to the auditory stimuli.

COMPARISON WITH EXISTING METHOD(S)

The current study has demonstrated a novel method to control the jaw-related motion artifacts in fNIRS signals.

CONCLUSIONS

Our method will benefit the study of the hearing, language and cognitive functions in normal healthy subjects and patients.

A direct comparison of voice pitch processing in acoustic and electric hearing

In single-sided deafness patients fitted with a cochlear implant (CI) in the affected ear and preserved normal hearing in the other ear, acoustic and electric hearing can be directly compared without the need for an external control group. Although poor pitch perception is a crucial limitation when listening through CIs, it remains unclear how exactly the cortical processing of pitch information differs between acoustic and electric hearing. Hence, we separately presented both ears of 20 of these patients with vowel sequences in which the pitch contours were either repetitive or variable, while simultaneously recording functional near-infrared spectroscopy (fNIRS) and EEG data. Overall, the results showed smaller and delayed auditory cortex activity in electric hearing, particularly for the P2 event-related potential component, which appears to reflect the processing of voice pitch information. Both the fNIRS data and EEG source reconstructions furthermore showed that vowel sequences with variable pitch contours evoked additional activity in posterior right auditory cortex in electric but not acoustic hearing. This surprising discrepancy demonstrates, firstly, that the acoustic detail transmitted by CIs is sufficient to distinguish between speech sounds that only vary regarding their pitch information. Secondly, the absence of a condition difference when stimulating the normal-hearing ears suggests a saturation of cortical activity levels following unilateral deafness. Taken together, these results provide strong evidence in favour of using CIs in this patient group.

The Effects of Cortical Reorganization and Applications of Functional Near-Infrared Spectroscopy in Deaf People and Cochlear Implant Users

A cochlear implant (CI) is currently the only FDA-approved biomedical device that can restore hearing for the majority of patients with severe-to-profound sensorineural hearing loss (SNHL). While prelingually and postlingually deaf individuals benefit substantially from CI, the outcomes after implantation vary greatly. Numerous studies have attempted to study the variables that affect CI outcomes, including the personal characteristics of CI candidates, environmental variables, and device-related variables. Up to 80% of the results remained unexplainable because all these variables could only roughly predict auditory performance with a CI. Brain structure/function differences after hearing deprivation, that is, cortical reorganization, has gradually attracted the attention of neuroscientists. The cross-modal reorganization in the auditory cortex following deafness is thought to be a key factor in the success of CI. In recent years, the adaptive and maladaptive effects of this reorganization on CI rehabilitation have been argued because the neural mechanisms of how this reorganization impacts CI learning and rehabilitation have not been revealed. Due to the lack of brain processes describing how this plasticity affects CI learning and rehabilitation, the adaptive and deleterious consequences of this reorganization on CI outcomes have recently been the subject of debate. This review describes the evidence for different roles of cross-modal reorganization in CI performance and attempts to explore the possible reasons. Additionally, understanding the core influencing mechanism requires taking into account the cortical changes from deafness to hearing restoration. However, methodological issues have restricted longitudinal research on cortical function in CI. Functional near-infrared spectroscopy (fNIRS) has been increasingly used for the study of brain function and language assessment in CI because of its unique advantages, which are considered to have great potential. Here, we review studies on auditory cortex reorganization in deaf patients and CI recipients, and then we try to illustrate the feasibility of fNIRS as a neuroimaging tool in predicting and assessing speech performance in CI recipients. Here, we review research on the cross-modal reorganization of the auditory cortex in deaf patients and CI recipients and seek to demonstrate the viability of using fNIRS as a neuroimaging technique to predict and evaluate speech function in CI recipients.

Clenching-Related Motion Artifacts in Functional Near-Infrared Spectroscopy in the Auditory Cortex

Functional near-infrared spectroscopy (fNIRS), a non-invasive optical neuroimaging technique, has demonstrated its great potential in monitoring cerebral activity as an alternative to functional magnetic resonance imaging (fMRI) in research and clinical usage. fNIRS has seen increasing applications in studying the auditory cortex in healthy subjects and cochlear implant users. However, fNIRS is susceptible to motion artifacts, especially those related to jaw movement, which can affect fNIRS signals in speech and auditory tasks. This study aimed to investigate the motion artifacts related to jaw movements including clenching, speaking, swallowing, and sniffing in a group of human subjects, and test whether our previously established denoising algorithm namely PCA-GLM can reduce the motion artifacts. Our results have shown that the jaw movements introduced artifacts that resemble task-evoked activations and that the PCA-GLM method effectively reduced the motion artifacts due to the clenching movements. The preliminary results of the present study underline the importance of the removal of the jaw-movement-related artifacts in fNIRS signals and suggest the efficacy of our PCA-GLM method in reducing the motion artifacts. Clinical Relevance- This work studies the motion artifacts due to jaw movements that frequently occur in speech perception and production tasks and validates the efficacy of an established denoising algorithm which benefits fNIRS studies on auditory and language functions.

Prefrontal cortex supports speech perception in listeners with cochlear implants

Cochlear implants are neuroprosthetic devices that can restore hearing in people with severe to profound hearing loss by electrically stimulating the auditory nerve. Because of physical limitations on the precision of this stimulation, the acoustic information delivered by a cochlear implant does not convey the same level of acoustic detail as that conveyed by normal hearing. As a result, speech understanding in listeners with cochlear implants is typically poorer and more effortful than in listeners with normal hearing. The brain networks supporting speech understanding in listeners with cochlear implants are not well understood, partly due to difficulties obtaining functional neuroimaging data in this population. In the current study, we assessed the brain regions supporting spoken word understanding in adult listeners with right unilateral cochlear implants (n=20) and matched controls (n=18) using high-density diffuse optical tomography (HD-DOT), a quiet and non-invasive imaging modality with spatial resolution comparable to that of functional MRI. We found that while listening to spoken words in quiet, listeners with cochlear implants showed greater activity in the left prefrontal cortex than listeners with normal hearing, specifically in a region engaged in a separate spatial working memory task. These results suggest that listeners with cochlear implants require greater cognitive processing during speech understanding than listeners with normal hearing, supported by compensatory recruitment of the left prefrontal cortex.

Functional Reorganization of the Central Auditory System in Children with Single-Sided Deafness: A Protocol Using fNIRS

In children, single-sided deafness (SSD) affects the development of linguistic and social skills and can impede educational progress. These difficulties may relate to cortical changes that occur following SSD, such as reduced inter-hemispheric functional asymmetry and maladaptive brain plasticity. To investigate these neuronal changes and their evolution in children, a non-invasive technique is required that is little affected by motion artifacts. Here, we present a research protocol that uses functional near-infrared spectroscopy (fNIRS) to evaluate the reorganization of cortical auditory asymmetry in children with SSD; it also examines how the cortical changes relate to auditory and language skills. The protocol is designed for children whose SSD has not been treated, because hearing restoration can alter both brain reorganization and behavioral performance. We propose a single-center, cross-sectional study that includes 30 children with SSD (congenital or acquired moderate-to-profound deafness) and 30 children with normal hearing (NH), all aged 5–16 years. The children undergo fNIRS during monaural and binaural stimulation, and the pattern of cortical activity is analyzed using measures of the peak amplitude and area under the curve for both oxy- and deoxyhemoglobin. These cortical measures can be compared between the two groups of children, and analyses can be run to determine whether they relate to binaural hearing (speech-in-noise and sound localization), speech perception and production, and quality of life (QoL). The results could be of relevance for developing individualized rehabilitation programs for SSD, which could reduce patients’ difficulties and prevent long-term neurofunctional and clinical consequences.

Research Status and Future Development of Cochlear Reimplantation

Cochlear implants are the most successful sensory prostheses worldwide, and they can be useful for patients with severe and profound hearing impairment. However, various complications, including infection, pain, and device failure which is mainly due to falls and trauma, are associated with the use of cochlear implants. Reimplantation is required to replace the initial device in severe complications. Nevertheless, reimplantation can present certain surgical risks and may impose a significant economic and psychological burden on patients and their families; therefore, it requires greater attention and focus. This article presents a review of the literature on cochlear reimplantation and summarizes the current status, knowledge gaps, and future research directions on cochlear reimplantation. Since 1980s, cochlear reimplantation techniques can be considered to be relatively mature; however, some clinical and scientific problems remain unresolved, including the lack of a unified definition of cochlear reimplantation, non-standardized calculation of the reimplantation rat, and insufficient effect assessment. This review highlights the urgent need to establish an international consensus statement on cochlear reimplantation research to standardize the definition, calculation formulas of reimplantation rate, and follow-up systems.

Consistency of children's hemodynamic responses during spontaneous speech

Significance: Hemodynamic responses (HRs) are typically averaged across experimental sessions based on the assumption that brain activation is consistent over multiple trials. This may not be a safe assumption, especially in pediatric populations, due to unaccounted effects of inattention, fatigue, or habituation. Aim: The purpose of this study was to quantify the consistency of the HR over speech and language brain regions during speech production in typically developing school-aged children. Approach: Brain activity over speech and language regions of interest (ROIs) was recorded with functional near-infrared spectroscopy during a picture description paradigm with 37 children (aged 7 to 12 years). We divided the 30 experimental trials, each 5 s long, into three segments of 10 trials each corresponding with early (trials 1 to 10), middle (trials 11 to 20), and late (trials 21 to 30) trials. We then compared oxygenated (HbO) and deoxygenated (HbR) hemoglobin concentrations averaged across each 10 trial segment to overall concentrations averaged across all 30 trials. We also compared differential hemoglobin (HbD) across ROIs. Results: HbO and HbR averaged across all experimental trials most strongly correlated with HbO and HbR from early trials. HbD values from channels over most speech and language regions did not appreciably change throughout the experimental session. The exception was HbD values from channels over the dorsal inferior frontal gyrus (dIFG). This region showed significantly higher activation over the left hemisphere during the first segment of the experiment. Conclusions: Our findings suggest that brain activity from speech and language ROIs was relatively consistent over the experimental session. The exception was increased activation of left dIFG during earlier experimental trials. We suggest that researchers critically evaluate the consistency of HRs from different brain regions to determine the reliability of HRs recorded during experimental sessions. This step is instrumental in ensuring that uncontrolled effects do not mask patterns of task-related activation.

Functional localization of audiovisual speech using near infrared spectroscopy

Visual cues are especially vital for hearing impaired individuals such as cochlear implant (CI) users to understand speech in noise. Functional Near Infrared Spectroscopy (fNIRS) is a light-based imaging technology that is ideally suited for measuring the brain activity of CI users due to its compatibility with both the ferromagnetic and electrical components of these implants. In a preliminary step toward better elucidating the behavioral and neural correlates of audiovisual (AV) speech integration in CI users, we designed a speech-in-noise task and measured the extent to which 24 normal hearing individuals could integrate the audio of spoken monosyllabic words with the corresponding visual signals of a female speaker. In our behavioral task, we found that audiovisual pairings provided average improvements of 103% and 197% over auditory-alone listening conditions in -6 and -9 dB signal-to-noise ratios consisting of multi-talker background noise. In an fNIRS task using similar stimuli, we measured activity during auditory-only listening, visual-only lipreading, and AV listening conditions. We identified cortical activity in all three conditions over regions of middle and superior temporal cortex typically associated with speech processing and audiovisual integration. In addition, three channels active during the lipreading condition showed uncorrected correlations associated with behavioral measures of audiovisual gain as well as with the McGurk effect. Further work focusing primarily on the regions of interest identified in this study could test how AV speech integration may differ for CI users who rely on this mechanism for daily communication.

Neuroplasticity following cochlear implants

The auditory cortex of people with sensorineural hearing loss can be re-afferented using a cochlear implant (CI): a neural prosthesis that bypasses the damaged cells in the cochlea to directly stimulate the auditory nerve. Although CIs are the most successful neural prosthesis to date, some CI users still do not achieve satisfactory outcomes using these devices. To explain variability in outcomes, clinicians and researchers have increasingly focused their attention on neuroscientific investigations that examined how the auditory cortices respond to the electric signals that originate from the CI. This chapter provides an overview of the literature that examined how the auditory cortex changes its functional properties in response to inputs from the CI, in animal models and in humans. We focus first on the basic responses to sounds delivered through electrical hearing and, next, we examine the integrity of two fundamental aspects of the auditory system: tonotopy and processing of binaural cues. When addressing the effects of CIs in humans, we also consider speech-evoked responses. We conclude by discussing to what extent this neuroscientific literature can contribute to clinical practices and help to overcome variability in outcomes.

Interdisciplinary Approaches to the Study of Listening Effort in Young Children with Cochlear Implants

Very early bilateral implantation is thought to significantly reduce the attentional effort required to acquire spoken language, and consequently offer a profound improvement in quality of life. Despite the early intervention, however, auditory and communicative outcomes in children with cochlear implants remain poorer than in hearing children. The distorted auditory input via the cochlear implants requires more auditory attention resulting in increased listening effort and fatigue. Listening effort and fatigue may critically affect attention to speech, and in turn language processing, which may help to explain the variation in language and communication abilities. However, measuring attention to speech and listening effort is demanding in infants and very young children. Three objective techniques for measuring listening effort are presented in this paper that may address the challenges of testing very young and/or uncooperative children with cochlear implants: pupillometry, electroencephalography, and functional near-infrared spectroscopy. We review the studies of listening effort that used these techniques in paediatric populations with hearing loss, and discuss potential benefits of the systematic evaluation of listening effort in these populations.

Use of Functional Near-Infrared Spectroscopy to Predict and Measure Cochlear Implant Outcomes: A Scoping Review

Outcomes following cochlear implantation vary widely for both adults and children, and behavioral tests are currently relied upon to assess this. However, these behavioral tests rely on subjective judgements that can be unreliable, particularly for infants and young children. The addition of an objective test of outcome following cochlear implantation is therefore desirable. The aim of this scoping review was to comprehensively catalogue the evidence for the potential of functional near infrared spectroscopy (fNIRS) to be used as a tool to objectively predict and measure cochlear implant outcomes. A scoping review of the literature was conducted following the PRISMA extension for scoping review framework. Searches were conducted in the MEDLINE, EMBASE, PubMed, CINAHL, SCOPUS, and Web of Science electronic databases, with a hand search conducted in Google Scholar. Key terms relating to near infrared spectroscopy and cochlear implants were used to identify relevant publications. Eight records met the criteria for inclusion. Seven records reported on adult populations, with five records only including post-lingually deaf individuals and two including both pre- and post-lingually deaf individuals. Studies were either longitudinal or cross-sectional, and all studies compared fNIRS measurements with receptive speech outcomes. This review identified and collated key work in this field. The homogeneity of the populations studied so far identifies key gaps for future research, including the use of fNIRS in infants. By mapping the literature on this important topic, this review contributes knowledge towards the improvement of outcomes following cochlear implantation.

Decoding Multiple Sound-Categories in the Auditory Cortex by Neural Networks: An fNIRS Study

This study aims to decode the hemodynamic responses (HRs) evoked by multiple sound-categories using functional near-infrared spectroscopy (fNIRS). The six different sounds were given as stimuli (English, non-English, annoying, nature, music, and gunshot). The oxy-hemoglobin (HbO) concentration changes are measured in both hemispheres of the auditory cortex while 18 healthy subjects listen to 10-s blocks of six sound-categories. Long short-term memory (LSTM) networks were used as a classifier. The classification accuracy was 20.38 ± 4.63% with six class classification. Though LSTM networks' performance was a little higher than chance levels, it is noteworthy that we could classify the data subject-wise without feature selections.

Analysis methods for measuring passive auditory fNIRS responses generated by a block-design paradigm

Significance: Functional near-infrared spectroscopy (fNIRS) is an increasingly popular tool in auditory research, but the range of analysis procedures employed across studies may complicate the interpretation of data. Aim: We aim to assess the impact of different analysis procedures on the morphology, detection, and lateralization of auditory responses in fNIRS. Specifically, we determine whether averaging or generalized linear model (GLM)-based analysis generates different experimental conclusions when applied to a block-protocol design. The impact of parameter selection of GLMs on detecting auditory-evoked responses was also quantified. Approach: 17 listeners were exposed to three commonly employed auditory stimuli: noise, speech, and silence. A block design, comprising sounds of 5 s duration and 10 to 20 s silent intervals, was employed. Results: Both analysis procedures generated similar response morphologies and amplitude estimates, and both indicated that responses to speech were significantly greater than to noise or silence. Neither approach indicated a significant effect of brain hemisphere on responses to speech. Methods to correct for systemic hemodynamic responses using short channels improved detection at the individual level. Conclusions: Consistent with theoretical considerations, simulations, and other experimental domains, GLM and averaging analyses generate the same group-level experimental conclusions. We release this dataset publicly for use in future development and optimization of algorithms.

Evaluating cortical responses to speech in children: A functional near-infrared spectroscopy (fNIRS) study

Functional neuroimaging of speech processing has both research and clinical potential. This work is facilitating an ever-increasing understanding of the complex neural mechanisms involved in the processing of speech. Neural correlates of speech understanding also have potential clinical value, especially for infants and children, in whom behavioural assessments can be unreliable. Such measures would not only benefit normally hearing children experiencing speech and language delay, but also hearing impaired children with and without hearing devices. In the current study, we examined cortical correlates of speech intelligibility in normally hearing paediatric listeners. Cortical responses were measured using functional near-infrared spectroscopy (fNIRS), a non-invasive neuroimaging technique that is fully compatible with hearing devices, including cochlear implants. In nineteen normally hearing children (aged 6 - 13 years) we measured activity in temporal and frontal cortex bilaterally whilst participants listened to both clear- and noise-vocoded sentences targeting four levels of speech intelligibility. Cortical activation in superior temporal and inferior frontal cortex was generally stronger in the left hemisphere than in the right. Activation in left superior temporal cortex grew monotonically with increasing speech intelligibility. In the same region, we identified a trend towards greater activation on correctly vs. incorrectly perceived trials, suggesting a possible sensitivity to speech intelligibility per se, beyond sensitivity to changing acoustic properties across stimulation conditions. Outside superior temporal cortex, we identified other regions in which fNIRS responses varied with speech intelligibility. For example, channels overlying posterior middle temporal regions in the right hemisphere exhibited relative deactivation during sentence processing (compared to a silent baseline condition), with the amplitude of that deactivation being greater in more difficult listening conditions. This finding may represent sensitivity to components of the default mode network in lateral temporal regions, and hence effortful listening in normally hearing paediatric listeners. Our results indicate that fNIRS has the potential to provide an objective marker of speech intelligibility in normally hearing children. Should these results be found to apply to individuals experiencing language delay or to those listening through a hearing device, such as a cochlear implant, fNIRS may form the basis of a clinically useful measure of speech understanding.

Cortical Activity Linked to Clocking in Deaf Adults: fNIRS Insights with Static and Animated Stimuli Presentation

The question of the possible impact of deafness on temporal processing remains unanswered. Different findings, based on behavioral measures, show contradictory results. The goal of the present study is to analyze the brain activity underlying time estimation by using functional near infrared spectroscopy (fNIRS) techniques, which allow examination of the frontal, central and occipital cortical areas. A total of 37 participants (19 deaf) were recruited. The experimental task involved processing a road scene to determine whether the driver had time to safely execute a driving task, such as overtaking. The road scenes were presented in animated format, or in sequences of 3 static images showing the beginning, mid-point, and end of a situation. The latter presentation required a clocking mechanism to estimate the time between the samples to evaluate vehicle speed. The results show greater frontal region activity in deaf people, which suggests that more cognitive effort is needed to process these scenes. The central region, which is involved in clocking according to several studies, is particularly activated by the static presentation in deaf people during the estimation of time lapses. Exploration of the occipital region yielded no conclusive results. Our results on the frontal and central regions encourage further study of the neural basis of time processing and its links with auditory capacity.

Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals

Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.

fNIRS Assessment of Speech Comprehension in Children with Normal Hearing and Children with Hearing Aids in Virtual Acoustic Environments: Pilot Data and Practical Recommendations

The integration of virtual acoustic environments (VAEs) with functional near-infrared spectroscopy (fNIRS) offers novel avenues to investigate behavioral and neural processes of speech-in-noise (SIN) comprehension in complex auditory scenes. Particularly in children with hearing aids (HAs), the combined application might offer new insights into the neural mechanism of SIN perception in simulated real-life acoustic scenarios. Here, we present first pilot data from six children with normal hearing (NH) and three children with bilateral HAs to explore the potential applicability of this novel approach. Children with NH received a speech recognition benefit from low room reverberation and target-distractors' spatial separation, particularly when the pitch of the target and the distractors was similar. On the neural level, the left inferior frontal gyrus appeared to support SIN comprehension during effortful listening. Children with HAs showed decreased SIN perception across conditions. The VAE-fNIRS approach is critically compared to traditional SIN assessments. Although the current study shows that feasibility still needs to be improved, the combined application potentially offers a promising tool to investigate novel research questions in simulated real-life listening. Future modified VAE-fNIRS applications are warranted to replicate the current findings and to validate its application in research and clinical settings.

NIRS measures in pain and analgesia: Fundamentals, features, and function

Current pain assessment techniques based only on clinical evaluation and self-reports are not objective and may lead to inadequate treatment. Having a functional biomarker will add to the clinical fidelity, diagnosis, and perhaps improve treatment efficacy in patients. While many approaches have been deployed in pain biomarker discovery, functional near-infrared spectroscopy (fNIRS) is a technology that allows for non-invasive measurement of cortical hemodynamics. The utility of fNIRS is especially attractive given its ability to detect specific changes in the somatosensory and high-order cortices as well as its ability to measure (1) brain function similar to functional magnetic resonance imaging, (2) graded responses to noxious and innocuous stimuli, (3) analgesia, and (4) nociception under anesthesia. In this review, we evaluate the utility of fNIRS in nociception/pain with particular focus on its sensitivity and specificity, methodological advantages and limitations, and the current and potential applications in various pain conditions. Everything considered, fNIRS technology could enhance our ability to evaluate evoked and persistent pain across different age groups and clinical populations.

The Benefit of Cross-Modal Reorganization on Speech Perception in Pediatric Cochlear Implant Recipients Revealed Using Functional Near-Infrared Spectroscopy

Cochlear implants (CIs) are the most successful treatment for severe-to-profound deafness in children. However, speech outcomes with a CI often lag behind those of normally-hearing children. Some authors have attributed these deficits to the takeover of the auditory temporal cortex by vision following deafness, which has prompted some clinicians to discourage the rehabilitation of pediatric CI recipients using visual speech. We studied this cross-modal activity in the temporal cortex, along with responses to auditory speech and non-speech stimuli, in experienced CI users and normally-hearing controls of school-age, using functional near-infrared spectroscopy. Strikingly, CI users displayed significantly greater cortical responses to visual speech, compared with controls. Importantly, in the same regions, the processing of auditory speech, compared with non-speech stimuli, did not significantly differ between the groups. This suggests that visual and auditory speech are processed synergistically in the temporal cortex of children with CIs, and they should be encouraged, rather than discouraged, to use visual speech.

Automated Thresholding Method for fNIRS-Based Functional Connectivity Analysis: Validation With a Case Study on Alzheimer's Disease

While functional integration has been suggested to reflect brain health, non-standardized network thresholding methods complicate network interpretation. We propose a new method to analyze functional near-infrared spectroscopy-based functional connectivity (fNIRS-FC). In this study, we employed wavelet analysis for motion correction and orthogonal minimal spanning trees (OMSTs) to derive the brain connectivity. The proposed method was applied to an Alzheimer's disease (AD) dataset and was compared with a number of well-known thresholding techniques. The results demonstrated that the proposed method outperformed the benchmarks in filtering cost-effective networks and in differentiation between patients with mild AD and healthy controls. The results also supported the proposed method as a feasible technique to analyze fNIRS-FC, especially with cost-efficiency, assortativity and laterality as a set of effective features for the diagnosis of AD.

Functional Near-Infrared Spectroscopy in the Study of Speech and Language Impairment Across the Life Span: A Systematic Review

Purpose Functional brain imaging is playing an increasingly important role in the diagnosis and treatment of communication disorders, yet many populations and settings are incompatible with functional magnetic resonance imaging and other commonly used techniques. We conducted a systematic review of neuroimaging studies using functional near-infrared spectroscopy (fNIRS) with individuals with speech or language impairment across the life span. We aimed to answer the following question: To what extent has fNIRS been used to investigate the neural correlates of speech-language impairment? Method This systematic review was preregistered with PROSPERO, the international prospective register of systematic reviews (CRD42019136464). We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol for preferred reporting items for systematic reviews. The database searches were conducted between February and March of 2019 with the following search terms: (a) fNIRS or functional near-infrared spectroscopy or NIRS or near-infrared spectroscopy, (b) speech or language, and (c) disorder or impairment or delay. Results We found 34 fNIRS studies that involved individuals with speech or language impairment across nine categories: (a) autism spectrum disorders; (b) developmental speech and language disorders; (c) cochlear implantation and deafness; (d) dementia, dementia of the Alzheimer's type, and mild cognitive impairment; (e) locked-in syndrome; (f) neurologic speech disorders/dysarthria; (g) stroke/aphasia; (h) stuttering; and (i) traumatic brain injury. Conclusions Though it is not without inherent challenges, fNIRS may have advantages over other neuroimaging techniques in the areas of speech and language impairment. fNIRS has clinical applications that may lead to improved early and differential diagnosis, increase our understanding of response to treatment, improve neuroprosthetic functioning, and advance neurofeedback.

Brain Functional Alterations in Long-term Unilateral Hearing Impairment

BACKGROUND

The rate of patients with unilateral hearing impairments (UHI) increase with age and are characterized by asymmetric auditory afferents in which auditory information is asymmetrically transmitted to the brain. Long-term bilateral hearing imbalance can cause abnormal functional changes in the cerebral cortex. However, the relationship between functional alterations in the brain and the severity of the hearing impairment remains unclear.

METHODS

This study included 33 patients with UHI (left-sided impairment in 17 and right-sided impairment in 16) and 32 healthy patients. All participants underwent resting-state, blood oxygen level dependent functional magnetic resonance imaging. Fractional amplitude of low frequency fluctuation (fALFF) values were calculated after data preprocessing and compared among the left-sided and right-sided impairment groups and the control group. Pure tone audiometry was used to evaluate patients' hearing impairment level. The correlation between fALFF values of abnormal brain regions and the duration and severity of hearing impairment was analyzed.

RESULTS

Results provide evidence for altered resting-state functional activities in the brain of patients with left or right long-term UHI, with significantly increased fALFF values in the Heschl's gyrus, superior temporal gyrus, and insula were observed. Moreover, complicated networks reorganization involved in the visual, cognitive, sensorimotor and information transmission functions except for the auditory function and some brain regions exhibited functional changes only in the one-sided impairment group. In addition, the severity of hearing impairment is related with the functional activities in the bilateral Heschl's gyrus, bilateral insula, right superior temporal gyrus, and left middle frontal gyrus.

CONCLUSION

In conclusion, alterations in functional activity are observed in the brains of patients with long-term hearing impairments and multiple brain regions within different functional networks are involved in the brain functional remodeling. The brain reintegration mechanism appears to be asymmetrical and the lateralization pattern in the contralateral brain hemisphere for auditory information processing related with the severity of hearing impairment.

Advantages of double density alignment of fNIRS optodes to evaluate cortical activities related to phonological short-term memory using NIRS-SPM

Phonological short-term memory (STM) and working memory (WM) capacity, which is temporal storage of phonological information, facilitates language development. This capacity is often impaired in cochlear implant (CI) users who have congenital hearing loss. Functional near-infrared spectroscopy (fNIRS) is potentially useful to reveal underlying mechanisms of this impairment due to its tolerance to magnetic and electrical artifacts generated by CIs. The spatial resolution of the standard fNIRS, however, seems inadequate to evaluate cortical activity associated with the maintenance of phonological information in the STM/WM tasks. In the present study recruiting 14 normal hearing adults, we applied a double density alignment of fNIRS optodes to improve spatial resolution in the generalized linear model (GLM)-based statistical analysis using NIRS-SPM, in which cortical activities were estimated during each of three stages (encoding, maintenance, and retrieval) in pseudoword STM tasks with auditory or visual presentation. Since the double density alignment of fNIRS optodes contains two sets of standard density arrays, in the off-line analysis the measured cortical hemodynamic responses can be analyzed as data from two independent standard density arrays as well as those from one double density array (DD-array) which has two times higher density of channels. The two standard arrays demonstrated a similar pattern of cortical activation at each stage of the auditory and visual tasks, which proved the reliability of our fNIRS analysis, but failed to detect significant cortical activation in 2 of 12 conditions including the maintenance stage in the visual task. On the other hand, DD-array revealed significant cortical activation in all conditions. These differences were observed when estimated cortical activation was localized in small regions, which suggests higher spatial resolution in DD-array than the standard arrays. In our knowledge, this is the first clinical study supporting the previous experimental phantom study which demonstrated improvement of spatial resolution in the double density arrangement of fNIRS optodes. These findings imply that the double density alignment of fNIRS optodes improves reliability and spatial resolution in fNIRS-based estimation of cortical activity in the STM/WM studies, although further studies are required to determine usefulness of this method in the CI population.

Cortical Activation Patterns of Different Masking Noises and Correlation With Their Masking Efficacy, Determined by Functional Near-Infrared Spectroscopy

Acoustic therapy in tinnitus treatment is poorly characterized, and efficacy assessment depends on subjective descriptions. Narrow-band noise, notched sound, and white noise have positive therapeutic effects on monotonous tinnitus. Considering the tonotopic characteristics of the auditory system and the spectral characteristics of these three masking sounds, the activation pattern of the auditory cortex and the mechanism of inhibiting tinnitus may be different. This study aimed to compare the activation patterns of three spectrally different masking noises and study the correlation between the masking effects and variational amplitude of oxygenated hemoglobin (HbO) in the corresponding cortical regions. We also assessed near-infrared spectroscopy brain function imaging (NIRS) as an objective assessment tool in acoustic therapy. Patients with persistent non-pulsatile tinnitus and control volunteers without tinnitus were enrolled in this study. The subjects were seated in a sound-proof room, with two optode arrays covering the bilateral temporal lobe. Auditory stimuli were presented; stimulation sequences followed the block design: different noises appeared randomly and repeated in five cycles. Tinnitus match and residual inhibition were performed in the tinnitus group. The data analyses were conducted using the NIRS_SPM toolbox. The group analysis results showed that the narrow-band noise caused a marginally significant decrease in HbO signal in the Brodmann 21 region (BA21), while white noise caused a significant increase in HbO signal in BA21. Notched sound did not cause significant changes in the HbO signal in the temporal cortex. And none of the three masking noises caused significant changes in the HbR signal in the temporal cortex. The depth of residual inhibition induced by the narrow-band noise and white noise significantly correlated with ΔHbO in the region of interest (ROI). However, neither the depth nor duration of the residual inhibition induced by notched sound correlated with the ΔHbO. Thus, NIRS showed three cortical activation patterns induced by three different masking noises, and correlations between residual inhibition effects and change of HbO amplitude were found. NIRS could therefore be applied in objective assessment of acoustic therapy.

Structural neuroimaging of the altered brain stemming from pediatric and adolescent hearing loss-Scientific and clinical challenges

There has been a spurt in structural neuroimaging studies of the effect of hearing loss on the brain. Specifically, magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) technologies provide an opportunity to quantify changes in gray and white matter structures at the macroscopic scale. To date, there have been 32 MRI and 23 DTI studies that have analyzed structural differences accruing from pre- or peri-lingual pediatric hearing loss with congenital or early onset etiology and postlingual hearing loss in pre-to-late adolescence. Additionally, there have been 15 prospective clinical structural neuroimaging studies of children and adolescents being evaluated for cochlear implants. The results of the 70 studies are summarized in two figures and three tables. Plastic changes in the brain are seen to be multifocal rather than diffuse, that is, differences are consistent across regions implicated in the hearing, speech and language networks regardless of modes of communication and amplification. Structures in that play an important role in cognition are affected to a lesser extent. A limitation of these studies is the emphasis on volumetric measures and on homogeneous groups of subjects with hearing loss. It is suggested that additional measures of morphometry and connectivity could contribute to a greater understanding of the effect of hearing loss on the brain. Then an interpretation of the observed macroscopic structural differences is given. This is followed by discussion of how structural imaging can be combined with functional imaging to provide biomarkers for longitudinal tracking of amplification. This article is categorized under: Developmental Biology > Developmental Processes in Health and Disease Translational, Genomic, and Systems Medicine > Translational Medicine Laboratory Methods and Technologies > Imaging.

Cortical Speech Processing in Postlingually Deaf Adult Cochlear Implant Users, as Revealed by Functional Near-Infrared Spectroscopy

An experiment was conducted to investigate the feasibility of using functional near-infrared spectroscopy (fNIRS) to image cortical activity in the language areas of cochlear implant (CI) users and to explore the association between the activity and their speech understanding ability. Using fNIRS, 15 experienced CI users and 14 normal-hearing participants were imaged while presented with either visual speech or auditory speech. Brain activation was measured from the prefrontal, temporal, and parietal lobe in both hemispheres, including the language-associated regions. In response to visual speech, the activation levels of CI users in an a priori region of interest (ROI)—the left superior temporal gyrus or sulcus—were negatively correlated with auditory speech understanding. This result suggests that increased cross-modal activity in the auditory cortex is predictive of poor auditory speech understanding. In another two ROIs, in which CI users showed significantly different mean activation levels in response to auditory speech compared with normal-hearing listeners, activation levels were significantly negatively correlated with CI users’ auditory speech understanding. These ROIs were located in the right anterior temporal lobe (including a portion of prefrontal lobe) and the left middle superior temporal lobe. In conclusion, fNIRS successfully revealed activation patterns in CI users associated with their auditory speech understanding.

Functional near-infrared spectroscopy as a tool for assessing speech and spoken language processing in pediatric and adult cochlear implant users

Much of what is known about the course of auditory learning in following cochlear implantation is based on behavioral indicators that users are able to perceive sound. Both prelingually deafened children and postlingually deafened adults who receive cochlear implants display highly variable speech and language processing outcomes, although the basis for this is poorly understood. To date, measuring neural activity within the auditory cortex of implant recipients of all ages has been challenging, primarily because the use of traditional neuroimaging techniques is limited by the implant itself. Functional near-infrared spectroscopy (fNIRS) is an imaging technology that works with implant users of all ages because it is non-invasive, compatible with implant devices, and not subject to electrical artifacts. Thus, fNIRS can provide insight into processing factors that contribute to variations in spoken language outcomes in implant users, both children and adults. There are important considerations to be made when using fNIRS, particularly with children, to maximize the signal-to-noise ratio and to best identify and interpret cortical responses. This review considers these issues, recent data, and future directions for using fNIRS as a tool to understand spoken language processing in children and adults who hear through a cochlear implant.

Human central auditory plasticity: A review of functional near-infrared spectroscopy (fNIRS) to measure cochlear implant performance and tinnitus perception

OBJECTIVE

Functional near-infrared spectroscopy (fNIRS) is an emerging noninvasive technology used to study cerebral cortex activity. Being virtually silent and compatible with cochlear implants has helped establish fNIRS as an important tool when investigating auditory cortex as well as cortices involved with hearing and language processing in adults and during child development. With respect to this review article, more recently, fNIRS has also been used to investigate central auditory plasticity following hearing loss and tinnitus or phantom sound perception.

METHODS

Here, we review the currently available literature reporting the use of fNIRS in human studies with cochlear implants and tinnitus to measure human central auditory cortical circuits. We also provide the reader with detailed reviews of the technology and traditional recording paradigms/methods used in these auditory-based studies.

RESULTS

The purpose of this review article is to summarize theoretical advancements in our understanding of the neurocognitive mechanisms underlying auditory processes and their plasticity through fNIRS research of human auditory performance with cochlear implantation and plasticity that may contribute to the central percepts of tinnitus.

CONCLUSION

fNIRS is an emerging noninvasive brain imaging technology that has wide reaching application that can be applied to human studies involving cochlear implants and tinnitus.

LEVEL OF EVIDENCE

N/A.

Measuring Cortical Activity During Auditory Processing with Functional Near-Infrared Spectroscopy

Functional near-infrared spectroscopy (fNIRS) is an optical, non-invasive neuroimaging technique that investigates human brain activity by calculating concentrations of oxy- and deoxyhemoglobin. The aim of this publication is to review the current state of the art as to how fNIRS has been used to study auditory function. We address temporal and spatial characteristics of the hemodynamic response to auditory stimulation as well as experimental factors that affect fNIRS data such as acoustic and stimulus-driven effects. The rising importance that fNIRS is generating in auditory neuroscience underlines the strong potential of the technology, and it seems likely that fNIRS will become a useful clinical tool.

Joint Attention in Hearing Parent-Deaf Child and Hearing Parent-Hearing Child Dyads

Here we characterize establishment of joint attention in hearing parent-deaf child dyads and hearing parent-hearing child dyads. Deaf children were candidates for cochlear implantation who had not yet been implanted and who had no exposure to formal manual communication (e.g., American Sign Language). Because many parents whose deaf children go through early cochlear implant surgery do not themselves know a visual language, these dyads do not share a formal communication system based in a common sensory modality prior to the child's implantation. Joint attention episodes were identified during free play between hearing parents and their hearing children (N = 4) and hearing parents and their deaf children (N = 4). Attentional episode types included successful parent-initiated joint attention, unsuccessful parent-initiated joint attention, passive attention, successful child-initiated joint attention, and unsuccessful child-initiated joint attention. Group differences emerged in both successful and unsuccessful parent-initiated attempts at joint attention, parent passive attention, and successful child-initiated attempts at joint attention based on proportion of time spent in each. These findings highlight joint attention as an indicator of early communicative efficacy in parent-child interaction for different child populations. We discuss the active role parents and children play in communication, regardless of their hearing status.

Cortical Processing Related to Intensity of a Modulated Noise Stimulus-a Functional Near-Infrared Study

Sound intensity is a key feature of auditory signals. A profound understanding of cortical processing of this feature is therefore highly desirable. This study investigates whether cortical functional near-infrared spectroscopy (fNIRS) signals reflect sound intensity changes and where on the brain cortex maximal intensity-dependent activations are located. The fNIRS technique is particularly suitable for this kind of hearing study, as it runs silently. Twenty-three normal hearing subjects were included and actively participated in a counterbalanced block design task. Four intensity levels of a modulated noise stimulus with long-term spectrum and modulation characteristics similar to speech were applied, evenly spaced from 15 to 90 dB SPL. Signals from auditory processing cortical fields were derived from a montage of 16 optodes on each side of the head. Results showed that fNIRS responses originating from auditory processing areas are highly dependent on sound intensity level: higher stimulation levels led to higher concentration changes. Caudal and rostral channels showed different waveform morphologies, reflecting specific cortical signal processing of the stimulus. Channels overlying the supramarginal and caudal superior temporal gyrus evoked a phasic response, whereas channels over Broca's area showed a broad tonic pattern. This data set can serve as a foundation for future auditory fNIRS research to develop the technique as a hearing assessment tool in the normal hearing and hearing-impaired populations.

Attention to speech and spoken language development in deaf children with cochlear implants: a 10-year longitudinal study

Early auditory/language experience plays an important role in language development. In this study, we examined the effects of severe-to-profound hearing loss and subsequent cochlear implantation on the development of attention to speech in children with cochlear implants (CIs). In addition, we investigated the extent to which attention to speech may predict spoken language development in children with CIs. We tested children with CIs and compared them to chronologically age-matched peers with normal hearing (NH) on their attention to speech at four time points post implantation; specifically, less than 1 month, 3 to 6 months, 12 months, and 18 months post implantation. We also collected a variety of well-established speech perception and spoken language measures from the children with CIs in a 10-year longitudinal study. Children with CIs showed reduced attention to speech as compared to their peers with NH at less than 1 month post implantation, but a similar degree of attention to speech as their NH peers during later time points. In addition, attention to speech at 3 to 6 months post implantation predicts speech perception in children with CIs. These results inform language acquisition theories and bring insights into our understanding of early severe-to-profound hearing loss on infants' attention to speech skills. In addition, the findings have significant clinical implications for early intervention on hearing loss, which emphasizes the importance of developing strong listening skills. A video abstract of this article can be viewed at: https://www.youtube.com/watch?v=f7xiYo3Ua08&feature=youtu.be.

Variability of the hemodynamic response in infants: Influence of experimental design and stimulus complexity

Measuring brain activity in developmental populations remains a major challenge despite great technological advances. Among the numerous available methods, functional near-infrared spectroscopy (fNIRS), an imaging modality that probes the hemodynamic response, is a powerful tool for recording brain activity in a great variety of situations and populations. Neurocognitive studies with infants have often reported inverted hemodynamic responses, i.e. a decrease instead of an increase in regional blood oxygenation, but the exact physiological explanation and cognitive interpretation of this response remain unclear. Here, we first provide an overview of the basic principles of NIRS and its use in cognitive developmental neuroscience. We then review the infant fNIRS literature to show that the hemodynamic response is modulated by experimental design and stimulus complexity, sometimes leading to hemodynamic responses with non-canonical shapes. We also argue that this effect is further modulated by the age of participants, the cortical regions involved, and the developmental stage of the tested cognitive process. We argue that this variability needs to be taken into account when designing and interpreting developmental studies measuring the hemodynamic response.

Cortical Activation Patterns Correlate with Speech Understanding After Cochlear Implantation

OBJECTIVES

Cochlear implants are a standard therapy for deafness, yet the ability of implanted patients to understand speech varies widely. To better understand this variability in outcomes, the authors used functional near-infrared spectroscopy to image activity within regions of the auditory cortex and compare the results to behavioral measures of speech perception.

DESIGN

The authors studied 32 deaf adults hearing through cochlear implants and 35 normal-hearing controls. The authors used functional near-infrared spectroscopy to measure responses within the lateral temporal lobe and the superior temporal gyrus to speech stimuli of varying intelligibility. The speech stimuli included normal speech, channelized speech (vocoded into 20 frequency bands), and scrambled speech (the 20 frequency bands were shuffled in random order). The authors also used environmental sounds as a control stimulus. Behavioral measures consisted of the speech reception threshold, consonant-nucleus-consonant words, and AzBio sentence tests measured in quiet.

RESULTS

Both control and implanted participants with good speech perception exhibited greater cortical activations to natural speech than to unintelligible speech. In contrast, implanted participants with poor speech perception had large, indistinguishable cortical activations to all stimuli. The ratio of cortical activation to normal speech to that of scrambled speech directly correlated with the consonant-nucleus-consonant words and AzBio sentences scores. This pattern of cortical activation was not correlated with auditory threshold, age, side of implantation, or time after implantation. Turning off the implant reduced the cortical activations in all implanted participants.

CONCLUSIONS

Together, these data indicate that the responses the authors measured within the lateral temporal lobe and the superior temporal gyrus correlate with behavioral measures of speech perception, demonstrating a neural basis for the variability in speech understanding outcomes after cochlear implantation.

Adaptive benefit of cross-modal plasticity following cochlear implantation in deaf adults

It has been suggested that visual language is maladaptive for hearing restoration with a cochlear implant (CI) due to cross-modal recruitment of auditory brain regions. Rehabilitative guidelines therefore discourage the use of visual language. However, neuroscientific understanding of cross-modal plasticity following cochlear implantation has been restricted due to incompatibility between established neuroimaging techniques and the surgically implanted electronic and magnetic components of the CI. As a solution to this problem, here we used functional near-infrared spectroscopy (fNIRS), a noninvasive optical neuroimaging method that is fully compatible with a CI and safe for repeated testing. The aim of this study was to examine cross-modal activation of auditory brain regions by visual speech from before to after implantation and its relation to CI success. Using fNIRS, we examined activation of superior temporal cortex to visual speech in the same profoundly deaf adults both before and 6 mo after implantation. Patients' ability to understand auditory speech with their CI was also measured following 6 mo of CI use. Contrary to existing theory, the results demonstrate that increased cross-modal activation of auditory brain regions by visual speech from before to after implantation is associated with better speech understanding with a CI. Furthermore, activation of auditory cortex by visual and auditory speech developed in synchrony after implantation. Together these findings suggest that cross-modal plasticity by visual speech does not exert previously assumed maladaptive effects on CI success, but instead provides adaptive benefits to the restoration of hearing after implantation through an audiovisual mechanism.

Investigating the role of temporal lobe activation in speech perception accuracy with normal hearing adults: An event-related fNIRS study

Functional near infrared spectroscopy (fNIRS) is a safe, non-invasive, relatively quiet imaging technique that is tolerant of movement artifact making it uniquely ideal for the assessment of hearing mechanisms. Previous research demonstrates the capacity for fNIRS to detect cortical changes to varying speech intelligibility, revealing a positive relationship between cortical activation amplitude and speech perception score. In the present study, we use an event-related design to investigate the hemodynamic response in the temporal lobe across different listening conditions. We presented participants with a speech recognition task using sentences in quiet, sentences in noise, and vocoded sentences. Hemodynamic responses were examined across conditions and then compared when speech perception was accurate compared to when speech perception was inaccurate in the context of noisy speech. Repeated measures, two-way ANOVAs revealed that the speech in noise condition (-2.8dB signal-to-noise ratio/SNR) demonstrated significantly greater activation than the easier listening conditions on multiple channels bilaterally. Further analyses comparing correct recognition trials to incorrect recognition trials (during the presentation phase of the trial) revealed that activation was significantly greater during correct trials. Lastly, during the repetition phase of the trial, where participants correctly repeated the sentence, the hemodynamic response demonstrated significantly higher deoxyhemoglobin than oxyhemoglobin, indicating a difference between the effects of perception and production on the cortical response. Using fNIRS, the present study adds meaningful evidence to the body of knowledge that describes the brain/behavior relationship related to speech perception.

Hemodynamics of speech production: An fNIRS investigation of children who stutter

Stuttering affects nearly 1% of the population worldwide and often has life-altering negative consequences, including poorer mental health and emotional well-being, and reduced educational and employment achievements. Over two decades of neuroimaging research reveals clear anatomical and physiological differences in the speech neural networks of adults who stutter. However, there have been few neurophysiological investigations of speech production in children who stutter. Using functional near-infrared spectroscopy (fNIRS), we examined hemodynamic responses over neural regions integral to fluent speech production including inferior frontal gyrus, premotor cortex, and superior temporal gyrus during a picture description task. Thirty-two children (16 stuttering and 16 controls) aged 7–11 years participated in the study. We found distinctly different speech-related hemodynamic responses in the group of children who stutter compared to the control group. Whereas controls showed significant activation over left dorsal inferior frontal gyrus and left premotor cortex, children who stutter exhibited deactivation over these left hemisphere regions. This investigation of neural activation during natural, connected speech production in children who stutter demonstrates that in childhood stuttering, atypical functional organization for speech production is present and suggests promise for the use of fNIRS during natural speech production in future research with typical and atypical child populations.