The scalp-recorded brainstem response to speech: neural origins and plasticity

Binaural responses to a speech syllable are altered in children with hearing loss: Evidence from the frequency-following response

BACKGROUND & RATIONALE

In prior work using non-speech stimuli, children with hearing loss show impaired perception of binaural cues and no significant change in cortical responses to bilateral versus unilateral stimulation. Aims of the present study were to: 1) identify bilateral responses to envelope and spectral components of a speech syllable using the frequency-following response (FFR), 2) determine if abnormalities in the bilateral FFR occur in children with hearing loss, and 3) assess functional consequences of abnormal bilateral FFR responses on perception of binaural timing cues.

METHODS

A single-syllable speech stimulus (/dα/) was presented to each ear individually and bilaterally. Participants were 9 children with normal hearing (MAge = 12.1 ± 2.5 years) and 6 children with bilateral hearing loss who were experienced bilateral hearing aid users (MAge = 14.0 ± 2.6 years). FFR temporal and spectral peak amplitudes were compared between listening conditions and groups using linear mixed model regression analyses. Behavioral sensitivity to binaural cues were measured by lateralization responses as coming from the right or left side of the head.

RESULTS

Both temporal and spectral peaks in FFR responses increased in amplitude in the bilateral compared to unilateral listening conditions in children with normal hearing. These measures of "bilateral advantage" were reduced in the group of children with bilateral hearing loss and associated with decreased sensitivity to interaural timing differences.

CONCLUSION

This study is the first to show that bilateral responses in both temporal and spectral domains can be measured in children using the FFR and is altered in children with hearing loss with consequences to binaural hearing.

Individual differences in the consistency of neural and behavioural responses to speech sounds

There are documented individual differences among adults in the consistency of speech sound processing, both at neural and behavioural levels. Some adults show more consistent neural responses to speech sounds than others, as measured by an event-related potential called the frequency-following response (FFR); similarly, some adults show more consistent behavioural responses to native speech sounds than others, as measured by two-alternative forced choice (2AFC) and visual analog scaling (VAS) tasks. Adults also differ in how successfully they can perceive non-native speech sounds. Interestingly, it remains unclear whether these differences are related within individuals. In the current study, native English-speaking adults completed native phonetic perception tasks (2AFC and VAS), a non-native (German) phonetic perception task, and an FFR recording session. From these tasks, we derived measures of the consistency of participants' neural and behavioural responses to native speech as well as their non-native perception ability. We then examined the relationships among individual differences in these measures. Analysis of the behavioural measures revealed that more consistent responses to native sounds predicted more successful perception of unfamiliar German sounds. Analysis of neural and behavioural data did not reveal clear relationships between FFR consistency and our phonetic perception measures. This multimodal work furthers our understanding of individual differences in speech processing among adults, and may eventually lead to individualized approaches for enhancing non-native language acquisition in adulthood.

Inhibitory effects of prepulse stimuli on the electrophysiological responses to startle stimuli in the deep layers of the superior colliculus

Background

Prepulse inhibition (PPI) is a phenomenon where a weak prepulse stimulus inhibits the startle reflex to a subsequent stronger stimulus, which can be induced by various sensory stimulus modalities such as visual, tactile, and auditory stimuli.

Methods

This study investigates the neural mechanisms underlying auditory PPI by focusing on the deep layers of the superior colliculus (deepSC) and the inferior colliculus (IC) in rats. Nineteen male Sprague-Dawley rats were implanted with electrodes in the left deepSC and the right IC, and electrophysiological recordings were conducted under anesthesia to observe the frequency following responses (FFRs) to startle stimuli with and without prepulse stimuli.

Results

Our results showed that in the deepSC, narrowband noise as a prepulse stimulus significantly inhibited the envelope component of the startle response, while the fine structure component remained unaffected. However, this inhibitory effect was not observed in the IC or when the prepulse stimulus was a gap.

Conclusion

These findings suggest that the deepSC plays a crucial role in the neural circuitry of PPI, particularly in the modulation of the envelope component of the startle response. The differential effects of narrowband noise and gap as prepulse stimuli also indicate distinct neural pathways for sound-induced PPI and Gap-PPI. Understanding these mechanisms could provide insights into sensory processing and potential therapeutic targets for disorders involving impaired PPI, such as tinnitus.

Myogenic artifacts masquerade as neuroplasticity in the auditory frequency-following response

The frequency-following response (FFR) is an evoked potential that provides a neural index of complex sound encoding in the brain. FFRs have been widely used to characterize speech and music processing, experience-dependent neuroplasticity (e.g., learning and musicianship), and biomarkers for hearing and language-based disorders that distort receptive communication abilities. It is widely assumed that FFRs stem from a mixture of phase-locked neurogenic activity from the brainstem and cortical structures along the hearing neuraxis. In this study, we challenge this prevailing view by demonstrating that upwards of ~50% of the FFR can originate from an unexpected myogenic source: contamination from the postauricular muscle (PAM) vestigial startle reflex. We measured PAM, transient auditory brainstem responses (ABRs), and sustained frequency-following response (FFR) potentials reflecting myogenic (PAM) and neurogenic (ABR/FFR) responses in young, normal-hearing listeners with varying degrees of musical training. We first establish that PAM artifact is present in all ears, varies with electrode proximity to the muscle, and can be experimentally manipulated by directing listeners' eye gaze toward the ear of sound stimulation. We then show this muscular noise easily confounds auditory FFRs, spuriously amplifying responses 3-4-fold with tandem PAM contraction and even explaining putative FFR enhancements observed in highly skilled musicians. Our findings expose a new and unrecognized myogenic source to the FFR that drives its large inter-subject variability and cast doubt on whether changes in the response typically attributed to neuroplasticity/pathology are solely of brain origin.

Automatic Recognition of Auditory Brainstem Response Waveforms Using a Deep Learning-Based Framework

OBJECTIVE

Recognition of auditory brainstem response (ABR) waveforms may be challenging, particularly for older individuals or those with hearing loss. This study aimed to investigate deep learning frameworks to improve the automatic recognition of ABR waveforms in participants with varying ages and hearing levels.

STUDY DESIGN

The research used a descriptive study design to collect and analyze pure tone audiometry and ABR data from 100 participants.

SETTING

The research was conducted at a tertiary academic medical center, specifically at the Clinical Audiology Center of Tsinghua Chang Gung Hospital (Beijing, China).

METHODS

Data from 100 participants were collected and categorized into four groups based on age and hearing level. Features from both time-domain and frequency-domain ABR signals were extracted and combined with demographic factors, such as age, sex, pure-tone thresholds, stimulus intensity, and original signal sequences to generate feature vectors. An enhanced Wide&Deep model was utilized, incorporating the Light-multi-layer perceptron (MLP) model to train the recognition of ABR waveforms. The recognition accuracy (ACC) of each model was calculated for the overall data set and each group.

RESULTS

The ACC rates of the Light-MLP model were 97.8%, 97.2%, 93.8%, and 92.0% for Groups 1 to 4, respectively, with a weighted average ACC rate of 95.4%. For the Wide&Deep model, the ACC rates were 93.4%, 90.8%, 92.0%, and 88.3% for Groups 1 to 4, respectively, with a weighted average ACC rate of 91.0%.

CONCLUSION

Both the Light-MLP model and the Wide&Deep model demonstrated excellent ACC in automatic recognition of ABR waveforms across participants with diverse ages and hearing levels. While the Wide&Deep model's performance was slightly poorer than that of the Light-MLP model, particularly due to the limited sample size, it is anticipated that with an expanded data set, the performance of Wide&Deep model may be further improved.

Effects of Temporal Processing on Speech-in-Noise Perception in Middle-Aged Adults

Auditory temporal processing is a vital component of auditory stream segregation, or the process in which complex sounds are separated and organized into perceptually meaningful objects. Temporal processing can degrade prior to hearing loss, and is suggested to be a contributing factor to difficulties with speech-in-noise perception in normal-hearing listeners. The current study tested this hypothesis in middle-aged adults-an under-investigated cohort, despite being the age group where speech-in-noise difficulties are first reported. In 76 participants, three mechanisms of temporal processing were measured: peripheral auditory nerve function using electrocochleography, subcortical encoding of periodic speech cues (i.e., fundamental frequency; F0) using the frequency following response, and binaural sensitivity to temporal fine structure (TFS) using a dichotic frequency modulation detection task. Two measures of speech-in-noise perception were administered to explore how contributions of temporal processing may be mediated by different sensory demands present in the speech perception task. This study supported the hypothesis that temporal coding deficits contribute to speech-in-noise difficulties in middle-aged listeners. Poorer speech-in-noise perception was associated with weaker subcortical F0 encoding and binaural TFS sensitivity, but in different contexts, highlighting that diverse aspects of temporal processing are differentially utilized based on speech-in-noise task characteristics.

Auditory Encoding of Natural Speech at Subcortical and Cortical Levels Is Not Indicative of Cognitive Decline

More and more patients worldwide are diagnosed with dementia, which emphasizes the urgent need for early detection markers. In this study, we built on the auditory hypersensitivity theory of a previous study-which postulated that responses to auditory input in the subcortex as well as cortex are enhanced in cognitive decline-and examined auditory encoding of natural continuous speech at both neural levels for its indicative potential for cognitive decline. We recruited study participants aged 60 years and older, who were divided into two groups based on the Montreal Cognitive Assessment, one group with low scores (n = 19, participants with signs of cognitive decline) and a control group (n = 25). Participants completed an audiometric assessment and then we recorded their electroencephalography while they listened to an audiobook and click sounds. We derived temporal response functions and evoked potentials from the data and examined response amplitudes for their potential to predict cognitive decline, controlling for hearing ability and age. Contrary to our expectations, no evidence of auditory hypersensitivity was observed in participants with signs of cognitive decline; response amplitudes were comparable in both cognitive groups. Moreover, the combination of response amplitudes showed no predictive value for cognitive decline. These results challenge the proposed hypothesis and emphasize the need for further research to identify reliable auditory markers for the early detection of cognitive decline.

Myogenic artifacts masquerade as neuroplasticity in the auditory frequency-following response (FFR)

The frequency-following response (FFR) is an evoked potential that provides a "neural fingerprint" of complex sound encoding in the brain. FFRs have been widely used to characterize speech and music processing, experience-dependent neuroplasticity (e.g., learning, musicianship), and biomarkers for hearing and language-based disorders that distort receptive communication abilities. It is widely assumed FFRs stem from a mixture of phase-locked neurogenic activity from brainstem and cortical structures along the hearing neuraxis. Here, we challenge this prevailing view by demonstrating upwards of ~50% of the FFR can originate from a non-neural source: contamination from the postauricular muscle (PAM) vestigial startle reflex. We first establish PAM artifact is present in all ears, varies with electrode proximity to the muscle, and can be experimentally manipulated by directing listeners' eye gaze toward the ear of sound stimulation. We then show this muscular noise easily confounds auditory FFRs, spuriously amplifying responses by 3-4x fold with tandem PAM contraction and even explaining putative FFR enhancements observed in highly skilled musicians. Our findings expose a new and unrecognized myogenic source to the FFR that drives its large inter-subject variability and cast doubt on whether changes in the response typically attributed to neuroplasticity/pathology are solely of brain origin.

Frequency-Following Responses in Sensorineural Hearing Loss: A Systematic Review

PURPOSE

This systematic review aims to assess the impact of sensorineural hearing loss (SNHL) on various frequency-following response (FFR) parameters.

METHODS

Following PRISMA guidelines, a systematic review was conducted using PubMed, Web of Science, and Scopus databases up to January 2023. Studies evaluating FFRs in patients with SNHL and normal hearing controls were included.

RESULTS

Sixteen case-control studies were included, revealing variability in acquisition parameters. In the time domain, patients with SNHL exhibited prolonged latencies. The specific waves that were prolonged differed across studies. There was no consensus regarding wave amplitude in the time domain. In the frequency domain, focusing on studies that elicited FFRs with stimuli of 170 ms or longer, participants with SNHL displayed a significantly smaller fundamental frequency (F0). Results regarding changes in the temporal fine structure (TFS) were inconsistent.

CONCLUSION

Patients with SNHL may require more time for processing (speech) stimuli, reflected in prolonged latencies. However, the exact timing of this delay remains unclear. Additionally, when presenting longer stimuli (≥ 170 ms), patients with SNHL show difficulties tracking the F0 of (speech) stimuli. No definite conclusions could be drawn on changes in wave amplitude in the time domain and the TFS in the frequency domain. Patient characteristics, acquisition parameters, and FFR outcome parameters differed greatly across studies. Future studies should be performed in larger and carefully matched subject groups, using longer stimuli presented at the same intensity in dB HL for both groups, or at a carefully determined maximum comfortable loudness level.

Brief Report: Atypical Temporal Sensitivity in Coarticulation in Autism: Evidence from Sibilant-Vowel Interaction in Cantonese

PURPOSE

Atypicalities in the prosodic aspects of speech are commonly considered in clinical assessments of autism. While there is an increasing number of studies using objective measures to assess prosodic deficits, such studies have primarily focused on the intonational and rhythmic aspects of prosody. Little is known about prosodic deficits that are reflected at the segmental level, despite the strong connection between prosody and segmental realization. This study examines the nature of sibilant-vowel coarticulation among male adult native speakers of Cantonese with autism and those without.

METHODS

Fifteen Cantonese-speaking autistic (ASD) adults (mean age = 25 years) and 23 neuro-typical (NT) adults (mean age = 20 years) participated. Each participant read aloud 42 syllables with a sibilant onset in carrier phrase. Spectral means and variance, skewness and kurtosis were measured, and regressed by vocalic rounding (rounded vs. unrounded), cohort (ASD vs. NT), sibilant duration, and articulation rate.

RESULTS

While neurotypical participants exhibit sibilant-vowel coarticulation that are sensitive to variation in sibilant duration, autistic participants show no sensitivity to segmental temporal changes.

CONCLUSION

These findings point to the potential for atypicalities in prosody-segment interaction as an important characteristic of autistic speech.

The Early Subcortical Response at the Fundamental Frequency of Speech Is Temporally Separated from Later Cortical Contributions

Most parts of speech are voiced, exhibiting a degree of periodicity with a fundamental frequency and many higher harmonics. Some neural populations respond to this temporal fine structure, in particular at the fundamental frequency. This frequency-following response to speech consists of both subcortical and cortical contributions and can be measured through EEG as well as through magnetoencephalography (MEG), although both differ in the aspects of neural activity that they capture: EEG is sensitive to both radial and tangential sources as well as to deep sources, whereas MEG is more restrained to the measurement of tangential and superficial neural activity. EEG responses to continuous speech have shown an early subcortical contribution, at a latency of around 9 msec, in agreement with MEG measurements in response to short speech tokens, whereas MEG responses to continuous speech have not yet revealed such an early component. Here, we analyze MEG responses to long segments of continuous speech. We find an early subcortical response at latencies of 4-11 msec, followed by later right-lateralized cortical activities at delays of 20-58 msec as well as potential subcortical activities. Our results show that the early subcortical component of the FFR to continuous speech can be measured from MEG in populations of participants and that its latency agrees with that measured with EEG. They furthermore show that the early subcortical component is temporally well separated from later cortical contributions, enabling an independent assessment of both components toward further aspects of speech processing.

Rapid and objective assessment of auditory temporal processing using dynamic amplitude-modulated stimuli

Auditory neural coding of speech-relevant temporal cues can be noninvasively probed using envelope following responses (EFRs), neural ensemble responses phase-locked to the stimulus amplitude envelope. EFRs emphasize different neural generators, such as the auditory brainstem or auditory cortex, by altering the temporal modulation rate of the stimulus. EFRs can be an important diagnostic tool to assess auditory neural coding deficits that go beyond traditional audiometric estimations. Existing approaches to measure EFRs use discrete amplitude modulated (AM) tones of varying modulation frequencies, which is time consuming and inefficient, impeding clinical translation. Here we present a faster and more efficient framework to measure EFRs across a range of AM frequencies using stimuli that dynamically vary in modulation rates, combined with spectrally specific analyses that offer optimal spectrotemporal resolution. EFRs obtained from several species (humans, Mongolian gerbils, Fischer-344 rats, and Cba/CaJ mice) showed robust, high-SNR tracking of dynamic AM trajectories (up to 800Hz in humans, and 1.4 kHz in rodents), with a fivefold decrease in recording time and thirtyfold increase in spectrotemporal resolution. EFR amplitudes between dynamic AM stimuli and traditional discrete AM tokens within the same subjects were highly correlated (94% variance explained) across species. Hence, we establish a time-efficient and spectrally specific approach to measure EFRs. These results could yield novel clinical diagnostics for precision audiology approaches by enabling rapid, objective assessment of temporal processing along the entire auditory neuraxis.

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds

Background

As a tonal language, Mandarin Chinese has the following pronunciation elements for each syllable: the vowel, consonant, tone, duration, and intensity. Revealing the characteristics of auditory-related cortical processing of these different pronunciation elements is interesting.

Methods

A Mandarin pronunciation multifeature paradigm was designed, during which a standard stimulus and five different phonemic deviant stimuli were presented. The electroencephalogram (EEG) data were recorded with 256-electrode high-density EEG equipment. Time-domain and source localization analyses were conducted to demonstrate waveform characteristics and locate the sources of the cortical processing of mismatch negativity (MMN) and P3a components following different stimuli.

Results

Vowel and consonant differences elicited distinct MMN and P3a components, but tone and duration differences did not. Intensity differences elicited distinct MMN components but not P3a components. For MMN and P3a components, the activated cortical areas were mainly in the frontal-temporal lobe. However, the regions and intensities of the cortical activation were significantly different among the components for the various deviant stimuli. The activated cortical areas of the MMN and P3a components elicited by vowels and consonants seemed to be larger and show more intense activation.

Conclusion

The auditory processing centers use different auditory-related cognitive resources when processing different Mandarin pronunciation elements. Vowels and consonants carry more information for speech comprehension; moreover, more neurons in the cortex may be involved in the recognition and cognitive processing of these elements.

Extending Subcortical EEG Responses to Continuous Speech to the Sound-Field

The auditory brainstem response (ABR) is a valuable clinical tool for objective hearing assessment, which is conventionally detected by averaging neural responses to thousands of short stimuli. Progressing beyond these unnatural stimuli, brainstem responses to continuous speech presented via earphones have been recently detected using linear temporal response functions (TRFs). Here, we extend earlier studies by measuring subcortical responses to continuous speech presented in the sound-field, and assess the amount of data needed to estimate brainstem TRFs. Electroencephalography (EEG) was recorded from 24 normal hearing participants while they listened to clicks and stories presented via earphones and loudspeakers. Subcortical TRFs were computed after accounting for non-linear processing in the auditory periphery by either stimulus rectification or an auditory nerve model. Our results demonstrated that subcortical responses to continuous speech could be reliably measured in the sound-field. TRFs estimated using auditory nerve models outperformed simple rectification, and 16 minutes of data was sufficient for the TRFs of all participants to show clear wave V peaks for both earphones and sound-field stimuli. Subcortical TRFs to continuous speech were highly consistent in both earphone and sound-field conditions, and with click ABRs. However, sound-field TRFs required slightly more data (16 minutes) to achieve clear wave V peaks compared to earphone TRFs (12 minutes), possibly due to effects of room acoustics. By investigating subcortical responses to sound-field speech stimuli, this study lays the groundwork for bringing objective hearing assessment closer to real-life conditions, which may lead to improved hearing evaluations and smart hearing technologies.

A Preliminary Study Characterizing Subcortical and Cortical Auditory Processing and Their Relation to Autistic Traits and Sensory Features

This study characterizes the subcortical auditory brainstem response (speech-ABR) and cortical auditory processing (P1 and Mismatch Negativity; MMN) to speech sounds and their relationship to autistic traits and sensory features within the same group of autistic children (n = 10) matched on age and non-verbal IQ to their typically developing (TD) peers (n = 21). No speech-ABR differences were noted, but autistic individuals had larger P1 and faster MMN responses. Correlations revealed that larger P1 amplitudes and MMN responses were associated with greater autistic traits and more sensory features. These findings highlight the complexity of the auditory system and its relationships to behaviours in autism, while also emphasizing the importance of measurement and developmental matching.

Sequence Processing in Music Predicts Reading Skills in Young Readers: A Longitudinal Study

Musical abilities, both in the pitch and temporal dimension, have been shown to be positively associated with phonological awareness and reading abilities in both children and adults. There is increasing evidence that the relationship between music and language relies primarily on the temporal dimension, including both meter and rhythm. It remains unclear to what extent skill level in these temporal aspects of music may uniquely contribute to the prediction of reading outcomes. A longitudinal design was used to test a group-administered musical sequence transcription task (MSTT). This task was designed to preferentially engage sequence processing skills while controlling for fine-grained pitch discrimination and rhythm in terms of temporal grouping. Forty-five children, native speakers of Portuguese (Mage = 7.4 years), completed the MSTT and a cognitive-linguistic protocol that included visual and auditory working memory tasks, as well as phonological awareness and reading tasks in second grade. Participants then completed reading assessments in third and fifth grades. Longitudinal regression models showed that MSTT and phonological awareness had comparable power to predict reading. The MSTT showed an overall classification accuracy for identifying low-achievement readers in Grades 2, 3, and 5 that was analogous to a comprehensive model including core predictors of reading disability. In addition, MSTT was the variable with the highest loading and the most discriminatory indicator of a phonological factor. These findings carry implications for the role of temporal sequence processing in contributing to the relationship between music and language and the potential use of MSTT as a language-independent, time- and cost-effective tool for the early identification of children at risk of reading disability.

Endophenotype trait domains for advancing gene discovery in autism spectrum disorder

Autism spectrum disorder (ASD) is associated with a diverse range of etiological processes, including both genetic and non-genetic causes. For a plurality of individuals with ASD, it is likely that the primary causes involve multiple common inherited variants that individually account for only small levels of variation in phenotypic outcomes. This genetic landscape creates a major challenge for detecting small but important pathogenic effects associated with ASD. To address similar challenges, separate fields of medicine have identified endophenotypes, or discrete, quantitative traits that reflect genetic likelihood for a particular clinical condition and leveraged the study of these traits to map polygenic mechanisms and advance more personalized therapeutic strategies for complex diseases. Endophenotypes represent a distinct class of biomarkers useful for understanding genetic contributions to psychiatric and developmental disorders because they are embedded within the causal chain between genotype and clinical phenotype, and they are more proximal to the action of the gene(s) than behavioral traits. Despite their demonstrated power for guiding new understanding of complex genetic structures of clinical conditions, few endophenotypes associated with ASD have been identified and integrated into family genetic studies. In this review, we argue that advancing knowledge of the complex pathogenic processes that contribute to ASD can be accelerated by refocusing attention toward identifying endophenotypic traits reflective of inherited mechanisms. This pivot requires renewed emphasis on study designs with measurement of familial co-variation including infant sibling studies, family trio and quad designs, and analysis of monozygotic and dizygotic twin concordance for select trait dimensions. We also emphasize that clarification of endophenotypic traits necessarily will involve integration of transdiagnostic approaches as candidate traits likely reflect liability for multiple clinical conditions and often are agnostic to diagnostic boundaries. Multiple candidate endophenotypes associated with ASD likelihood are described, and we propose a new focus on the analysis of "endophenotype trait domains" (ETDs), or traits measured across multiple levels (e.g., molecular, cellular, neural system, neuropsychological) along the causal pathway from genes to behavior. To inform our central argument for research efforts toward ETD discovery, we first provide a brief review of the concept of endophenotypes and their application to psychiatry. Next, we highlight key criteria for determining the value of candidate endophenotypes, including unique considerations for the study of ASD. Descriptions of different study designs for assessing endophenotypes in ASD research then are offered, including analysis of how select patterns of results may help prioritize candidate traits in future research. We also present multiple candidate ETDs that collectively cover a breadth of clinical phenomena associated with ASD, including social, language/communication, cognitive control, and sensorimotor processes. These ETDs are described because they represent promising targets for gene discovery related to clinical autistic traits, and they serve as models for analysis of separate candidate domains that may inform understanding of inherited etiological processes associated with ASD as well as overlapping neurodevelopmental disorders.

The effect of familiarity on neural tracking of music stimuli is modulated by mind wandering

One way to investigate the cortical tracking of continuous auditory stimuli is to use the stimulus reconstruction approach. However, the cognitive and behavioral factors impacting this cortical representation remain largely overlooked. Two possible candidates are familiarity with the stimulus and the ability to resist internal distractions. To explore the possible impacts of these two factors on the cortical representation of natural music stimuli, forty-one participants listened to monodic natural music stimuli while we recorded their neural activity. Using the stimulus reconstruction approach and linear mixed models, we found that familiarity positively impacted the reconstruction accuracy of music stimuli and that this effect of familiarity was modulated by mind wandering.

Attentional Modulation of the Cortical Contribution to the Frequency-Following Response Evoked by Continuous Speech

Selective attention to one of several competing speakers is required for comprehending a target speaker among other voices and for successful communication with them. It moreover has been found to involve the neural tracking of low-frequency speech rhythms in the auditory cortex. Effects of selective attention have also been found in subcortical neural activities, in particular regarding the frequency-following response related to the fundamental frequency of speech (speech-FFR). Recent investigations have, however, shown that the speech-FFR contains cortical contributions as well. It remains unclear whether these are also modulated by selective attention. Here we used magnetoencephalography to assess the attentional modulation of the cortical contributions to the speech-FFR. We presented both male and female participants with two competing speech signals and analyzed the cortical responses during attentional switching between the two speakers. Our findings revealed robust attentional modulation of the cortical contribution to the speech-FFR: the neural responses were higher when the speaker was attended than when they were ignored. We also found that, regardless of attention, a voice with a lower fundamental frequency elicited a larger cortical contribution to the speech-FFR than a voice with a higher fundamental frequency. Our results show that the attentional modulation of the speech-FFR does not only occur subcortically but extends to the auditory cortex as well.SIGNIFICANCE STATEMENT Understanding speech in noise requires attention to a target speaker. One of the speech features that a listener can use to identify a target voice among others and attend it is the fundamental frequency, together with its higher harmonics. The fundamental frequency arises from the opening and closing of the vocal folds and is tracked by high-frequency neural activity in the auditory brainstem and in the cortex. Previous investigations showed that the subcortical neural tracking is modulated by selective attention. Here we show that attention affects the cortical tracking of the fundamental frequency as well: it is stronger when a particular voice is attended than when it is ignored.

Sensory representations and pupil-indexed listening effort provide complementary contributions to multi-talker speech intelligibility

Optimal speech perception in noise requires successful separation of the target speech stream from multiple competing background speech streams. The ability to segregate these competing speech streams depends on the fidelity of bottom-up neural representations of sensory information in the auditory system and top-down influences of effortful listening. Here, we use objective neurophysiological measures of bottom-up temporal processing using envelope-following responses (EFRs) to amplitude modulated tones and investigate their interactions with pupil-indexed listening effort, as it relates to performance on the Quick speech in noise (QuickSIN) test in young adult listeners with clinically normal hearing thresholds. We developed an approach using ear-canal electrodes and adjusting electrode montages for modulation rate ranges, which extended the rage of reliable EFR measurements as high as 1024Hz. Pupillary responses revealed changes in listening effort at the two most difficult signal-to-noise ratios (SNR), but behavioral deficits at the hardest SNR only. Neither pupil-indexed listening effort nor the slope of the EFR decay function independently related to QuickSIN performance. However, a linear model using the combination of EFRs and pupil metrics significantly explained variance in QuickSIN performance. These results suggest a synergistic interaction between bottom-up sensory coding and top-down measures of listening effort as it relates to speech perception in noise. These findings can inform the development of next-generation tests for hearing deficits in listeners with normal-hearing thresholds that incorporates a multi-dimensional approach to understanding speech intelligibility deficits.

Neural Processing of Speech Sounds in ASD and First-Degree Relatives

Efficient neural encoding of sound plays a critical role in speech and language, and when impaired, may have reverberating effects on communication skills. This study investigated disruptions to neural processing of temporal and spectral properties of speech in individuals with ASD and their parents and found evidence of inefficient temporal encoding of speech sounds in both groups. The ASD group further demonstrated less robust neural representation of spectral properties of speech sounds. Associations between neural processing of speech sounds and language-related abilities were evident in both groups. Parent-child associations were also detected in neural pitch processing. Together, results suggest that atypical neural processing of speech sounds is a heritable ingredient contributing to the ASD language phenotype.

Can auditory evoked responses elicited to click and/or verbal sound identify children with or at risk of central auditory processing disorder: A scoping review

BACKGROUND

(Central) auditory processing disorders, (C)APDs are clinically identified using behavioral tests. However, changes in attention and motivation may easily affect true identification. Although auditory electrophysiological tests, such as Auditory Brainstem Responses (ABR), are independent of most confounding cognitive factors, there is no consensus that click and/or speech-evoked ABR can be used to identify children with or at-risk of (C)APDs due to heterogeneity among studies.

AIMS

This study aimed to review the possibility of using ABR evoked by click and/or speech stimuli to identify children with or at risk of (C)APDs.

METHODS

The online databases of PubMed, Web of Science, Medline, Embase, and CINAHL were explored using combined keywords for all English and French articles published until April 2021. Additional gray literature was also included such as conference abstracts, dissertations, and editorials in ProQuest Dissertations.

MAIN CONTRIBUTION

Thirteen papers met the eligibility criteria and were included in the scoping review. Fourteen papers were cross-sectional and two were interventional studies. Eleven papers used click stimuli to assess children with/at risk of (C)APDs, and speech stimuli were utilized in the remaining studies. Despite the diversity of the results, especially in click ABR assessments, most studies indicated increases in the wave latencies and/or decreases in the wave amplitudes of click ABR in children with/at risk of (C)APDs. The results of speech ABR assessments were more consistent, as prolongation of the transient components of speech ABR was observed in these children, while sustained components remained almost unchanged.

CONCLUSIONS

Although both click and speech-evoked ABRs could be used to assess children with (C)APDs, it appears that speech-evoked ABR assessments yield more reliable findings. These findings, however, should be interpreted with caution given the heterogeneity among studies. Well-designed studies on children with confirmed (C)APDs using standard diagnostic and assessment protocols are recommended.

Perceptual warping exposes categorical representations for speech in human brainstem responses

The brain transforms continuous acoustic events into discrete category representations to downsample the speech signal for our perceptual-cognitive systems. Such phonetic categories are highly malleable, and their percepts can change depending on surrounding stimulus context. Previous work suggests these acoustic-phonetic mapping and perceptual warping of speech emerge in the brain no earlier than auditory cortex. Here, we examined whether these auditory-category phenomena inherent to speech perception occur even earlier in the human brain, at the level of auditory brainstem. We recorded speech-evoked frequency following responses (FFRs) during a task designed to induce more/less warping of listeners' perceptual categories depending on stimulus presentation order of a speech continuum (random, forward, backward directions). We used a novel clustered stimulus paradigm to rapidly record the high trial counts needed for FFRs concurrent with active behavioral tasks. We found serial stimulus order caused perceptual shifts (hysteresis) near listeners' category boundary confirming identical speech tokens are perceived differentially depending on stimulus context. Critically, we further show neural FFRs during active (but not passive) listening are enhanced for prototypical vs. category-ambiguous tokens and are biased in the direction of listeners' phonetic label even for acoustically-identical speech stimuli. These findings were not observed in the stimulus acoustics nor model FFR responses generated via a computational model of cochlear and auditory nerve transduction, confirming a central origin to the effects. Our data reveal FFRs carry category-level information and suggest top-down processing actively shapes the neural encoding and categorization of speech at subcortical levels. These findings suggest the acoustic-phonetic mapping and perceptual warping in speech perception occur surprisingly early along the auditory neuroaxis, which might aid understanding by reducing ambiguity inherent to the speech signal.

Assessing Auditory Processing in Children with Listening Difficulties: A Pilot Study

BACKGROUND

Auditory processing disorders (APD) may be one of the problems experienced by children with listening difficulties (LiD). The combination of auditory behavioural and electrophysiological tests could help to provide a better understanding of the abilities/disabilities of children with LiD. The current study aimed to quantify the auditory processing abilities and function in children with LiD.

METHODS

Twenty children, ten with LiD (age = 8.46; SD = 1.39) and ten typically developing (TD) (age = 9.45; SD = 1.57) participated in this study. All children were evaluated with auditory processing tests as well as with attention and phonemic synthesis tasks. Electrophysiological measures were also conducted with click and speech auditory brainstem responses (ABR).

RESULTS

Children with LiD performed significantly worse than TD children for most behavioural tasks, indicating shortcomings in functional auditory processing. Moreover, the click-ABR wave I amplitude was smaller, and the speech-ABR waves D and E latencies were longer for the LiD children compared to the results of TD children. No significant difference was found when evaluating neural correlates between groups.

CONCLUSIONS

Combining behavioural testing with click-ABR and speech-ABR can highlight functional and neurophysiological deficiencies in children with learning and listening issues, especially at the brainstem level.

Quantifying the Influence of Factors on the Accuracy of Speech Perception in Mandarin-Speaking Cochlear Implant Patients

Rehabilitation of hearing perception in cochlear implant (CI) patients is a challenging process. A comprehensive analysis of the characteristics of hearing rehabilitation in Mandarin-speaking CI patients was conducted. We measured the aided hearing threshold (AHT) and the speech perception accuracy (SPA) and collected clinical data. A total of 49 CI patients were included. Significant linear relationships existed between the AHT and SPA. The SPA increased by about 5-7% when the AHT decreased by 5 dB. An apparent individual difference in the SPA was observed under the same AHT, which in some patients was lower than the reference value fitted by the regression model. The timing of both of cochlear implantation and rehabilitation training was found to lead to significant improvement in SPA. The SPA increases by 2.1-3.6% per year of cochlear implantation and 0.7-1.5% per year of rehabilitation training. The time of auditory deprivation can significantly reduce the SPA by about 1.0-1.6% per year. The SPA was still poor in some CI patients when the hearing compensation seemed satisfying. Early cochlear implantation and post-operative rehabilitation are essential for recovery of the patient's SPA if the indications for cochlear implantation are met.

Speech auditory brainstem response in audiological practice: a systematic review

BACKGROUND

Speech-ABR is an auditory brainstem response that evaluates the integrity of the temporal and spectral coding of speech in the upper levels of the brainstem. It reflects the acoustic properties of the stimulus used and consists of seven major waves. Waves V and A represent the onset of the response; wave C transition region; D, E, and F waves periodic region (frequency following response); and wave O reflects the offset of the response.

PURPOSE

The aim of this study is to evaluate the clinical availability of the speech-ABR procedure through a literature review.

METHODS

Literature search was conducted in Pubmed, Google Scholar, Scopus and Science Direct databases. Clinical studies of the last 15 years have been included in this review and 60 articles have been reviewed.

RESULTS

As a result of the articles reviewed, it was seen that most of the studies on speech ABR were conducted with children and young people and generally focused on latency analysis measurements. Most used stimulus is the /da/ syllable.

CONCLUSIONS

Speech ABR can objectively measure the auditory cues important for speech recognition and has many clinical applications. It can be used as a biomarker for auditory processing disorders, learning disorders, dyslexia, otitis media, hearing loss, language disorders and phonological disorders. S-ABR is an effective procedure that can be used in speech and language evaluations in people with hearing aids or cochlear implant. It may also be of benefit to the aging auditory system's ability to encode temporal cues.

The possible role of early-stage phase-locked neural activities in speech-in-noise perception in human adults across age and hearing loss

Ageing affects auditory neural phase-locked activities which could increase the challenges experienced during speech-in-noise (SiN) perception by older adults. However, evidence for how ageing affects SiN perception through these phase-locked activities is still lacking. It is also unclear whether influences of ageing on phase-locked activities in response to different acoustic properties have similar or different mechanisms to affect SiN perception. The present study addressed these issues by measuring early-stage phase-locked encoding of speech under quiet and noisy backgrounds (speech-shaped noise (SSN) and multi-talker babbles) in adults across a wide age range (19-75 years old). Participants passively listened to a repeated vowel whilst the frequency-following response (FFR) to fundamental frequency that has primary subcortical sources and cortical phase-locked response to slowly-fluctuating acoustic envelopes were recorded. We studied how these activities are affected by age and age-related hearing loss and how they are related to SiN performances (word recognition in sentences in noise). First, we found that the effects of age and hearing loss differ for the FFR and slow-envelope phase-locking. FFR was significantly decreased with age and high-frequency (≥ 2 kHz) hearing loss but increased with low-frequency (< 2 kHz) hearing loss, whilst the slow-envelope phase-locking was significantly increased with age and hearing loss across frequencies. Second, potential relationships between the types of phase-locked activities and SiN perception performances were also different. We found that the FFR and slow-envelope phase-locking positively corresponded to SiN performance under multi-talker babbles and SSN, respectively. Finally, we investigated how age and hearing loss affected SiN perception through phase-locked activities via mediation analyses. We showed that both types of activities significantly mediated the relation between age/hearing loss and SiN perception but in distinct manners. Specifically, FFR decreased with age and high-frequency hearing loss which in turn contributed to poorer SiN performance but increased with low-frequency hearing loss which in turn contributed to better SiN performance under multi-talker babbles. Slow-envelope phase-locking increased with age and hearing loss which in turn contributed to better SiN performance under both SSN and multi-talker babbles. Taken together, the present study provided evidence for distinct neural mechanisms of early-stage auditory phase-locked encoding of different acoustic properties through which ageing affects SiN perception.

Speech ABR Findings in Auto Rickshaw Drivers Exposed to Occupational Noise

Most of the persons with noise exposure will have clinically normal hearing threshold while experiencing reduced speech comprehension. The motive of this study is to assess the impact of occupational noise on the encoding of speech stimuli in the auditory system in the auto-rickshaw drivers and compare the auditory brainstem responses (ABR) using speech stimuli with that of controls. The study was done in experimental design, where speech evoked ABR was measured in 21 auto-drivers who were continuously exposed to higher levels of occupational noise, and they were compared to the results of 37 individuals who were not exposed to noise. Speech ABR was administered in both the groups and the absolute latencies and amplitudes of the peaks V, A, C, D, E, F and O were compared. The results revealed that there is a statistically significant difference (p < 0.05) in the latency of peak V (F(1,32) = 6.13, p < 0.05, η p 2  = 0.12) and peak A (F(1,32) = 4.03, p < 0.05, η p 2  = 0.08) between the control and experimental group. Similarly, there was a statistically significant difference seen in the amplitude of peak D (F(1,32) = 6.38, p < 0.05, η p 2  = 0.12) and peak F (F(1,32) = 7.97, p < 0.05, η p 2  = 0.15). Acknowledging how the speech signals are coded in the brainstem may aid in the timely detection and intervention of hearing-related issues, even in individuals having normal hearing acuity. The results indicate that there is damage at the level of the brainstem which will lead to poor speech understanding in those who are exposed to occupational noise. These indicators are present even before routine audiometry indicates a hearing loss.

Subcortical and Cortical Electrophysiological Measures in Children With Speech-in-Noise Deficits Associated With Auditory Processing Disorders

PURPOSE

The aim of this study was to analyze the subcortical and cortical auditory evoked potentials for speech stimuli in children with speech-in-noise (SIN) deficits associated with auditory processing disorder (APD) without any reading or language deficits.

METHOD

The study included 20 children in the age range of 9-13 years. Ten children were recruited to the APD group; they had below-normal scores on the speech-perception-in-noise test and were diagnosed as having APD. The remaining 10 were typically developing (TD) children and were recruited to the TD group. Speech-evoked subcortical (brainstem) and cortical (auditory late latency) responses were recorded and compared across both groups.

RESULTS

The results showed a statistically significant reduction in the amplitudes of the subcortical potentials (both for stimulus in quiet and in noise) and the magnitudes of the spectral components (fundamental frequency and the second formant) in children with SIN deficits in the APD group compared to the TD group. In addition, the APD group displayed enhanced amplitudes of the cortical potentials compared to the TD group.

CONCLUSION

Children with SIN deficits associated with APD exhibited impaired coding/processing of the auditory information at the level of the brainstem and the auditory cortex.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21357735.

Methodological considerations when measuring and analyzing auditory steady-state responses with multi-channel EEG

The auditory steady-state response (ASSR) has been traditionally recorded with few electrodes and is often measured as the voltage difference between mastoid and vertex electrodes (vertical montage). As high-density EEG recording systems have gained popularity, multi-channel analysis methods have been developed to integrate the ASSR signal across channels. The phases of ASSR across electrodes can be affected by factors including the stimulus modulation rate and re-referencing strategy, which will in turn affect the estimated ASSR strength. To explore the relationship between the classical vertical-montage ASSR and whole-scalp ASSR, we applied these two techniques to the same data to estimate the strength of ASSRs evoked by tones with sinusoidal amplitude modulation rates of around 40, 100, and 200 Hz. The whole-scalp methods evaluated in our study, with either linked-mastoid or common-average reference, included ones that assume equal phase across all channels, as well as ones that allow for different phase relationships. The performance of simple averaging was compared to that of more complex methods involving principal component analysis. Overall, the root-mean-square of the phase locking values (PLVs) across all channels provided the most efficient method to detect ASSR across the range of modulation rates tested here.

Updates to the guinea pig animal model for in-vivo auditory neuroscience in the low-frequency hearing range

For gaining insight into general principles of auditory processing, it is critical to choose model organisms whose set of natural behaviors encompasses the processes being investigated. This reasoning has led to the development of a variety of animal models for auditory neuroscience research, such as guinea pigs, gerbils, chinchillas, rabbits, and ferrets; but in recent years, the availability of cutting-edge molecular tools and other methodologies in the mouse model have led to waning interest in these unique model species. As laboratories increasingly look to include in-vivo components in their research programs, a comprehensive description of procedures and techniques for applying some of these modern neuroscience tools to a non-mouse small animal model would enable researchers to leverage unique model species that may be best suited for testing their specific hypotheses. In this manuscript, we describe in detail the methods we have developed to apply these tools to the guinea pig animal model to answer questions regarding the neural processing of complex sounds, such as vocalizations. We describe techniques for vocalization acquisition, behavioral testing, recording of auditory brainstem responses and frequency-following responses, intracranial neural signals including local field potential and single unit activity, and the expression of transgenes allowing for optogenetic manipulation of neural activity, all in awake and head-fixed guinea pigs. We demonstrate the rich datasets at the behavioral and electrophysiological levels that can be obtained using these techniques, underscoring the guinea pig as a versatile animal model for studying complex auditory processing. More generally, the methods described here are applicable to a broad range of small mammals, enabling investigators to address specific auditory processing questions in model organisms that are best suited for answering them.

Athleticism and sex impact neural processing of sound

Biology and experience both influence the auditory brain. Sex is one biological factor with pervasive effects on auditory processing. Females process sounds faster and more robustly than males. These differences are linked to hormone differences between the sexes. Athleticism is an experiential factor known to reduce ongoing neural noise, but whether it influences how sounds are processed by the brain is unknown. Furthermore, it is unknown whether sports participation influences auditory processing differently in males and females, given the well-documented sex differences in auditory processing seen in the general population. We hypothesized that athleticism enhances auditory processing and that these enhancements are greater in females. To test these hypotheses, we measured auditory processing in collegiate Division I male and female student-athletes and their non-athlete peers (total n = 1012) using the frequency-following response (FFR). The FFR is a neurophysiological response to sound that reflects the processing of discrete sound features. We measured across-trial consistency of the response in addition to fundamental frequency (F0) and harmonic encoding. We found that athletes had enhanced encoding of the harmonics, which was greatest in the female athletes, and that athletes had more consistent responses than non-athletes. In contrast, F0 encoding was reduced in athletes. The harmonic-encoding advantage in female athletes aligns with previous work linking harmonic encoding strength to female hormone levels and studies showing estrogen as mediating athlete sex differences in other sensory domains. Lastly, persistent deficits in auditory processing from previous concussive and repetitive subconcussive head trauma may underlie the reduced F0 encoding in athletes, as poor F0 encoding is a hallmark of concussion injury.

Brainstem evoked auditory potentials in tinnitus: A best-evidence synthesis and meta-analysis

Introduction

Accumulating evidence suggests a role of the brainstem in tinnitus generation and modulation. Several studies in chronic tinnitus patients have reported latency and amplitude changes of the different peaks of the auditory brainstem response, possibly reflecting neural changes or altered activity. The aim of the systematic review was to assess if alterations within the brainstem of chronic tinnitus patients are reflected in short- and middle-latency auditory evoked potentials (AEPs).

Methods

A systematic review was performed and reported according to the PRISMA guidelines. Studies evaluating short- and middle-latency AEPs in tinnitus patients and controls were included. Two independent reviewers conducted the study selection, data extraction, and risk of bias assessment. Meta-analysis was performed using a multivariate meta-analytic model.

Results

Twenty-seven cross-sectional studies were included. Multivariate meta-analysis revealed that in tinnitus patients with normal hearing, significantly longer latencies of auditory brainstem response (ABR) waves I (SMD = 0.66 ms, p < 0.001), III (SMD = 0.43 ms, p < 0.001), and V (SMD = 0.47 ms, p < 0.01) are present. The results regarding possible changes in middle-latency responses (MLRs) and frequency-following responses (FFRs) were inconclusive.

Discussion

The discovered changes in short-latency AEPs reflect alterations at brainstem level in tinnitus patients. More specifically, the prolonged ABR latencies could possibly be explained by high frequency sensorineural hearing loss, or other modulating factors such as cochlear synaptopathy or somatosensory tinnitus generators. The question whether middle-latency AEP changes, representing subcortical level of the auditory pathway, are present in tinnitus still remains unanswered. Future studies should identify and correctly deal with confounding factors, such as age, gender and the presence of somatosensory tinnitus components.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021243687, PROSPERO [CRD42021243687].

Effects of Temporal Envelope Cutoff Frequency, Number of Channels, and Carrier Type on Brainstem Neural Representation of Pitch in Vocoded Speech

PURPOSE

The objective of this study was to determine if and how the subcortical neural representation of pitch cues in listeners with normal hearing is affected by systematic manipulation of vocoder parameters.

METHOD

This study assessed the effects of temporal envelope cutoff frequency (50 and 500 Hz), number of channels (1-32), and carrier type (sine-wave and noise-band) on brainstem neural representation of fundamental frequency (f _o) in frequency-following responses (FFRs) to vocoded vowels of 15 young adult listeners with normal hearing.

RESULTS

Results showed that FFR f _o strength (quantified as absolute f _o magnitude divided by noise floor [NF] magnitude) significantly improved with 500-Hz vs. 50-Hz temporal envelopes for all channel numbers and both carriers except the 1-channel noise-band vocoder. FFR f _o strength with 500-Hz temporal envelopes significantly improved when the channel number increased from 1 to 2, but it either declined (sine-wave vocoders) or saturated (noise-band vocoders) when the channel number increased from 4 to 32. FFR f _o strength with 50-Hz temporal envelopes was similarly small for both carriers with all channel numbers, except for a significant improvement with the 16-channel sine-wave vocoder. With 500-Hz temporal envelopes, FFR f _o strength was significantly greater for sine-wave vocoders than for noise-band vocoders with channel numbers 1-8; no significant differences were seen with 16 and 32 channels. With 50-Hz temporal envelopes, the carrier effect was only observed with 16 channels. In contrast, there was no significant carrier effect for the absolute f _o magnitude. Compared to sine-wave vocoders, noise-band vocoders had a higher NF and thus lower relative FFR f _o strength.

CONCLUSIONS

It is important to normalize the f _o magnitude relative to the NF when analyzing the FFRs to vocoded speech. The physiological findings reported here may result from the availability of f _o-related temporal periodicity and spectral sidelobes in vocoded signals and should be considered when selecting vocoder parameters and interpreting results in future physiological studies. In general, the dependence of brainstem neural phase-locking strength to f _o on vocoder parameters may confound the comparison of pitch-related behavioral results across different vocoder designs.

Temporal Pitch Sensitivity in an Animal Model: Psychophysics and Scalp Recordings : Temporal Pitch Sensitivity in Cat

Cochlear implant (CI) users show limited sensitivity to the temporal pitch conveyed by electric stimulation, contributing to impaired perception of music and of speech in noise. Neurophysiological studies in cats suggest that this limitation is due, in part, to poor transmission of the temporal fine structure (TFS) by the brainstem pathways that are activated by electrical cochlear stimulation. It remains unknown, however, how that neural limit might influence perception in the same animal model. For that reason, we developed non-invasive psychophysical and electrophysiological measures of temporal (i.e., non-spectral) pitch processing in the cat. Normal-hearing (NH) cats were presented with acoustic pulse trains consisting of band-limited harmonic complexes that simulated CI stimulation of the basal cochlea while removing cochlear place-of-excitation cues. In the psychophysical procedure, trained cats detected changes from a base pulse rate to a higher pulse rate. In the scalp-recording procedure, the cortical-evoked acoustic change complex (ACC) and brainstem-generated frequency following response (FFR) were recorded simultaneously in sedated cats for pulse trains that alternated between the base and higher rates. The range of perceptual sensitivity to temporal pitch broadly resembled that of humans but was shifted to somewhat higher rates. The ACC largely paralleled these perceptual patterns, validating its use as an objective measure of temporal pitch sensitivity. The phase-locked FFR, in contrast, showed strong brainstem encoding for all tested pulse rates. These measures demonstrate the cat's perceptual sensitivity to pitch in the absence of cochlear-place cues and may be valuable for evaluating neural mechanisms of temporal pitch perception in the feline animal model of stimulation by a CI or novel auditory prostheses.

Neonatal Frequency-Following Responses: A Methodological Framework for Clinical Applications

The frequency-following response (FFR) to periodic complex sounds is a noninvasive scalp-recorded auditory evoked potential that reflects synchronous phase-locked neural activity to the spectrotemporal components of the acoustic signal along the ascending auditory hierarchy. The FFR has gained recent interest in the fields of audiology and auditory cognitive neuroscience, as it has great potential to answer both basic and applied questions about processes involved in sound encoding, language development, and communication. Specifically, it has become a promising tool in neonates, as its study may allow both early identification of future language disorders and the opportunity to leverage brain plasticity during the first 2 years of life, as well as enable early interventions to prevent and/or ameliorate sound and language encoding disorders. Throughout the present review, we summarize the state of the art of the neonatal FFR and, based on our own extensive experience, present methodological approaches to record it in a clinical environment. Overall, the present review is the first one that comprehensively focuses on the neonatal FFRs applications, thus supporting the feasibility to record the FFR during the first days of life and the predictive potential of the neonatal FFR on detecting short- and long-term language abilities and disruptions.

The neural response at the fundamental frequency of speech is modulated by word-level acoustic and linguistic information

Spoken language comprehension requires rapid and continuous integration of information, from lower-level acoustic to higher-level linguistic features. Much of this processing occurs in the cerebral cortex. Its neural activity exhibits, for instance, correlates of predictive processing, emerging at delays of a few 100 ms. However, the auditory pathways are also characterized by extensive feedback loops from higher-level cortical areas to lower-level ones as well as to subcortical structures. Early neural activity can therefore be influenced by higher-level cognitive processes, but it remains unclear whether such feedback contributes to linguistic processing. Here, we investigated early speech-evoked neural activity that emerges at the fundamental frequency. We analyzed EEG recordings obtained when subjects listened to a story read by a single speaker. We identified a response tracking the speaker's fundamental frequency that occurred at a delay of 11 ms, while another response elicited by the high-frequency modulation of the envelope of higher harmonics exhibited a larger magnitude and longer latency of about 18 ms with an additional significant component at around 40 ms. Notably, while the earlier components of the response likely originate from the subcortical structures, the latter presumably involves contributions from cortical regions. Subsequently, we determined the magnitude of these early neural responses for each individual word in the story. We then quantified the context-independent frequency of each word and used a language model to compute context-dependent word surprisal and precision. The word surprisal represented how predictable a word is, given the previous context, and the word precision reflected the confidence about predicting the next word from the past context. We found that the word-level neural responses at the fundamental frequency were predominantly influenced by the acoustic features: the average fundamental frequency and its variability. Amongst the linguistic features, only context-independent word frequency showed a weak but significant modulation of the neural response to the high-frequency envelope modulation. Our results show that the early neural response at the fundamental frequency is already influenced by acoustic as well as linguistic information, suggesting top-down modulation of this neural response.

A Linear Superposition Model of Envelope and Frequency Following Responses May Help Identify Generators Based on Latency

Envelope and frequency-following responses (FFR_ENV and FFR_TFS) are scalp-recorded electrophysiological potentials that closely follow the periodicity of complex sounds such as speech. These signals have been established as important biomarkers in speech and learning disorders. However, despite important advances, it has remained challenging to map altered FFR_ENV and FFR_TFS to altered processing in specific brain regions. Here we explore the utility of a deconvolution approach based on the assumption that FFR_ENV and FFR_TFS reflect the linear superposition of responses that are triggered by the glottal pulse in each cycle of the fundamental frequency (F0 responses). We tested the deconvolution method by applying it to FFR_ENV and FFR_TFS of rhesus monkeys to human speech and click trains with time-varying pitch patterns. Our analyses show that F0_ENV responses could be measured with high signal-to-noise ratio and featured several spectro-temporally and topographically distinct components that likely reflect the activation of brainstem (<5 ms; 200-1000 Hz), midbrain (5-15 ms; 100-250 Hz), and cortex (15-35 ms; ~90 Hz). In contrast, F0_TFS responses contained only one spectro-temporal component that likely reflected activity in the midbrain. In summary, our results support the notion that the latency of F0 components map meaningfully onto successive processing stages. This opens the possibility that pathologically altered FFR_ENV or FFR_TFS may be linked to altered F0_ENV or F0_TFS and from there to specific processing stages and ultimately spatially targeted interventions.

Principal component decomposition of acoustic and neural representations of time-varying pitch reveals adaptive efficient coding of speech covariation patterns

Understanding the effects of statistical regularities on speech processing is a central issue in auditory neuroscience. To investigate the effects of distributional covariance on the neural processing of speech features, we introduce and validate a novel approach: decomposition of time-varying signals into patterns of covariation extracted with Principal Component Analysis. We used this decomposition to assay the sensory representation of pitch covariation patterns in native Chinese listeners and non-native learners of Mandarin Chinese tones. Sensory representations were examined using the frequency-following response, a far-field potential that reflects phase-locked activity from neural ensembles along the auditory pathway. We found a more efficient representation of the covariation patterns that accounted for more redundancy in the form of distributional covariance. Notably, long-term language and short-term training experiences enhanced the sensory representation of these covariation patterns.

The importance of the motor system in the development of music-based forms of auditory rehabilitation

Hearing abilities decline with age, and one of the most commonly reported hearing issues in older adults is a difficulty understanding speech when there is loud background noise. Understanding speech in noise relies on numerous cognitive processes, including working memory, and is supported by numerous brain regions, including the motor and motor planning systems. Indeed, many working memory processes are supported by motor and premotor cortical regions. Interestingly, lifelong musicians and nonmusicians given music training over the course of weeks or months show an improved ability to understand speech when there is loud background noise. These benefits are associated with enhanced working memory abilities, and enhanced activity in motor and premotor cortical regions. Accordingly, it is likely that music training improves the coupling between the auditory and motor systems and promotes plasticity in these regions and regions that feed into auditory/motor areas. This leads to an enhanced ability to dynamically process incoming acoustic information, and is likely the reason that musicians and those who receive laboratory-based music training are better able to understand speech when there is background noise. Critically, these findings suggest that music-based forms of auditory rehabilitation are possible and should focus on tasks that promote auditory-motor interactions.

Aging Affects Subcortical Pitch Information Encoding Differently in Humans With Different Language Backgrounds

Aging and language background have been shown to affect pitch information encoding at the subcortical level. To study the individual and compounded effects on subcortical pitch information encoding, Frequency Following Responses were recorded from subjects across various ages and language backgrounds. Differences were found in pitch information encoding strength and accuracy among the groups, indicating that language experience and aging affect accuracy and magnitude of pitch information encoding ability at the subcortical level. Moreover, stronger effects of aging were seen in the magnitude of phase-locking in the native language speaker groups, while language background appears to have more impact on the accuracy of pitch tracking in older adult groups.

Bilinguals' speech perception in noise: Perceptual and neural associations

The current study characterized subcortical speech sound processing among monolinguals and bilinguals in quiet and challenging listening conditions and examined the relation between subcortical neural processing and perceptual performance. A total of 59 normal-hearing adults, ages 19–35 years, participated in the study: 29 native Hebrew-speaking monolinguals and 30 Arabic-Hebrew-speaking bilinguals. Auditory brainstem responses to speech sounds were collected in a quiet condition and with background noise. The perception of words and sentences in quiet and background noise conditions was also examined to assess perceptual performance and to evaluate the perceptual-physiological relationship. Perceptual performance was tested among bilinguals in both languages (first language (L1-Arabic) and second language (L2-Hebrew)). The outcomes were similar between monolingual and bilingual groups in quiet. Noise, as expected, resulted in deterioration in perceptual and neural responses, which was reflected in lower accuracy in perceptual tasks compared to quiet, and in more prolonged latencies and diminished neural responses. However, a mixed picture was observed among bilinguals in perceptual and physiological outcomes in noise. In the perceptual measures, bilinguals were significantly less accurate than their monolingual counterparts. However, in neural responses, bilinguals demonstrated earlier peak latencies compared to monolinguals. Our results also showed that perceptual performance in noise was related to subcortical resilience to the disruption caused by background noise. Specifically, in noise, increased brainstem resistance (i.e., fewer changes in the fundamental frequency (F0) representations or fewer shifts in the neural timing) was related to better speech perception among bilinguals. Better perception in L1 in noise was correlated with fewer changes in F0 representations, and more accurate perception in L2 was related to minor shifts in auditory neural timing. This study delves into the importance of using neural brainstem responses to speech sounds to differentiate individuals with different language histories and to explain inter-subject variability in bilinguals’ perceptual abilities in daily life situations.

Rapid Enhancement of Subcortical Neural Responses to Sine-Wave Speech

The efferent auditory nervous system may be a potent force in shaping how the brain responds to behaviorally significant sounds. Previous human experiments using the frequency following response (FFR) have shown efferent-induced modulation of subcortical auditory function online and over short- and long-term time scales; however, a contemporary understanding of FFR generation presents new questions about whether previous effects were constrained solely to the auditory subcortex. The present experiment used sine-wave speech (SWS), an acoustically-sparse stimulus in which dynamic pure tones represent speech formant contours, to evoke FFR_SWS. Due to the higher stimulus frequencies used in SWS, this approach biased neural responses toward brainstem generators and allowed for three stimuli (/bɔ/, /bu/, and /bo/) to be used to evoke FFR_SWSbefore and after listeners in a training group were made aware that they were hearing a degraded speech stimulus. All SWS stimuli were rapidly perceived as speech when presented with a SWS carrier phrase, and average token identification reached ceiling performance during a perceptual training phase. Compared to a control group which remained naïve throughout the experiment, training group FFR_SWS amplitudes were enhanced post-training for each stimulus. Further, linear support vector machine classification of training group FFR_SWS significantly improved post-training compared to the control group, indicating that training-induced neural enhancements were sufficient to bolster machine learning classification accuracy. These results suggest that the efferent auditory system may rapidly modulate auditory brainstem representation of sounds depending on their context and perception as non-speech or speech.

Comparing Sound-Field Speech-Auditory Brainstem Response Components between Cochlear Implant Users with Different Speech Recognition in Noise Scores

OBJECTIVES

Many studies have suggested that cochlear implant (CI) users vary in terms of speech recognition in noise. Studies in this field attribute this variety partly to subcortical auditory processing. Studying speech-Auditory Brainstem Response (speech-ABR) provides good information about speech processing; thus, this work was designed to compare speech-ABR components between two groups of CI users with good and poor speech recognition in noise scores.

MATERIALS & METHODS

The present study was conducted on two groups of CI users aged 8-10 years old. The first group (CI-good) consisted of 15 children with prelingual CI who had good speech recognition in noise performance. The second group (CI-poor) was matched with the first group, but they had poor speech recognition in noise performance. The speech-ABR test in a sound-field presentation was performed for all the participants.

RESULTS

The speech-ABR response showed more delay in C, D, E, F, O latencies in CI-poor than CI-good users (P <0.05), meanwhile no significant difference was observed in initial wave (V(t= -0.293, p= 0.771 and A (t= -1.051, p= 0.307). Analysis in spectral-domain showed a weaker representation of fundamental frequency as well as the first formant and high-frequency component of speech stimuli in the CI users with poor auditory performance.

CONCLUSIONS

Results revealed that CI users who showed poor auditory performance in noise performance had deficits in encoding the periodic portion of speech signals at the brainstem level. Also, this study could be as physiological evidence for poorer pitch processing in CI users with poor speech recognition in noise performance.

Music Listening and Homeostatic Regulation: Surviving and Flourishing in a Sonic World

This paper argues for a biological conception of music listening as an evolutionary achievement that is related to a long history of cognitive and affective-emotional functions, which are grounded in basic homeostatic regulation. Starting from the three levels of description, the acoustic description of sounds, the neurological level of processing, and the psychological correlates of neural stimulation, it conceives of listeners as open systems that are in continuous interaction with the sonic world. By monitoring and altering their current state, they can try to stay within the limits of operating set points in the pursuit of a controlled state of dynamic equilibrium, which is fueled by interoceptive and exteroceptive sources of information. Listening, in this homeostatic view, can be adaptive and goal-directed with the aim of maintaining the internal physiology and directing behavior towards conditions that make it possible to thrive by seeking out stimuli that are valued as beneficial and worthy, or by attempting to avoid those that are annoying and harmful. This calls forth the mechanisms of pleasure and reward, the distinction between pleasure and enjoyment, the twin notions of valence and arousal, the affect-related consequences of music listening, the role of affective regulation and visceral reactions to the sounds, and the distinction between adaptive and maladaptive listening.

Listening in the Moment: How Bilingualism Interacts With Task Demands to Shape Active Listening

While there is evidence for bilingual enhancements of inhibitory control and auditory processing, two processes that are fundamental to daily communication, it is not known how bilinguals utilize these cognitive and sensory enhancements during real-world listening. To test our hypothesis that bilinguals engage their enhanced cognitive and sensory processing in real-world listening situations, bilinguals and monolinguals performed a selective attention task involving competing talkers, a common demand of everyday listening, and then later passively listened to the same competing sentences. During the active and passive listening periods, evoked responses to the competing talkers were collected to understand how online auditory processing facilitates active listening and if this processing differs between bilinguals and monolinguals. Additionally, participants were tested on a separate measure of inhibitory control to see if inhibitory control abilities related with performance on the selective attention task. We found that although monolinguals and bilinguals performed similarly on the selective attention task, the groups differed in the neural and cognitive processes engaged to perform this task, compared to when they were passively listening to the talkers. Specifically, during active listening monolinguals had enhanced cortical phase consistency while bilinguals demonstrated enhanced subcortical phase consistency in the response to the pitch contours of the sentences, particularly during passive listening. Moreover, bilinguals’ performance on the inhibitory control test related with performance on the selective attention test, a relationship that was not seen for monolinguals. These results are consistent with the hypothesis that bilinguals utilize inhibitory control and enhanced subcortical auditory processing in everyday listening situations to engage with sound in ways that are different than monolinguals.

Sex differences in auditory processing vary across estrous cycle

In humans, females process a sound's harmonics more robustly than males. As estrogen regulates auditory plasticity in a sex-specific manner in seasonally breeding animals, estrogen signaling is one hypothesized mechanism for this difference in humans. To investigate whether sex differences in harmonic encoding vary similarly across the reproductive cycle of mammals, we recorded frequency-following responses (FFRs) to a complex sound in male and female rats. Female FFRs were collected during both low and high levels of circulating estrogen during the estrous cycle. Overall, female rodents had larger harmonic encoding than male rodents, and greater harmonic strength was seen during periods of greater estrogen production in the females. These results argue that hormonal differences, specifically estrogen, underlie sex differences in harmonic encoding in rodents and suggest that a similar mechanism may underlie differences seen in humans.

On prediction of aided behavioural measures using speech auditory brainstem responses and decision trees

Current clinical strategies to assess benefits from hearing aids (HAs) are based on self-reported questionnaires and speech-in-noise (SIN) tests; which require behavioural cooperation. Instead, objective measures based on Auditory Brainstem Responses (ABRs) to speech stimuli would not require the individuals' cooperation. Here, we re-analysed an existing dataset to predict behavioural measures with speech-ABRs using regression trees. Ninety-two HA users completed a self-reported questionnaire (SSQ-Speech) and performed two aided SIN tests: sentences in noise (BKB-SIN) and vowel-consonant-vowels (VCV) in noise. Speech-ABRs were evoked by a 40 ms [da] and recorded in 2x2 conditions: aided vs. unaided and quiet vs. background noise. For each recording condition, two sets of features were extracted: 1) amplitudes and latencies of speech-ABR peaks, 2) amplitudes and latencies of speech-ABR F0 encoding. Two regression trees were fitted for each of the three behavioural measures with either feature set and age, digit-span forward and backward, and pure tone average (PTA) as possible predictors. The PTA was the only predictor in the SSQ-Speech trees. In the BKB-SIN trees, performance was predicted by the aided latency of peak F in quiet for participants with PTAs between 43 and 61 dB HL. In the VCV trees, performance was predicted by the aided F0 encoding latency and the aided amplitude of peak VA in quiet for participants with PTAs ≤ 47 dB HL. These findings indicate that PTA was more informative than any speech-ABR measure, as these were relevant only for a subset of the participants. Therefore, speech-ABRs evoked by a 40 ms [da] are not a clinical predictor of behavioural measures in HA users.