Cross-Linguistic Comparison of Frequency-Following Responses to Voice Pitch in American and Chinese Neonates and Adults

Longitudinal trajectories of the neural encoding mechanisms of speech-sound features during the first year of life

Infants quickly recognize the sounds of their mother language, perceiving the spectrotemporal acoustic features of speech. However, the underlying neural machinery remains unclear. We used an auditory evoked potential termed frequency-following response (FFR) to unravel the neural encoding maturation for two speech sound characteristics: voice pitch and temporal fine structure. 37 healthy-term neonates were tested at birth and retested at the ages of six and twelve months. Results revealed a reduction in neural phase-locking onset to the stimulus envelope from birth to six months, stabilizing by twelve months. While neural encoding of voice pitch remained consistent across ages, temporal fine structure encoding matured rapidly from birth to six months, without further improvement from six to twelve months. Results highlight the critical importance of the first six months of life in the maturation of neural encoding mechanisms that are crucial for phoneme discrimination during early language acquisition.

Cross-linguistic and acoustic-driven effects on multiscale neural synchrony to stress rhythms

We investigated how neural oscillations code the hierarchical nature of stress rhythms in speech and how stress processing varies with language experience. By measuring phase synchrony of multilevel EEG-acoustic tracking and intra-brain cross-frequency coupling, we show the encoding of stress involves different neural signatures (delta rhythms = stress foot rate; theta rhythms = syllable rate), is stronger for amplitude vs. duration stress cues, and induces nested delta-theta coherence mirroring the stress-syllable hierarchy in speech. Only native English, but not Mandarin, speakers exhibited enhanced neural entrainment at central stress (2 Hz) and syllable (4 Hz) rates intrinsic to natural English. English individuals with superior cortical-stress tracking capabilities also displayed stronger neural hierarchical coherence, highlighting a nuanced interplay between internal nesting of brain rhythms and external entrainment rooted in language-specific speech rhythms. Our cross-language findings reveal brain-speech synchronization is not purely a "bottom-up" but benefits from "top-down" processing from listeners' language-specific experience.

Subcortical auditory system in tinnitus with normal hearing: insights from electrophysiological perspective

PURPOSE

The mechanism of tinnitus remains poorly understood; however, studies have underscored the significance of the subcortical auditory system in tinnitus perception. In this study, our aim was to investigate the subcortical auditory system using electrophysiological measurements in individuals with tinnitus and normal hearing. Additionally, we aimed to assess speech-in-noise (SiN) perception to determine whether individuals with tinnitus exhibit SiN deficits despite having normal-hearing thresholds.

METHODS

A total 42 normal-hearing participants, including 22 individuals with chronic subjective tinnitus and 20 normal individuals, participated in the study. We recorded auditory brainstem response (ABR) and speech-evoked frequency following response (sFFR) from the participants. SiN perception was also assessed using the Matrix test.

RESULTS

Our results revealed a significant prolongation of the O peak, which encodes sound offset in sFFR, for the tinnitus group (p < 0.01). The greater non-stimulus-evoked activity was also found in individuals with tinnitus (p < 0.01). In ABR, the tinnitus group showed reduced wave I amplitude and prolonged absolute wave I, III, and V latencies (p ≤ 0.02). Our findings suggested that individuals with tinnitus had poorer SiN perception compared to normal participants (p < 0.05).

CONCLUSION

The deficit in encoding sound offset may indicate an impaired inhibitory mechanism in tinnitus. The greater non-stimulus-evoked activity observed in the tinnitus group suggests increased neural noise at the subcortical level. Additionally, individuals with tinnitus may experience speech-in-noise deficits despite having a normal audiogram. Taken together, these findings suggest that the lack of inhibition and increased neural noise may be associated with tinnitus perception.

Exposure to bilingual or monolingual maternal speech during pregnancy affects the neurophysiological encoding of speech sounds in neonates differently

Introduction

Exposure to maternal speech during the prenatal period shapes speech perception and linguistic preferences, allowing neonates to recognize stories heard frequently in utero and demonstrating an enhanced preference for their mother's voice and native language. Yet, with a high prevalence of bilingualism worldwide, it remains an open question whether monolingual or bilingual maternal speech during pregnancy influence differently the fetus' neural mechanisms underlying speech sound encoding.

Methods

In the present study, the frequency-following response (FFR), an auditory evoked potential that reflects the complex spectrotemporal dynamics of speech sounds, was recorded to a two-vowel /oa/ stimulus in a sample of 129 healthy term neonates within 1 to 3 days after birth. Newborns were divided into two groups according to maternal language usage during the last trimester of gestation (monolingual; bilingual). Spectral amplitudes and spectral signal-to-noise ratios (SNR) at the stimulus fundamental (F0) and first formant (F1) frequencies of each vowel were, respectively, taken as measures of pitch and formant structure neural encoding.

Results

Our results reveal that while spectral amplitudes at F0 did not differ between groups, neonates from bilingual mothers exhibited a lower spectral SNR. Additionally, monolingually exposed neonates exhibited a higher spectral amplitude and SNR at F1 frequencies.

Discussion

We interpret our results under the consideration that bilingual maternal speech, as compared to monolingual, is characterized by a greater complexity in the speech sound signal, rendering newborns from bilingual mothers more sensitive to a wider range of speech frequencies without generating a particularly strong response at any of them. Our results contribute to an expanding body of research indicating the influence of prenatal experiences on language acquisition and underscore the necessity of including prenatal language exposure in developmental studies on language acquisition, a variable often overlooked yet capable of influencing research outcomes.

The frequency-following response in late preterm neonates: a pilot study

Introduction

Infants born very early preterm are at high risk of language delays. However, less is known about the consequences of late prematurity. Hence, the aim of the present study is to characterize the neural encoding of speech sounds in late preterm neonates in comparison with those born at term.

Methods

The speech-evoked frequency-following response (FFR) was recorded to a consonant-vowel stimulus /da/ in 36 neonates in three different groups: 12 preterm neonates [mean gestational age (GA) 36.05 weeks], 12 "early term neonates" (mean GA 38.3 weeks), and "late term neonates" (mean GA 41.01 weeks).

Results

From the FFR recordings, a delayed neural response and a weaker stimulus F0 encoding in premature neonates compared to neonates born at term was observed. No differences in the response time onset nor in stimulus F0 encoding were observed between the two groups of neonates born at term. No differences between the three groups were observed in the neural encoding of the stimulus temporal fine structure.

Discussion

These results highlight alterations in the neural encoding of speech sounds related to prematurity, which were present for the stimulus F0 but not for its temporal fine structure.

Short- and long-term neuroplasticity interact during the perceptual learning of concurrent speech

Plasticity from auditory experience shapes the brain's encoding and perception of sound. However, whether such long-term plasticity alters the trajectory of short-term plasticity during speech processing has yet to be investigated. Here, we explored the neural mechanisms and interplay between short- and long-term neuroplasticity for rapid auditory perceptual learning of concurrent speech sounds in young, normal-hearing musicians and nonmusicians. Participants learned to identify double-vowel mixtures during ~ 45 min training sessions recorded simultaneously with high-density electroencephalography (EEG). We analyzed frequency-following responses (FFRs) and event-related potentials (ERPs) to investigate neural correlates of learning at subcortical and cortical levels, respectively. Although both groups showed rapid perceptual learning, musicians showed faster behavioral decisions than nonmusicians overall. Learning-related changes were not apparent in brainstem FFRs. However, plasticity was highly evident in cortex, where ERPs revealed unique hemispheric asymmetries between groups suggestive of different neural strategies (musicians: right hemisphere bias; nonmusicians: left hemisphere). Source reconstruction and the early (150-200 ms) time course of these effects localized learning-induced cortical plasticity to auditory-sensory brain areas. Our findings reinforce the domain-general benefits of musicianship but reveal that successful speech sound learning is driven by a critical interplay between long- and short-term mechanisms of auditory plasticity, which first emerge at a cortical level.

Developmental Trajectory of the Frequency-Following Response During the First 6 Months of Life

PURPOSE

The aim of the present study is to characterize the maturational changes during the first 6 months of life in the neural encoding of two speech sound features relevant for early language acquisition: the stimulus fundamental frequency (fo), related to stimulus pitch, and the vowel formant composition, particularly F1. The frequency-following response (FFR) was used as a snapshot into the neural encoding of these two stimulus attributes.

METHOD

FFRs to a consonant-vowel stimulus /da/ were retrieved from electroencephalographic recordings in a sample of 80 healthy infants (45 at birth and 35 at the age of 1 month). Thirty-two infants (16 recorded at birth and 16 recorded at 1 month) returned for a second recording at 6 months of age.

RESULTS

Stimulus fo and F1 encoding showed improvements from birth to 6 months of age. Most remarkably, a significant improvement in the F1 neural encoding was observed during the first month of life.

CONCLUSION

Our results highlight the rapid and sustained maturation of the basic neural machinery necessary for the phoneme discrimination ability during the first 6 months of age.

Cross-linguistic and acoustic-driven effects on multiscale neural synchrony to stress rhythms

We investigated how neural oscillations code the hierarchical nature of stress rhythms in speech and how stress processing varies with language experience. By measuring phase synchrony of multilevel EEG-acoustic tracking and intra-brain cross-frequency coupling, we show the encoding of stress involves different neural signatures (delta rhythms = stress foot rate; theta rhythms = syllable rate), is stronger for amplitude vs. duration stress cues, and induces nested delta-theta coherence mirroring the stress-syllable hierarchy in speech. Only native English, but not Mandarin, speakers exhibited enhanced neural entrainment at central stress (2 Hz) and syllable (4 Hz) rates intrinsic to natural English. English individuals with superior cortical-stress tracking capabilities also displayed stronger neural hierarchical coherence, highlighting a nuanced interplay between internal nesting of brain rhythms and external entrainment rooted in language-specific speech rhythms. Our cross-language findings reveal brain-speech synchronization is not purely a "bottom-up" but benefits from "top-down" processing from listeners' language-specific experience.

Effects of Silent Intervals on the Extraction of Human Frequency-Following Responses Using Non-Negative Matrix Factorization

Source-Separation Non-Negative Matrix Factorization (SSNMF) is a mathematical algorithm recently developed to extract scalp-recorded frequency-following responses (FFRs) from noise. Despite its initial success, the effects of silent intervals on algorithm performance remain undetermined. Our purpose in this study was to determine the effects of silent intervals on the extraction of FFRs, which are electrophysiological responses that are commonly used to evaluate auditory processing and neuroplasticity in the human brain. We used an English vowel /i/ with a rising frequency contour to evoke FFRs in 23 normal-hearing adults. The stimulus had a duration of 150 ms, while the silent interval between the onset of one stimulus and the offset of the next one was also 150 ms. We computed FFR Enhancement and Noise Residue to estimate algorithm performance, while silent intervals were either included (i.e., the WithSI condition) or excluded (i.e., the WithoutSI condition) in our analysis. The FFR Enhancements and Noise Residues obtained in the WithoutSI condition were significantly better (p < .05) than those obtained in the WithSI condition. On average, the exclusion of silent intervals produced a 11.78% increment in FFR Enhancement and a 20.69% decrement in Noise Residue. These results not only quantify the effects of silent intervals on the extraction of human FFRs, but also provide recommendations for designing and improving the SSNMF algorithm in future research.

Short- and long-term experience-dependent neuroplasticity interact during the perceptual learning of concurrent speech

Plasticity from auditory experiences shapes brain encoding and perception of sound. However, whether such long-term plasticity alters the trajectory of short-term plasticity during speech processing has yet to be investigated. Here, we explored the neural mechanisms and interplay between short- and long-term neuroplasticity for rapid auditory perceptual learning of concurrent speech sounds in young, normal-hearing musicians and nonmusicians. Participants learned to identify double-vowel mixtures during ∼45 minute training sessions recorded simultaneously with high-density EEG. We analyzed frequency-following responses (FFRs) and event-related potentials (ERPs) to investigate neural correlates of learning at subcortical and cortical levels, respectively. While both groups showed rapid perceptual learning, musicians showed faster behavioral decisions than nonmusicians overall. Learning-related changes were not apparent in brainstem FFRs. However, plasticity was highly evident in cortex, where ERPs revealed unique hemispheric asymmetries between groups suggestive of different neural strategies (musicians: right hemisphere bias; nonmusicians: left hemisphere). Source reconstruction and the early (150-200 ms) time course of these effects localized learning-induced cortical plasticity to auditory-sensory brain areas. Our findings confirm domain-general benefits for musicianship but reveal successful speech sound learning is driven by a critical interplay between long- and short-term mechanisms of auditory plasticity that first emerge at a cortical level.

Prenatal daily musical exposure is associated with enhanced neural representation of speech fundamental frequency: Evidence from neonatal frequency-following responses

Fetal hearing experiences shape the linguistic and musical preferences of neonates. From the very first moment after birth, newborns prefer their native language, recognize their mother's voice, and show a greater responsiveness to lullabies presented during pregnancy. Yet, the neural underpinnings of this experience inducing plasticity have remained elusive. Here we recorded the frequency-following response (FFR), an auditory evoked potential elicited to periodic complex sounds, to show that prenatal music exposure is associated to enhanced neural encoding of speech stimuli periodicity, which relates to the perceptual experience of pitch. FFRs were recorded in a sample of 60 healthy neonates born at term and aged 12-72 hours. The sample was divided into two groups according to their prenatal musical exposure (29 daily musically exposed; 31 not-daily musically exposed). Prenatal exposure was assessed retrospectively by a questionnaire in which mothers reported how often they sang or listened to music through loudspeakers during the last trimester of pregnancy. The FFR was recorded to either a /da/ or an /oa/ speech-syllable stimulus. Analyses were centered on stimuli sections of identical duration (113 ms) and fundamental frequency (F0  = 113 Hz). Neural encoding of stimuli periodicity was quantified as the FFR spectral amplitude at the stimulus F0 . Data revealed that newborns exposed daily to music exhibit larger spectral amplitudes at F0 as compared to not-daily musically-exposed newborns, regardless of the eliciting stimulus. Our results suggest that prenatal music exposure facilitates the tuning to human speech fundamental frequency, which may support early language processing and acquisition. RESEARCH HIGHLIGHTS: Frequency-following responses to speech were collected from a sample of neonates prenatally exposed to music daily and compared to neonates not-daily exposed to music. Neonates who experienced daily prenatal music exposure exhibit enhanced frequency-following responses to the periodicity of speech sounds. Prenatal music exposure is associated with a fine-tuned encoding of human speech fundamental frequency, which may facilitate early language processing and acquisition.

Speech-Encoding Deficits in Neonates Born Large-for-Gestational Age as Revealed With the Envelope Frequency-Following Response

OBJECTIVES

The present envelope frequency-following response (FFRENV) study aimed at characterizing the neural encoding of the fundamental frequency of speech sounds in neonates born at the higher end of the birth weight continuum (>90th percentile), known as large-for-gestational age (LGA).

DESIGN

Twenty-five LGA newborns were recruited from the maternity unit of Sant Joan de Déu Barcelona Children's Hospital and paired by age and sex with 25 babies born adequate-for-gestational age (AGA), all from healthy mothers and normal pregnancies. FFRENVs were elicited to the/da/ syllable and recorded while the baby was sleeping in its cradle after a successful universal hearing screening. Neural encoding of the stimulus' envelope of the fundamental frequency (F0ENV) was characterized through the FFRENV spectral amplitude. Relationships between electrophysiological parameters and maternal/neonatal variables that may condition neonatal neurodevelopment were assessed, including pregestational body mass index (BMI), maternal gestational weight gain and neonatal BMI.

RESULTS

LGA newborns showed smaller spectral amplitudes at the F0ENV compared to the AGA group. Significant negative correlations were found between neonatal BMI and the spectral amplitude at the F0ENV.

CONCLUSIONS

Our results indicate that in spite of having a healthy pregnancy, LGA neonates' central auditory system is impaired in encoding a fundamental aspect of the speech sounds, namely their fundamental frequency. The negative correlation between the neonates' BMI and FFRENV indicates that this impaired encoding is independent of the pregnant woman BMI and weight gain during pregnancy, supporting the role of the neonatal BMI. We suggest that the higher adipose tissue observed in the LGA group may impair, via proinflammatory products, the fine-grained central auditory system microstructure required for the neural encoding of the fundamental frequency of speech sounds.

Performance of Statistical Indicators in the Objective Detection of Speech-Evoked Envelope Following Responses

OBJECTIVES

To assess the sensitivity of statistical indicators used for the objective detection of speech-evoked envelope following responses (EFRs) in infants and adults.

DESIGN

Twenty-three adults and 21 infants with normal hearing participated in this study. A modified/susa∫i/speech token was presented at 65 dB SPL monoaurally. Presentation level in infants was corrected using in-ear measurements. EFRs were recorded between high forehead and ipsilateral mastoid. Statistical post-processing was completed using F -test, Magnitude-Square Coherence, Rayleigh test, Rayleigh-Moore test, and Hotelling's T 2 test. Logistic regression models assessed the sensitivity of each statistical indicator in both infants and adults as a function of testing duration.

RESULTS

The Rayleigh-Moore and Rayleigh tests were the most sensitive statistical indicators for speech-evoked EFR detection in infants. Comparatively, Magnitude-Square Coherence and Hotelling's T 2 also provide clinical benefit for infants in all conditions after ~30 minutes of testing, whereas the F -test failed to detect responses to EFRs elicited by vowels with accuracy greater than chance. In contrast, the F-test was the most sensitive for vowel-elicited response detection for adults in short tests (<10 minute) and performed comparatively with the Rayleigh-Moore and Rayleigh test during longer test durations. Decreased sensitivity was observed in infants relative to adults across all testing durations and statistical indicators, but the effects were largest in low frequency stimuli and seemed to be mostly, but not wholly, caused by differences in response amplitude.

CONCLUSIONS

The choice of statistical indicator significantly impacts the sensitivity of speech-evoked EFR detection. In both groups and for all stimuli, the Rayleigh test and Rayleigh-Moore tests have high sensitivity. Differences in EFR detection are present between infants and adults regardless of statistical indicator; however, these effects are largest for low-frequency EFR stimuli and for amplitude-based statistical indicators.

The effect of child development on the components of the Frequency Following Response: Child development and the Frequency Following Response

During childhood, neuronal modifications occur so that typical childhood communicative development occurs. This work aims to contribute to the understanding of differences in the speech encoding of infants and school-age children by assessing the effects of child development, in different phases of early childhood, on the encoding of speech sounds. There were 98 subjects of both sexes, aged from 1 day to 8 years and 9 months who participated in the study. All subjects underwent a Frequency Following Response (FFR) assessment. A regression and linear correlation showed the effects of age in the FFR components, i.e., significant decrease in the latency and increased amplitude of all FFR waves with age. An increase in the slope measure was also observed. Younger infants require more time and show less robust responses when encoding speech than their older counterparts, which were shown to have more stable and well-organized FFR responses.

Implementation of Machine Learning on Human Frequency-Following Responses: A Tutorial

The frequency-following response (FFR) provides enriched information on how acoustic stimuli are processed in the human brain. Based on recent studies, machine learning techniques have demonstrated great utility in modeling human FFRs. This tutorial focuses on the fundamental principles, algorithmic designs, and custom implementations of several supervised models (linear regression, logistic regression, k -nearest neighbors, support vector machines) and an unsupervised model ( k -means clustering). Other useful machine learning tools (Markov chains, dimensionality reduction, principal components analysis, nonnegative matrix factorization, and neural networks) are discussed as well. Each model's applicability and its pros and cons are explained. The choice of a suitable model is highly dependent on the research question, FFR recordings, target variables, extracted features, and their data types. To promote understanding, an example project implemented in Python is provided, which demonstrates practical usage of several of the discussed models on a sample dataset of six FFR features and a target response label.

A Home-Based Approach to Auditory Brainstem Response Measurement: Proof-of-Concept and Practical Guidelines

Broad-scale neuroscientific investigations of diverse human populations are difficult to implement. This is because the primary neuroimaging methods (magnetic resonance imaging, electroencephalography [EEG]) historically have not been portable, and participants may be unable or unwilling to travel to test sites. Miniaturization of EEG technologies has now opened the door to neuroscientific fieldwork, allowing for easier access to under-represented populations. Recent efforts to conduct auditory neuroscience outside a laboratory setting are reviewed and then an in-home technique for recording auditory brainstem responses (ABRs) and frequency-following responses (FFRs) in a home setting is introduced. As a proof of concept, we have conducted two in-home electrophysiological studies: one in 27 children aged 6 to 16 years (13 with autism spectrum disorder) and another in 12 young adults aged 18 to 27 years, using portable electrophysiological equipment to record ABRs and FFRs to click and speech stimuli, spanning rural and urban and multiple homes and testers. We validate our fieldwork approach by presenting waveforms and data on latencies and signal-to-noise ratio. Our findings demonstrate the feasibility and utility of home-based ABR/FFR techniques, paving the course for larger fieldwork investigations of populations that are difficult to test or recruit. We conclude this tutorial with practical tips and guidelines for recording ABRs and FFRs in the field and discuss possible clinical and research applications of this approach.

Neonatal Frequency-Following Responses: A Methodological Framework for Clinical Applications

The frequency-following response (FFR) to periodic complex sounds is a noninvasive scalp-recorded auditory evoked potential that reflects synchronous phase-locked neural activity to the spectrotemporal components of the acoustic signal along the ascending auditory hierarchy. The FFR has gained recent interest in the fields of audiology and auditory cognitive neuroscience, as it has great potential to answer both basic and applied questions about processes involved in sound encoding, language development, and communication. Specifically, it has become a promising tool in neonates, as its study may allow both early identification of future language disorders and the opportunity to leverage brain plasticity during the first 2 years of life, as well as enable early interventions to prevent and/or ameliorate sound and language encoding disorders. Throughout the present review, we summarize the state of the art of the neonatal FFR and, based on our own extensive experience, present methodological approaches to record it in a clinical environment. Overall, the present review is the first one that comprehensively focuses on the neonatal FFRs applications, thus supporting the feasibility to record the FFR during the first days of life and the predictive potential of the neonatal FFR on detecting short- and long-term language abilities and disruptions.

Language experience during the sensitive period narrows infants' sensory encoding of lexical tones-Music intervention reverses it

The sensitive period for phonetic learning (6∼12 months), evidenced by improved native speech processing and declined non-native speech processing, represents an early milestone in language acquisition. We examined the extent that sensory encoding of speech is altered by experience during this period by testing two hypotheses: (1) early sensory encoding of non-native speech declines as infants gain native-language experience, and (2) music intervention reverses this decline. We longitudinally measured the frequency-following response (FFR), a robust indicator of early sensory encoding along the auditory pathway, to a Mandarin lexical tone in 7- and 11-months-old monolingual English-learning infants. Infants received either no intervention (language-experience group) or music intervention (music-intervention group) randomly between FFR recordings. The language-experience group exhibited the expected decline in FFR pitch-tracking accuracy to the Mandarin tone, while the music-intervention group did not. Our results support both hypotheses and demonstrate that both language and music experiences alter infants' speech encoding.

Non-negative matrix factorization improves the efficiency of recording frequency-following responses in normal-hearing adults and neonates

OBJECTIVE

One challenge in extracting the scalp-recorded frequency-following response (FFR) is related to its inherently small amplitude, which means that the response cannot be identified with confidence when only a relatively small number of recording sweeps are included in the averaging procedure.

DESIGN

This study examined how the non-negative matrix factorisation (NMF) algorithm with a source separation constraint could be applied to improve the efficiency of FFR recordings. Conventional FFRs elicited by an English vowel/i/with a rising frequency contour were collected. Study sample: Fifteen normal-hearing adults and 15 normal-hearing neonates were recruited.

RESULTS

The improvements of FFR recordings, defined as the correlation coefficient and root-mean-square differences across a sweep series of amplitude spectrograms before and after the application of the source separation NMF (SSNMF) algorithm, were characterised through an exponential curve fitting model. Statistical analysis of variance indicated that the SSNMF algorithm was able to enhance the FFRs recorded in both groups of participants.

CONCLUSIONS

Such improvements enabled FFR extractions in a relatively small number of recording sweeps, and opened a new window to better understand how speech sounds are processed in the human brain.

Randomized Trial to Increase Speech Sound Differentiation in Infants Born Preterm

OBJECTIVE

To test whether infant-directed foreign language active learning would specifically increase speech sound differentiation to the intervention language while not decreasing differentiation in response to English.

STUDY DESIGN

Pilot randomized controlled trial of stable infants born preterm in the newborn intensive care unit with normal auditory brainstem responses, whose parents spoke only English and had no musical training or familial hearing abnormality. Assignment was to 1 of 3 groups: passive exposure to English infant-directed lullabies and readings (English-enrichment, control group) and contingent exposure by active sucking on a sensor-equipped pacifier to either infant-directed French lullabies and readings (English environment, French-contingent learning group) or infant-directed Mandarin lullabies and readings (English environment, Chinese-contingent learning group). The main outcome measures were preintervention and postintervention event-related potentials (ERPs) in response to standardized speech syllables in each language.

RESULTS

Forty-one subjects completed the study, including 15 in the English-enrichment control group and 13 each in the French-contingent and Chinese-contingent groups. The median gestational age at birth was 34 weeks (IQR, 8.75 weeks); postmenstrual age at intervention ranged from 36 to 46 weeks and was similar across the 3 groups. Postintervention mean ERP amplitude to pairs of English speech sounds did not differ across the 3 groups; however, ERP amplitude in French sound differentiation was greater in the French-contingent group than in the Chinese-contingent or English-enrichment groups, and ERP amplitude greater in Chinese sound differentiation was greater in the Chinese-contingent group compared with the other 2 groups.

CONCLUSION

Contingent infant-directed foreign language exposure increased speech sound differentiation specific to the intervention language and did not decrease differentiation in response to English.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT03232931.

Deficient neural encoding of speech sounds in term neonates born after fetal growth restriction

Infants born after fetal growth restriction (FGR)-an obstetric condition defined as the failure to achieve the genetic growth potential-are prone to neurodevelopmental delays, with language being one of the major affected areas. Yet, while verbal comprehension and expressive language impairments have been observed in FGR infants, children and even adults, specific related impairments at birth, such as in the ability to encode the sounds of speech, necessary for language acquisition, remain to be disclosed. Here, we used the frequency-following response (FFR), a brain potential correlate of the neural phase locking to complex auditory stimuli, to explore the encoding of speech sounds in FGR neonates. Fifty-three neonates born with FGR and 48 controls born with weight adequate-for-gestational age (AGA) were recruited. The FFR was recorded to the consonant-vowel stimulus (/da/) during sleep and quantified as the spectral amplitude to the fundamental frequency of the syllable and its signal-to-noise ratio (SNR). The outcome was available in 45 AGA and 51 FGR neonates, yielding no differences for spectral amplitudes. However, SNR was strongly attenuated in the FGR group compared to the AGA group at the vowel region of the stimulus. These findings suggest that FGR population present a deficit in the neural pitch tracking of speech sounds already present at birth. Our results pave the way for future research on the potential clinical use of the FFR in this population, so that if confirmed, a disrupted FFR recorded at birth may help deriving FGR neonates at risk for postnatal follow-ups.

Separating the Novel Speech Sound Perception of Lexical Tone Chimeras From Their Auditory Signal Manipulations: Behavioral and Electroencephalographic Evidence

Previous research has shown the novelty of lexical-tone chimeras (artificially constructed speech sounds created by combining normal speech sounds of a given language) to native speakers of the language from which the chimera components were drawn. However, the source of such novelty remains unclear. Our goal in this study was to separate the effects of chimeric tonal novelty in Mandarin speech from the effects of auditory signal manipulations. We recruited 20 native speakers of Mandarin and constructed two sets of lexical-tone chimeras by interchanging the envelopes and fine structures of both a falling/yi⁴/and a rising/yi²/Mandarin tone through 1, 2, 3, 4, 6, 8, 16, 32, and 64 auditory filter banks. We conducted pitch-perception ability tasks via a two-alternative, forced-choice paradigm to produce behavioral (versus physiological) pitch perception data. We also obtained electroencephalographic measurements through the scalp-recorded frequency-following response (FFR). Analyses of variances and post hoc Greenhouse-Geisser procedures revealed that the differences observed in the participants' reaction times and FFR measurements were attributable primarily to chimeric novelty rather than signal manipulation effects. These findings can be useful in assessing neuroplasticity and developing speech-processing strategies.

The Accuracy of Envelope Following Responses in Predicting Speech Audibility

OBJECTIVES

The present study aimed to (1) evaluate the accuracy of envelope following responses (EFRs) in predicting speech audibility as a function of the statistical indicator used for objective response detection, stimulus phoneme, frequency, and level, and (2) quantify the minimum sensation level (SL; stimulus level above behavioral threshold) needed for detecting EFRs.

DESIGN

In 21 participants with normal hearing, EFRs were elicited by 8 band-limited phonemes in the male-spoken token /susa∫i/ (2.05 sec) presented between 20 and 65 dB SPL in 15 dB increments. Vowels in /susa∫i/ were modified to elicit two EFRs simultaneously by selectively lowering the fundamental frequency (f0) in the first formant (F1) region. The modified vowels elicited one EFR from the low-frequency F1 and another from the mid-frequency second and higher formants (F2+). Fricatives were amplitude-modulated at the average f0. EFRs were extracted from single-channel EEG recorded between the vertex (Cz) and the nape of the neck when /susa∫i/ was presented monaurally for 450 sweeps. The performance of the three statistical indicators, F-test, Hotelling's T, and phase coherence, was compared against behaviorally determined audibility (estimated SL, SL ≥0 dB = audible) using area under the receiver operating characteristics (AUROC) curve, sensitivity (the proportion of audible speech with a detectable EFR [true positive rate]), and specificity (the proportion of inaudible speech with an undetectable EFR [true negative rate]). The influence of stimulus phoneme, frequency, and level on the accuracy of EFRs in predicting speech audibility was assessed by comparing sensitivity, specificity, positive predictive value (PPV; the proportion of detected EFRs elicited by audible stimuli) and negative predictive value (NPV; the proportion of undetected EFRs elicited by inaudible stimuli). The minimum SL needed for detection was evaluated using a linear mixed-effects model with the predictor variables stimulus and EFR detection p value.

RESULTS

of the 3 statistical indicators were similar; however, at the type I error rate of 5%, the sensitivities of Hotelling's T (68.4%) and phase coherence (68.8%) were significantly higher than the F-test (59.5%). In contrast, the specificity of the F-test (97.3%) was significantly higher than the Hotelling's T (88.4%). When analyzed using Hotelling's T as a function of stimulus, fricatives offered higher sensitivity (88.6 to 90.6%) and NPV (57.9 to 76.0%) compared with most vowel stimuli (51.9 to 71.4% and 11.6 to 51.3%, respectively). When analyzed as a function of frequency band (F1, F2+, and fricatives aggregated as low-, mid- and high-frequencies, respectively), high-frequency stimuli offered the highest sensitivity (96.9%) and NPV (88.9%). When analyzed as a function of test level, sensitivity improved with increases in stimulus level (99.4% at 65 dB SPL). The minimum SL for EFR detection ranged between 13.4 and 21.7 dB for F1 stimuli, 7.8 to 12.2 dB for F2+ stimuli, and 2.3 to 3.9 dB for fricative stimuli.

CONCLUSIONS

EFR-based inference of speech audibility requires consideration of the statistical indicator used, phoneme, stimulus frequency, and stimulus level.

Effect of Auditory Maturation on the Encoding of a Speech Syllable in the First Days of Life

(1) Background: In neonates and infants, the physiological modifications associated with language development are reflected in their Frequency Following Responses (FFRs) in the first few months of life. (2) Objective: This study aimed to test the FFRs of infants in the first 45 days of life in order to evaluate how auditory maturation affects the encoding of a speech syllable. (3) Method: In total, 80 healthy, normal-hearing infants, aged 3 to 45 days old, participated in this study. The sample was divided into three groups: GI, 38 neonates from 3 to 15 days; GII, 25 infants from 16 to 30 days; and GIII, 17 infants from 31 to 45 days. All participants underwent FFR testing. Results: With age, there was a decrease in the latency of all FFR waves, with statistically significant differences among the groups studied for waves V, A, E, F, and O. The mean amplitudes showed an increase, with a statistically significant difference only for wave V. The slope measure increased over the 45 days, with a statistically significant difference between GIII and GI and between GIII and GII. (4) Conclusions: The encoding of a speech sound changes with auditory maturation over the first 45 days of an infant’s life.

Frequency-Following Response in Newborns and Infants: A Systematic Review of Acquisition Parameters

Purpose The purpose of this study is to characterize parameters used for frequency-following response (FFR) acquisition in children up to 24 months of age through a systematic review. Method The study was registered in PROSPERO and followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses' recommendations. Search was performed in six databases (LILACS, LIVIVO, PsycINFO, PubMed, Scopus, and Web of Science) and gray literature (Google Scholar, OpenGrey, ProQuest)as well as via manual searches in bibliographic references. Observational studies using speech stimuli to elicit the FFR in infants with normal hearing on the age range from 0 until 24 months were included. No restrictions regarding language and year of publication were applied. Risk of bias was assessed with the Joanna Briggs Institute Critical Appraisal Checklist. Data on stimulus, presentation rate, time window for analysis, number of sweeps, artifact rejection, online filters, stimulated ear, and examination condition were extracted. Results Four hundred fifty-nine studies were identified. After removing duplicates and reading titles and abstracts, 15 articles were included. Seven studies were classified as low risk of bias, seven as moderate risk, and one as high risk. Conclusions There is a consensus in the use of some acquisition parameters of the FFR with speech stimulus, such as the vertical mounting, the use of alternating polarity, a sampling rate of 20000 Hz, and the /da/ synthesized syllable of 40 ms in duration as the preferred stimulus. Although these parameters show some consensus, the results disclosed lack of a single established protocol for FFR acquisition with speech stimulus in infants in the investigated age range.

Relationships between click auditory brainstem response and speech frequency following response with development in infants born preterm

The speech evoked frequency following response (sFFR) is used to study relationships between neural processing and functional aspects of speech and language that are not captured by click or toneburst evoked auditory brainstem responses (ABR). The sFFR is delayed, deviant, or weak in school age children having a variety of disorders, including autism, dyslexia, reading and language disorders, in relation to their typically developing peers. Much less is known about the developmental characteristics of sFFR, especially in preterm infants, who are at risk of having language delays. In term neonates, phase locking and spectral representation of the fundamental frequency is developed in the early days of life. Spectral representation of higher harmonics and latencies associated with transient portions of the stimulus are still developing in term infants through at least 10 months of age. The goal of this research was to determine whether sFFR could be measured in preterm infants and to characterize its developmental trajectory in the time and frequency domain. Click ABR and sFFR were measured in 28 preterm infants at ages 33 to 64 weeks gestational age. The sFFR could be measured in the majority of infants at 33 weeks gestational age, and the detectability of all sFFR waves was 100% by 64 weeks gestational age. The latency of all waves associated with the transient portion of the response (waves V, A, and O), and most waves (waves D and E) associated with the quasi-steady state decreased with increasing age. The interpeak wave A-O latency did not change with age, indicating that these waves share a neural generator, or the neural generators are developing at the same rate. The spectral amplitude of F₀ and the lower frequencies of the first formant increased with age, but that for higher frequencies of the first formant and higher harmonics did not. The results suggest that the sFFR can be reliably recorded in preterm infants, including those cared for in the neonatal intensive care unit. These findings support that in preterm infants, F₀ amplitude continues to develop within the first 6 months of life and develops before efficient representation of higher frequency harmonics. Further research is needed to determine if the sFFR in preterm infants is predictive of long-term language or learning disorders.

Neural encoding of voice pitch and formant structure at birth as revealed by frequency-following responses

Detailed neural encoding of voice pitch and formant structure plays a crucial role in speech perception, and is of key importance for an appropriate acquisition of the phonetic repertoire in infants since birth. However, the extent to what newborns are capable of extracting pitch and formant structure information from the temporal envelope and the temporal fine structure of speech sounds, respectively, remains unclear. Here, we recorded the frequency-following response (FFR) elicited by a novel two-vowel, rising-pitch-ending stimulus to simultaneously characterize voice pitch and formant structure encoding accuracy in a sample of neonates and adults. Data revealed that newborns tracked changes in voice pitch reliably and no differently than adults, but exhibited weaker signatures of formant structure encoding, particularly at higher formant frequency ranges. Thus, our results indicate a well-developed encoding of voice pitch at birth, while formant structure representation is maturing in a frequency-dependent manner. Furthermore, we demonstrate the feasibility to assess voice pitch and formant structure encoding within clinical evaluation times in a hospital setting, and suggest the possibility to use this novel stimulus as a tool for longitudinal developmental studies of the auditory system.

Characteristics of Speech-Evoked Envelope Following Responses in Infancy

Envelope following responses (EFRs) may be a useful tool for evaluating the audibility of speech sounds in infants. The present study aimed to evaluate the characteristics of speech-evoked EFRs in infants with normal hearing, relative to adults, and identify age-dependent changes in EFR characteristics during infancy. In 42 infants and 21 young adults, EFRs were elicited by the first (F1) and the second and higher formants (F2+) of the vowels /u/, /a/, and /i/, dominant in low and mid frequencies, respectively, and by amplitude-modulated fricatives /s/ and /∫/, dominant in high frequencies. In a subset of 20 infants, the in-ear stimulus level was adjusted to match that of an average adult ear (65 dB sound pressure level [SPL]). We found that (a) adult-infant differences in EFR amplitude, signal-to-noise ratio, and intertrial phase coherence were larger and spread across the frequency range when in-ear stimulus level was adjusted in infants, (b) adult-infant differences in EFR characteristics were the largest for low-frequency stimuli, (c) infants demonstrated adult-like phase coherence when they received a higher (i.e., unadjusted) stimulus level, and (d) EFR phase coherence and signal-to-noise ratio changed with age in the first year of life for a few F2+ vowel stimuli in a level-specific manner. Together, our findings reveal that development-related changes in EFRs during infancy likely vary by stimulus frequency, with low-frequency stimuli demonstrating the largest adult-infant differences. Consistent with previous research, our findings emphasize the significant role of stimulus level calibration methods while investigating developmental trends in EFRs.

Characteristics of the Frequency-Following Response to Speech in Neonates and Potential Applicability in Clinical Practice: A Systematic Review

Purpose We sought to critically analyze and evaluate published evidence regarding feasibility and clinical potential for predicting neurodevelopmental outcomes of the frequency-following responses (FFRs) to speech recordings in neonates (birth to 28 days). Method A systematic search of MeSH terms in the Cumulative Index to Nursing and Allied HealthLiterature, Embase, Google Scholar, Ovid Medline (R) and E-Pub Ahead of Print, In-Process & Other Non-Indexed Citations and Daily, Web of Science, SCOPUS, COCHRANE Library, and ClinicalTrials.gov was performed. Manual review of all items identified in the search was performed by two independent reviewers. Articles were evaluated based on the level of methodological quality and evidence according to the RTI item bank. Results Seven articles met inclusion criteria. None of the included studies reported neurodevelopmental outcomes past 3 months of age. Quality of the evidence ranged from moderate to high. Protocol variations were frequent. Conclusions Based on this systematic review, the FFR to speech can capture both temporal and spectral acoustic features in neonates. It can accurately be recorded in a fast and easy manner at the infant's bedside. However, at this time, further studies are needed to identify and validate which FFR features could be incorporated as an addition to standard evaluation of infant sound processing evaluation in subcortico-cortical networks. This review identifies the need for further research focused on identifying specific features of the neonatal FFRs, those with predictive value for early childhood outcomes to help guide targeted early speech and hearing interventions.

Evolving perspectives on the sources of the frequency-following response

The auditory frequency-following response (FFR) is a non-invasive index of the fidelity of sound encoding in the brain, and is used to study the integrity, plasticity, and behavioral relevance of the neural encoding of sound. In this Perspective, we review recent evidence suggesting that, in humans, the FFR arises from multiple cortical and subcortical sources, not just subcortically as previously believed, and we illustrate how the FFR to complex sounds can enhance the wider field of auditory neuroscience. Far from being of use only to study basic auditory processes, the FFR is an uncommonly multifaceted response yielding a wealth of information, with much yet to be tapped.

Analyzing the FFR: A tutorial for decoding the richness of auditory function

The frequency-following response, or FFR, is a neurophysiological response to sound that precisely reflects the ongoing dynamics of sound. It can be used to study the integrity and malleability of neural encoding of sound across the lifespan. Sound processing in the brain can be impaired with pathology and enhanced through expertise. The FFR can index linguistic deprivation, autism, concussion, and reading impairment, and can reflect the impact of enrichment with short-term training, bilingualism, and musicianship. Because of this vast potential, interest in the FFR has grown considerably in the decade since our first tutorial. Despite its widespread adoption, there remains a gap in the current knowledge of its analytical potential. This tutorial aims to bridge this gap. Using recording methods we have employed for the last 20 + years, we have explored many analysis strategies. In this tutorial, we review what we have learned and what we think constitutes the most effective ways of capturing what the FFR can tell us. The tutorial covers FFR components (timing, fundamental frequency, harmonics) and factors that influence FFR (stimulus polarity, response averaging, and stimulus presentation/recording jitter). The spotlight is on FFR analyses, including ways to analyze FFR timing (peaks, autocorrelation, phase consistency, cross-phaseogram), magnitude (RMS, SNR, FFT), and fidelity (stimulus-response correlations, response-to-response correlations and response consistency). The wealth of information contained within an FFR recording brings us closer to understanding how the brain reconstructs our sonic world.

Systematic Review of Auditory Training in Pediatric Cochlear Implant Recipients

Objective The purpose of this systematic review is to evaluate the published research in auditory training (AT) for pediatric cochlear implant (CI) recipients. This review investigates whether AT in children with CIs leads to improvements in speech and language development, cognition, and/or quality of life and whether improvements, if any, remain over time post AT intervention. Method A systematic search of 7 databases identified 96 review articles published up until January 2017, 9 of which met the inclusion criteria. Data were extracted and independently assessed for risk of bias and quality of study against a PICOS (participants, intervention, control, outcomes, and study) framework. Results All studies reported improvements in trained AT tasks, including speech discrimination/identification and working memory. Retention of improvements over time was found whenever it was assessed. Transfer of learning was measured in 4 of 6 studies, which assessed generalization. Quality of life was not assessed. Overall, evidence for the included studies was deemed to be of low quality. Conclusion Benefits of AT were illustrated through the improvement in trained tasks, and this was observed in all reviewed studies. Transfer of improvement to other domains and also retention of benefits post AT were evident when assessed, although rarely done. However, higher quality evidence to further examine outcomes of AT in pediatric CI recipients is needed.

Brainstem auditory evoked potentials with speech stimulus in neonates

INTRODUCTION

Brainstem auditory evoked potentials in response to complex sounds, such as speech sounds, investigate the neural representation of these sounds at subcortical levels, and faithfully reflect the stimulus characteristics. However, there are few studies that utilize this type of stimulus; for it to be used in clinical practice it is necessary to establish standards of normality through studies performed in different populations.

OBJECTIVE

To analyze the latencies and amplitudes of the waves obtained from the tracings of brainstem auditory evoked potentials using speech stimuli in Brazilian neonates with normal hearing and without auditory risk factors.

METHODS

21 neonates with a mean age of 9 days without risk of hearing loss and with normal results at the neonatal hearing screening were evaluated according to the Joint Committee on Infant Hearing protocols. Auditory evoked potentials were performed with speech stimuli (/da/ syllable) at the intensity of 80 dBNA and the latency and amplitude of the waves obtained were analyzed.

RESULTS

In the transient portion, we observed a 100% response rate for all analyzable waves (Wave I, Wave III, Wave V and Wave A), and these waves exhibited a latency <10ms. In the sustained portion, Wave B was identified in 53.12% of subjects; Wave C in 75%; Wave D in 90.62%; Wave E in 96.87%; Wave F in 87.5% and Wave O was identified in 87.5% of subjects. The observed latency of these waves ranged from 11.51ms to 52.16ms. Greater similarity was observed for the response latencies, as well as greater amplitude variation in the studied group.

CONCLUSIONS

Although the wave morphology obtained for brainstem evoked potentials with speech stimulation in neonates is quite similar to that of adults, a longer latency and greater variation in amplitude were observed in the waves analyzed.

Effects of Inter-Stimulus Interval on Speech-Evoked Frequency-Following Response in Elderly Adults

Background: The speech-evoked frequency following response (FFR) has shown to be useful in assessing complex auditory processing abilities and in different age groups. While many aspects of FFR have been studied extensively, the effect of timing, as measured by inter-stimulus-interval (ISI), especially in the older adult population, has yet to be thoroughly investigated. Objective: The purpose of this study was to examine the effects of different ISIs on speech evoked FFR in older and younger adults who speak a tonal language, and to investigate whether the older adults' FFR were more susceptible to the change in ISI. Materials and Methods: Twenty-two normal hearing participants were recruited in our study, including 11 young adult participants and 11 elderly participants. An Intelligent Hearing Systems Smart EP evoke potential system was used to record the FFR in four ISI conditions (40, 80, 120 and 160 ms). A recorded natural speech token with a falling tone /yi/ was used as the stimulus. Two indices, stimulus-to-response correlation coefficient and pitch strength, were used to quantify the FFR responses. Two-way analysis of variance (ANOVA) was used to analyze the differences in different age groups and different ISI conditions. Results: There was no significant difference in stimulus-to-response correlation coefficient and pitch strength among the different ISI conditions, in either age groups. Older adults appeared to have weaker FFR for all ISI conditions when compared to their younger adult counterparts. Conclusion: Shorter ISIs did not result in worse FFRs from older adults or younger adults. For speech-evoked FFR using a recorded natural speech token that is 250 ms in length, an ISI of as short as 40 ms appeared to be sufficient and effective to record FFR for elderly adults.

Temporal Coding of Voice Pitch Contours in Mandarin Tones

Accurate perception of time-variant pitch is important for speech recognition, particularly for tonal languages with different lexical tones such as Mandarin, in which different tones convey different semantic information. Previous studies reported that the auditory nerve and cochlear nucleus can encode different pitches through phase-locked neural activities. However, little is known about how the inferior colliculus (IC) encodes the time-variant periodicity pitch of natural speech. In this study, the Mandarin syllable /ba/ pronounced with four lexical tones (flat, rising, falling then rising and falling) were used as stimuli. Local field potentials (LFPs) and single neuron activity were simultaneously recorded from 90 sites within contralateral IC of six urethane-anesthetized and decerebrate guinea pigs in response to the four stimuli. Analysis of the temporal information of LFPs showed that 93% of the LFPs exhibited robust encoding of periodicity pitch. Pitch strength of LFPs derived from the autocorrelogram was significantly (p < 0.001) stronger for rising tones than flat and falling tones. Pitch strength are also significantly increased (p < 0.05) with the characteristic frequency (CF). On the other hand, only 47% (42 or 90) of single neuron activities were significantly synchronized to the fundamental frequency of the stimulus suggesting that the temporal spiking pattern of single IC neuron could encode the time variant periodicity pitch of speech robustly. The difference between the number of LFPs and single neurons that encode the time-variant F0 voice pitch supports the notion of a transition at the level of IC from direct temporal coding in the spike trains of individual neurons to other form of neural representation.

Development of Phase Locking and Frequency Representation in the Infant Frequency-Following Response

PURPOSE

This study investigates the development of phase locking and frequency representation in infants using the frequency-following response to consonant-vowel syllables.

METHOD

The frequency-following response was recorded in 56 infants and 15 young adults to 2 speech syllables (/ba/ and /ga/), which were presented in randomized order to the right ear. Signal-to-noise ratio and Fsp analyses were used to verify that individual responses were present above the noise floor. Thirty-six and 39 infants met these criteria for the /ba/ or /ga/ syllables, respectively, and 31 infants met the criteria for both syllables. Data were analyzed to obtain measures of phase-locking strength and spectral magnitudes.

RESULTS

Phase-locking strength to the fine structure in the consonant-vowel transition was higher in young adults than in infants, but phase locking was equivalent at the fundamental frequency between infants and adults. However, frequency representation of the fundamental frequency was higher in older infants than in either the younger infants or adults.

CONCLUSION

Although spectral amplitudes changed during the first year of life, no changes were found with respect to phase locking to the stimulus envelope. These findings demonstrate the feasibility of obtaining these measures of phase locking and fundamental pitch strength in infants as young as 2 months of age.

Hidden Markov modeling of frequency-following responses to Mandarin lexical tones

BACKGROUND

The frequency-following response (FFR) is a scalp-recorded electrophysiological potential reflecting phase-locked activity from neural ensembles in the auditory system. The FFR is often used to assess the robustness of subcortical pitch processing. Due to low signal-to-noise ratio at the single-trial level, FFRs are typically averaged across thousands of stimulus repetitions. Prior work using this approach has shown that subcortical encoding of linguistically-relevant pitch patterns is modulated by long-term language experience.

NEW METHOD

We examine the extent to which a machine learning approach using hidden Markov modeling (HMM) can be utilized to decode Mandarin tone-categories from scalp-record electrophysiolgical activity. We then assess the extent to which the HMM can capture biologically-relevant effects (language experience-driven plasticity). To this end, we recorded FFRs to four Mandarin tones from 14 adult native speakers of Chinese and 14 of native English. We trained a HMM to decode tone categories from the FFRs with varying size of averages.

RESULTS AND COMPARISONS WITH EXISTING METHODS

Tone categories were decoded with above-chance accuracies using HMM. The HMM derived metric (decoding accuracy) revealed a robust effect of language experience, such that FFRs from native Chinese speakers yielded greater accuracies than native English speakers. Critically, the language experience-driven plasticity was captured with average sizes significantly smaller than those used in the extant literature.

CONCLUSIONS

Our results demonstrate the feasibility of HMM in assessing the robustness of neural pitch. Machine-learning approaches can complement extant analytical methods that capture auditory function and could reduce the number of trials needed to capture biological phenomena.

Stability and plasticity in neural encoding of linguistically relevant pitch patterns

While lifelong language experience modulates subcortical encoding of pitch patterns, there is emerging evidence that short-term training introduced in adulthood also shapes subcortical pitch encoding. Here we use a cross-language design to examine the stability of language experience-dependent subcortical plasticity over multiple days. We then examine the extent to which behavioral relevance induced by sound-to-category training leads to plastic changes in subcortical pitch encoding in adulthood relative to adolescence, a period of ongoing maturation of subcortical and cortical auditory processing. Frequency-following responses (FFRs), which reflect phase-locked activity from subcortical neural ensembles, were elicited while participants passively listened to pitch patterns reflective of Mandarin tones. In experiment 1, FFRs were recorded across three consecutive days from native Chinese-speaking (n = 10) and English-speaking (n = 10) adults. In experiment 2, FFRs were recorded from native English-speaking adolescents (n = 20) and adults (n = 15) before, during, and immediately after a session of sound-to-category training, as well as a day after training ceased. Experiment 1 demonstrated the stability of language experience-dependent subcortical plasticity in pitch encoding across multiple days of passive exposure to linguistic pitch patterns. In contrast, experiment 2 revealed an enhancement in subcortical pitch encoding that emerged a day after the sound-to-category training, with some developmental differences observed. Taken together, these findings suggest that behavioral relevance is a critical component for the observation of plasticity in the subcortical encoding of pitch.NEW & NOTEWORTHY We examine the timescale of experience-dependent auditory plasticity to linguistically relevant pitch patterns. We find extreme stability in lifelong experience-dependent plasticity. We further demonstrate that subcortical function in adolescents and adults is modulated by a single session of sound-to-category training. Our results suggest that behavioral relevance is a necessary ingredient for neural changes in pitch encoding to be observed throughout human development. These findings contribute to the neurophysiological understanding of long- and short-term experience-dependent modulation of pitch.

Correlation between the frequency difference limen and an index based on principal component analysis of the frequency-following response of normal hearing listeners

Subcortical phase locking tends to reflect performance differences in tasks related to pitch perception across different types of populations. Enhancement or attenuation in its strength may correspond to population excellence or deficiency in pitch perception. However, it is still unclear whether differences in perceptual capability among individuals with normal hearing can be predicted by subcortical phase locking. In this study, we examined the brain-behavior relationship between frequency-following responses (FFRs) evoked by pure/sweeping tones and frequency difference limens (FDLs). FFRs are considered to reflect subcortical phase locking, and FDLs are a psychophysical measure of behavioral performance in pitch discrimination. Traditional measures of FFR strength were found to be poorly correlated with FDL. Here, we introduced principal component analysis into FFR analysis and extracted an FFR component that was correlated with individual pitch discrimination. The absolute value of the score of this FFR principal component (but not the original score) was negatively correlated with FDL, regardless of stimulus type. The topographic distribution of this component was relatively constant across individuals and across stimulus types, and the inferior colliculus was identified as its origin. The findings suggest that subcortical phase locking at certain but not all FFR generators carries the neural information required for the prediction of individual pitch perception among humans with normal hearing.

Voice Pitch Elicited Frequency Following Response in Chinese Elderlies

Background: Perceptual and electrophysiological studies have found reduced speech discrimination in quiet and noisy environment, delayed neural timing, decreased neural synchrony, and decreased temporal processing ability in elderlies, even those with normal hearing. However, recent studies have also demonstrated that language experience and auditory training enhance the temporal dynamics of sound encoding in the auditory brainstem response (ABR). The purpose of this study was to explore the pitch processing ability at the brainstem level in an aging population that has a tonal language background.

Method: Mandarin speaking younger (n = 12) and older (n = 12) adults were recruited for this study. All participants had normal audiometric test results and normal suprathreshold click-evoked ABR. To record frequency following responses (FFRs) elicited by Mandarin lexical tones, two Mandarin Chinese syllables with different fundamental frequency pitch contours (Flat Tone and Falling Tone) were presented at 70 dB SPL. Fundamental frequencies (f0) of both the stimulus and the responses were extracted and compared to individual brainstem responses. Two indices were used to examine different aspects of pitch processing ability at the brainstem level: Pitch Strength and Pitch Correlation.

Results: Lexical tone elicited FFR were overall weaker in the older adult group compared to their younger adult counterpart. Measured by Pitch Strength and Pitch Correlation, statistically significant group differences were only found when the tone with a falling f0 (Falling Tone) were used as the stimulus.

Conclusion: Results of this study demonstrated that in a tonal language speaking population, pitch processing ability at the brainstem level of older adults are not as strong and robust as their younger counterparts. Findings of this study are consistent with previous reports on brainstem responses of older adults whose native language is English. On the other hand, lexical tone elicited FFRs have been shown to correlate with the length of language exposure. Older adults’ degraded responses in our study may also be due to that, the Mandarin speaking older adults’ long term exposure somewhat counteracted the negative impact on aging and helped maintain, or at least reduced, the degradation rate in their temporal processing capacity at the brainstem level.

Subcortical neural representation to Mandarin pitch contours in American and Chinese newborns

Voice pitch carries important information for speech understanding. This study examines the neural representation of voice pitch at the subcortical level, as reflected by the scalp-recorded frequency-following responses from ten American and ten Chinese newborns. By utilizing a set of four distinctive Mandarin pitch contours that mimic the English vowel /yi/, the results indicate that the rising and dipping pitch contours produce significantly better tracking accuracy and larger response amplitudes than the falling pitch contour. This finding suggests a hierarchy of potential stimuli when testing neonates who are born in a tonal or non-tonal linguistic environment.

Development of Subcortical Pitch Representation in Three-Month-Old Chinese Infants

This study investigated the development of subcortical pitch processing, as reflected by the scalp-recorded frequency-following response, during early infancy. Thirteen Chinese infants who were born and raised in Mandarin-speaking households were recruited to partake in this study. Through a prospective-longitudinal study design, infants were tested twice: at 1-3 days after birth and at three months of age. A set of four contrastive Mandarin pitch contours were used to elicit frequency-following responses. Frequency Error and Pitch Strength were derived to represent the accuracy and magnitude of the elicited responses. Paired-samples t tests were conducted and demonstrated a significant decrease in Frequency Error and a significant increase in Pitch Strength at three months of age compared to 1-3 days after birth. Results indicated the developmental trajectory of subcortical pitch processing during the first three months of life.