Predictive processing of pitch trends in newborn infants

Predictive processing of music and language in autism: Evidence from Mandarin and English speakers

Atypical predictive processing has been associated with autism across multiple domains, based mainly on artificial antecedents and consequents. As structured sequences where expectations derive from implicit learning of combinatorial principles, language and music provide naturalistic stimuli for investigating predictive processing. In this study, we matched melodic and sentence stimuli in cloze probabilities and examined musical and linguistic prediction in Mandarin- (Experiment 1) and English-speaking (Experiment 2) autistic and non-autistic individuals using both production and perception tasks. In the production tasks, participants listened to unfinished melodies/sentences and then produced the final notes/words to complete these items. In the perception tasks, participants provided expectedness ratings of the completed melodies/sentences based on the most frequent notes/words in the norms. While Experiment 1 showed intact musical prediction but atypical linguistic prediction in autism in the Mandarin sample that demonstrated imbalanced musical training experience and receptive vocabulary skills between groups, the group difference disappeared in a more closely matched sample of English speakers in Experiment 2. These findings suggest the importance of taking an individual differences approach when investigating predictive processing in music and language in autism, as the difficulty in prediction in autism may not be due to generalized problems with prediction in any type of complex sequence processing.

Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates

The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.

Auditory learning of recurrent tone sequences is present in the newborn's brain

The seemingly effortless ability of our auditory system to rapidly detect new events in a dynamic environment is crucial for survival. Whether the underlying brain processes are innate is unknown. To answer this question, electroencephalography was recorded while regularly patterned (REG) versus random (RAND) tone sequences were presented to sleeping neonates. Regular relative to random sequences elicited differential neural responses after only a single repetition of the pattern indicating the existence of an innate capacity of the auditory system to detect auditory sequential regularities. We show that the newborn auditory system accumulates evidence only somewhat longer than the minimum amount determined by the ideal Bayesian observer model (the prediction from a variable-order Markov chain model) before detecting a repeating pattern. Thus, newborns can quickly form representations for regular features of the sound input, preparing the way for learning the contingencies of the environment.

Phonemic mismatch negativity mediates the association between phoneme awareness and character reading ability in young Chinese children

Poor phonological awareness is associated with greater risk for reading disability. The underlying neural mechanism of such association may lie in the brain processing of phonological information. Lower amplitude of auditory mismatch negativity (MMN) has been associated with poor phonological awareness and with the presence of reading disability. The current study recorded auditory MMN to phoneme and lexical tone contrast with odd-ball paradigm and examined whether auditory MMN mediated the associations between phonological awareness and character reading ability through a three-year longitudinal study in 78 native Mandarin-speaking kindergarten children. Hierarchical linear regression and mediation analyses showed that the effect of phoneme awareness on the character reading ability was mediated by the phonemic MMN in young Chinese children. Findings underscore the key role of phonemic MMN as the underlying neurodevelopmental mechanism linking phoneme awareness and reading ability.

Prerequisites of language acquisition in the newborn brain

Learning to decode and produce speech is one of the most demanding tasks faced by infants. Nevertheless, infants typically utter their first words within a year, and phrases soon follow. Here we review cognitive abilities of newborn infants that promote language acquisition, focusing primarily on studies tapping neural activity. The results of these studies indicate that infants possess core adult auditory abilities already at birth, including statistical learning and rule extraction from variable speech input. Thus, the neonatal brain is ready to categorize sounds, detect word boundaries, learn words, and separate speech streams: in short, to acquire language quickly and efficiently from everyday linguistic input.

Neural phoneme discrimination in variable speech in newborns - Associations with dyslexia risk and later language skills

A crucial skill in infant language acquisition is learning of the native language phonemes. This requires the ability to group complex sounds into distinct auditory categories based on their shared features. Problems in phonetic learning have been suggested to underlie language learning difficulties in dyslexia, a developmental reading-skill deficit. We investigated auditory abilities important for language acquisition in newborns with or without a familial risk for dyslexia with electrophysiological mismatch responses (MMRs). We presented vowel changes in a sequence of acoustically varying vowels, requiring grouping of the stimuli to two phoneme categories. The vowel changes elicited an MMR which was significantly diminished in infants whose parents had the most severe dyslexia in our sample. Phoneme-MMR amplitude and its hemispheric lateralization were associated with language test outcomes assessed at 28 months, an age at which it becomes possible to behaviourally test children and several standardized tests are available. In addition, statistically significant MMRs to violations of a complex sound-order rule were only found in infants without dyslexia risk, but these results are very preliminary due to small sample size. The results demonstrate the relevance of the newborn infants' readiness for phonetic learning for their emerging language skills. Phoneme extraction difficulties in infants at familial risk may contribute to the phonological deficits observed in dyslexia.

Challenges and new perspectives of developmental cognitive EEG studies

Despite shared procedures with adults, electroencephalography (EEG) in early development presents many specificities that need to be considered for good quality data collection. In this paper, we provide an overview of the most representative early cognitive developmental EEG studies focusing on the specificities of this neuroimaging technique in young participants, such as attrition and artifacts. We also summarize the most representative results in developmental EEG research obtained in the time and time-frequency domains and use more advanced signal processing methods. Finally, we briefly introduce three recent standardized pipelines that will help promote replicability and comparability across experiments and ages. While this paper does not claim to be exhaustive, it aims to give a sufficiently large overview of the challenges and solutions available to conduct robust cognitive developmental EEG studies.

More efficient formation of longer-term representations for word forms at birth can be linked to better language skills at 2 years

Infants are able to extract words from speech early in life. Here we show that the quality of forming longer-term representations for word forms at birth predicts expressive language ability at the age of two years. Seventy-five neonates were familiarized with two spoken disyllabic pseudowords. We then tested whether the neonate brain predicts the second syllable from the first one by presenting a familiarized pseudoword frequently, and occasionally violating the learned syllable combination by different rare pseudowords. Distinct brain responses were elicited by predicted and unpredicted word endings, suggesting that the neonates had learned the familiarized pseudowords. The difference between responses to predicted and unpredicted pseudowords indexing the quality of word-form learning during familiarization significantly correlated with expressive language scores (the mean length of utterance) at 24 months in the same infant. These findings suggest that 1) neonates can memorize disyllabic words so that a learned first syllable generates predictions for the word ending, and 2) early individual differences in the quality of word-form learning correlate with language skills. This relationship helps early identification of infants at risk for language impairment.

Relevance to the higher order structure may govern auditory statistical learning in neonates

Hearing is one of the earliest senses to develop and is quite mature by birth. Contemporary theories assume that regularities in sound are exploited by the brain to create internal models of the environment. Through statistical learning, internal models extrapolate from patterns to predictions about subsequent experience. In adults, altered brain responses to sound enable us to infer the existence and properties of these models. In this study, brain potentials were used to determine whether newborns exhibit context-dependent modulations of a brain response that can be used to infer the existence and properties of internal models. Results are indicative of significant context-dependence in the responsivity to sound in newborns. When common and rare sounds continue in stable probabilities over a very long period, neonates respond to all sounds equivalently (no differentiation). However, when the same common and rare sounds at the same probabilities alternate over time, the neonate responses show clear differentiations. The context-dependence is consistent with the possibility that the neonate brain produces more precise internal models that discriminate between contexts when there is an emergent structure to be discovered but appears to adopt broader models when discrimination delivers little or no additional information about the environment.

The sound of silence: Predictive error responses to unexpected sound omission in adults

The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.

Developmental course of the repetition effect and change detection responses from infancy through childhood: a longitudinal study

Neuronal repetition effect (repetition suppression and repetition enhancement) and change detection responses are fundamental brain responses that have implications in learning and cognitive development in infants and children. Studies have shown altered neuronal repetition and change detection responses in various clinical populations. However, the developmental course of these neuronal responses from infancy through childhood is still unknown. Using an electroencephalography oddball task, we investigate the developmental peculiarities of repetition effect and change detection responses in 43 children that we followed longitudinally from 3 months to 4 years of age. Analyses were conducted on theta (3-5 Hz), alpha (5-10 Hz), and beta (10-30 Hz) time-frequency windows. Results indicated that in the theta time-frequency window, in frontocentral and frontal regions of the brain, repetition and change detection responses followed a U-shaped pattern from 3 months to 4 years of age. Moreover, the change detection response was stronger in young infants compared to older children in frontocentral regions, regardless of the time-frequency window. Our findings add to the evidence of top-down modulation of perceptual systems in infants and children.

Infant repetition effects and change detection: Are they related to adaptive skills?

Repetition effects and change detection response have been proposed as neuro-electrophysiological correlates of fundamental learning processes. As such, they could be a good predictor of brain maturation and cognitive development. We recorded high density EEG in 71 healthy infants (32 females) aged between 3 and 9 months, while they listened to vowel sequences (standard /a/a/a/i/ [80%] and deviant /a/a/a/a/ [20%]). Adaptive skills, a surrogate of cognitive development, were measured via the parent form of the Adaptive Behavior Assessment System Second Edition (ABAS-II). Cortical auditory-evoked potentials (CAEPs) analyses, time-frequency analyses and a statistical approach using linear mixed models (LMMs) and linear regression models were performed. Age and adaptive skills were tested as predictors. Age modulation of repetition effects and change detection response was observed in theta (3-5 Hz), alpha (5-10 Hz) and high gamma (80-90 Hz) oscillations and in all CAEPs. Moreover, adaptive skills modulation of repetition effects was evidenced in theta (3-5 Hz), high gamma oscillations (80-90 Hz), N250/P350 peak-to-peak amplitude and P350 latency. Finally, adaptive skills modulation of change detection response was observed in the N250/P350 peak-to-peak amplitude. Our results confirm that repetition effects and change detection response evolve with age. Moreover, our results suggest that repetition effects and change detection response vary according to adaptive skills displayed by infants during the first year of life, demonstrating their predictive value for neurodevelopment.

The Neurophysiological Processing of Music in Children: A Systematic Review With Narrative Synthesis and Considerations for Clinical Practice in Music Therapy

Introduction: Evidence supporting the use of music interventions to maximize arousal and awareness in adults presenting with a disorder of consciousness continues to grow. However, the brain of a child is not simply a small adult brain, and therefore adult theories are not directly translatable to the pediatric population. The present study aims to synthesize brain imaging data about the neural processing of music in children aged 0-18 years, to form a theoretical basis for music interventions with children presenting with a disorder of consciousness following acquired brain injury. Methods: We conducted a systematic review with narrative synthesis utilizing an adaptation of the methodology developed by Popay and colleagues. Following the development of the narrative that answered the central question "what does brain imaging data reveal about the receptive processing of music in children?", discussion was centered around the clinical implications of music therapy with children following acquired brain injury. Results: The narrative synthesis included 46 studies that utilized EEG, MEG, fMRI, and fNIRS scanning techniques in children aged 0-18 years. From birth, musical stimuli elicit distinct but immature electrical responses, with components of the auditory evoked response having longer latencies and variable amplitudes compared to their adult counterparts. Hemodynamic responses are observed throughout cortical and subcortical structures however cortical immaturity impacts musical processing and the localization of function in infants and young children. The processing of complex musical stimuli continues to mature into late adolescence. Conclusion: While the ability to process fundamental musical elements is present from birth, infants and children process music more slowly and utilize different cortical areas compared to adults. Brain injury in childhood occurs in a period of rapid development and the ability to process music following brain injury will likely depend on pre-morbid musical processing. Further, a significant brain injury may disrupt the developmental trajectory of complex music processing. However, complex music processing may emerge earlier than comparative language processing, and occur throughout a more global circuitry.

Melody complexity of infants' cry and non-cry vocalisations increases across the first six months

In early infancy, melody provides the most salient prosodic element for language acquisition and there is huge evidence for infants' precocious aptitudes for musical and speech melody perception. Yet, a lack of knowledge remains with respect to melody patterns of infants' vocalisations. In a search for developmental regularities of cry and non-cry vocalisations and for building blocks of prosody (intonation) over the first 6 months of life, more than 67,500 melodies (fundamental frequency contours) of 277 healthy infants from monolingual German families were quantitatively analysed. Based on objective criteria, vocalisations with well-identifiable melodies were grouped into those exhibiting a simple (single-arc) or complex (multiple-arc) melody pattern. Longitudinal analysis using fractional polynomial multi-level mixed effects logistic regression models were applied to these patterns. A significant age (but not sex) dependent developmental pattern towards more complexity was demonstrated in both vocalisation types over the observation period. The theoretical concept of melody development (MD-Model) contends that melody complexification is an important building block on the path towards language. Recognition of this developmental process will considerably improve not only our understanding of early preparatory processes for language acquisition, but most importantly also allow for the creation of clinically robust risk markers for developmental language disorders.

Attentional engagement during syllable discrimination: The role of salient prosodic cues in 6- to 8-month-old infants

Prosodic cues drive speech segmentation and guide syllable discrimination. However, less is known about the attentional mechanisms underlying an infant's ability to benefit from prosodic cues. This study investigated how 6- to 8-month-old Italian infants allocate their attention to strong vs. weak syllables after familiarization with four repeats of a single CV sequence with alternating strong and weak syllables (different syllables on each trial). In the discrimination test-phase, either the strong or the weak syllable was replaced by a pure tone matching the suprasegmental characteristics of the segmental syllable, i.e., duration, loudness and pitch, whereas the familiarized stimulus was presented as a control. By using an eye-tracker, attention deployment (fixation times) and cognitive resource allocation (pupil dilation) were measured under conditions of high and low saliency that corresponded to the strong and weak syllabic changes, respectively. Italian learning infants were found to look longer and also to show, through pupil dilation, more attention to changes in strong syllable replacement rather than weak syllable replacement, compared to the control condition. These data offer insights into the strategies used by infants to deploy their attention towards segmental units guided by salient prosodic cues, like the stress pattern of syllables, during speech segmentation.

The development of auditory functions

Typical development and maturation of the auditory system, at both the peripheral and central levels, is essential for the acquisition of speech, language, and auditory skills. The peripheral system generally encodes three basic parameters associated with auditory stimuli-time, frequency, and intensity. These acoustic cues are subsequently processed by the central auditory structures to reach and be perceived by the cerebral cortex. Observations of the human fetal and neonatal ear indicate that the peripheral auditory system is structurally and functionally adult-like at birth. In contrast, the central auditory system exhibits progressive anatomical and physiologic changes until early adulthood. Enriched experience with sound is fundamental and critical to auditory development. The absence of early and prolonged acoustic stimulation delays neuronal maturation, affecting the central auditory nervous system, in particular, and leading to atypical development. The present chapter reviews the various stages of development of the auditory system structures, especially the embryology of the human ear, before briefly presenting the trajectories of typical development of auditory abilities from infants to school-aged children.

Early vocal contact and music in the NICU: new insights into preventive interventions

It is now clearly established that the environment and the sensory stimuli, particularly during the perinatal period, have an impact on infant's development. During the last trimester of gestation, activity-dependent plasticity shapes the fetal brain, and prematurity has been shown to alter the typical developmental trajectories. In this delicate period, preventive interventions aiming at modulating these developmental trajectories through activity-inducing interventions are currently underway to be tested. The purpose of this review paper is to describe the potentialities of early vocal contact and music on the preterm infant's brain development, and their potential beneficial effect on early development. Scientific evidence supports a behavioral orientation of the newborn to organized sounds, such as those of voice and music, and recent neuroimaging studies further confirm full cerebral processing of music as multisensory stimuli. However, the impact of long-term effects of music exposure and early vocal contact on preterm infants' long-term neurodevelopment needs be further investigated. To conclude, it is necessary to establish the neuroscientific bases of the early perception and the long-term effects of music and early vocal contact on the premature newborns' development. Scientific projects are currently on the way to fill this gap in knowledge.

Enhanced Neonatal Brain Responses To Sung Streams Predict Vocabulary Outcomes By Age 18 Months

Words and melodies are some of the basic elements infants are able to extract early in life from the auditory input. Whether melodic cues contained in songs can facilitate word-form extraction immediately after birth remained unexplored. Here, we provided converging neural and computational evidence of the early benefit of melodies for language acquisition. Twenty-eight neonates were tested on their ability to extract word-forms from continuous flows of sung and spoken syllabic sequences. We found different brain dynamics for sung and spoken streams and observed successful detection of word-form violations in the sung condition only. Furthermore, neonatal brain responses for sung streams predicted expressive vocabulary at 18 months as demonstrated by multiple regression and cross-validation analyses. These findings suggest that early neural individual differences in prosodic speech processing might be a good indicator of later language outcomes and could be considered as a relevant factor in the development of infants' language skills.

Bridging prediction and attention in current research on perception and action

Prediction and attention are fundamental brain functions in the service of perception and action. Theories on prediction relate to neural (mental) models inferring about (present or future) sensory or action-related information, whereas theories of attention are about the control of information flow underlying perception and action. Both concepts are related and not always clearly distinguishable. The special issue includes current research on prediction and attention in various subfields of perception and action. It especially considers interactions between predictive and attentive processes, which constitute a newly emerging and highly interesting field of research. As outlined in this editorial, the contributions in this special issue allow specifying as well as bridging concepts on prediction and attention. The joint consideration of prediction and attention also reveals common functional principles of perception and action.