Fundamental frequency variation within neonatal crying: Does ambient language matter?

A self-training automatic infant-cry detector

Infant cry is one of the first distinctive and informative life signals observed after birth. Neonatologists and automatic assistive systems can analyse infant cry to early-detect pathologies. These analyses extensively use reference expert-curated databases containing annotated infant-cry audio samples. However, these databases are not publicly accessible because of their sensitive data. Moreover, the recorded data can under-represent specific phenomena or the operational conditions required by other medical teams. Additionally, building these databases requires significant investments that few hospitals can afford. This paper describes an open-source workflow for infant-cry detection, which identifies audio segments containing high-quality infant-cry samples with no other overlapping audio events (e.g. machine noise or adult speech). It requires minimal training because it trains an LSTM-with-self-attention model on infant-cry samples automatically detected from the recorded audio through cluster analysis and HMM classification. The audio signal processing uses energy and intonation acoustic features from 100-ms segments to improve spectral robustness to noise. The workflow annotates the input audio with intervals containing infant-cry samples suited for populating a database for neonatological and early diagnosis studies. On 16 min of hospital phone-audio recordings, it reached sufficient infant-cry detection accuracy in 3 neonatal care environments (nursery—69%, sub-intensive—82%, intensive—77%) involving 20 infants subject to heterogeneous cry stimuli, and had substantial agreement with an expert’s annotation. Our workflow is a cost-effective solution, particularly suited for a sub-intensive care environment, scalable to monitor from one to many infants. It allows a hospital to build and populate an extensive high-quality infant-cry database with a minimal investment.

How Tone, Intonation and Emotion Shape the Development of Infants’ Fundamental Frequency Perception

Fundamental frequency (ƒ₀), perceived as pitch, is the first and arguably most salient auditory component humans are exposed to since the beginning of life. It carries multiple linguistic (e.g., word meaning) and paralinguistic (e.g., speakers’ emotion) functions in speech and communication. The mappings between these functions and ƒ₀ features vary within a language and differ cross-linguistically. For instance, a rising pitch can be perceived as a question in English but a lexical tone in Mandarin. Such variations mean that infants must learn the specific mappings based on their respective linguistic and social environments. To date, canonical theoretical frameworks and most empirical studies do not view or consider the multi-functionality of ƒ₀, but typically focus on individual functions. More importantly, despite the eventual mastery of ƒ₀ in communication, it is unclear how infants learn to decompose and recognize these overlapping functions carried by ƒ₀. In this paper, we review the symbioses and synergies of the lexical, intonational, and emotional functions that can be carried by ƒ₀ and are being acquired throughout infancy. On the basis of our review, we put forward the Learnability Hypothesis that infants decompose and acquire multiple ƒ₀ functions through native/environmental experiences. Under this hypothesis, we propose representative cases such as the synergy scenario, where infants use visual cues to disambiguate and decompose the different ƒ₀ functions. Further, viable ways to test the scenarios derived from this hypothesis are suggested across auditory and visual modalities. Discovering how infants learn to master the diverse functions carried by ƒ₀ can increase our understanding of linguistic systems, auditory processing and communication functions.

Voices as Cues to Children's Needs for Caregiving

The aim of this study was to explore the role of voices as cues to adults of children’s needs for potential caregiving during early childhood. To this purpose, 74 college students listened to pairs of 5-year-old versus 10-year-old children verbalizing neutral-content sentences and indicated which voice was better associated with each of 14 traits, potentially meaningful in interactions between young children and adults. Results indicated that children with immature voices were perceived more positively and as being more helpless than children with mature voices. Children’s voices, regardless of the content of speech, seem to be a powerful source of information about children’s need for caregiving for parents and others during the first six years of life.

Cooperative care and the evolution of the prelinguistic vocal learning

The development of the earliest vocalizations of human infants is influenced by social feedback from caregivers. As these vocalizations change, they increasingly elicit such feedback. This pattern of development is in stark contrast to that of our close phylogenetic relatives, Old World monkeys and apes, who produce mature-sounding vocalizations at birth. We put forth a scenario to account for this difference: Humans have a cooperative breeding strategy, which pressures infants to compete for the attention from caregivers. Humans use this strategy because large brained human infants are energetically costly and born altricial. An altricial brain accommodates vocal learning. To test this hypothetical scenario, we present findings from New World marmoset monkeys indicating that, through convergent evolution, this species adopted a largely identical developmental system-one that includes vocal learning and cooperative breeding.

Cry features of healthy neonates who passed their newborn hearing screening vs. those who did not

OBJECTIVES

Temporal and fundamental frequency (fo) variations in infant cries provide critical insights into the maturity of vocal control and hearing performances. Earlier research has examined the use of vocalisation properties (in addition to hearing tests) to identify infants at risk of hearing impairment. The aim of this study was to determine whether such an approach could be suitable for neonates.

METHODS

To investigate this, we recruited 74 healthy neonates within their first week of life as our participants, assigning them to either a group that passed the ABR-based NHS (PG, N = 36) or a group that did not, but were diagnosed as normally hearing in follow-up check at 3 months of life, a so-called false-positive group (NPG, N = 36). Spontaneously uttered cries (N = 2330) were recorded and analysed quantitatively. The duration, minimum, maximum and mean fo, as well as two variability measures (fo range, fo sigma), were calculated for each cry utterance, averaged for individual neonates, and compared between the groups.

RESULTS

A multiple analysis of variance (MANOVA) revealed no significant effects. This confirms that cry features reflecting vocal control do not differ between healthy neonates with normal hearing, irrespective of the outcome of their initial NHS.

CONCLUSIONS

Healthy neonates who do not pass the NHS but are normal hearing in the follow-up (false positive cases) have the same cry properties as those with normal hearing who do. This is an essential prerequisite to justify the research strategy of incorporating vocal analysis into NHS to complement ABR measures in identifying hearing-impaired newborns.

Melody complexity of infants' cry and non-cry vocalisations increases across the first six months

In early infancy, melody provides the most salient prosodic element for language acquisition and there is huge evidence for infants' precocious aptitudes for musical and speech melody perception. Yet, a lack of knowledge remains with respect to melody patterns of infants' vocalisations. In a search for developmental regularities of cry and non-cry vocalisations and for building blocks of prosody (intonation) over the first 6 months of life, more than 67,500 melodies (fundamental frequency contours) of 277 healthy infants from monolingual German families were quantitatively analysed. Based on objective criteria, vocalisations with well-identifiable melodies were grouped into those exhibiting a simple (single-arc) or complex (multiple-arc) melody pattern. Longitudinal analysis using fractional polynomial multi-level mixed effects logistic regression models were applied to these patterns. A significant age (but not sex) dependent developmental pattern towards more complexity was demonstrated in both vocalisation types over the observation period. The theoretical concept of melody development (MD-Model) contends that melody complexification is an important building block on the path towards language. Recognition of this developmental process will considerably improve not only our understanding of early preparatory processes for language acquisition, but most importantly also allow for the creation of clinically robust risk markers for developmental language disorders.

Musical Intervals in Infants' Spontaneous Crying over the First 4 Months of Life

INTRODUCTION

Perception and memorizing of melody and rhythm start about the third trimester of gestation. Infants have astonishing musical predispositions, and melody contour is most salient for them.

OBJECTIVE

To longitudinally analyse melody contour of spontaneous crying of healthy infants and to identify melodic intervals. The aim was 3-fold: (1) to answer the question whether spontaneous crying of healthy infants regularly exhibits melodic intervals across the observation period, (2) to investigate whether interval events become more complex with age and (3) to analyse interval size distribution.

METHODS

Weekly cry recordings of 12 healthy infants (6 females) over the first 4 months of life were analysed (6,130 cry utterances) using frequency spectrograms and pitch analyses (PRAAT). A preselection of utterances containing a well-identifiable, noise-free and undisturbed melodic contour was applied to identify and measure melodic intervals in the final subset of 3,114 utterances. Age-dependent frequency of occurrence of melodic intervals was statistically analysed using generalized estimating equations.

RESULTS

85.3% of all preselected melody contours (n = 3,114) either contained single rising or falling melodic intervals or complex events as combinations of both. In total 6,814 melodic intervals were measured. A significant increase in interval occurrence was found characterized by a non-linear age effect (3 developmental phases). Complex events were found to significantly increase linearly with age. In both calculations, no sex effect was found. Interval size distribution showed a maximum of the minor second as the prevailing musical interval in infants' crying over the first 4 months of life.

CONCLUSION

Melodic intervals seem to be a regular phenomenon of spontaneous crying of healthy infants. They are suggested to be a further candidate for developing an early risk marker of vocal control in infants. Subsequent studies are needed to compare healthy infants and infants at risk for respiratory-laryngeal dysfunction to investigate the diagnostic value of the occurrence of melodic intervals and their age-depending complexification.

Typical vs. atypical: Combining auditory Gestalt perception and acoustic analysis of early vocalisations in Rett syndrome

BACKGROUND

Early speech-language development of individuals with Rett syndrome (RTT) has been repeatedly characterised by a co-occurrence of apparently typical and atypical vocalisations.

AIMS

To describe specific features of this intermittent character of typical versus atypical early RTT-associated vocalisations by combining auditory Gestalt perception and acoustic vocalisation analysis.

METHODS AND PROCEDURES

We extracted N = 363 (pre-)linguistic vocalisations from home video recordings of an infant later diagnosed with RTT. In a listening experiment, all vocalisations were assessed for (a)typicality by five experts on early human development. Listeners' auditory concepts of (a)typicality were investigated in context of a comprehensive set of acoustic time-, spectral- and/or energy-related higher-order features extracted from the vocalisations.

OUTCOMES AND RESULTS

More than half of the vocalisations were rated as 'atypical' by at least one listener. Atypicality was mainly related to the auditory attribute 'timbre', and to prosodic, spectral, and voice quality features in the acoustic domain.

CONCLUSIONS AND IMPLICATIONS

Knowledge gained in our study shall contribute to the generation of an objective model of early vocalisation atypicality. Such a model might be used for increasing caregivers' and healthcare professionals' sensitivity to identify atypical vocalisation patterns, or even for a probabilistic approach to automatically detect RTT based on early vocalisations.

From melody to words: The role of sex hormones in early language development

Contribution to Special Issue on Fast effects of steroids. Human infants are the most proficient of the few vocal learner species. Sharing similar principles in terms of the generation and modification of complex sounds, cross-vocal learner comparisons are a suitable strategy when it comes to better understanding the evolution and mechanisms of auditory-vocal learning in human infants. This approach will also help us to understand sex differences in relation to vocal development towards language, the underlying brain mechanisms thereof and sex-specific hormonal effects. Although we are still far from being capable of discovering the "fast effects of steroids" in human infants, we have identified that peripheral hormones (blood serum) are important regulators of vocal behaviour towards language during a transitory hormone surge ("mini-puberty") that is comparable in its extent to puberty. This new area of research in human infants provides a promising opportunity to not only better understand early language acquisition from an ontogenetic and phylogenetic perspective, but to also identify reliable clinical risk-markers in infants for the development of later language disorders.

Fundamental Frequency Variation of Neonatal Spontaneous Crying Predicts Language Acquisition in Preterm and Term Infants

Spontaneous cries of infants exhibit rich melodic features (i.e., time variation of fundamental frequency [F0 ]) even during the neonatal period, and the development of these characteristics might provide an essential base for later expressive prosody in language. However, little is known about the melodic features of spontaneous cries in preterm infants, who have a higher risk of later language-related problems. Thus, the present study investigated how preterm birth influenced melodic features of spontaneous crying at term-equivalent age as well as how these melodic features related to language outcomes at 18 months of corrected age in preterm and term infants. At term, moderate-to-late preterm (MLP) infants showed spontaneous cries with significantly higher F0 variation and melody complexity than term infants, while there were no significant differences between very preterm (VP) and term infants. Furthermore, larger F0 variation within cry series at term was significantly related to better language and cognitive outcomes, particularly expressive language skills, at 18 months. On the other hand, no other melodic features at term predicted any developmental outcomes at 18 months. The present results suggest that the additional postnatal vocal experience of MLP preterm infants increased F0 variation and the complexity of spontaneous cries at term. Additionally, the increases in F0 variation may partly reflect the development of voluntary vocal control, which, in turn, contributes to expressive language in infancy.