Infants' statistical word segmentation in an artificial language is linked to both parental speech input and reported production abilities

Infants show systematic rhythmic motor responses while listening to rhythmic speech

Rhythm is known to play an important role in infant language acquisition, but few infant language development studies have considered that rhythm is multimodal and shows strong connections between speech and the body. Based on the observation that infants sometimes show rhythmic motor responses when listening to auditory rhythms, the present study asked whether specific rhythm cues (pitch, intensity, or duration) would systematically increase infants' spontaneous rhythmic body movement, and whether their rhythmic movements would be associated with their speech processing abilities. We used pre-existing experimental and video data of 148 German-learning 7.5- and 9.5-month-old infants tested on their use of rhythm as a cue for speech segmentation. The infants were familiarized with an artificial language featuring syllables alternating in pitch, intensity, duration, or none of these cues. Subsequently, they were tested on their recognition of bisyllables based on perceived rhythm. We annotated infants' rhythmic movements in the videos, analyzed whether the rhythmic moving durations depended on the perceived rhythmic cue, and correlated them with the speech segmentation performance. The result was that infants' motor engagement was highest when they heard a duration-based speech rhythm. Moreover, we found an association of the quantity of infants' rhythmic motor responses and speech segmentation. However, contrary to the predictions, infants who exhibited fewer rhythmic movements showed a more mature performance in speech segmentation. In sum, the present study provides initial exploratory evidence that infants' spontaneous rhythmic body movements while listening to rhythmic speech are systematic, and may be linked with their language processing. Moreover, the results highlight the need for considering infants' spontaneous rhythmic body movements as a source of individual differences in infant auditory and speech perception.

Infants' abilities to segment word forms from spectrally degraded speech in the first year of life

Infants begin to segment word forms from fluent speech-a crucial task in lexical processing-between 4 and 7 months of age. Prior work has established that infants rely on a variety of cues available in the speech signal (i.e., prosodic, statistical, acoustic-segmental, and lexical) to accomplish this task. In two experiments with French-learning 6- and 10-month-olds, we use a psychoacoustic approach to examine if and how degradation of the two fundamental acoustic components extracted from speech by the auditory system, namely, temporal (both frequency and amplitude modulation) and spectral information, impact word form segmentation. Infants were familiarized with passages containing target words, in which frequency modulation (FM) information was replaced with pure tones using a vocoder, while amplitude modulation (AM) was preserved in either 8 or 16 spectral bands. Infants were then tested on their recognition of the target versus novel control words. While the 6-month-olds were unable to segment in either condition, the 10-month-olds succeeded, although only in the 16 spectral band condition. These findings suggest that 6-month-olds need FM temporal cues for speech segmentation while 10-month-olds do not, although they need the AM cues to be presented in enough spectral bands (i.e., 16). This developmental change observed in infants' sensitivity to spectrotemporal cues likely results from an increase in the range of available segmentation procedures, and/or shift from a vowel to a consonant bias in lexical processing between the two ages, as vowels are more affected by our acoustic manipulations. RESEARCH HIGHLIGHTS: Although segmenting speech into word forms is crucial for lexical acquisition, the acoustic information that infants' auditory system extracts to process continuous speech remains unknown. We examined infants' sensitivity to spectrotemporal cues in speech segmentation using vocoded speech, and revealed a developmental change between 6 and 10 months of age. We showed that FM information, that is, the fast temporal modulations of speech, is necessary for 6- but not 10-month-old infants to segment word forms. Moreover, reducing the number of spectral bands impacts 10-month-olds' segmentation abilities, who succeed when 16 bands are preserved, but fail with 8 bands.

Prosody outweighs statistics in 6-month-old German-learning infants' speech segmentation

It is well established that infants use various cues to find words within fluent speech from about 7 to 8 months of age. Research suggests that two main mechanisms support infants' speech segmentation: prosodic cues like the word stress patterns, and distributional cues like transitional probabilities (TPs). We tested 6-month-old German-learning infants' use of prosodic and statistical cues for speech segmentation in three experiments. In Experiment 1, infants were familiarized with an artificial language string where TPs signaled either word boundaries or iambic words-a stress pattern that is disfavored in German. Experiment 2 was a control and only the test phase was presented. In Experiment 3, prosodic cues were absent in the string and only TPs signaled word boundaries. All experiments included the same conditions at test: disyllabic words with high TPs in the string, words with low TPs and words with non-co-occurring syllables. Results showed that infants relied more strongly on prosodic cues than on TPs for word segmentation. Notably, no segmentation evidence emerged when prosodic cues were absent in the string. This finding underlines early impacts of language-specific structural properties on segmentation mechanisms.

Mother-infant social gaze dynamics relate to infant brain activity and word segmentation

The 'social brain', consisting of areas sensitive to social information, supposedly gates the mechanisms involved in human language learning. Early preverbal interactions are guided by ostensive signals, such as gaze patterns, which are coordinated across body, brain, and environment. However, little is known about how the infant brain processes social gaze in naturalistic interactions and how this relates to infant language development. During free-play of 9-month-olds with their mothers, we recorded hemodynamic cortical activity of ´social brain` areas (prefrontal cortex, temporo-parietal junctions) via fNIRS, and micro-coded mother's and infant's social gaze. Infants' speech processing was assessed with a word segmentation task. Using joint recurrence quantification analysis, we examined the connection between infants' ´social brain` activity and the temporal dynamics of social gaze at intrapersonal (i.e., infant's coordination, maternal coordination) and interpersonal (i.e., dyadic coupling) levels. Regression modeling revealed that intrapersonal dynamics in maternal social gaze (but not infant's coordination or dyadic coupling) coordinated significantly with infant's cortical activity. Moreover, recurrence quantification analysis revealed that intrapersonal maternal social gaze dynamics (in terms of entropy) were the best predictor of infants' word segmentation. The findings support the importance of social interaction in language development, particularly highlighting maternal social gaze dynamics.

Music and language in the crib: Early cross-domain effects of experience on categorical perception of prominence in spoken language

Rhythm perception helps young infants find structure in both speech and music. However, it remains unknown whether categorical perception of suprasegmental linguistic rhythm signaled by a co-variation of multiple acoustic cues can be modulated by prior between- (music) and within-domain (language) experience. Here we tested 6-month-old German-learning infants' ability to have a categorical perception of lexical stress, a linguistic prominence signaled through the co-variation of pitch, intensity, and duration. By measuring infants' pupil size, we find that infants as a group fail to perceive co-variation of these acoustic cues as categorical. However, at an individual level, infants with above-average exposure to music and language at home succeeded. Our results suggest that early exposure to music and infant-directed language can boost the categorical perception of prominence. RESEARCH HIGHLIGHTS: 6-month-old German-learning infants' ability to perceive lexical stress prominence categorically depends on exposure to music and language at home. Infants with high exposure to music show categorical perception. Infants with high exposure to infant-directed language show categorical perception. Co-influence of high exposure to music and infant-directed language may be especially beneficial for categorical perception. Early exposure to predictable rhythms boosts categorical perception of prominence.

The association between statistical learning and language development during childhood: A scoping review

The statistical account of language acquisition asserts that language is learned through computations on the statistical regularities present in natural languages. This type of account can predict variability in language development measures as arising from individual differences in extracting this statistical information. Given that statistical learning has been attested across different domains and modalities, a central question is which modality is more tightly yoked with language skills. The results of a scoping review, which aimed for the first time at identifying the evidence of the association between statistical learning skills and language outcomes in typically developing infants and children, provide preliminary support for the statistical learning account of language acquisition, mostly in the domain of lexical outcomes, indicating that typically developing infants and children with stronger auditory and audio-visual statistical learning skills perform better on lexical competence tasks. The results also suggest that the relevance of statistical learning skills for language development is dependent on sensory modality.

Statistical word segmentation: Anchoring learning across contexts

The present experiments were designed to assess infants' abilities to use syllable co-occurrence regularities to segment fluent speech across contexts. Specifically, we investigated whether 9-month-old infants could use statistical regularities in one speech context to support speech segmentation in a second context. Contexts were defined by different word sets representing contextual differences that might occur across conversations or utterances. This mimics the integration of information across multiple interactions within a single language, which is critical for language acquisition. In particular, we performed two experiments to assess whether a statistically segmented word could be used to anchor segmentation in a second, more challenging context, namely speech with variable word lengths. The results of Experiment 1 were consistent with past work suggesting that statistical learning may be hindered by speech with word-length variability, which is inherent to infants' natural speech environments. In Experiment 2, we found that infants could use a previously statistically segmented word to support word segmentation in a novel, challenging context. We also present findings suggesting that this ability was associated with infants' early word knowledge but not their performance on a cognitive development assessment.

Early recognition of familiar word-forms as a function of production skills

Growing evidence shows that early speech processing relies on information extracted from speech production. In particular, production skills are linked to word-form processing, as more advanced producers prefer listening to pseudowords containing consonants they do not yet produce. However, it is unclear whether production affects word-form encoding (the translation of perceived phonological information into a memory trace) and/or recognition (the automatic retrieval of a stored item). Distinguishing recognition from encoding makes it possible to explore whether sensorimotor information is stored in long-term phonological representations (and thus, retrieved during recognition) or is processed when encoding a new item, but not necessarily when retrieving a stored item. In this study, we asked whether speech-related sensorimotor information is retained in long-term representations of word-forms. To this aim, we tested the effect of production on the recognition of ecologically learned, real familiar word-forms. Testing these items allowed to assess the effect of sensorimotor information in a context in which encoding did not happen during testing itself. Two groups of French-learning monolinguals (11- and 14-month-olds) participated in the study. Using the Headturn Preference Procedure, each group heard two lists, each containing 10 familiar word-forms composed of either early-learned consonants (commonly produced by French-learners at these ages) or late-learned consonants (more rarely produced at these ages). We hypothesized differences in listening preferences as a function of word-list and/or production skills. At both 11 and 14 months, babbling skills modulated orientation times to the word-lists containing late-learned consonants. This specific effect establishes that speech production impacts familiar word-form recognition by 11 months, suggesting that sensorimotor information is retained in long-term word-form representations and accessed during word-form processing.

Seven-month-old infants detect symmetrical structures in multi-featured abstract visual patterns

The present study investigated 7-month-old infants' ability to perceive structural symmetry in mosaic-like abstract visual patterns. We examined infants' (n = 98) spontaneous looking behaviour to mosaic-like sequences with symmetrical and asymmetrical structures. Sequences were composed of square tiles from two categories that differed in their colour scheme and internal shape. We manipulated sequence length (3 or 5 tiles) and abstractness of the symmetry (token vs. category level). The 7-month-olds discriminated structurally symmetrical from asymmetrical mosaics in the first half of the test phase (first 8 trials). Sequence length, level of symmetry, or number of unique tiles per sequence did not significantly modulate infants' looking behaviour. These results suggest that very young infants detect differences in structural symmetry in multi-featured visual patterns.

Pupillary entrainment reveals individual differences in cue weighting in 9-month-old German-learning infants

Young infants can segment continuous speech with statistical as well as prosodic cues. Understanding how these cues interact can be informative about how infants solve the segmentation problem. Here we investigate how German-speaking adults and 9-month-old German-learning infants weigh statistical and prosodic cues when segmenting continuous speech. We measured participants' pupil size while they were familiarized with a continuous speech stream where prosodic cues were pitted off against transitional probabilities. Adult participants' changes in pupil size synchronized with the occurrence of prosodic words during the familiarization and the temporal alignment of these pupillary changes was predictive of adult participants' performance at test. Further, 9-month-olds as a group failed to consistently segment the familiarization stream with prosodic or statistical cues. However, the variability in temporal alignment of the pupillary changes at word frequency showed that prosodic and statistical cues compete for dominance when segmenting continuous speech. A follow-up language development questionnaire at 40 months of age suggested that infants who entrained to prosodic words performed better on a vocabulary task and those infants who relied more on statistical cues performed better on grammatical tasks. Together these results suggest that statistics and prosody may serve different roles in speech segmentation in infancy.

Variability in Quantity and Quality of Early Linguistic Experience in Children With Cochlear Implants: Evidence from Analysis of Natural Auditory Environments

OBJECTIVES

Understanding how quantity and quality of language input vary across children with cochlear implants (CIs) is important for explaining sources of large individual differences in language outcomes of this at-risk pediatric population. Studies have mostly focused either on intervention-related, device-related, and/or patient-related factors, or relied on data from parental reports and laboratory-based speech corpus to unravel factors explaining individual differences in language outcomes among children with CIs. However, little is known about the extent to which children with CIs differ in quantity and quality of language input they experience in their natural linguistic environments. To address this knowledge gap, the present study analyzed the quantity and quality of language input to early-implanted children (age of implantation <23 mo) during the first year after implantation.

DESIGN

Day-long Language ENvironment Analysis (LENA) recordings, derived from home environments of 14 early-implanted children, were analyzed to estimate numbers of words per day, type-token ratio (TTR), and mean length of utterance in morphemes (MLUm) in adults' speech. Properties of language input were analyzed across these three dimensions to examine how input in home environments varied across children with CIs in quantity, defined as number of words, and quality, defined as whether speech was child-directed or overheard.

RESULTS

Our per-day estimates demonstrated that children with CIs were highly variable in the number of total words (mean ± SD = 25,134 ± 9,267 words) and high-quality child-directed words (mean ± SD = 10,817 ± 7,187 words) they experienced in a day in their home environments during the first year after implantation. The results also showed that the patterns of variability across children in quantity and quality of language input changes depending on whether the speech was child-directed or overheard. Children also experienced highly different environments in terms of lexical diversity (as measured by TTR) and morphosyntactic complexity (as measured by MLUm) of language input. The results demonstrated that children with CIs varied substantially in the quantity and quality of language input experienced in their home environments. More importantly, individual children experienced highly variable amounts of high-quality, child-directed speech, which may drive variability in language outcomes across children with CIs.

CONCLUSIONS

Analyzing early language input in natural, linguistic environments of children with CIs showed that the quantity and quality of early linguistic input vary substantially across individual children with CIs. This substantial individual variability suggests that the quantity and quality of early linguistic input are potential sources of individual differences in outcomes of children with CIs and warrant further investigation to determine the effects of this variability on outcomes.

The effects of maternal input on language in the absence of genetic confounds: Vocabulary development in internationally adopted children

Previous studies have found correlations between parent input and child language outcomes, providing prima facie evidence for a causal relation. However, this could also reflect the effects of shared genes. The present study removed this genetic confound by measuring English vocabulary growth in 29 preschool-aged children (21 girls) aged 31-73 months and 17 infants (all girls) aged 15-32 months adopted from China and Eastern Europe and comparing it to speech produced by their adoptive mothers. Vocabulary growth in both groups was correlated with maternal input features; in infants with mean-length of maternal utterance, and in preschoolers with both mean-length of utterance and lexical diversity. Thus, input effects on language outcomes persist even in the absence of genetic confounds.

A Shift in the Direction of the Production Effect in Children Aged 2-6 Years

Research has found mixed evidence for the production effect in childhood. Some studies have found a positive effect of production on word recognition and recall, while others have found the reverse. This paper takes a developmental approach to investigate the production effect. Children aged 2-6 years (n = 150) from a predominantly white population in Ottawa, Canada were trained on familiar words which were either seen, heard or produced, followed by a recall task. Results showed a developmental shift: younger participants showed a reverse production effect, recalling more words that were heard during training, while older children showed the typical production effect, recalling more produced words. The effect of production on recall is not unidirectional and varies by age.

The Relation Between Preschoolers' Vocabulary Development and Their Ability to Predict and Recognize Words

By age 2, children are developing foundational language processing skills, such as quickly recognizing words and predicting words before they occur. How do these skills relate to children's structural knowledge of vocabulary? Multiple aspects of language processing were simultaneously measured in a sample of 2-to-5-year-olds (N = 215): While older children were more fluent at recognizing words, at predicting words in a graded fashion, and at revising incorrect predictions, only revision was associated with concurrent vocabulary knowledge once age was accounted for. However, an exploratory longitudinal follow-up (N = 55) then found that word recognition and prediction skills were associated with rate of subsequent vocabulary development, but revision skills were not. We argue that prediction skills may facilitate language learning through enhancing processing speed.

Electrophysiological signatures of visual statistical learning in 3-month-old infants at familial and low risk for autism spectrum disorder

Visual statistical learning (VSL) refers to the ability to extract associations and conditional probabilities within the visual environment. It may serve as a precursor to cognitive and social communication development. Quantifying VSL in infants at familial risk (FR) for Autism Spectrum Disorder (ASD) provides opportunities to understand how genetic predisposition can influence early learning processes which may, in turn, lay a foundation for cognitive and social communication delays. We examined electroencephalography (EEG) signatures of VSL in 3-month-old infants, examining whether EEG correlates of VSL differentiated FR from low-risk (LR) infants. In an exploratory analysis, we then examined whether EEG correlates of VSL at 3 months relate to cognitive function and ASD symptoms at 18 months. Infants were exposed to a continuous stream of looming shape pairs with varying probability that the shapes would occur in sequence (high probability-deterministic condition; low probability-probabilistic condition). EEG was time-locked to shapes based on their transitional probabilities. EEG analysis examined group-level characteristics underlying specific components, including the late frontal positivity (LFP) and N700 responses. FR infants demonstrated increased LFP and N700 response to the probabilistic condition, whereas LR infants demonstrated increased LFP and N700 response to the deterministic condition. LFP at 3 months predicted 18-month visual reception skills and not ASD symptoms. Our findings thus provide evidence for distinct VSL processes in FR and LR infants as early as 3 months. Atypical pattern learning in FR infants may lay a foundation for later delays in higher level, nonverbal cognitive skills, and predict ASD symptoms well before an ASD diagnosis is made.

One language or two? Navigating cross-language conflict in statistical word segmentation

Bilingual infants must navigate the similarities and differences between their languages to achieve native proficiency in childhood. Bilinguals learning to find individual words in fluent speech face the possibility of conflicting cues to word boundaries across their languages. Despite this challenge, bilingual infants typically begin to segment and learn words in both languages around the same time as monolinguals. It is possible that early bilingual experience may support infants' abilities to track regularities relevant for word segmentation separately across their languages. In a dual speech stream statistical word segmentation task, we assessed whether 16-month-old infants could track syllable co-occurrence regularities in two artificial languages despite conflicting information across the languages. We found that bilingual, but not monolingual, infants were able to segment the dual speech streams using statistical regularities. Although the two language groups did not differ on secondary measures of cognitive and linguistic development, bilingual infants' real-world experience with bilingual speakers was predictive of their performance in the dual language statistical segmentation task.

The role of production abilities in the perception of consonant category in infants

The influence of motor knowledge on speech perception is well established, but the functional role of the motor system is still poorly understood. The present study explores the hypothesis that speech production abilities may help infants discover phonetic categories in the speech stream, in spite of coarticulation effects. To this aim, we examined the influence of babbling abilities on consonant categorization in 6- and 9-month-old infants. Using an intersensory matching procedure, we investigated the infants' capacity to associate auditory information about a consonant in various vowel contexts with visual information about the same consonant, and to map auditory and visual information onto a common phoneme representation. Moreover, a parental questionnaire evaluated the infants' consonantal repertoire. In a first experiment using /b/-/d/ consonants, we found that infants who displayed babbling abilities and produced the /b/ and/or the /d/ consonants in repetitive sequences were able to correctly perform intersensory matching, while non-babblers were not. In a second experiment using the /v/-/z/ pair, which is as visually contrasted as the /b/-/d/ pair but which is usually not produced at the tested ages, no significant matching was observed, for any group of infants, babbling or not. These results demonstrate, for the first time, that the emergence of babbling could play a role in the extraction of vowel-independent representations for consonant place of articulation. They have important implications for speech perception theories, as they highlight the role of sensorimotor interactions in the development of phoneme representations during the first year of life.