Episodes of experience and generative intelligence

Caregiver reactions to babbling organize turn-taking interactions: Facilitative effects of vocal versus non-vocal responses

Turn-taking interactions are foundational to the development of social, communicative, and cognitive skills. In infants, vocal turn-taking experience is predictive of infants' socioemotional and language development. However, different forms of turn-taking interactions may have different effects on infant vocalizing. It is presently unknown how caregiver vocal, non-vocal and multimodal responses to infant vocalizations compare in extending caregiver-infant vocal turn-taking bouts. In bouts that begin with an infant vocalization, responses that maintain versus change the communicative modality may differentially affect the likelihood of further infant vocalizing. No studies have examined how caregiver response modalities that either matched or differed from the infant acoustic (vocal) modality might affect the temporal structure of vocal turn-taking beyond the initial serve-and-return exchanges. We video-recorded free-play sessions of 51 caregivers with their 9-month-old infants. Caregivers responded to babbling most often with vocalizations. In turn, caregiver vocal responses were significantly more likely to elicit subsequent infant babbling. Bouts following an initial caregiver vocal response contained significantly more turns than those following a non-vocal or multimodal response. Thus prelinguistic turn-taking is sensitive to the modality of caregivers' responses. Future research should investigate if such sensitivity is grounded in attentional constraints, which may influence the structure of turn-taking interactions.

Grounded language acquisition through the eyes and ears of a single child

Starting around 6 to 9 months of age, children begin acquiring their first words, linking spoken words to their visual counterparts. How much of this knowledge is learnable from sensory input with relatively generic learning mechanisms, and how much requires stronger inductive biases? Using longitudinal head-mounted camera recordings from one child aged 6 to 25 months, we trained a relatively generic neural network on 61 hours of correlated visual-linguistic data streams, learning feature-based representations and cross-modal associations. Our model acquires many word-referent mappings present in the child's everyday experience, enables zero-shot generalization to new visual referents, and aligns its visual and linguistic conceptual systems. These results show how critical aspects of grounded word meaning are learnable through joint representation and associative learning from one child's input.