Communicative cues in the absence of a human interaction partner enhance 12-month-old infants’ word learning

Early-emerging combinatorial thought: Human infants flexibly combine kind and quantity concepts

Combinatorial thought, or the ability to combine a finite set of concepts into a myriad of complex ideas and knowledge structures, is the key to the productivity of the human mind and underlies communication, science, technology, and art. Despite the importance of combinatorial thought for human cognition and culture, its developmental origins remain unknown. To address this, we tested whether 12-mo-old infants (N = 60), who cannot yet speak and only understand a handful of words, can combine quantity and kind concepts activated by verbal input. We proceeded in two steps: first, we taught infants two novel labels denoting quantity (e.g., "mize" for 1 item; "padu" for 2 items, Experiment 1). Then, we assessed whether they could combine quantity and kind concepts upon hearing complex expressions comprising their labels (e.g., "padu duck", Experiments 2-3). At test, infants viewed four different sets of objects (e.g., 1 duck, 2 ducks, 1 ball, 2 balls) while being presented with the target phrase (e.g., "padu duck") naming one of them (e.g., 2 ducks). They successfully retrieved and combined on-line the labeled concepts, as evidenced by increased looking to the named sets but not to distractor sets. Our results suggest that combinatorial processes for building complex representations are available by the end of the first year of life. The infant mind seems geared to integrate concepts in novel productive ways. This ability may be a precondition for deciphering the ambient language(s) and building abstract models of experience that enable fast and flexible learning.

Toddlers' prior social experience with speakers influences their word learning

Toddlers prefer to learn from familiar adults, particularly their caregivers, and perform better on word learning tasks when taught by caregivers than by strangers. However, it remains unclear why toddlers learn better from caregivers than from strangers. One possibility is that toddlers are more receptive to learning from individuals whom they have found to be engaging in previous interactions. The current study tested whether toddlers learn more from an unfamiliar adult who was previously engaging than from an unfamiliar adult who was previously unengaging. Toddlers (27-29 months, N = 40) were taught labels for novel objects by two different experimenters. Prior to word learning, toddlers watched pre-recorded videos of one experimenter utilizing engaging behaviors (i.e., using infant-directed speech, gestures, eye contact, and positive affect) and one experimenter utilizing unengaging behaviors (i.e., using adult-directed speech, no gestures, no eye contact, and neutral affect). Both experimenters were equally engaging during labeling. Word learning was then tested using a looking-while-listening paradigm. The results of linear mixed-effects model, cluster-based permutation, and growth curve analyses suggest heightened performance for words that were taught by the experimenter who was previously engaging. These results begin to reveal the kinds of social experiences that promote success in early word learning.

Grounding the Vector Space of an Octopus: Word Meaning from Raw Text

Most, if not all, philosophers agree that computers cannot learn what words refers to from raw text alone. While many attacked Searle’s Chinese Room thought experiment, no one seemed to question this most basic assumption. For how can computers learn something that is not in the data? Emily Bender and Alexander Koller (2020) recently presented a related thought experiment—the so-called Octopus thought experiment, which replaces the rule-based interlocutor of Searle’s thought experiment with a neural language model. The Octopus thought experiment was awarded a best paper prize and was widely debated in the AI community. Again, however, even its fiercest opponents accepted the premise that what a word refers to cannot be induced in the absence of direct supervision. I will argue that what a word refers to is probably learnable from raw text alone. Here’s why: higher-order concept co-occurrence statistics are stable across languages and across modalities, because language use (universally) reflects the world we live in (which is relatively stable). Such statistics are sufficient to establish what words refer to. My conjecture is supported by a literature survey, a thought experiment, and an actual experiment.

Face-to-face contact during infancy: How the development of gaze to faces feeds into infants' vocabulary outcomes

Infants acquire their first words through interactions with social partners. In the first year of life, infants receive a high frequency of visual and auditory input from faces, making faces a potential strong social cue in facilitating word-to-world mappings. In this position paper, we review how and when infant gaze to faces is likely to support their subsequent vocabulary outcomes. We assess the relevance of infant gaze to faces selectively, in three domains: infant gaze to different features within a face (that is, eyes and mouth); then to faces (compared to objects); and finally to more socially relevant types of faces. We argue that infant gaze to faces could scaffold vocabulary construction, but its relevance may be impacted by the developmental level of the infant and the type of task with which they are presented. Gaze to faces proves relevant to vocabulary, as gazes to eyes could inform about the communicative nature of the situation or about the labeled object, while gazes to the mouth could improve word processing, all of which are key cues to highlighting word-to-world pairings. We also discover gaps in the literature regarding how infants' gazes to faces (versus objects) or to different types of faces relate to vocabulary outcomes. An important direction for future research will be to fill these gaps to better understand the social factors that influence infant vocabulary outcomes.

Nonverbal Action Interpretation Guides Novel Word Disambiguation in 12-Month-Olds

Whether young infants can exploit sociopragmatic information to interpret new words is a matter of debate. Based on findings and theories from the action interpretation literature, we hypothesized that 12-month-olds should distinguish communicative object-directed actions expressing reference from instrumental object-directed actions indicative of one’s goals, and selectively use the former to identify referents of novel linguistic expressions. This hypothesis was tested across four eye-tracking experiments. Infants watched pairs of unfamiliar objects, one of which was first targeted by either a communicative action (e.g., pointing) or an instrumental action (e.g., grasping) and then labeled with a novel word. As predicted, infants fast-mapped the novel words onto the targeted objects after pointing (Experiments 1 and 4) but not after grasping (Experiment 2) unless the grasping action was preceded by an ostensive signal (Experiment 3). Moreover, whenever infants mapped a novel word onto the object indicated by a communicative action, they tended to map a different novel word onto the distractor object, displaying a mutual exclusivity effect. This reliance on nonverbal action interpretation in the disambiguation of novel words indicates that sociopragmatic inferences about reference likely supplement associative and statistical learning mechanisms from the outset of word learning.

Learning Through Processing: Toward an Integrated Approach to Early Word Learning

Children's linguistic knowledge and the learning mechanisms by which they acquire it grow substantially in infancy and toddlerhood, yet theories of word learning largely fail to incorporate these shifts. Moreover, researchers' often-siloed focus on either familiar word recognition or novel word learning limits the critical consideration of how these two relate. As a step toward a mechanistic theory of language acquisition, we present a framework of "learning through processing" and relate it to the prevailing methods used to assess children's early knowledge of words. Incorporating recent empirical work, we posit a specific, testable timeline of qualitative changes in the learning process in this interval. We conclude with several challenges and avenues for building a comprehensive theory of early word learning: better characterization of the input, reconciling results across approaches, and treating lexical knowledge in the nascent grammar with sufficient sophistication to ensure generalizability across languages and development.

Infant media use: A harm reduction approach

There are a myriad of potentially harmful developmental outcomes associated with infant digital media use. Studies revealing risk associated with early media use have informed the current American Academy of Pediatrics (AAP) recommendations that discourage most digital media use among children under 18 months of age. Recent research advances, however, suggest potential benefits of technology engagement in this age group. Additionally, surveys of parents reveal that most infants engage with digital media for at least 30 min a day, exceeding the AAP recommendations. In response to these discoveries and cultural trends, some scholars have made compelling cases to adapt the AAP guidelines for infants. A helpful model for developing infant digital media use guidelines for families may be the harm reduction approach. The intent of this review is to suggest adaptations to the AAP guidelines for infant media engagement using a harm reduction framework. This review describes the challenge of restrictive guidelines, briefly summarizes the harm reduction approach, provides a review of risks and benefits associated with infant media use in each developmental domain (physical, cognitive, and socioemotional), summarizes correlates of infant screen media use, and examines intervention strategies for reducing screen time. The paper concludes with examples of possible adaptations to current AAP infant media use recommendations using harm reduction and bioecological frameworks.

Toddler word learning from contingent screens with and without human presence

While previous studies have documented that toddlers learn less well from passive screens than from live interaction, the rise of interactive, digital screen media opens new perspectives, since some work has shown that toddlers can learn similarly well from a human present via video chat as from live exposure. The present study aimed to disentangle the role of human presence from other aspects of social interactions on learning advantages in contingent screen settings. We assessed 16-month-old toddlers' fast mapping of novel words from screen in three conditions: in-person, video chat, and virtual agent. All conditions built on the same controlled and scripted interaction. In the in-person condition, toddlers learned two novel word-object associations from an experimenter present in the same room and reacting contingently to infants' gaze direction. In the video chat condition, the toddler saw the experimenter in real time on screen, while the experimenter only had access to the toddler's real-time gaze position as captured by an eyetracker. This setup allowed contingent reactivity to the toddler's gaze while controlling for any cues beyond these instructions. The virtual agent condition was programmed to follow the infant's gaze, to smile, and to name the object with the same parameters as the experimenter in the other conditions. After the learning phase, all toddlers were tested on their word recognition in a looking-while-listening paradigm. Comparisons against chance revealed that toddlers showed above-chance word learning in the in-person group only. Toddlers in the virtual agent group showed significantly worse performance than those in the in-person group, while performance in the video chat group overlapped with the other two groups. These results confirm that in-person interaction leads to best learning outcomes even in the absence of rich social cues. They also elucidate that contingency is not sufficient either, and that in order for toddlers to learn from interactive digital media, more cues to social agency are required.