Making smart social judgments takes time: infants' recruitment of goal information when generating action predictions

What is in an action? Preschool children predict that agents take previous paths and not previous goals

Developmental science has experienced a vivid debate on whether young children prioritize goals over means in their prediction of others' actions. Influential developmental theories highlight the role of goal objects for action understanding. Yet, recent infant studies report evidence for the opposite. The empirical evidence is therefore inconclusive. The current study advanced this debate by assessing preschool children's verbal predictions of others' actions. In five experiments (N = 302), we investigated whether preschool children and adults predict agents to move towards their previous goal (that is, show goal-related predictions) or predict agents to move along the same movement path that they pursued before. While Experiments 1a, 1b and 1c presented young children and adults with animated agents, Experiments 2a and 2b presented participants with human grasping action. An integrative analysis across experiments revealed that children were more likely to predict the agent to move along the same movement path, Z = -4.574, p ≤ 0.0001 (r = 0.304). That is, preschool children were more likely to predict that agents would move along the same trajectory even though this action would lead to a new goal object. Thus, our findings suggest that young children's action prediction relies on the detection of spatial and movement information. Overall, we discuss our findings in terms of theoretical frameworks that conceive of action understanding as an umbrella term that comprises different forms and facets in which humans understand others' actions. RESEARCH HIGHLIGHTS: We investigated whether preschool children predict agents to move towards their previous goal or to move along the same movement path that they pursued before. Unlike adults, preschool children predicted that agents would move along the same trajectory even though this action would lead to a new goal. Adults' goal-based predictions were affected from contextual details, whereas children systematically made path-based predictions. Young children's action prediction relies on the detection of spatial and movement information.

Mirroring Communicative Actions: Contextual Modulation of Mu Rhythm Desynchronization in Response to the 'Back-Of-Hand' Action in 9-Month-Old Infants

This study measured mu rhythm desynchronization (MRD), while nine-month-old infants observed an agent extend her arm and hand, palm up ('back-of-hand action') either in social (object and recipient present), individual (object present, recipient absent), or social object-absent (recipient present, object absent) situations across two experiments. In addition, infants' MRD was measured as they reached for objects. Results revealed significant mu desynchronization in the right centro-parietal region selectively for the social group, indicating that infants processed the back-of-hand action as an object-directed request. Findings suggest to extend the action reconstruction account to object-directed communicative actions as well.

Emergent Goal-Anticipatory Gaze in Infants via Event-Predictive Learning and Inference

From about 7 months of age onward, infants start to reliably fixate the goal of an observed action, such as a grasp, before the action is complete. The available research has identified a variety of factors that influence such goal-anticipatory gaze shifts, including the experience with the shown action events and familiarity with the observed agents. However, the underlying cognitive processes are still heavily debated. We propose that our minds (i) tend to structure sensorimotor dynamics into probabilistic, generative event-predictive, and event boundary predictive models, and, meanwhile, (ii) choose actions with the objective to minimize predicted uncertainty. We implement this proposition by means of event-predictive learning and active inference. The implemented learning mechanism induces an inductive, event-predictive bias, thus developing schematic encodings of experienced events and event boundaries. The implemented active inference principle chooses actions by aiming at minimizing expected future uncertainty. We train our system on multiple object-manipulation events. As a result, the generation of goal-anticipatory gaze shifts emerges while learning about object manipulations: the model starts fixating the inferred goal already at the start of an observed event after having sampled some experience with possible events and when a familiar agent (i.e., a hand) is involved. Meanwhile, the model keeps reactively tracking an unfamiliar agent (i.e., a mechanical claw) that is performing the same movement. We qualitatively compare these modeling results to behavioral data of infants and conclude that event-predictive learning combined with active inference may be critical for eliciting goal-anticipatory gaze behavior in infants.

Heterogeneity of Visual Preferences for Biological and Repetitive Movements in Children With Autism Spectrum Disorder

Previous studies have repeatedly reported atypical visual preferences to repetitive movements and deficient perception of biological movements in individuals with autism spectrum disorder (ASD). However, limited research has investigated the heterogeneity of the visual preferences in individuals with ASD. In the current study, we explored the visual preferences to different movement types (repetitive, biological, and random) in children with ASD using a paired preferential looking paradigm. Thirty-nine children with ASD and 37 typically developing (TD) children participated in our study, with their eye movements recorded as the index of visual preferences. We examined the differences of visual preferences between the ASD and TD group, and the heterogeneity of visual preferences within the ASD group. We found group differences between children with ASD and TD children: Overall, the ASD group preferred repetitive movements while the TD group preferred biological movements. We also detected heterogeneity of visual preferences within the ASD group: Although the majority of children with ASD preferred repetitive movements as previous studies reported, 9 out of 39 children with ASD preferred biological movements similarly as their TD peers. Moreover, the visual preference patterns were correlated with autistic symptoms, especially the socio-communicative impairments. Our study provided evidence of heterogeneity of visual attention and main visual preference to repetitive movements in children with ASD. The findings add to the body of literature of the heterogeneous behavioral symptoms and the atypical visual preferences in individuals with ASD. LAY SUMMARY: The current study examined visual preferences to biological, repetitive, and random movements in children with Autism Spectrum Disorder (ASD). We showed a pair of two videos representing two types of movements (random, repetitive, or biological movements) to children with ASD and typically developing children. We found the main visual preferences for repetitive movements and heterogeneity of visual attention within the ASD group. Our findings provide theoretical and methodological implications for future study of the heterogeneity in the ASD population.

Let's get it together: Infants generate visual predictions based on collaborative goals

Infants engage in social interactions that include multiple partners from very early in development. A growing body of research shows that infants visually predict the outcomes of an individual's intentional actions, such as a person reaching towards an object (e.g., Krogh-Jespersen & Woodward, 2014), and even show sophistication in their predictions regarding failed actions (e.g., Brandone, Horwitz, Aslin, & Wellman, 2014). Less is known about infants' understanding of actions involving more than one individual (e.g., collaborative actions), which require representing each partners' actions in light of the shared goal. Using eye-tracking, Study 1 examined whether 14-month-old infants visually predict the actions of an individual based on her previously shared goal. Infants viewed videos of two women engaged in either a collaborative or noncollaborative interaction. At test, only one woman was present and infants' visual predictions regarding her future actions were measured. Fourteen-month-olds anticipated an individual's future actions based on her past collaborative behavior. Study 2 revealed that 11-month-old infants only visually predict higher-order shared goals after engaging in a collaborative intervention. Together, our results indicate that by the second year after birth, infants perceive others' collaborative actions as structured by shared goals and that active engagement in collaboration strengthens this understanding in young infants.

Thematic roles: Core knowledge or linguistic construct?

The status of thematic roles such as Agent and Patient in cognitive science is highly controversial: To some they are universal components of core knowledge, to others they are scholarly fictions without psychological reality. We address this debate by posing two critical questions: to what extent do humans represent events in terms of abstract role categories, and to what extent are these categories shaped by universal cognitive biases? We review a range of literature that contributes answers to these questions: psycholinguistic and event cognition experiments with adults, children, and infants; typological studies grounded in cross-linguistic data; and studies of emerging sign languages. We pose these questions for a variety of roles and find that the answers depend on the role. For Agents and Patients, there is strong evidence for abstract role categories and a universal bias to distinguish the two roles. For Goals and Recipients, we find clear evidence for abstraction but mixed evidence as to whether there is a bias to encode Goals and Recipients as part of one or two distinct categories. Finally, we discuss the Instrumental role and do not find clear evidence for either abstraction or universal biases to structure instrumental categories.

Six-Month-Old Infants Predict Agents' Goal-Directed Actions on Occluded Objects

Infants can infer agents' goals after observing agents' goal-directed actions on objects and can subsequently make predictions about how agents will act on objects in the future. We investigated the representations supporting these predictions. We familiarized 6-month-old infants to an agent who preferentially reached for one of two featurally distinct objects following a cue. At test, the objects were sequentially occluded from the infant in the agent's presence. We asked whether infants could generate action predictions without visual access to the relevant objects by measuring whether infants shifted their gaze to the location of the agent's hidden goal object following the cue. We also examined what infants represented about the hidden objects by removing one of the occluders to reveal either the original hidden object or the unexpected other object and measuring infants' looking time. We found that, even without visual access to the objects, infants made predictive gazes to the location of the agent's occluded goal object, but failed to represent the features of either hidden object. These results suggest that infants make goal-based action predictions when the relevant objects in the scene are occluded, but doing so may come at the expense of maintaining representations of the objects.

Goal prediction in 2-year-old children with and without autism spectrum disorder: An eye-tracking study

This study examined the predictive reasoning abilities of typically developing (TD) infants and 2-year-old children with autism spectrum disorder (ASD) in an eye-tracking paradigm. Participants watched a video of a goal-directed action in which a human actor reached for and grasped one of two objects. At test, the objects switched locations. Across these events, we measured: visual anticipation of the action outcome with kinematic cues (i.e., a completed reaching behavior); goal prediction of the action outcome without kinematic cues (i.e., an incomplete reach); and latencies to generate predictions across these two tasks. Results revealed similarities in action anticipation across groups when trajectory information regarding the intended goal was present; however, when predicting the goal without kinematic cues, developmental and diagnostic differences became evident. Younger TD children generated goal-based visual predictions, whereas older TD children were not systematic in their visual predictions. In contrast to both TD groups, children with ASD generated location-based predictions, suggesting that their visual predictions may reflect visuomotor perseveration. Together, these results suggest differences in early predictive reasoning abilities. Autism Res 2018, 11: 870-882. © 2018 International Society for Autism Research, Wiley Periodicals, Inc.

LAY SUMMARY

The current study examines the ability to generate visual predictions regarding other people's goal-directed actions, specifically reaching and grasping an object, in infants and children with and without autism spectrum disorder. Results showed no differences in abilities when movement information about a person's goal was evident; however, differences were evident across age and clinical diagnoses when relying on previous knowledge to generate a visual prediction.

Reaching the goal: Active experience facilitates 8-month-old infants' prospective analysis of goal-based actions

From early in development, infants view others' actions as structured by intentions, and this action knowledge may be supported by shared action production/perception systems. Because the motor system is inherently prospective, infants' understanding of goal-directed actions should support predictions of others' future actions, yet little is known about the nature and developmental origins of this ability, specifically whether young infants use the goal-directed nature of an action to rapidly predict future social behaviors and whether their action experience influences this ability. Across three conditions, we varied the level of action experience infants engaged in to determine whether motor priming influenced infants' ability to generate rapid social predictions. Results revealed that young infants accurately generated goal-based visual predictions when they had previously been reaching for objects; however, infants who passively observed a demonstration were less successful. Further analyses showed that engaging the cognitively based prediction system to generate goal-based predictions following motor engagement resulted in slower latencies to predict, suggesting that these smart predictions take more time to deploy. Thus, 8-month-old infants may have motor representations of goal-directed actions, yet this is not sufficient for them to predict others' actions; rather, their own action experience supports the ability to rapidly implement knowledge to predict future behavior.

Infants' Understanding of Object-Directed Action: An Interdisciplinary Synthesis

Recognizing that the object-directed actions of others are governed by goals and intentions is a crucial component of human interaction. These actions often occur rapidly and without explanation, yet we learn from and predict the actions of others with remarkable speed and accuracy, even during the first year of life. This review paper will serve as a bridge between several disparate literatures that, we suggest, can each contribute to our understanding of how infants interpret action. Specifically, we provide a review not just of research on infant goal attribution per se, but also incorporate findings from studies on the mirror neuron system and infant object cognition. The integration of these various research approaches allows for a novel construal of the extents and limits of early goal attribution – one in which the importance of the entire action context is considered – and points to specific future research directions.

Think fast! The relationship between goal prediction speed and social competence in infants

Skilled social interactions require knowledge about others' intentions and the ability to implement this knowledge in real-time to generate appropriate responses to one's partner. Young infants demonstrate an understanding of other people's intentions (e.g. Woodward, Sommerville, Gerson, Henderson & Buresh, 2009), yet it is not until the second year that infants seem to master the real-time implementation of their knowledge during social interactions (e.g. Warneken & Tomasello, 2007). The current study investigates the possibility that developments in social competence during the second year are related to increases in the speed with which infants can employ their understanding of others' intentions. Twenty- to 22-month-old infants (N = 23) viewed videos of goal-directed actions on a Tobii eye-tracker and then engaged in an interactive perspective-taking task. Infants who quickly and accurately anticipated another person's future behavior in the eye-tracking task were more successful at taking their partner's perspective in the social interaction. Success on the perspective-taking task was specifically related to the ability to correctly predict another person's intentions. These findings highlight the importance of not only being a 'smart' social partner but also a 'fast' social thinker.

Active Drumming Experience Increases Infants' Sensitivity to Audiovisual Synchrony during Observed Drumming Actions

In the current study, we examined the role of active experience on sensitivity to multisensory synchrony in six-month-old infants in a musical context. In the first of two experiments, we trained infants to produce a novel multimodal effect (i.e., a drum beat) and assessed the effects of this training, relative to no training, on their later perception of the synchrony between audio and visual presentation of the drumming action. In a second experiment, we then contrasted this active experience with the observation of drumming in order to test whether observation of the audiovisual effect was as effective for sensitivity to multimodal synchrony as active experience. Our results indicated that active experience provided a unique benefit above and beyond observational experience, providing insights on the embodied roots of (early) music perception and cognition.

Goal attributions and instrumental helping at 14 and 24 months of age

Infants reason about goals and helping as early as 3 months of age, but toddlers fail to help others appropriately until well into the second year. Five experiments explored the reasons for this discrepancy. First, we verified that 14-month-old toddlers encode the goal of an actor's reaching action, in a situation in which a social agent selectively reaches for one of two objects. Then, four further experiments presented toddlers with a social agent who manifested her goal in this manner when the two objects were accessible, and then requested help in obtaining her goal object when the two objects were out of reach. In all the experiments, toddlers responded to the actor's request for help by handing her an out-of-reach object, showing that they understood that a prosocial action was called for and were motivated to perform it. When the two objects had moved out of the social agent's sight so that she could not indicate the goal object directly, 24-month-old children used her prior goal-directed action to select the appropriate goal object, but 14-month-old toddlers did not. The 14-month-olds toddlers helped appropriately only when no attribution of enduring goals was necessary, because the social agent could see the out-of-reach object and both looked at and reached toward it while making her request. These findings suggest striking limits to 14-month-old toddlers' understanding of helping.

Shifting goals: effects of active and observational experience on infants' understanding of higher order goals

Action perception links have been argued to support the emergence of action understanding, but their role in infants’ perception of distal goals has not been fully investigated. The current experiments address this issue. During the development of means-end actions, infants shift their focus from the means of the action to the distal goal. In Experiment One, we evaluated whether this same shift in attention (from the means to the distal goal) when learning to produce multi-step actions is reflected in infants’ perception of others’ means-end actions. Eight-months-old infants underwent active training in means-end action production and their subsequent analysis of an observed means-end action was assessed in a visual habituation paradigm. Infants’ degree of success in the training paradigm was related to their subsequent interpretation of the observed action as directed at the means versus the distal goal. In Experiment Two, observational and control manipulations provided evidence that these effects depended on the infants’ active engagement in the means-end actions. These results suggest that the processes that give rise to means-end structure in infants’ motor behavior also support the emergence of means-end structure in their analysis of others’ goals.

Mirroring and the development of action understanding

The discovery of mirror neurons in the monkey motor cortex has inspired wide-ranging hypotheses about the potential relationship between action control and social cognition. In this paper, we consider the hypothesis that this relationship supports the early development of a critical aspect of social understanding, the ability to analyse others' actions in terms of goals. Recent investigations of infant action understanding have revealed rich connections between motor development and the analysis of goals in others' actions. In particular, infants' own goal-directed actions influence their analysis of others' goals. This evidence indicates that the cognitive systems that drive infants' own actions contribute to their analysis of goals in others' actions. These effects occur at a relatively abstract level of analysis both in terms of the structure infants perceive in others' actions and relevant structure in infants' own actions. Although the neural bases of these effects in infants are not yet well understood, current evidence indicates that connections between action production and action perception in infancy involve the interrelated neural systems at work in generating planned, intelligent action.