The link between perception and action in early infancy: From the viewpoint of the direct-matching hypothesis

Let's get it together: Infants generate visual predictions based on collaborative goals

Infants engage in social interactions that include multiple partners from very early in development. A growing body of research shows that infants visually predict the outcomes of an individual's intentional actions, such as a person reaching towards an object (e.g., Krogh-Jespersen & Woodward, 2014), and even show sophistication in their predictions regarding failed actions (e.g., Brandone, Horwitz, Aslin, & Wellman, 2014). Less is known about infants' understanding of actions involving more than one individual (e.g., collaborative actions), which require representing each partners' actions in light of the shared goal. Using eye-tracking, Study 1 examined whether 14-month-old infants visually predict the actions of an individual based on her previously shared goal. Infants viewed videos of two women engaged in either a collaborative or noncollaborative interaction. At test, only one woman was present and infants' visual predictions regarding her future actions were measured. Fourteen-month-olds anticipated an individual's future actions based on her past collaborative behavior. Study 2 revealed that 11-month-old infants only visually predict higher-order shared goals after engaging in a collaborative intervention. Together, our results indicate that by the second year after birth, infants perceive others' collaborative actions as structured by shared goals and that active engagement in collaboration strengthens this understanding in young infants.

Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement

In a social world, observing the actions of others is fundamental to understanding what they are doing, as well as their intentions and feelings. Studies of the neural basis and decoding of action observation are important for understanding action-related processes and have implications for cognitive, social neuroscience, and human-machine interaction (HMI). In the current study, we first investigated temporal-spatial dynamics during action observation using a combined 64-channel electroencephalography (EEG) and 48-channel functional near-infrared spectroscopy (fNIRS) system. We measured brain activation while 16 healthy participants observed three action tasks: (1) grasping a cup with the intention of drinking; (2) grasping a cup with the intention of moving it; and (3) touching a cup with an unclear intention. The EEG and fNIRS source analysis results revealed the dynamic involvement of both the mirror neuron system (MNS) and the theory of mind (ToM)/mentalizing network during action observation. The source analysis results suggested that the extent to which these two systems were engaged was determined by the clarity of the intention of the observed action. Based on the difference in neural activity observed among different action-observation tasks in the first experiment, we conducted a second experiment to classify the neural processes underlying action observation using a feature classification method. We constructed complex brain networks based on the EEG and fNIRS data. Fusing features from both EEG and fNIRS complex brain networks resulted in a classification accuracy of 72.7% for the three action observation tasks. This study provides a theoretical and empirical basis for elucidating the neural mechanisms of action observation and intention understanding, and a feasible method for decoding the underlying neural processes.

Six-Month-Old Infants Predict Agents' Goal-Directed Actions on Occluded Objects

Infants can infer agents' goals after observing agents' goal-directed actions on objects and can subsequently make predictions about how agents will act on objects in the future. We investigated the representations supporting these predictions. We familiarized 6-month-old infants to an agent who preferentially reached for one of two featurally distinct objects following a cue. At test, the objects were sequentially occluded from the infant in the agent's presence. We asked whether infants could generate action predictions without visual access to the relevant objects by measuring whether infants shifted their gaze to the location of the agent's hidden goal object following the cue. We also examined what infants represented about the hidden objects by removing one of the occluders to reveal either the original hidden object or the unexpected other object and measuring infants' looking time. We found that, even without visual access to the objects, infants made predictive gazes to the location of the agent's occluded goal object, but failed to represent the features of either hidden object. These results suggest that infants make goal-based action predictions when the relevant objects in the scene are occluded, but doing so may come at the expense of maintaining representations of the objects.

Goal prediction in 2-year-old children with and without autism spectrum disorder: An eye-tracking study

This study examined the predictive reasoning abilities of typically developing (TD) infants and 2-year-old children with autism spectrum disorder (ASD) in an eye-tracking paradigm. Participants watched a video of a goal-directed action in which a human actor reached for and grasped one of two objects. At test, the objects switched locations. Across these events, we measured: visual anticipation of the action outcome with kinematic cues (i.e., a completed reaching behavior); goal prediction of the action outcome without kinematic cues (i.e., an incomplete reach); and latencies to generate predictions across these two tasks. Results revealed similarities in action anticipation across groups when trajectory information regarding the intended goal was present; however, when predicting the goal without kinematic cues, developmental and diagnostic differences became evident. Younger TD children generated goal-based visual predictions, whereas older TD children were not systematic in their visual predictions. In contrast to both TD groups, children with ASD generated location-based predictions, suggesting that their visual predictions may reflect visuomotor perseveration. Together, these results suggest differences in early predictive reasoning abilities. Autism Res 2018, 11: 870-882. © 2018 International Society for Autism Research, Wiley Periodicals, Inc.

LAY SUMMARY

The current study examines the ability to generate visual predictions regarding other people's goal-directed actions, specifically reaching and grasping an object, in infants and children with and without autism spectrum disorder. Results showed no differences in abilities when movement information about a person's goal was evident; however, differences were evident across age and clinical diagnoses when relying on previous knowledge to generate a visual prediction.

Reaching the goal: Active experience facilitates 8-month-old infants' prospective analysis of goal-based actions

From early in development, infants view others' actions as structured by intentions, and this action knowledge may be supported by shared action production/perception systems. Because the motor system is inherently prospective, infants' understanding of goal-directed actions should support predictions of others' future actions, yet little is known about the nature and developmental origins of this ability, specifically whether young infants use the goal-directed nature of an action to rapidly predict future social behaviors and whether their action experience influences this ability. Across three conditions, we varied the level of action experience infants engaged in to determine whether motor priming influenced infants' ability to generate rapid social predictions. Results revealed that young infants accurately generated goal-based visual predictions when they had previously been reaching for objects; however, infants who passively observed a demonstration were less successful. Further analyses showed that engaging the cognitively based prediction system to generate goal-based predictions following motor engagement resulted in slower latencies to predict, suggesting that these smart predictions take more time to deploy. Thus, 8-month-old infants may have motor representations of goal-directed actions, yet this is not sufficient for them to predict others' actions; rather, their own action experience supports the ability to rapidly implement knowledge to predict future behavior.

Not Just Being Lifted: Infants are Sensitive to Delay During a Pick-Up Routine

In the present study we observed whether infants show online adjustments to the mother’s incipient action by looking at their sensitivity to changes as the pick-up unfolded. Twenty-three 3-month-old infants and their mothers were observed in the lab, where mothers were instructed (1) to pick-up their infants as they usually did (normal pick-up), and then (2) to delay the pick-up for 6 s after placing their hands on the infants’ waist (delayed pick-up). In both Normal and Delayed conditions infant’s body tension, affective displays and gaze shifts were coded during three phases: Approach, Contact, and Lift. Additionally, a measure of infants’ head support in terms of head lag at the beginning and end of Lift was computed. Results showed that during normal pick-up infants tensed up their body during the Approach phase and increased their tension during contact, maintaining it through Lift; their head was also supported and in line with their body during Lift. When the pick-up was delayed, infants also tensed their body during Approach, yet this tension did not increase during the Contact phase and was significantly lower at Lift. Their head support was also lower in the Delayed condition and they shifted their gazes away from their mothers’ face more often than in the Normal condition. These results suggest that infants are sensitive to changes of the timing of the pick-up sequence, which in turn may have affected their contribution to the interaction.

Shifting goals: effects of active and observational experience on infants' understanding of higher order goals

Action perception links have been argued to support the emergence of action understanding, but their role in infants’ perception of distal goals has not been fully investigated. The current experiments address this issue. During the development of means-end actions, infants shift their focus from the means of the action to the distal goal. In Experiment One, we evaluated whether this same shift in attention (from the means to the distal goal) when learning to produce multi-step actions is reflected in infants’ perception of others’ means-end actions. Eight-months-old infants underwent active training in means-end action production and their subsequent analysis of an observed means-end action was assessed in a visual habituation paradigm. Infants’ degree of success in the training paradigm was related to their subsequent interpretation of the observed action as directed at the means versus the distal goal. In Experiment Two, observational and control manipulations provided evidence that these effects depended on the infants’ active engagement in the means-end actions. These results suggest that the processes that give rise to means-end structure in infants’ motor behavior also support the emergence of means-end structure in their analysis of others’ goals.

A developmental perspective on action and social cognition

The target article argues that developmental processes are key to understanding the mirror neuron system, yet neglects several bodies of developmental research that are informative for doing so. Infants' actions and action understanding are structured by goals, and the former lends structure to the latter. Evaluating the origins and functions of mirror neurons depends on integrating investigations of neural, social-cognitive and motor development.

Making smart social judgments takes time: infants' recruitment of goal information when generating action predictions

Previous research has shown that young infants perceive others' actions as structured by goals. One open question is whether the recruitment of this understanding when predicting others' actions imposes a cognitive challenge for young infants. The current study explored infants' ability to utilize their knowledge of others' goals to rapidly predict future behavior in complex social environments and distinguish goal-directed actions from other kinds of movements. Fifteen-month-olds (N = 40) viewed videos of an actor engaged in either a goal-directed (grasping) or an ambiguous (brushing the back of her hand) action on a Tobii eye-tracker. At test, critical elements of the scene were changed and infants' predictive fixations were examined to determine whether they relied on goal information to anticipate the actor's future behavior. Results revealed that infants reliably generated goal-based visual predictions for the grasping action, but not for the back-of-hand behavior. Moreover, response latencies were longer for goal-based predictions than for location-based predictions, suggesting that goal-based predictions are cognitively taxing. Analyses of areas of interest indicated that heightened attention to the overall scene, as opposed to specific patterns of attention, was the critical indicator of successful judgments regarding an actor's future goal-directed behavior. These findings shed light on the processes that support “smart” social behavior in infants, as it may be a challenge for young infants to use information about others' intentions to inform rapid predictions.

Encouragement is Nothing Without Control: Factors Influencing the Development of Reaching and Face Preference

Four parent-guided training procedures aimed at facilitating independent reaching were compared in 36 three-month-old infants recruited for this study and 36 infants taken from previously published reports. Training procedures systematically varied whether parental encouragement to act on external objects was provided, and whether self-produced experiences of moving an object were present. Reaching behavior was assessed before and after training, and face preference was measured after training by recording infants’ eye gaze in a visual-preference task. Results showed that simultaneous experiences of parental encouragement and self-produced object motion encouraged successful reaching and face preference. Neither experience in isolation was effective, indicating that both external encouragement and self-produced action experiences are necessary to facilitate successful reaching. However, experiences with self-produced object motion increased infants’ face preference. This result provides evidence for a developmental link between self-produced motor experiences and the emergence of face preference in three-month-old infants.