Perceiving what you intend to do from what you do: evidence for embodiment in social interactions

Dyadic body competence predicts movement synchrony during the mirror game

The process of synchronizing our body movements with others is known to enhance rapport, affect, and prosociality. Furthermore, emerging evidence suggests that synchronizing activities may enhance cognitive performance. Unknown, by contrast, is the extent to which people's individual traits and experiences influence their ability to achieve and maintain movement synchrony with another person, which is key for unlocking the social and affective benefits of movement synchrony. Here, we take a dyad-centered approach to gain a deeper understanding of the role of embodiment in achieving and maintaining movement synchrony. Using existing data, we explored the relationship between body competence and body perception scores at the level of the dyad, and the dyad's movement synchrony and complexity while playing a 2.5-min movement mirroring game. The data revealed that dyadic body competence scores positively correlate with movement synchrony, but not complexity, and that dyadic body perception scores are not associated with movement synchrony or complexity. Movement synchrony was greater when the more experienced member of the dyad was responsible for copying movements. Finally, movement synchrony and complexity were stable across the duration of the mirror game. These findings show that movement synchrony is sensitive to the composition of the dyad involved, specifically the dyad's embodiment, illuminating the value of dyadic approaches to understanding body movements in social contexts.

Learning from illusions: From perception studies to perspective-taking interventions

Visual illusions have always fascinated people but they have often been confined to the field of entertainment. Although philosophers, psychologists and neuroscientists have used them to explore the bases of human perception and to teach about vision, these attractive tools have still remained largely underexploited. The goal of the present paper is to argue that visual illusions can also serve as a powerful medium to question our relation to the world and to others, as they demonstrate that we do not fully perceive reality and that each interpretation of the world may be equally sound. Further, specific 3D visual illusions, such as 3D ambiguous objects that give rise to two specific interpretations, enable the viewer to realize that their perception is tied to their viewing point, and that this may also apply to social cognition and interactions. Specifically, this low-level embodied experience should generalize to other levels and enhance the consideration of others' perspective independently of the type of representations. Therefore, the use of illusions in general, and 3D ambiguous objects in particular, constitutes an avenue for future interventions designed to increase our perspective-taking abilities and the pacification of social relations through mutual understanding, which is particularly relevant in the current era.

A systematic review of handover actions in human dyads

Introduction

Handover actions are joint actions in which an object is passed from one actor to another. In order to carry out a smooth handover action, precise coordination of both actors' movements is of critical importance. This requires the synchronization of both the kinematics of the reaching movement and the grip forces of the two actors during the interaction. Psychologists, for example, may be interested in studying handover actions in order to identify the cognitive mechanisms underlying the interaction of two partners. In addition, robotic engineers may utilize insights from sensorimotor information processing in human handover as models for the design controllers in robots in hybrid (human-robot) interaction scenarios. To date, there is little knowledge transfer between researchers in different disciplines and no common framework or language for the study of handover actions.

Methods

For this reason, we systematically reviewed the literature on human-human handover actions in which at least one of the two types of behavioral data, kinematics or grip force, was measured.

Results

Nine relevant studies were identified. The different methodologies and results of the individual studies are here described and contextualized.

Discussion

Based on these results, a common framework is suggested that, provides a distinct and straightforward language and systematics for use in future studies. We suggest to term the actors as giver and receiver, as well as to subdivide the whole action into four phases: (1) Reach and grasp, (2) object transport, (3) object transfer, and (4) end of handover to comprehensively and clearly describe the handover action. The framework aims to foster the necessary exchange between different scientific disciplines to promote research on handover actions. Overall, the results support the assumption that givers adapt their executions according to the receiver's intentions, that the start of the release of the object is processed feedforward and that the release process is feedback-controlled in the transfer phase. We identified the action planning of the receiver as a research gap.

The implicit effect of action mental simulation on action evaluation

The main assumption underlying the present investigation is that action observation elicits a mandatory mental simulation representing the action forward in time. In Experiment 1, participants observed pairs of photos portraying the initial and the final still frames of an action video; then they observed a photo depicting the very same action but either forward or backward in time. Their task was to tell whether the action in the photo portrayed something happened before or after the action seen at encoding. In this explicit task, the evaluation was faster for forward photos than for backward photos. Crucially, the effect was replicated when instructions asked only to evaluate at test whether the photo depicted a scene congruent with the action seen at encoding (implicit task from two still frames, Experiment 2), and when at encoding, they were presented a single still frame and evaluated at test whether a photo depicted a scene congruent with the action seen at encoding (implicit task from single still frame; Experiment 3). Overall, the results speak in favour of a mandatory mechanism through which our brain simulates the action also in tasks that do not explicitly require action simulation.

Effect of Social Context on Cognitive and Motor Behavior: A Systematic Review

Human cognitive and motor behavior is influenced by the social contexts. The aim of this systematic review is to investigate the impact of the social contexts on human behaviors. A systematic search of the literature was performed via Pub-Med/Medline, Web of sciences, Google scholar, Science direct, Springer-Link and EMBASE and 68 articles were selected. After applying all the inclusion and exclusion criteria, 16 articles were retained. The results show that the presence of other people and the social context influence motor behavior (i.e. movement duration, trajectory behavior, maximum speed) and cognitive behavior (reaction time). Studies have shown an improvement in performance in the presence of other people compared to the individual situation. However, other studies showed that the presence of other people led to deterioration in performance compared to the individual situation. The improvement of behavior is attributed to the social phenomenon of facilitation while the deterioration was explained by the conduct theory or the distraction conflict theory. These social phenomena of facilitation or inhibition could be related to the perception-action theory, which interferes with interaction with other. This, in turn, seems to be associated with neural circuits of mirror neurons and motor system.

The combined effects of motor and social goals on the kinematics of object-directed motor action

Voluntary actions towards manipulable objects are usually performed with a particular motor goal (i.e., a task-specific object-target-effector interaction) and in a particular social context (i.e., who would benefit from these actions), but the mutual influence of these two constraints has not yet been properly studied. For this purpose, we asked participants to grasp an object and place it on either a small or large target in relation to Fitts’ law (motor goal). This first action prepared them for a second grasp-to-place action which was performed under temporal constraints, either by the participants themselves or by a confederate (social goal). Kinematic analysis of the first preparatory grasp-to-place action showed that, while deceleration time was impacted by the motor goal, peak velocity was influenced by the social goal. Movement duration and trajectory height were modulated by both goals, the effect of the social goal being attenuated by the effect of the motor goal. Overall, these results suggest that both motor and social constraints influence the characteristics of object-oriented actions, with effects that combine in a hierarchical way.

Observer-Agent Kinematic Similarity Facilitates Action Intention Decoding

It is well known that the kinematics of an action is modulated by the underlying motor intention. In turn, kinematics serves as a cue also during action observation, providing hints about the intention of the observed action. However, an open question is whether decoding others’ intentions on the basis of their kinematics depends solely on how much the kinematics varies across different actions, or rather it is also influenced by its similarity with the observer motor repertoire. The execution of reach-to-grasp and place actions, differing for target size and context, was recorded in terms of upper-limb kinematics in 21 volunteers and in an actor. Volunteers had later to observe the sole reach-to-grasp phase of the actor’s actions, and predict the underlying intention. The potential benefit of the kinematic actor-participant similarity for recognition accuracy was evaluated. In execution, both target size and context modulated specific kinematic parameters. More importantly, although participants performed above chance in intention recognition, the similarity of motor patterns positively correlated with recognition accuracy. Overall, these data indicate that kinematic similarity exerts a facilitative role in intention recognition, providing further support to the view of action intention recognition as a visuo-motor process grounded in motor resonance.

Mnemonic effects of action simulation from pictures and phrases

Several theoretical approaches suggest that language comprehension and action observation rely on similar mental simulations. Granted that these two simulations partially overlap, we assumed that simulations stemming from action observations are more direct than those stemming from action phrases. The implied prediction was that simulation from action observation should prevail on simulation from action phrases when their effects are contrasted. The results of three experiments confirmed that, when at encoding the phrases were paired with pictures of actions whose kinematics was incongruent with the implied kinematics of the actions described in the phrases, memory for action phrases was impaired (Experiment 1). However, the reverse was not true: when the pictures were paired with phrases representing actions whose kinematics were incongruent with the kinematics of the actions portrayed in the pictures, memory for pictures portraying actions was not impaired (Experiment 2). Also, in line with evidence that simulations from action phrases and those from action observation partially overlap, when their effects were not contrasted their products were misrecognized. In our experiments, when action phrases only presented at recognition described actions depicted in pictures seen at encoding, they were misrecognized as had already been read at encoding (Experiment 1); further, when pictures only presented at recognition portrayed actions described in phrases presented at encoding, they were misrecognized as seen at encoding (Experiment 2). A third experiment excluded the possibility that the pattern of findings was simply a consequence of better memory for pictures of actions as opposed to memory for action phrases (Experiment 3). The implications of our results in relation to the literature on simulation in language comprehension and action observation are discussed.

Contribution of Developmental Psychology to the Study of Social Interactions: Some Factors in Play, Joint Attention and Joint Action and Implications for Robotics

Children exchange information through multiple modalities, including verbal communication, gestures and social gaze and they gradually learn to plan their behavior and coordinate successfully with their partners. The development of joint attention and joint action, especially in the context of social play, provides rich opportunities for describing the characteristics of interactions that can lead to shared outcomes. In the present work, we argue that human-robot interactions (HRI) can benefit from these developmental studies, through influencing the human's perception and interpretation of the robot's behavior. We thus endeavor to describe some components that could be implemented in the robot to strengthen the feeling of dealing with a social agent, and therefore improve the success of collaborative tasks. Focusing in particular on motor precision, coordination, and anticipatory planning, we discuss the question of complexity in HRI. In the context of joint activities, we highlight the necessity of (1) considering multiple speech acts involving multimodal communication (both verbal and non-verbal signals), and (2) analyzing separately the forms and functions of communication. Finally, we examine some challenges related to robot competencies, such as the issue of language and symbol grounding, which might be tackled by bringing together expertise of researchers in developmental psychology and robotics.

Humans adjust their grip force when passing an object according to the observed speed of the partner's reaching out movement

The way an object is released by the passer to a partner is fundamental for the success of the handover and for the experienced fluency and quality of the interaction. Nonetheless, although its apparent simplicity, object handover involves a complex combination of predictive and reactive control mechanisms that were not fully investigated so far. Here, we show that passers use visual-feedback based anticipatory control to trigger the beginning of the release, to launch the appropriate motor program, and adapt such predictions to different speeds of the receiver’s reaching out movements. In particular, the passer starts releasing the object in synchrony with the collision with the receiver, regardless of the receiver’s speed, but the passer’s speed of grip force release is correlated with receiver speed. When visual feedback is removed, the beginning of the passer’s release is delayed proportionally with the receiver’s reaching out speed; however, the correlation between the passer’s peak rate of change of grip force is maintained. In a second study with 11 participants receiving an object from a robotic hand programmed to release following stereotypical biomimetic profiles, we found that handovers are experienced as more fluent when they exhibit more reactive release behaviours, shorter release durations, and shorter handover durations. The outcomes from the two studies contribute understanding of the roles of sensory input in the strategy that empower humans to perform smooth and safe handovers, and they suggest methods for programming controllers that would enable artificial hands to hand over objects with humans in an easy, natural and efficient way.

Cooperative and competitive contexts do not modify the effect of social intention on motor action

In social interactions, the movements performed by others can be used to anticipate their intention. The present paper investigates whether cooperative vs competitive contexts influence the kinematics of object-directed motor actions and whether they modulate the effect of social intention on motor actions. An "Actor" and a "Partner" participated in a task consisting in displacing a wooden dowel under time constraint. Before this Main action, the Actor performed a Preparatory action which consisted in placing the dowel at the center of the table. Information about who would make the forthcoming Main action was provided only to the Actor through headphones. Results demonstrate an exaggeration of spatial and temporal actions' parameters when acting for the Partner, in cooperative, as well as in competitive context. This finding suggests that the motor manifestation of social intention is largely determined by non-conscious implicit processes that seem little influenced by the context of social interaction.

The role of perspective in discriminating between social and non-social intentions from reach-to-grasp kinematics

Making correct inferences regarding social and individual intentions may be crucial for successful interactions, especially when we are required to discriminate between cooperative and competitive behaviors. The results of previous studies indicate that reach-to-grasp kinematic parameters may be used to infer the social or individual outcome of a movement. However, the majority of the studies investigated this ability by presenting reach-to-grasp movements from a third-person perspective only. The aim of the present study was to assess whether the ability to recognize the intent associated to a reach-to-grasp movement varies as a function of perspective by manipulating the perspective of observation (second- and third-perspective) within participants. To this end, we presented participants with video clips of models performing a reach-to-grasp movement with different intents. The video clips were recorded both from a lateral view (third-person perspective) and from a frontal view (second-person perspective). After viewing the clips, in two subsequent tasks participants were asked to distinguish between social and non-social intentions by observing the initial phase of the same action recorded from the two different views. Results showed that, when a fast-speed movement was presented from a lateral view, participants were able to predict its social intention. In contrast, when the same movement was observed from a frontal view, performance was impaired. These results indicate that the ability to detect social intentions from motor cues can be biased by the visual perspective of the observer, specifically for fast-speed movements.

Faster but Less Careful Prehension in Presence of High, Rather than Low, Social Status Attendees

Ample evidence attests that social intention, elicited through gestures explicitly signaling a request of communicative intention, affects the patterning of hand movement kinematics. The current study goes beyond the effect of social intention and addresses whether the same action of reaching to grasp an object for placing it in an end target position within or without a monitoring attendee's peripersonal space, can be moulded by pure social factors in general, and by social facilitation in particular. A motion tracking system (Optotrak Certus) was used to record motor acts. We carefully avoided the usage of communicative intention by keeping constant both the visual information and the positional uncertainty of the end target position, while we systematically varied the social status of the attendee (a high, or a low social status) in separated blocks. Only thirty acts performed in the presence of a different social status attendee, revealed a significant change of kinematic parameterization of hand movement, independently of the attendee's distance. The amplitude of peak velocity reached by the hand during the reach-to-grasp and the lift-to-place phase of the movement was larger in the high rather than in the low social status condition. By contrast, the deceleration time of the reach-to-grasp phase and the maximum grasp aperture was smaller in the high rather than in the low social status condition. These results indicated that the hand movement was faster but less carefully shaped in presence of a high, but not of a low social status attendee. This kinematic patterning suggests that being monitored by a high rather than a low social status attendee might lead participants to experience evaluation apprehension that informs the control of motor execution. Motor execution would rely more on feedforward motor control in the presence of a high social status human attendee, vs. feedback motor control, in the presence of a low social status attendee.

Facilitation effect of observed motor deviants in a cooperative motor task: Evidence for direct perception of social intention in action

Spatiotemporal parameters of voluntary motor action may help optimize human social interactions. Yet it is unknown whether individuals performing a cooperative task spontaneously perceive subtly informative social cues emerging through voluntary actions. In the present study, an auditory cue was provided through headphones to an actor and a partner who faced each other. Depending on the pitch of the auditory cue, either the actor or the partner were required to grasp and move a wooden dowel under time constraints from a central to a lateral position. Before this main action, the actor performed a preparatory action under no time constraint, consisting in placing the wooden dowel on the central location when receiving either a neutral ("prêt"-ready) or an informative auditory cue relative to who will be asked to perform the main action (the actor: "moi"-me, or the partner: "lui"-him). Although the task focused on the main action, analysis of motor performances revealed that actors performed the preparatory action with longer reaction times and higher trajectories when informed that the partner would be performing the main action. In this same condition, partners executed the main actions with shorter reaction times and lower velocities, despite having received no previous informative cues. These results demonstrate that the mere observation of socially driven motor actions spontaneously influences the low-level kinematics of voluntary motor actions performed by the observer during a cooperative motor task. These findings indicate that social intention can be anticipated from the mere observation of action patterns.