Are We Real When We Fake? Attunement to Object Weight in Natural and Pantomimed Grasping Movements

Contextual expectations shape the motor coding of movement kinematics during the prediction of observed actions: A TMS study

Contextual information may shape motor resonance and support intention understanding during observation of incomplete, ambiguous actions. It is unclear, however, whether this effect is contingent upon kinematics ambiguity or contextual information is continuously integrated with kinematics to predict the overarching action intention. Moreover, a differentiation between the motor mapping of the intention suggested by context or kinematics has not been clearly demonstrated. In a first action execution phase, 29 participants were asked to perform reaching-to-grasp movements towards big or small food objects with the intention to eat or to move; electromyography from the First Dorsal Interosseous (FDI) and Abductor Digiti Minimi (ADM) was recorded. Depending on object size, the intentions to eat or to move were differently implemented by a whole-hand or a precision grip kinematics, thus qualifying an action-muscle dissociation. Then, in a following action prediction task, the same participants were asked to observe an actor performing the same actions and to predict his/her intention while motor resonance was assessed for the same muscles. Of note, videos were interrupted at early or late action phases, and actions were embedded in contexts pointing toward an eating or a moving intention, congruently or incongruently with kinematics. We found greater involvement of the FDI or ADM in the execution of precision or whole-hand grips, respectively. Crucially, this pattern of activation was mirrored during observation of the same actions in congruent contexts, but it was cancelled out or reversed in the incongruent ones, either when videos were interrupted at either early or long phases of action deployment. Our results extend previous evidence by showing that contextual information shapes motor resonance not only under conditions of perceptual uncertainty but also when more informative kinematics is available.

Anticipation (second-order motor planning) is stored in memory - processing of grasp postures in a priming paradigm

The end-state comfort effect (ESC) describes the tendency to grasp an object with an initial uncomfortable grasp posture in order to achieve a comfortable end posture. The ESC is an example for anticipative processes in manual action. ESC planning is investigated in many studies where this effect is measured in the context of motor observation and motion capture. However, there is little evidence if the anticipative link between different action states, especially between initial grasp postures and comfortable end postures, is represented in memory. The aim of the present study was to investigate whether the perception of a grasp posture holding a bar leads to the activation of action-related representations of grasping actions. For this purpose, a priming paradigm was used in which prime images were shown depicting either a comfortable (overhand grip) or uncomfortable (underhand grip) grasp posture holding a two-colored bar. The subsequently shown target images represented either a comfortable (thumb-up) or uncomfortable (thumb-down) final grasp posture of this grasping action. Due to the different grasp postures in the prime and target, prime-target pairs represented different types of action sequences. Furthermore, physically possible, and physically impossible actions were presented. Participants were asked to react to the top color of the bar shown in the target-picture, whereby the shown grasp posture was irrelevant for this decision. Results showed that reaction times did not differ after presentation of an overhand grip to target pictures showing comfortable or uncomfortable final grasp postures. In contrast, after presentation of an underhand grip in the prime, reactions to target pictures with final comfortable grasp postures were faster compared to target pictures with uncomfortable grasp postures. The effect was only found for the physically possible action. The findings suggest that the perception of the underhand grip leads to cognitive pre-activation of a final action state. The present study suggests that the association between an initial uncomfortable underhand grip and its action effect, in form of a final action state that is consistent with the ESC, is represented in memory. Such motor representation might be important for the anticipation and control of goal-directed grasping.

A glimpse into social perception in light of vitality forms

The American psychoanalyst and developmental psychologist Daniel Stern's idea of vitality forms might suggest a new solution to explain how other minds are intensely expressed in their actions. Vitality forms characterize the expressive style of actions. The effective perception of vitality forms allows people to recognize the affective states and intentions of others in their actions, and could even open the possibility of properties of objects that are indicated by the given actions. Currently, neurophysiological studies present that there might be a neural mirror mechanism in the dorso-central insula (DCI), middle cingulate cortex (MCC), and other related cerebral areas, which serve to preferably perceive and deliver vitality forms of actions. In this article, possible types of vitality forms related to other minds, which have been brought to particular attention in recent years, have been collected and discussed in the following four areas: (1) Vitality forms on understanding non-verbal intention, (2) on understanding verbal intention, (3) vitality forms as grounding social cognition, and (4) as grounding social emotion. These four areas, however, might refer to an entirety of a binary actor-observer communicative landscape. In this review, we try to simplify the analysis by relying on two fundamental dimensions of criteria: first, the idea of vitality forms is conceived as the most basic way of observing subsequent higher-order dimensions of action, that is, understanding intention in the style of action. Thus, in the first two subsections, the relationships between vitality forms and their roles in understanding non-verbal and verbal intention have been discussed. Second, vitality forms could also be conceived as background conditions of all the other mental categories, that is, vitality forms can ground cognition and emotion in a social context. In the second dimension, the existence of social cognition or emotion depends on the existence of the stylistic kinematics of action. A grounding relation is used to distinguish a ground, that is, vitality forms, and its grounded mental categories. As relating with the domain of social perception, in this review, it has been discussed vitality forms possibly could ground social cognition and social emotion, respectively.

Visual estimation of the force applied by another person

As observers, we believe that we can visually estimate the force that another person is applying to a material. However, it is unclear what kind of cues we use to do this. We focused on two types of visual change that occur when actors push an elastic material from above with their fingers: visual shaking and visual indentation depth. The first one relates to a finger/hand shaking, known as an "induced tremor", and the second one relates to material deformation due to the application of force. We found that human observers mainly used visual shaking to estimate the force being applied by another person in a video clip. Overall, the apparent applied force was perceived to be stronger when the level of visual shaking was greater. We also found that observers mainly used visual indentation depth and visual shaking to estimate the softness rating of materials. Overall, the apparent softness was perceived to be greater when the visual indentation depth was larger and the level of visual shaking was lower, which indicates that observers use visual shaking to estimate the force being applied, and that estimated force is then used for an estimation of softness.

Do graspable objects always leave a motor signature? A study on memory traces

Several studies have reported the existence of reciprocal interactions between the type of motor activity physically performed on objects and the conceptual knowledge that is retained of them. Whether covert motor activity plays a similar effect is less clear. Certainly, objects are strong triggers for actions, and motor components can make the associated concepts more memorable. However, addition of an action-related memory trace may not always be automatic and could rather depend on 'how' objects are encountered. To test this hypothesis, we compared memory for objects that passive observers experienced as verbal labels (the word describing them), visual images (color photographs) and actions (pantomimes of object use). We predicted that the more direct the involvement of action-related representations the more effective would be the addition of a motor code to the experience and the more accurate would be the recall. Results showed that memory for objects presented as words i.e., a format that might only indirectly prime the sensorimotor system, was generally less accurate compared to memory for objects presented as photographs or pantomimes, which are more likely to directly elicit motor simulation processes. In addition, free recall of objects experienced as pantomimes was more accurate when these items afforded actions performed towards one's body than actions directed away from the body. We propose that covert motor activity can contribute to objects' memory, but the beneficial addition of a motor code to the experience is not necessarily automatic. An advantage is more likely to emerge when the observer is induced to take a first-person stance during the encoding phase, as may happen for objects affording actions directed towards the body, which obviously carry more relevance for the actor.

Facial Signals and Social Actions in Multimodal Face-to-Face Interaction

In a conversation, recognising the speaker's social action (e.g., a request) early may help the potential following speakers understand the intended message quickly, and plan a timely response. Human language is multimodal, and several studies have demonstrated the contribution of the body to communication. However, comparatively few studies have investigated (non-emotional) conversational facial signals and very little is known about how they contribute to the communication of social actions. Therefore, we investigated how facial signals map onto the expressions of two fundamental social actions in conversations: asking questions and providing responses. We studied the distribution and timing of 12 facial signals across 6778 questions and 4553 responses, annotated holistically in a corpus of 34 dyadic face-to-face Dutch conversations. Moreover, we analysed facial signal clustering to find out whether there are specific combinations of facial signals within questions or responses. Results showed a high proportion of facial signals, with a qualitatively different distribution in questions versus responses. Additionally, clusters of facial signals were identified. Most facial signals occurred early in the utterance, and had earlier onsets in questions. Thus, facial signals may critically contribute to the communication of social actions in conversation by providing social action-specific visual information.

A whole body characterization of individual strategies, gender differences, and common styles in overarm throwing

Overarm throwing is a fundamental human skill. Since paleolithic hunter-gatherer societies, the ability of throwing played a key role in brain and body co-evolution. For decades, throwing skill acquisition has been the subject of developmental and gender studies. However, due to its complex multijoint nature, whole body throwing has found little space in quantitative studies of motor behavior. In this study we examined how overarm throwing varies within and between individuals in a sample of untrained adults. To quantitatively compare whole body kinematics across throwing actions, we introduced a new combination of spatiotemporal principal component, linear discrimination, and clustering analyses. We found that the identity and gender of a thrower can be robustly inferred by the kinematics of a single throw, reflecting the characteristic features in individual throwing strategies and providing a quantitative ground for the well-known differences between males and females in throwing behavior. We also identified four main classes of throwing strategies, stable within individuals and resembling the main stages of throwing proficiency acquisition during motor development. These results support earlier proposals linking interindividual and gender differences in throwing, with skill acquisition interrupted at different stages of the typical developmental trajectory of throwing motor behavior.NEW & NOTEWORTHY Unconstrained throwing, because of its complexity, received little attention in quantitative motor control studies. By introducing a new approach to analyze whole body kinematics, we quantitatively characterized gender effects, interindividual differences, and common patterns in nontrained throwers. The four throwing styles identified across individuals resemble different stages in the acquisition of throwing skills during development. These results advance our understanding of complex motor skills, bridging the gap between motor control, motor development, and sport science.

A review of grasping as the movements of digits in space

It is tempting to describe human reach-to-grasp movements in terms of two, more or less independent visuomotor channels, one relating hand transport to the object’s location and the other relating grip aperture to the object’s size. Our review of experimental work questions this framework for reasons that go beyond noting the dependence between the two channels. Both the lack of effect of size illusions on grip aperture and the finding that the variability in grip aperture does not depend on the object’s size indicate that size information is not used to control grip aperture. An alternative is to describe grip formation as emerging from controlling the movements of the digits in space. Each digit’s trajectory when grasping an object is remarkably similar to its trajectory when moving to tap the same position on its own. The similarity is also evident in the fast responses when the object is displaced. This review develops a new description of the speed-accuracy trade-off for multiple effectors that is applied to grasping. The most direct support for the digit-in-space framework is that prism-induced adaptation of each digit’s tapping movements transfers to that digit’s movements when grasping, leading to changes in grip aperture for adaptation in opposite directions for the two digits. We conclude that although grip aperture and hand transport are convenient variables to describe grasping, treating grasping as movements of the digits in space is a more suitable basis for understanding the neural control of grasping.

Highs and Lows in Motor Control Development

Motor control is classically described as relying on two components: anticipatory control (feedforward processing) and online control (feedback processing). Here we aimed to unveil the developmental steps of both feedback and feedforward control in 5-10 years old children, using a simple and ecological task. We manipulated object's weight in a reach-to-displace paradigm. When the weight was known before lifting it, anticipatory processes were quantifiable during the reaching phase. Conversely, an unknown weight triggered online corrections during the displacing phase. Movement kinematics revealed that children anticipate this objet property as young as 5 y-o. This anticipation becomes adequate around 7 y-o and is paralleled by poor online corrections. This simple yet relevant paradigm should allow quantifying deviations from neurotypical patterns in disorders of motor control.

Does gesture strengthen sensorimotor knowledge of objects? The case of the size-weight illusion

Co-speech gestures have been proposed to strengthen sensorimotor knowledge related to objects’ weight and manipulability. This pre-registered study (https://www.osf.io/9uh6q/) was designed to explore how gestures affect memory for sensorimotor information through the application of the visual-haptic size-weight illusion (i.e., objects weigh the same, but are experienced as different in weight). With this paradigm, a discrepancy can be induced between participants’ conscious illusory perception of objects’ weight and their implicit sensorimotor knowledge (i.e., veridical motor coordination). Depending on whether gestures reflect and strengthen either of these types of knowledge, gestures may respectively decrease or increase the magnitude of the size-weight illusion. Participants (N = 159) practiced a problem-solving task with small and large objects that were designed to induce a size-weight illusion, and then explained the task with or without co-speech gesture or completed a control task. Afterwards, participants judged the heaviness of objects from memory and then while holding them. Confirmatory analyses revealed an inverted size-weight illusion based on heaviness judgments from memory and we found gesturing did not affect judgments. However, exploratory analyses showed reliable correlations between participants’ heaviness judgments from memory and (a) the number of gestures produced that simulated actions, and (b) the kinematics of the lifting phases of those gestures. These findings suggest that gestures emerge as sensorimotor imaginings that are governed by the agent’s conscious renderings about the actions they describe, rather than implicit motor routines.

Numerical Affordance Influences Action Execution: A Kinematic Study of Finger Movement

Humans represent symbolic numbers as oriented from left to right: the mental number line (MNL). Up to now, scientific studies have mainly investigated the MNL by means of response times. However, the existing knowledge on the MNL can be advantaged by studies on motor patterns while responding to a number. Cognitive representations, in fact, cannot be fully understood without considering their impact on actions. Here we investigated whether a motor response can be influenced by number processing. Participants seated in front of a little soccer goal. On each trial they were visually presented with a numerical (2, 5, 8) or a non-numerical ($) stimulus. They were instructed to kick a small ball with their right index toward a frontal soccer goal as soon as a stimulus appeared on a screen. However, they had to refrain from kicking when number five was presented (no-go signal). Our main finding is that performing a kicking action after observation of the larger digit proved to be more efficient: the trajectory path was shorter and lower on the surface, velocity peak was anticipated. The smaller number, instead, specifically altered the temporal and spatial aspects of trajectories, leading to more prolonged left deviations. This is the first experimental demonstration that the reaching component of a movement is influenced by number magnitude. Since this paradigm does not require any verbal skill and non-symbolic stimuli (array of dots) can be used, it could be fruitfully adopted to evaluate number abilities in children and even preschoolers. Notably, this is a self-motivating and engaging task, which might help children to get involved and to reduce potential arousal connected to institutional paper-and-pencil examinations.

Estimating Tactile Perception by Observing Explorative Hand Motion of Others

When we acquire tactile information about an object's surface, we actively move our hands. Past studies have shown a correlation between participants' (i.e., touchers') hand motion in tactile exploration and the evaluated tactile attributes of the object, which suggests that tactile perception can be estimated from statistical analysis of touchers' hand motion. Though it has been reported that the statistical analysis of hand motion can indeed estimate tactile perception, whether humans can estimate tactile perception by observing the hand motion of others remains unclear. To investigate this, we conducted experiments wherein observers watched point-light moving hands of touchers in tactile exploration and evaluated the material being touched. Our results show that, although observers' estimation of touchers' perception was not accurate, observers extracted information from touchers' hand motion for estimation, and the correlations within observers' estimation were high. These results suggest that human observers can estimate tactile perception through visual observation of the hand motion of others by adopting common strategies about the relationships between touchers' hand motion and tactile perception.

The heaviness of invisible objects: Predictive weight judgments from observed real and pantomimed grasps

Observation of others' actions has been proposed to provide a shared experience of the properties of objects acted upon. We report results that suggest a similar form of shared experience may be gleaned from the observation of pantomimed grasps, i.e., grasps aimed at pretended objects. In a weight judgment task, participants were asked to observe a hand reaching towards and grasping either a real or imagined glass, and to predictively judge its weight. Results indicate that participants were able to discriminate whether the to-be-grasped glass was empty, and thus light, or full, and thus heavy. Worthy of further investigation, this finding suggests that by observing others' movements we can make predictions, and form expectations about the characteristics of objects that exist only in others' minds.