Predicting object size from hand kinematics: a temporal perspective

Contextual expectations shape the motor coding of movement kinematics during the prediction of observed actions: a TMS study

Contextual information may shape motor resonance and support intention understanding during observation of incomplete, ambiguous actions. It is unclear, however, whether this effect is contingent upon kinematics ambiguity or contextual information is continuously integrated with kinematics to predict the overarching action intention. Moreover, a differentiation between the motor mapping of the intention suggested by context or kinematics has not been clearly demonstrated. In a first action execution phase, 29 participants were asked to perform reaching-to-grasp movements towards big or small food objects with the intention to eat or to move; electromyography from the First Dorsal Interosseous (FDI) and Abductor Digiti Minimi (ADM) was recorded. Depending on object size, the intentions to eat or to move were differently implemented by a whole-hand or a precision grip kinematics, thus qualifying an action-muscle dissociation. Then, in a following action prediction task, the same participants were asked to observe an actor performing the same actions and to predict his/her intention while motor resonance was assessed for the same muscles. Of note, videos were interrupted at early or late action phases, and actions were embedded in contexts pointing toward an eating or a moving intention, congruently or incongruently with kinematics. We found greater involvement of the FDI or ADM in the execution of precision or whole-hand grips, respectively. Crucially, this pattern of activation was mirrored during observation of the same actions in congruent contexts, but it was cancelled out or reversed in the incongruent ones, either when videos were interrupted at either early or long phases of action deployment. Our results extend previous evidence by showing that contextual information shapes motor resonance not only under conditions of perceptual uncertainty but also when more informative kinematics is available.

Contextual Priors Shape Action Understanding before and beyond the Unfolding of Movement Kinematics

Previous studies have shown that contextual information may aid in guessing the intention underlying others' actions in conditions of perceptual ambiguity. Here, we aimed to evaluate the temporal deployment of contextual influence on action prediction with increasing availability of kinematic information during the observation of ongoing actions. We used action videos depicting an actor grasping an object placed on a container to perform individual or interpersonal actions featuring different kinematic profiles. Crucially, the container could be of different colors. First, in a familiarization phase, the probability of co-occurrence between each action kinematics and color cues was implicitly manipulated to 80% and 20%, thus generating contextual priors. Then, in a testing phase, participants were asked to predict action outcome when the same action videos were occluded at five different timeframes of the entire movement, ranging from when the actor was still to when the grasp of the object was fully accomplished. In this phase, all possible action-contextual cues' associations were equally presented. The results showed that for all occlusion intervals, action prediction was more facilitated when action kinematics deployed in high- than low-probability contextual scenarios. Importantly, contextual priors shaped action prediction even in the latest occlusion intervals, where the kinematic cues clearly unveiled an action outcome that was previously associated with low-probability scenarios. These residual contextual effects were stronger in individuals with higher subclinical autistic traits. Our findings highlight the relative contribution of kinematic and contextual information to action understanding and provide evidence in favor of their continuous integration during action observation.

Action prediction in psychosis

Aberrant motor-sensory predictive functions have been linked to symptoms of psychosis, particularly reduced attenuation of self-generated sensations and misattribution of self-generated actions. Building on the parallels between prediction of self- and other-generated actions, this study aims to investigate whether individuals with psychosis also demonstrate abnormal perceptions and predictions of others' actions. Patients with psychosis and matched controls completed a two-alternative object size discrimination task. In each trial, they observed reaching actions towards a small and a large object, with varying levels of temporal occlusion ranging from 10% to 80% of movement duration. Their task was to predict the size of the object that would be grasped. We employed a novel analytic approach to examine how object size information was encoded and read out across progressive levels of occlusion with single-trial resolution. Patients with psychosis exhibited an overall pattern of reduced and discontinuous evidence integration relative to controls, characterized by a period of null integration up to 20% of movement duration, during which they did not read any size information. Surprisingly, this drop in accuracy in the initial integration period was not accompanied by a reduction in confidence. Difficulties in action prediction were correlated with the severity of negative symptoms and impaired functioning in social relationships.

What's your point? Insights from virtual reality on the relation between intention and action in the production of pointing gestures

Human communication involves the process of translating intentions into communicative actions. But how exactly do our intentions surface in the visible communicative behavior we display? Here we focus on pointing gestures, a fundamental building block of everyday communication, and investigate whether and how different types of underlying intent modulate the kinematics of the pointing hand and the brain activity preceding the gestural movement. In a dynamic virtual reality environment, participants pointed at a referent to either share attention with their addressee, inform their addressee, or get their addressee to perform an action. Behaviorally, it was observed that these different underlying intentions modulated how long participants kept their arm and finger still, both prior to starting the movement and when keeping their pointing hand in apex position. In early planning stages, a neurophysiological distinction was observed between a gesture that is used to share attitudes and knowledge with another person versus a gesture that mainly uses that person as a means to perform an action. Together, these findings suggest that our intentions influence our actions from the earliest neurophysiological planning stages to the kinematic endpoint of the movement itself.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Interactionally Embedded Gestalt Principles of Multimodal Human Communication

Natural human interaction requires us to produce and process many different signals, including speech, hand and head gestures, and facial expressions. These communicative signals, which occur in a variety of temporal relations with each other (e.g., parallel or temporally misaligned), must be rapidly processed as a coherent message by the receiver. In this contribution, we introduce the notion of interactionally embedded, affordance-driven gestalt perception as a framework that can explain how this rapid processing of multimodal signals is achieved as efficiently as it is. We discuss empirical evidence showing how basic principles of gestalt perception can explain some aspects of unimodal phenomena such as verbal language processing and visual scene perception but require additional features to explain multimodal human communication. We propose a framework in which high-level gestalt predictions are continuously updated by incoming sensory input, such as unfolding speech and visual signals. We outline the constituent processes that shape high-level gestalt perception and their role in perceiving relevance and prägnanz. Finally, we provide testable predictions that arise from this multimodal interactionally embedded gestalt-perception framework. This review and framework therefore provide a theoretically motivated account of how we may understand the highly complex, multimodal behaviors inherent in natural social interaction.

Motor invariants in action execution and perception

The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.

Spatio-temporal dynamics of oscillatory brain activity during the observation of actions and interactions between point-light agents

Predicting actions from non-verbal cues and using them to optimise one's response behaviour (i.e. interpersonal predictive coding) is essential in everyday social interactions. We aimed to investigate the neural correlates of different cognitive processes evolving over time during interpersonal predictive coding. Thirty-nine participants watched two agents depicted by moving point-light stimuli while an electroencephalogram (EEG) was recorded. One well-recognizable agent performed either a 'communicative' or an 'individual' action. The second agent either was blended into a cluster of noise dots (i.e. present) or was entirely replaced by noise dots (i.e. absent), which participants had to differentiate. EEG amplitude and coherence analyses for theta, alpha and beta frequency bands revealed a dynamic pattern unfolding over time: Watching communicative actions was associated with enhanced coupling within medial anterior regions involved in social and mentalising processes and with dorsolateral prefrontal activation indicating a higher deployment of cognitive resources. Trying to detect the agent in the cluster of noise dots without having seen communicative cues was related to enhanced coupling in posterior regions for social perception and visual processing. Observing an expected outcome was modulated by motor system activation. Finally, when the agent was detected correctly, activation in posterior areas for visual processing of socially relevant features was increased. Taken together, our results demonstrate that it is crucial to consider the temporal dynamics of social interactions and of their neural correlates to better understand interpersonal predictive coding. This could lead to optimised treatment approaches for individuals with problems in social interactions.

Seeing a Bayesian ghost: Sensorimotor activation leads to an illusory social perception

Based on our prior experiences we form social expectations and anticipate another person’s response. Under certain conditions, these expectations can be so strong that they lead to illusory perception of another person who is actually not there (i.e., seeing a Bayesian ghost). We used EEG to investigate the neural correlates of such illusory social perception. Our results showed that activation of the premotor cortex predicted the occurrence of the Bayesian ghost, whereas its actual appearance was later accompanied by activation in sensorimotor and adjacent parietal regions. These findings confirm that our perception of others is so strongly affected by prior expectations, in such a way they can prompt illusory social perceptions associated with activity change in brain regions relevant for action perception. They also contribute to a better understanding of social interaction in healthy individuals as well as persons with mental illnesses, which can be characterized by illusory perception and social interaction difficulties.

•

Expecting a response to a social action can lead to an illusion of another person

•

The brain does not merely respond to social signals but anticipates social behavior

•

Sensorimotor activity indicates top-down predictions that outweigh sensory input

•

Illusory social perception is associated with sensorimotor and parietal activity

Visual estimation of the force applied by another person

As observers, we believe that we can visually estimate the force that another person is applying to a material. However, it is unclear what kind of cues we use to do this. We focused on two types of visual change that occur when actors push an elastic material from above with their fingers: visual shaking and visual indentation depth. The first one relates to a finger/hand shaking, known as an "induced tremor", and the second one relates to material deformation due to the application of force. We found that human observers mainly used visual shaking to estimate the force being applied by another person in a video clip. Overall, the apparent applied force was perceived to be stronger when the level of visual shaking was greater. We also found that observers mainly used visual indentation depth and visual shaking to estimate the softness rating of materials. Overall, the apparent softness was perceived to be greater when the visual indentation depth was larger and the level of visual shaking was lower, which indicates that observers use visual shaking to estimate the force being applied, and that estimated force is then used for an estimation of softness.

Same Action, Different Meaning: Neural Substrates of Action Semantic Meaning

Voluntary actions are shaped by desired goals and internal intentions. Multiple factors, including the planning of subsequent actions and the expectation of sensory outcome, were shown to modulate kinetics and neural activity patterns associated with similar goal-directed actions. Notably, in many real-world tasks, actions can also vary across the semantic meaning they convey, although little is known about how semantic meaning modulates associated neurobehavioral measures. Here, we examined how behavioral and functional magnetic resonance imaging measures are modulated when subjects execute similar actions (button presses) for two different semantic meanings-to answer "yes" or "no" to a binary question. Our findings reveal that, when subjects answer using their right hand, the two semantic meanings are differentiated based on voxel patterns in the frontoparietal cortex and lateral-occipital complex bilaterally. When using their left hand, similar regions were found, albeit only with a more liberal threshold. Although subjects were faster to answer "yes" versus "no" when using their right hand, the neural differences cannot be explained by these kinetic differences. To the best of our knowledge, this is the first evidence showing that semantic meaning is embedded in the neural representation of actions, independent of alternative modulating factors such as kinetic and sensory features.

Behavioral effects of continuous theta-burst stimulation in macaque parietal cortex

The neural mechanisms underlying the effects of continuous Theta-Burst Stimulation (cTBS) in humans are poorly understood. Animal studies can clarify the effects of cTBS on individual neurons, but behavioral evidence is necessary to demonstrate the validity of the animal model. We investigated the behavioral effect of cTBS applied over parietal cortex in rhesus monkeys performing a visually-guided grasping task with two differently sized objects, which required either a power grip or a pad-to-side grip. We used Fitts' law, predicting shorter grasping times (GT) for large compared to small objects, to investigate cTBS effects on two different grip types. cTBS induced long-lasting object-specific and dose-dependent changes in GT that remained present for up to two hours. High-intensity cTBS increased GTs for a power grip, but shortened GTs for a pad-to-side grip. Thus, high-intensity stimulation strongly reduced the natural GT difference between objects (i.e. the Fitts' law effect). In contrast, low-intensity cTBS induced the opposite effects on GT. Modifying the coil orientation from the standard 45-degree to a 30-degree angle induced opposite cTBS effects on GT. These findings represent behavioral evidence for the validity of the nonhuman primate model to study the neural underpinnings of non-invasive brain stimulation.

Analysis of subject specific grasping patterns

Existing haptic feedback devices are limited in their capabilities and are often cumbersome and heavy. In addition, these devices are generic and do not adapt to the users’ grasping behavior. Potentially, a human-oriented design process could generate an improved design. While current research done on human grasping was aimed at finding common properties within the research population, we investigated the dynamic patterns that make human grasping behavior distinct rather than generalized, i.e. subject specific. Experiments were conducted on 31 subjects who performed grasping tasks on five different objects. The kinematics and kinetics parameters were measured using a motion capture system and force sensors. The collected data was processed through a pipeline of dimensionality reduction and clustering algorithms. Using finger joint angles and reaction forces as our features, we were able to classify these tasks with over 95% success. In addition, we examined the effects of the objects’ mechanical properties on those patterns and the significance of the different features for the differentiation. Our results suggest that grasping patterns are, indeed, subject-specific; this, in turn, could suggest that a device capable of providing personalized feedback can improve the user experience and, in turn, increase the usability in different applications. This paper explores an undiscussed aspect of human dynamic patterns. Furthermore, the collected data offer a valuable dataset of human grasping behavior, containing 1083 grasp instances with both kinetics and kinematics data.

Observer-Agent Kinematic Similarity Facilitates Action Intention Decoding

It is well known that the kinematics of an action is modulated by the underlying motor intention. In turn, kinematics serves as a cue also during action observation, providing hints about the intention of the observed action. However, an open question is whether decoding others’ intentions on the basis of their kinematics depends solely on how much the kinematics varies across different actions, or rather it is also influenced by its similarity with the observer motor repertoire. The execution of reach-to-grasp and place actions, differing for target size and context, was recorded in terms of upper-limb kinematics in 21 volunteers and in an actor. Volunteers had later to observe the sole reach-to-grasp phase of the actor’s actions, and predict the underlying intention. The potential benefit of the kinematic actor-participant similarity for recognition accuracy was evaluated. In execution, both target size and context modulated specific kinematic parameters. More importantly, although participants performed above chance in intention recognition, the similarity of motor patterns positively correlated with recognition accuracy. Overall, these data indicate that kinematic similarity exerts a facilitative role in intention recognition, providing further support to the view of action intention recognition as a visuo-motor process grounded in motor resonance.

Predicting Intentions from Motion: The Subject-Adversarial Adaptation Approach

This paper aims at investigating the action prediction problem from a pure kinematic perspective. Specifically, we address the problem of recognizing future actions, indeed human intentions, underlying a same initial (and apparently unrelated) motor act. This study is inspired by neuroscientific findings asserting that motor acts at the very onset are embedding information about the intention with which are performed, even when different intentions originate from a same class of movements. To demonstrate this claim in computational and empirical terms, we designed an ad hoc experiment and built a new 3D and 2D dataset where, in both training and testing, we analyze a same class of grasping movements underlying different intentions. We investigate how much the intention discriminants generalize across subjects, discovering that each subject tends to affect the prediction by his/her own bias. Inspired by the domain adaptation problem, we propose to interpret each subject as a domain, leading to a novel subject adversarial paradigm. The proposed approach favorably copes with our new problem, boosting the considered baseline features encoding 2D and 3D information and which do not exploit the subject information.

Highs and Lows in Motor Control Development

Motor control is classically described as relying on two components: anticipatory control (feedforward processing) and online control (feedback processing). Here we aimed to unveil the developmental steps of both feedback and feedforward control in 5-10 years old children, using a simple and ecological task. We manipulated object's weight in a reach-to-displace paradigm. When the weight was known before lifting it, anticipatory processes were quantifiable during the reaching phase. Conversely, an unknown weight triggered online corrections during the displacing phase. Movement kinematics revealed that children anticipate this objet property as young as 5 y-o. This anticipation becomes adequate around 7 y-o and is paralleled by poor online corrections. This simple yet relevant paradigm should allow quantifying deviations from neurotypical patterns in disorders of motor control.

Change in effectivity yields recalibration of affordance geometry to preserve functional dynamics

Mon-Williams and Bingham (Exp Brain Res 211(1):145-160, 2011) developed a geometrical affordance model for reaches-to-grasp, and identified a constant scaling relationship, P, between safety margins (SM) and available apertures (SM) that are determined by the sizes of the objects and the individual hands. Bingham et al. (J Exp Psychol Hum Percept Perform 40(4):1542-1550, 2014) extended the model by introducing a dynamical component that scales the geometrical relationship to the stability of the reaching-to-grasp. The goal of the current study was to explore whether and how quickly change in the relevant effectivity (functionally determined hand size = maximum grip) would affect the geometrical and dynamical scaling relationships. The maximum grip of large-handed males was progressively restricted. Participants responded to this restriction by using progressively smaller safety margins, but progressively larger P (= SM/AA) values that preserved an invariant dynamical scaling relationship. The recalibration was relatively fast, occurring over five trials or less, presumably a number required to detect the variability or stability of performance. The results supported the affordance model for reaches-to-grasp in which the invariance is determined by the dynamical component, because it serves the goal of not colliding with the object before successful grasping can be achieved. The findings were also consistent with those of Snapp-Childs and Bingham (Exp Brain Res 198(4):527-533, 2009) who found changes in age-specific geometric scaling for stepping affordances as a function of changes in effectivities over the life span where those changes preserved a dynamic scaling constant similar to that in the current study.

Movement kinematics drive chain selection toward intention detection

Estimation of intentions from the observation of other people’s actions has been proposed to rely on the same motor chain organization supporting the execution of intentional actions. However, the nature of the mechanism by which a specific neuronal chain is selected among possible alternatives during action observation remains obscure. Our study shows that in absence of discriminative contextual cues, subtle changes in the kinematics of the observed action inform mapping to the most probable chain. These results shed light on the importance of kinematics for the attribution of intentions to actions.

The ability to understand intentions based on another’s movements is crucial for human interaction. This ability has been ascribed to the so-called motor chaining mechanism: anytime a motor chain is activated (e.g., grasp-to-drink), the observer attributes to the agent the corresponding intention (i.e., to drink) from the first motor act (i.e., the grasp). However, the mechanisms by which a specific chain is selected in the observer remain poorly understood. In the current study, we investigate the possibility that in the absence of discriminative contextual cues, slight kinematic variations in the observed grasp inform mapping to the most probable chain. Chaining of motor acts predicts that, in a sequential grasping task (e.g., grasp-to-drink), electromyographic (EMG) components that are required for the final act [e.g., the mouth-opening mylohyoid (MH) muscle] show anticipatory activation. To test this prediction, we used MH EMG, transcranial magnetic stimulation (TMS; MH motor-evoked potentials), and predictive models of movement kinematics to measure the level and timing of MH activation during the execution (Experiment 1) and the observation (Experiment 2) of reach-to-grasp actions. We found that MH-related corticobulbar excitability during grasping observation varied as a function of the goal (to drink or to pour) and the kinematics of the observed grasp. These results show that subtle changes in movement kinematics drive the selection of the most probable motor chain, allowing the observer to link an observed act to the agent’s intention.

Prospective motor control obeys to idiosyncratic strategies in autism

Disturbance of primary prospective motor control has been proposed to contribute to faults in higher mind functions of individuals with autism spectrum disorder, but little research has been conducted to characterize prospective control strategies in autism. In the current study, we applied pattern-classification analyses to kinematic features to verify whether children with autism spectrum disorder (ASD) and typically developing (TD) children altered their initial grasp in anticipation of self- and other-actions. Results indicate that children with autism adjusted their behavior to accommodate onward actions. The way they did so, however, varied idiosyncratically from one individual to another, which suggests that previous characterizations of general lack of prospective control strategies may be overly simplistic. These findings link abnormalities in anticipatory control with increased variability and offer insights into the difficulties that individuals with ASD may experience in social interaction.

PredPsych: A toolbox for predictive machine learning-based approach in experimental psychology research

Recent years have seen an increased interest in machine learning-based predictive methods for analyzing quantitative behavioral data in experimental psychology. While these methods can achieve relatively greater sensitivity compared to conventional univariate techniques, they still lack an established and accessible implementation. The aim of current work was to build an open-source R toolbox - "PredPsych" - that could make these methods readily available to all psychologists. PredPsych is a user-friendly, R toolbox based on machine-learning predictive algorithms. In this paper, we present the framework of PredPsych via the analysis of a recently published multiple-subject motion capture dataset. In addition, we discuss examples of possible research questions that can be addressed with the machine-learning algorithms implemented in PredPsych and cannot be easily addressed with univariate statistical analysis. We anticipate that PredPsych will be of use to researchers with limited programming experience not only in the field of psychology, but also in that of clinical neuroscience, enabling computational assessment of putative bio-behavioral markers for both prognosis and diagnosis.

Action Observation Areas Represent Intentions From Subtle Kinematic Features

Mirror neurons have been proposed to underlie humans' ability to understand others' actions and intentions. Despite 2 decades of research, however, the exact computational and neuronal mechanisms implied in this ability remain unclear. In the current study, we investigated whether, in the absence of contextual cues, regions considered to be part of the human mirror neuron system represent intention from movement kinematics. A total of 21 participants observed reach-to-grasp movements, performed with either the intention to drink or to pour while undergoing functional magnetic resonance imaging. Multivoxel pattern analysis revealed successful decoding of intentions from distributed patterns of activity in a network of structures comprising the inferior parietal lobule, the superior parietal lobule, the inferior frontal gyrus, and the middle frontal gyrus. Consistent with the proposal that parietal regions play a key role in intention understanding, classifier weights were higher in the inferior parietal region. These results provide the first demonstration that putative mirror neuron regions represent subtle differences in movement kinematics to read the intention of an observed motor act.

Reach-To-Grasp Movements: A Multimodal Techniques Study

The aim of the present study was to investigate the correlation between corticospinal activity, kinematics, and electromyography (EMG) associated with the execution of precision and whole-hand grasps (WHGs). To this end, motor-evoked potentials (MEPs) induced by transcranial magnetic stimulation (TMS), EMG, and 3-D motion capture data have been simultaneously recorded during the planning and the execution of prehensile actions toward either a small or a large object. Differences in the considered measures were expected to distinguish between the two types of grasping actions both in terms of action preparation and execution. The results indicate that the index finger (FDI) and the little finger (ADM) muscles showed different activation patterns during grasping execution, but only the FDI appeared to distinguish between the two types of actions during motor preparation. Kinematics analysis showed that precision grips differed from WHGs in terms of displayed fingers distance when shaping before object's contact, and in terms of timing and velocity patterns. Moreover, significant correlations suggest a relationship between the muscular activation and the temporal aspects concerned with the index finger's extension during whole-hand actions. Overall, the present data seem to suggest a crucial role played by index finger as an early "marker" of differential motor preparation for different types of grasps and as a "navigator" in guiding whole-hand prehensile actions. Aside from the novelty of the methodological approach characterizing the present study, the data provide new insights regarding the level of crosstalk among different levels concerned with the neuro-behavioral organization of reach-to-grasp movements.

Abilities to Explicitly and Implicitly Infer Intentions from Actions in Adults with Autism Spectrum Disorder

Previous research suggests that Autism Spectrum Disorder (ASD) might be associated with impairments on implicit but not explicit mentalizing tasks. However, such comparisons are made difficult by the heterogeneity of stimuli and the techniques used to measure mentalizing capabilities. We tested the abilities of 34 individuals (17 with ASD) to derive intentions from others' actions during both explicit and implicit tasks and tracked their eye-movements. Adults with ASD displayed explicit but not implicit mentalizing deficits. Adults with ASD displayed typical fixation patterns during both implicit and explicit tasks. These results illustrate an explicit mentalizing deficit in adults with ASD, which cannot be attributed to differences in fixation patterns.

Where Are You Throwing the Ball? I Better Watch Your Body, Not Just Your Arm!

The ability to intercept or avoid a moving object, whether to catch a ball, snatch one's prey, or avoid the path of a predator, is a skill that has been acquired throughout evolution by many species in the animal kingdom. This requires processing early visual cues in order to program anticipatory motor responses tuned to the forthcoming event. Here, we explore the nature of the early kinematics cues that could inform an observer about the future direction of a ball projected with an unconstrained overarm throw. Our goal was to pinpoint the body segments that, throughout the temporal course of the throwing action, could provide key cues for accurately predicting the side of the outgoing ball. We recorded whole-body kinematics from twenty non-expert participants performing unconstrained overarm throws at four different targets placed on a vertical plane at 6 m distance. In order to characterize the spatiotemporal structure of the information embedded in the kinematics of the throwing action about the outgoing ball direction, we introduced a novel combination of dimensionality reduction and machine learning techniques. The recorded kinematics clearly shows that throwing styles differed considerably across individuals, with corresponding inter-individual differences in the spatio-temporal structure of the thrower predictability. We found that for most participants it is possible to predict the region where the ball hit the target plane, with an accuracy above 80%, as early as 400-500 ms before ball release. Interestingly, the body parts that provided the most informative cues about the action outcome varied with the throwing style and during the time course of the throwing action. Not surprisingly, at the very end of the action, the throwing arm is the most informative body segment. However, cues allowing for predictions to be made earlier than 200 ms before release are typically associated to other body parts, such as the lower limbs and the contralateral arm. These findings are discussed in the context of the sport-science literature on throwing and catching interactive tasks, as well as from the wider perspective of the role of sensorimotor coupling in interpersonal social interactions.

Shaping of Reach-to-Grasp Kinematics by Intentions: A Meta-Analysis

When we reach to grasp something, we need to take into account both the properties of the object we are grasping and the intention we have in mind. Previous research has found these constraints to be visible in the reach-to-grasp kinematics, but there is no consensus on which kinematic parameters are the most sensitive. To examine this, a systematic literature search and meta-analyses were performed. The search identified studies assessing how changes in either an object property or a prior intention affect reach-to-grasp kinematics in healthy participants. Hereafter, meta-analyses were conducted using a restricted maximum likelihood random effect model. The meta-analyses showed that changes in both object properties and prior intentions affected reach-to-grasp kinematics. Based on these results, the authors argue for a tripartition of the reach-to-grasp movement in which the accelerating part of the reach is primarily associated with transporting the hand to the object (i.e., extrinsic object properties), the decelerating part of the reach is used as a preparation for object manipulation (i.e., prepare the grasp or the subsequent action), and the grasp is associated with manipulating the object's intrinsic properties, especially object size.

Visual information from observing grasping movement in allocentric and egocentric perspectives: development in typical children

Development of the motor system lags behind that of the visual system and might delay some visual properties more closely linked to action. We measured the developmental trajectory of the discrimination of object size from observation of the biological motion of a grasping action in egocentric and allocentric viewpoints (observing action of others or self), in children and adolescents from 5 to 18 years of age. Children of 5-7 years of age performed the task at chance, indicating a delayed ability to understand the goal of the action. We found a progressive improvement in the ability of discrimination from 9 to 18 years, which parallels the development of fine motor control. Only after 9 years of age did we observe an advantage for the egocentric view, as previously reported for adults. Given that visual and haptic sensitivity of size discrimination, as well as biological motion, are mature in early adolescence, we interpret our results as reflecting immaturity of the influence of the motor system on visual perception.

Decoding intentions from movement kinematics

How do we understand the intentions of other people? There has been a longstanding controversy over whether it is possible to understand others' intentions by simply observing their movements. Here, we show that indeed movement kinematics can form the basis for intention detection. By combining kinematics and psychophysical methods with classification and regression tree (CART) modeling, we found that observers utilized a subset of discriminant kinematic features over the total kinematic pattern in order to detect intention from observation of simple motor acts. Intention discriminability covaried with movement kinematics on a trial-by-trial basis, and was directly related to the expression of discriminative features in the observed movements. These findings demonstrate a definable and measurable relationship between the specific features of observed movements and the ability to discriminate intention, providing quantitative evidence of the significance of movement kinematics for anticipating others' intentional actions.

Doing It Your Way: How Individual Movement Styles Affect Action Prediction

Individuals show significant variations in performing a motor act. Previous studies in the action observation literature have largely ignored this ubiquitous, if often unwanted, characteristic of motor performance, assuming movement patterns to be highly similar across repetitions and individuals. In the present study, we examined the possibility that individual variations in motor style directly influence the ability to understand and predict others' actions. To this end, we first recorded grasping movements performed with different intents and used a two-step cluster analysis to identify quantitatively 'clusters' of movements performed with similar movement styles (Experiment 1). Next, using videos of the same movements, we proceeded to examine the influence of these styles on the ability to judge intention from action observation (Experiments 2 and 3). We found that motor styles directly influenced observers' ability to 'read' others' intention, with some styles always being less 'readable' than others. These results provide experimental support for the significance of motor variability for action prediction, suggesting that the ability to predict what another person is likely to do next directly depends on her individual movement style.

Are We Real When We Fake? Attunement to Object Weight in Natural and Pantomimed Grasping Movements

Behavioral and neuropsychological studies suggest that real actions and pantomimed actions tap, at least in part, different neural systems. Inspired by studies showing weight-attunement in real grasps, here we asked whether (and to what extent) kinematics of pantomimed reach-to-grasp movement can reveal the weight of the pretended target. To address this question, we instructed participants (n = 15) either to grasp or pretend to grasp toward two differently weighted objects, i.e., a light object and heavy object. Using linear discriminant analysis, we then proceeded to classify the weight of the target - either real or pretended - on the basis of the recorded movement patterns. Classification analysis revealed that pantomimed reach-to-grasp movements retained information about object weight, although to a lesser extent than real grasp movements. These results are discussed in relation to the mechanisms underlying the control of real and pantomimed grasping movements.

Grasping others' movements: Rapid discrimination of object size from observed hand movements

During reach-to-grasp movements, the hand is gradually molded to conform to the size and shape of the object to be grasped. Yet the ability to glean information about object properties by observing grasping movements is poorly understood. In this study, we capitalized on the effect of object size to investigate the ability to discriminate the size of an invisible object from movement kinematics. The study consisted of 2 phases. In the first action execution phase, to assess grip scaling, we recorded and analyzed reach-to-grasp movements performed toward differently sized objects. In the second action observation phase, video clips of the corresponding movements were presented to participants in a two-alternative forced-choice task. To probe discrimination performance over time, videos were edited to provide selective vision of different periods from 2 viewpoints. Separate analyses were conducted to determine how the participants' ability to discriminate between stimulus alternatives (Type I sensitivity) and their metacognitive ability to discriminate between correct and incorrect responses (Type II sensitivity) varied over time and viewpoint. We found that as early as 80 ms after movement onset, participants were able to discriminate object size from the observation of grasping movements delivered from the lateral viewpoint. For both viewpoints, information pickup closely matched the evolution of the hand's kinematics, reaching an almost perfect performance well before the fingers made contact with the object (60% of movement duration). These findings suggest that observers are able to decode object size from kinematic sources specified early on in the movement. (PsycINFO Database Record