Four fundamental dimensions underlie the perception of human actions

We evaluate the actions of other individuals based upon a variety of movements that reveal critical information to guide decision making and behavioural responses. These signals convey a range of information about the actor, including their goals, intentions and internal mental states. Although progress has been made to identify cortical regions involved in action processing, the organising principles underlying our representation of actions still remains unclear. In this paper we investigated the conceptual space that underlies action perception by assessing which qualities are fundamental to the perception of human actions. We recorded 240 different actions using motion-capture and used these data to animate a volumetric avatar that performed the different actions. 230 participants then viewed these actions and rated the extent to which each action demonstrated 23 different action characteristics (e.g., avoiding-approaching, pulling-pushing, weak-powerful). We analysed these data using Exploratory Factor Analysis to examine the latent factors underlying visual action perception. The best fitting model was a four-dimensional model with oblique rotation. We named the factors: friendly-unfriendly, formidable-feeble, planned-unplanned, and abduction-adduction. The first two factors of friendliness and formidableness explained approximately 22% of the variance each, compared to planned and abduction, which explained approximately 7-8% of the variance each; as such we interpret this representation of action space as having 2 + 2 dimensions. A closer examination of the first two factors suggests a similarity to the principal factors underlying our evaluation of facial traits and emotions, whilst the last two factors of planning and abduction appear unique to actions.

Respiratory function modulated during execution, observation, and imagination of walking via SII

The Mirror Neurons System (MNS) consists of brain areas active during actions execution, as well as observation-imagination of the same actions. MNS represents a potential mechanism by which we understand other's action goals. We investigated MNS activation for legs actions, and its interaction with the autonomic nervous system. We performed a physiological and fMRI investigation on the common neural structures recruited during the execution, observation, and imagination of walking, and their effects on respiratory activity. Bilateral SMA were activated by all three tasks, suggesting that these areas are responsible for the core of the MNS effect for walking. Moreover, we observed in bilateral parietal opercula (OP1, secondary somatosensory cortex-SII) evidence of an MNS subtending walking execution-observation-imagination that also modulated the respiratory function. We suggest that SII, in modulating the vegetative response during motor activity but also during observation-imagination, consists of a re-enacting function which facilitates the understanding of motor actions.

Neural decoding of gait phases during motor imagery and improvement of the decoding accuracy by concurrent action observation

Objective. Brain decoding of motor imagery (MI) not only is crucial for the control of neuroprosthesis but also provides insights into the underlying neural mechanisms. Walking consists of stance and swing phases, which are associated with different biomechanical and neural control features. However, previous knowledge on decoding the MI of gait is limited to simple information (e.g. the classification of 'walking' and 'rest').Approach. Here, we investigated the feasibility of electroencephalogram (EEG) decoding of the two gait phases during the MI of walking and whether the combined use of MI and action observation (AO) would improve decoding accuracy.Main results. We demonstrated that the stance and swing phases could be decoded from EEGs during MI or AO alone. We also demonstrated the decoding accuracy during MI was improved by concurrent AO. The decoding models indicated that the improved decoding accuracy following the combined use of MI and AO was facilitated by the additional information resulting from the concurrent cortical activations related to sensorimotor, visual, and action understanding systems associated with MI and AO.Significance. This study is the first to show that decoding the stance versus swing phases during MI is feasible. The current findings provide fundamental knowledge for neuroprosthetic design and gait rehabilitation, and they expand our understanding of the neural activity underlying AO, MI, and AO + MI of walking.Novelty and significanceBrain decoding of detailed gait-related information during motor imagery (MI) is important for brain-computer interfaces (BCIs) for gait rehabilitation. This study is the first to show the feasibility of EEG decoding of the stance versus swing phases during MI. We also demonstrated that the combined use of MI and action observation (AO) improves decoding accuracy, which is facilitated by the concurrent and synergistic involvement of the cortical activations for MI and AO. These findings extend the current understanding of neural activity and the combined effects of AO and MI and provide a basis for effective techniques for walking rehabilitation.

Phase dependent modulation of cortical activity during action observation and motor imagery of walking: An EEG study

Action observation (AO) and motor imagery (MI) are motor simulations which induce cortical activity related to execution of observed and imagined movements. Neuroimaging studies have mainly investigated where the cortical activities during AO and MI of movements are activated and if they match those activated during execution of the movements. However, it remains unclear how cortical activity is modulated; in particular, whether activity depends on observed or imagined phases of movements. We have previously examined the neural mechanisms underlying AO and MI of walking, focusing on the combined effect of AO with MI (AO+MI) and phase dependent modulation of corticospinal and spinal reflex excitability. Here, as a continuation of our previous studies, we investigated cortical activity depending on gait phases during AO and AO+MI of walking by using electroencephalography (EEG); 64-channel EEG signals were recorded in which participants observed walking with or without imagining it, respectively. EEG source and spectral analyses showed that, in the sensorimotor cortex during AO+MI and AO, the alpha and beta power were decreased, and power spectral modulations depended on walking phases. The phase dependent modulations during AO+MI, but not during AO, were like those which occur during actual walking as reported by previous walking studies. These results suggest that combinatory effects of AO+MI could induce parts of the phase dependent activation of the sensorimotor cortex during walking even without any movements. These findings would extend understanding of the neural mechanisms underlying walking and cognitive motor processes and provide clinically beneficial information towards rehabilitation for patients with neurological gait dysfunctions.

Timing is everything: Dance aesthetics depend on the complexity of movement kinematics

What constitutes a beautiful action? Research into dance aesthetics has largely focussed on subjective features like familiarity with the observed movement, but has rarely studied objective features like speed or acceleration. We manipulated the kinematic complexity of observed actions by creating dance sequences that varied in movement timing, but not in movement trajectory. Dance-naïve participants rated the dance videos on speed, effort, reproducibility, and enjoyment. Using linear mixed-effects modeling, we show that faster, more predictable movement sequences with varied velocity profiles are judged to be more effortful, less reproducible, and more aesthetically pleasing than slower sequences with more uniform velocity profiles. Accordingly, dance aesthetics depend not only on which movements are being performed but on how movements are executed and linked into sequences. The aesthetics of movement timing may apply across culturally-specific dance styles and predict both preference for and perceived difficulty of dance, consistent with information theory and effort heuristic accounts of aesthetic appreciation.

Sensitivity of occipito-temporal cortex, premotor and Broca's areas to visible speech gestures in a familiar language

When looking at a speaking person, the analysis of facial kinematics contributes to language discrimination and to the decoding of the time flow of visual speech. To disentangle these two factors, we investigated behavioural and fMRI responses to familiar and unfamiliar languages when observing speech gestures with natural or reversed kinematics. Twenty Italian volunteers viewed silent video-clips of speech shown as recorded (Forward, biological motion) or reversed in time (Backward, non-biological motion), in Italian (familiar language) or Arabic (non-familiar language). fMRI revealed that language (Italian/Arabic) and time-rendering (Forward/Backward) modulated distinct areas in the ventral occipito-temporal cortex, suggesting that visual speech analysis begins in this region, earlier than previously thought. Left premotor ventral (superior subdivision) and dorsal areas were preferentially activated with the familiar language independently of time-rendering, challenging the view that the role of these regions in speech processing is purely articulatory. The left premotor ventral region in the frontal operculum, thought to include part of the Broca's area, responded to the natural familiar language, consistent with the hypothesis of motor simulation of speech gestures.

Dilation and Constriction of Subjective Time Based on Observed Walking Speed

The physical properties of events are known to modulate perceived time. This study tested the effect of different quantitative (walking speed) and qualitative (walking-forward vs. walking-backward) features of observed motion on time perception in three complementary experiments. Participants were tested in the temporal discrimination (bisection) task, in which they were asked to categorize durations of walking animations as "short" or "long." We predicted the faster observed walking to speed up temporal integration and thereby to shift the point of subjective equality leftward, and this effect to increase monotonically with increasing walking speed. To this end, we tested participants with two different ranges of walking speeds in Experiment 1 and 2 and observed a parametric effect of walking speed on perceived time irrespective of the direction of walking (forward vs. rewound forward walking). Experiment 3 contained a more plausible backward walking animation compared to the rewound walking animation used in Experiments 1 and 2 (as validated based on independent subjective ratings). The effect of walking-speed and the lack of the effect of walking direction on perceived time were replicated in Experiment 3. Our results suggest a strong link between the speed but not the direction of perceived biological motion and subjective time.

Low perceptual sensitivity to altered video speed in viewing a soccer match

When watching videos, our sense of reality is continuously challenged. How much can a fundamental dimension of experience such as visual flow be modified before breaking the perception of real time? Here we found a remarkable indifference to speed manipulations applied to a popular video content, a soccer match. In a condition that mimicked real-life TV watching, none of 100 naïve observers spontaneously noticed speed alterations up/down to 12%, even when asked to report motion anomalies, and showed very low sensitivity to video speed changes (Just Noticeable Difference, JND = 18%). When tested with a constant-stimuli speed discrimination task, JND was still high, though much reduced (9%). The presence of the original voice-over with compensation for pitch did not affect perceptual performance. Thus, our results document a rather broad tolerance to speed manipulations in video viewing, even under attentive scrutiny. This finding may have important implications. For example, it can validate video compression strategies based on sub-threshold temporal squeezing. This way, a soccer match can last only 80 min and still be perceived as natural. More generally, knowing the boundaries of natural speed perception may help to optimize the flow of artificial visual stimuli which increasingly surround us.

The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others

The anterior cingulate cortex (ACC) is implicated in a broad range of behaviors and cognitive processes, but it has been unclear what contribution, if any, the ACC makes to social behavior. We argue that anatomical and functional evidence suggests that a specific sub-region of ACC-in the gyrus (ACCg)-plays a crucial role in processing social information. We propose that the computational properties of the ACCg support a contribution to social cognition by estimating how motivated other individuals are and dynamically updating those estimates when further evidence suggests they have been erroneous. Notably this model, based on vicarious motivation and error processing, provides a unified account of neurophysiological and neuroimaging evidence that the ACCg is sensitive to costs, benefits, and errors during social interactions. Furthermore, it makes specific, testable predictions about a key mechanism that may underpin variability in socio-cognitive abilities in health and disease.

Effects of visual motion consistent or inconsistent with gravity on postural sway

Vision plays an important role in postural control, and visual perception of the gravity-defined vertical helps maintaining upright stance. In addition, the influence of the gravity field on objects' motion is known to provide a reference for motor and non-motor behavior. However, the role of dynamic visual cues related to gravity in the control of postural balance has been little investigated. In order to understand whether visual cues about gravitational acceleration are relevant for postural control, we assessed the relation between postural sway and visual motion congruent or incongruent with gravity acceleration. Postural sway of 44 healthy volunteers was recorded by means of force platforms while they watched virtual targets moving in different directions and with different accelerations. Small but significant differences emerged in sway parameters with respect to the characteristics of target motion. Namely, for vertically accelerated targets, gravitational motion (GM) was associated with smaller oscillations of the center of pressure than anti-GM. The present findings support the hypothesis that not only static, but also dynamic visual cues about direction and magnitude of the gravitational field are relevant for balance control during upright stance.

Reputation in an economic game modulates premotor cortex activity during action observation

Our interactions with other people - and our processing of their actions - are shaped by their reputation. Research has identified an Action Observation Network (AON) which is engaged when observing other people's actions. Yet, little is known about how the processing of others' actions is influenced by another's reputation. Is the response of the AON modulated by the reputation of the actor? We developed a variant of the ultimatum game in which participants watched either the visible or occluded actions of two 'proposers'. These actions were tied to decisions of how to split a pot of money although the proposers' decisions on each trial were not known to participants when observing the actions. One proposer made fair offers on the majority of trials, establishing a positive reputation, whereas the other made predominantly, unfair offers resulting in a negative reputation. We found significant activations in two regions of the left dorsal premotor cortex (dPMC). The first of these showed a main effect of reputation with greater activation for the negative reputation proposer than the positive reputation proposer. Furthermore individual differences in trust ratings of the two proposers covaried with activation in the right primary motor cortex (M1). The second showed an interaction between visibility and reputation driven by a greater effect of reputation when participants were observing an occluded action. Our findings show that the processing of others' actions in the AON is modulated by an actor's reputation, and suggest a predictive role for the PMC during action observation.

Walking indoors, walking outdoors: an fMRI study

An observation/execution matching system for walking has not been assessed yet. The present fMRI study was aimed at assessing whether, as for object-directed actions, an observation/execution matching system is active for walking and whether the spatial context of walking (open or narrow space) recruits different neural correlates. Two experimental conditions were employed. In the execution condition, while being scanned, participants performed walking on a rolling cylinder located just outside the scanner. The same action was performed also while observing a video presenting either an open space (a country field) or a narrow space (a corridor). In the observation condition, participants observed a video presenting an individual walking on the same cylinder on which the actual action was executed, the open space video and the narrow space video, respectively. Results showed common bilateral activations in the dorsal premotor/supplementary motor areas and in the posterior parietal lobe for both execution and observation of walking, thus supporting a matching system for this action. Moreover, specific sectors of the occipital–temporal cortex and the middle temporal gyrus were consistently active when processing a narrow space versus an open one, thus suggesting their involvement in the visuo-motor transformation required when walking in a narrow space. We forward that the present findings may have implications for rehabilitation of gait and sport training.