Biological motion perception in the theoretical framework of perceptual decision-making: An event-related potential study

Biological motion perception plays a critical role in various decisions in daily life. Failure to decide accordingly in such a perceptual task could have life-threatening consequences. Neurophysiology and computational modeling studies suggest two processes mediating perceptual decision-making. One of these signals is associated with the accumulation of sensory evidence and the other with response selection. Recent EEG studies with humans have introduced an event-related potential called Centroparietal Positive Potential (CPP) as a neural marker aligned with the sensory evidence accumulation while effectively distinguishing it from motor-related lateralized readiness potential (LRP). The present study aims to investigate the neural mechanisms of biological motion perception in the framework of perceptual decision-making, which has been overlooked before. More specifically, we examine whether CPP would track the coherence of the biological motion stimuli and could be distinguished from the LRP signal. We recorded EEG from human participants while they performed a direction discrimination task of a point-light walker stimulus embedded in various levels of noise. Our behavioral findings revealed shorter reaction times and reduced miss rates as the coherence of the stimuli increased. In addition, CPP tracked the coherence of the biological motion stimuli with a tendency to reach a common level during the response, albeit with a later onset than the previously reported results in random-dot motion paradigms. Furthermore, CPP was distinguished from the LRP signal based on its temporal profile. Overall, our results suggest that the mechanisms underlying perceptual decision-making generalize to more complex and socially significant stimuli like biological motion.

Decoding the dynamic perception of risk and speed using naturalistic stimuli: A multivariate, whole-brain analysis

Time-resolved decoding of speed and risk perception in car driving is important for understanding the perceptual processes related to driving safety. In this study, we used an fMRI-compatible trackball with naturalistic stimuli to record dynamic ratings of perceived risk and speed and investigated the degree to which different brain regions were able to decode these. We presented participants with first-person perspective videos of cars racing on the same course. These videos varied in terms of subjectively perceived speed and risk profiles, as determined during a behavioral pilot. During the fMRI experiment, participants used the trackball to dynamically rate subjective risk in a first and speed in a second session and assessed overall risk and speed after watching each video. A standard multivariate correlation analysis based on these ratings revealed sparse decodability in visual areas only for the risk ratings. In contrast, the dynamic rating-based correlation analysis uncovered frontal, visual, and temporal region activation for subjective risk and dorsal visual stream and temporal region activation for subjectively perceived speed. Interestingly, further analyses showed that the brain regions for decoding risk changed over time, whereas those for decoding speed remained constant. Overall, our results demonstrate the advantages of time-resolved decoding to help our understanding of the dynamic networks associated with decoding risk and speed perception in realistic driving scenarios.

Driving Hebbian plasticity over ventral premotor-motor projections transiently enhances motor resonance

BACKGROUND

Making sense of others' actions relies on the activation of an action observation network (AON), which maps visual information about observed actions onto the observer's motor system. This motor resonance process manifests in the primary motor cortex (M1) as increased corticospinal excitability finely tuned to the muscles engaged in the observed action. Motor resonance in M1 is facilitated by projections from higher-order AON regions. However, whether manipulating the strength of AON-to-M1 connectivity affects motor resonance remains unclear.

METHODS

We used transcranial magnetic stimulation (TMS) in 48 healthy humans. Cortico-cortical paired associative stimulation (ccPAS) was administered over M1 and the ventral premotor cortex (PMv), a key AON node, to induce spike-timing-dependent plasticity (STDP) in the pathway connecting them. Single-pulse TMS assessed motor resonance during action observation.

RESULTS

Before ccPAS, action observation increased corticospinal excitability in the muscles corresponding to the observed movements, reflecting motor resonance in M1. Notably, ccPAS aimed at strengthening projections from PMv to M1 (PMv→M1) induced short-term enhancement of motor resonance. The enhancement specifically occurred with the ccPAS configuration consistent with forward PMv→M1 projections and dissipated 20 min post-stimulation; ccPAS administered in the reverse order (M1→PMv) and sham stimulation did not affect motor resonance.

CONCLUSIONS

These findings provide the first evidence that inducing STDP to strengthen PMv input to M1 neurons causally enhances muscle-specific motor resonance in M1. Our study sheds light on the plastic mechanisms that shape AON functionality and demonstrates that exogenous manipulation of AON connectivity can influence basic mirror mechanisms that underlie social perception.

TMS-induced inhibition of the left premotor cortex modulates illusory social perception

Communicative actions from one person are used to predict another person's response. However, in some cases, these predictions can outweigh the processing of sensory information and lead to illusory social perception such as seeing two people interact, although only one is present (i.e., seeing a Bayesian ghost). We applied either inhibitory brain stimulation over the left premotor cortex (i.e., real TMS) or sham TMS. Then, participants indicated the presence or absence of a masked agent that followed a communicative or individual gesture of another agent. As expected, participants had more false alarms in the communicative (i.e., Bayesian ghosts) than individual condition in the sham TMS session and this difference between conditions vanished after real TMS. In contrast to our hypothesis, the number of false alarms increased (rather than decreased) after real TMS. These pre-registered findings confirm the significance of the premotor cortex for social action predictions and illusory social perception.

Distributed and hierarchical neural encoding of multidimensional biological motion attributes in the human brain

The human visual system can efficiently extract distinct physical, biological, and social attributes (e.g. facing direction, gender, and emotional state) from biological motion (BM), but how these attributes are encoded in the brain remains largely unknown. In the current study, we used functional magnetic resonance imaging to investigate this issue when participants viewed multidimensional BM stimuli. Using multiple regression representational similarity analysis, we identified distributed brain areas, respectively, related to the processing of facing direction, gender, and emotional state conveyed by BM. These brain areas are governed by a hierarchical structure in which the respective neural encoding of facing direction, gender, and emotional state is modulated by each other in descending order. We further revealed that a portion of the brain areas identified in representational similarity analysis was specific to the neural encoding of each attribute and correlated with the corresponding behavioral results. These findings unravel the brain networks for encoding BM attributes in consideration of their interactions, and highlight that the processing of multidimensional BM attributes is recurrently interactive.

Cortical encoding of rhythmic kinematic structures in biological motion

Biological motion (BM) perception is of great survival value to human beings. The critical characteristics of BM information lie in kinematic cues containing rhythmic structures. However, how rhythmic kinematic structures of BM are dynamically represented in the brain and contribute to visual BM processing remains largely unknown. Here, we probed this issue in three experiments using electroencephalogram (EEG). We found that neural oscillations of observers entrained to the hierarchical kinematic structures of the BM sequences (i.e., step-cycle and gait-cycle for point-light walkers). Notably, only the cortical tracking of the higher-level rhythmic structure (i.e., gait-cycle) exhibited a BM processing specificity, manifested by enhanced neural responses to upright over inverted BM stimuli. This effect could be extended to different motion types and tasks, with its strength positively correlated with the perceptual sensitivity to BM stimuli at the right temporal brain region dedicated to visual BM processing. Modeling results further suggest that the neural encoding of spatiotemporally integrative kinematic cues, in particular the opponent motions of bilateral limbs, drives the selective cortical tracking of BM information. These findings underscore the existence of a cortical mechanism that encodes periodic kinematic features of body movements, which underlies the dynamic construction of visual BM perception.

Mirror neuron brain regions contribute to identifying actions, but not intentions

Previous studies have struggled to determine the relationship between mirror neuron brain regions and two distinct “action understanding” processes: identifying actions and identifying the intentions underlying those actions. This may be because the identification of intentions from others' actions requires an initial action identification process. Disruptive transcranial magnetic stimulation was administered to left inferior frontal gyrus (lIFG) during a novel cognitive task to determine which of these “action understanding” processes is subserved by mirror neuron brain regions. Participants identified either the actions performed by observed hand actions or the intentions underlying those actions. The extent to which intention identification was disrupted by lIFG (vs. control site) stimulation was dependent on the level of disruption to action identification. We subsequently performed functional magnetic resonance imaging during the same task. During action identification, responses were widespread within mirror neuron areas including lIFG and inferior parietal lobule. However, no independent responses were found in mirror neuron brain regions during intention identification. Instead, responses occurred in brain regions associated with two distinct mentalizing localizer tasks. This supports an account in which mirror neuron brain regions are involved in an initial action identification process, but the subsequent identification of intentions requires additional processing in mentalizing brain regions.

A two-stage framework for neural processing of biological motion

It remains to be understood how biological motion is hierarchically computed, from discrimination of local biological motion animacy to global dynamic body perception. Here, we addressed this functional separation of the correlates of the perception of local biological motion from perception of global motion of a body. We hypothesized that local biological motion processing can be isolated, by using a single dot motion perceptual decision paradigm featuring the biomechanical details of local realistic motion of a single joint. To ensure that we were indeed tackling processing of biological motion properties we used a discrimination instead of detection task. We discovered using representational similarity analysis that two key early dorsal and two ventral stream regions (visual motion selective hMT+ and V3A, extrastriate body area EBA and a region within fusiform gyrus FFG) showed robust and separable signals related to encoding of local biological motion and global motion-mediated shape. These signals reflected two independent processing stages, as revealed by representational similarity analysis and deconvolution of fMRI responses to each motion pattern. This study showed that higher level pSTS encodes both classes of biological motion in a similar way, revealing a higher-level integrative stage, reflecting scale independent biological motion perception. Our results reveal a two-stage framework for neural computation of biological motion, with an independent contribution of dorsal and ventral regions for the initial stage.

Decoding point-light displays and fully visible hand grasping actions within the action observation network

Action observation typically recruits visual areas and dorsal and ventral sectors of the parietal and premotor cortex. This network has been collectively termed as extended action observation network (eAON). Within this network, the elaboration of kinematic aspects of biological motion is crucial. Previous studies investigated these aspects by presenting subjects with point-light displays (PLDs) videos of whole-body movements, showing the recruitment of some of the eAON areas. However, studies focused on cortical activation during observation of PLDs grasping actions are lacking. In the present functional magnetic resonance imaging (fMRI) study, we assessed the activation of eAON in healthy participants during the observation of both PLDs and fully visible hand grasping actions, excluding confounding effects due to low-level visual features, motion, and context. Results showed that the observation of PLDs grasping stimuli elicited a bilateral activation of the eAON. Region of interest analyses performed on visual and sensorimotor areas showed no significant differences in signal intensity between PLDs and fully visible experimental conditions, indicating that both conditions evoked a similar motor resonance mechanism. Multivoxel pattern analysis (MVPA) revealed significant decoding of PLDs and fully visible grasping observation conditions in occipital, parietal, and premotor areas belonging to eAON. Data show that kinematic features conveyed by PLDs stimuli are sufficient to elicit a complete action representation, suggesting that these features can be disentangled within the eAON from the features usually characterizing fully visible actions. PLDs stimuli could be useful in assessing which areas are recruited, when only kinematic cues are available, for action recognition, imitation, and motor learning.

Differences in working memory coding of biological motion attributed to oneself and others

The question how the brain distinguishes between information about self and others is of fundamental interest to both philosophy and neuroscience. In this functional magnetic resonance imaging (fMRI) study, we sought to distinguish the neural substrates of representing a full‐body movement as one's movement and as someone else's movement. Participants performed a delayed match‐to‐sample working memory task where a retained full‐body movement (displayed using point‐light walkers) was arbitrarily labeled as one's own movement or as performed by someone else. By using arbitrary associations we aimed to address a limitation of previous studies, namely that our own movements are more familiar to us than movements of other people. A searchlight multivariate decoding analysis was used to test where information about types of movement and about self‐association was coded. Movement specific activation patterns were found in a network of regions also involved in perceptual processing of movement stimuli, however not in early sensory regions. Information about whether a memorized movement was associated with the self or with another person was found to be coded by activity in the left middle frontal gyrus (MFG), left inferior frontal gyrus (IFG), bilateral supplementary motor area, and (at reduced threshold) in the left temporoparietal junction (TPJ). These areas are frequently reported as involved in action understanding (IFG, MFG) and domain‐general self/other distinction (TPJ). Finally, in univariate analysis we found that selecting a self‐associated movement for retention was related to increased activity in the ventral medial prefrontal cortex.

From Hemispheric Asymmetry through Sensorimotor Experiences to Cognitive Outcomes in Children with Cerebral Palsy

Recent neuroimaging studies allowed us to explore abnormal brain structures and interhemispheric connectivity in children with cerebral palsy (CP). Behavioral researchers have long reported that children with CP exhibit suboptimal performance in different cognitive domains (e.g., receptive and expressive language skills, reading, mental imagery, spatial processing, subitizing, math, and executive functions). However, there has been very limited cross-domain research involving these two areas of scientific inquiry. To stimulate such research, this perspective paper proposes some possible neurological mechanisms involved in the cognitive delays and impairments in children with CP. Additionally, the paper examines the ways motor and sensorimotor experience during the development of these neural substrates could enable more optimal development for children with CP. Understanding these developmental mechanisms could guide more effective interventions to promote the development of both sensorimotor and cognitive skills in children with CP.

Distinct cerebellar regions for body motion discrimination

Visual processing of human movements is critical for adaptive social behavior. Cerebellar activations have been observed during biological motion discrimination in prior neuroimaging studies, and cerebellar lesions may be detrimental for this task. However, whether the cerebellum plays a causal role in biological motion discrimination has never been tested. Here, we addressed this issue in three different experiments by interfering with the posterior cerebellar lobe using transcranial magnetic stimulation (TMS) during a biological discrimination task. In Experiments 1 and 2, we found that TMS delivered at onset of the visual stimuli over the vermis (vermal lobule VI), but not over the left cerebellar hemisphere (left lobule VI/Crus I), interfered with participants' ability to distinguish biological from scrambled motion compared to stimulation of a control site (vertex). Interestingly, when stimulation was delivered at a later time point (300 ms after stimulus onset), participants performed worse when TMS was delivered over the left cerebellar hemisphere compared to the vermis and the vertex (Experiment 3). Our data show that the posterior cerebellum is causally involved in biological motion discrimination and suggest that different sectors of the posterior cerebellar lobe may contribute to the task at different time points.

5-day Multi-Session Intermittent Theta Burst Stimulation over Bilateral Posterior Superior Temporal Sulci in Adults with Autism-a Pilot Study

Background

Theta burst stimulation (TBS), a patterned repetitive transcranial magnetic stimulation (rTMS) protocol with shorter simulation duration and lower stimulus intensity, could be a better protocol for individuals with autism spectrum disorder (ASD). Our study aimed to explore the impacts of intermittent TBS (iTBS) over the bilateral posterior superior temporal sulcus (pSTS) on intellectually able adults with ASD.

Methods

In this randomized, single-blinded, sham-controlled crossover trial, 13 adults with ASD completed iTBS for 5 consecutive days over the bilateral pSTS and inion (as a sham control) in a 16-weeks interval and in a randomly assigned order. The neuropsychological function was measured with the Wisconsin Card Sorting Test (WCST) for cognitive flexibility while the clinical outcomes were measured with both self-rate and parents-rate Autism Spectrum Quotient (AQ) before and after 5-day iTBS interventions.

Results

The results revealed significantly immediate effects of multi-session iTBS over the bilateral pSTS on parent-rate autistic symptoms in adults with ASD. The post-hoc analysis revealed the impacts of multi-session iTBS on cognitive flexibility were affected by baseline social-communicative impairment and baseline cognitive performance. Besides, the impacts of multi-session iTBS on clinical symptoms was affected by the concurrent psychotropic medication use and baseline autistic symptoms.

Conclusions

Given the caveat of the small sample size and discrepancy of multiple informants, this pilot study suggests the therapeutic potential of 5-day multi-session iTBS over the pSTS in adults with ASD. Individual factors modulating the response to rTMS should be explicitly considered in the future trial.

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

Top-Down Attention Guidance Shapes Action Encoding in the pSTS

The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

Typically Efficient Lipreading without Motor Simulation

All it takes is a face-to-face conversation in a noisy environment to realize that viewing a speaker's lip movements contributes to speech comprehension. What are the processes underlying the perception and interpretation of visual speech? Brain areas that control speech production are also recruited during lipreading. This finding raises the possibility that lipreading may be supported, at least to some extent, by a covert unconscious imitation of the observed speech movements in the observer's own speech motor system-a motor simulation. However, whether, and if so to what extent, motor simulation contributes to visual speech interpretation remains unclear. In two experiments, we found that several participants with congenital facial paralysis were as good at lipreading as the control population and performed these tasks in a way that is qualitatively similar to the controls despite severely reduced or even completely absent lip motor representations. Although it remains an open question whether this conclusion generalizes to other experimental conditions and to typically developed participants, these findings considerably narrow the space of hypothesis for a role of motor simulation in lipreading. Beyond its theoretical significance in the field of speech perception, this finding also calls for a re-examination of the more general hypothesis that motor simulation underlies action perception and interpretation developed in the frameworks of motor simulation and mirror neuron hypotheses.

Functional specialization in human dorsal pathway for stereoscopic depth processing

Binocular disparity, a primary cue for stereoscopic depth perception, is widely represented in visual cortex. However, the functional specialization in the disparity processing network remains unclear. Using magnetic resonance imaging-guided transcranial magnetic stimulation, we studied the causal contributions of V3A and MT+ to stereoscopic depth perception. Subjects viewed random-dot stereograms forming transparent planes with various interplane disparities. Their smallest detectable disparity and largest detectable disparity were measured in two experiments. We found that the smallest detectable disparity was affected by V3A, but not MT+ , stimulation. On the other hand, the largest detectable disparity was affected by both V3A and MT+ stimulation. Our results suggest different roles of V3A and MT+ in stereoscopic depth processing.

The two-process theory of biological motion processing

Perception, identification, and understanding of others' actions from motion information are vital for our survival in the social world. A breakthrough in the understanding of action perception was the discovery that our visual system is sensitive to human action from the sparse motion input of only a dozen point lights, a phenomenon known as biological motion (BM) processing. Previous psychological and computational models cannot fully explain the emerging evidence for the existence of BM processing during early ontogeny. Here, we propose a two-process model of the mechanisms underlying BM processing. We hypothesize that the first system, the 'Step Detector,' rapidly processes the local foot motion and feet-below-the-body information that is specific to vertebrates, is less dependent on postnatal learning, and involves subcortical networks. The second system, the 'Bodily Action Evaluator,' slowly processes the fine global structure-from-motion, is specific to conspecific, and dependent on gradual learning processed in cortical networks. This proposed model provides new insight into research on the development of BM processing.

Observation of the point-light animation of a grasping hand activates sensorimotor cortex in nine-month-old infants

Measuring changes in sensorimotor alpha band activity in nine-month-old infants we sought to understand the involvement of the sensorimotor cortex during observation of the Point-Light (PL) animation of a grasping hand. Attenuation of alpha activity was found both when the PL display moved towards the to-be-grasped object and when the object was deleted from the video. Before the beginning of the movement of the PL stimuli, only in the presence of the object evoked attenuation of sensorimotor alpha activity was documented, possibly interpreted either as movement prediction or as graspable object perception. Our main findings demonstrate that, during observation of stimuli moving with biological kinematics, the infants' sensorimotor system is activated when the pictorial information is absent or highly reduced, and independently of the presence of the goal-directed object. The possible compensatory function of the sensorimotor system during observation of highly degraded moving stimuli is discussed.

It is the egg, not the chicken; dorsal visual deficits present in dyslexia are not present in illiterate adults

Some individuals with dyslexia demonstrate deficits in reading, visual attention, and visual processing which can be attributed to a functional failure of the magnocells in the visual system or in the dorsal visual pathway. The study examines the role of magno/dorsal function in dyslexic adults compared with normal, illiterate, and semi-literate readers. Coherent motion and coherent form were used in Experiment 1, and the frequency doubling illusion and static-gratings were used in Experiment 2. If a magno/dorsal deficit is demonstrated for dyslexic readers but not illiterate, semi-literate, and normal reading adults, then the deficit cannot be attributed to reading experience. Illiterate adults performed the same as normal and semi-literate readers in coherent motion and frequency doubling tasks, and all three groups performed better than the dyslexic readers. There was no difference between any of the groups in the coherent form or static grating tasks. Together, these studies show that illiterate and semi-literate adults do not demonstrate a magno/dorsal deficit that is a characteristic of some sufferers of dyslexia. Therefore, magno/dorsal deficits in dyslexia are unlikely to be a consequence of failing to learn to read but rather provides evidence to suggest a causal role for reduced visual magno/dorsal processing.

Increased functional coupling of the left amygdala and medial prefrontal cortex during the perception of communicative point-light stimuli

Interpersonal predictive coding (IPPC) describes the behavioral phenomenon whereby seeing a communicative rather than an individual action helps to discern a masked second agent. As little is known, yet, about the neural correlates of IPPC, we conducted a functional magnetic resonance imaging study in a group of 27 healthy participants using point-light displays of moving agents embedded in distractors. We discovered that seeing communicative compared to individual actions was associated with higher activation of right superior frontal gyrus, whereas the reversed contrast elicited increased neural activation in an action observation network that was activated during all trials. Our findings, therefore, potentially indicate the formation of action predictions and a reduced demand for executive control in response to communicative actions. Further, in a regression analysis, we revealed that increased perceptual sensitivity was associated with a deactivation of the left amygdala during the perceptual task. A consecutive psychophysiological interaction analysis showed increased connectivity of the amygdala with medial prefrontal cortex in the context of communicative compared to individual actions. Thus, whereas increased amygdala signaling might interfere with task-relevant processes, increased co-activation of the amygdala and the medial prefrontal cortex in a communicative context might represent the integration of mentalizing computations.

Visual attention and action: How cueing, direct mapping, and social interactions drive orienting

Despite considerable interest in both action perception and social attention over the last 2 decades, there has been surprisingly little investigation concerning how the manual actions of other humans orient visual attention. The present review draws together studies that have measured the orienting of attention, following observation of another's goal-directed action. Our review proposes that, in line with the literature on eye gaze, action is a particularly strong orienting cue for the visual system. However, we additionally suggest that action may orient visual attention using mechanisms, which gaze direction does not (i.e., neural direct mapping and corepresentation). Finally, we review the implications of these gaze-independent mechanisms for the study of attention to action. We suggest that our understanding of attention to action may benefit from being studied in the context of joint action paradigms, where the role of higher level action goals and social factors can be investigated.

PLAViMoP: How to standardize and simplify the use of point-light displays

The study of biological point-light displays (PLDs) has fascinated researchers for more than 40 years. However, the mechanisms underlying PLD perception remain unclear, partly due to difficulties with precisely controlling and transforming PLD sequences. Furthermore, little agreement exists regarding how transformations are performed. This article introduces a new free-access program called PLAViMoP (Point-Light Display Visualization and Modification Platform) and presents the algorithms for PLD transformations actually included in the software. PLAViMoP fulfills two objectives. First, it standardizes and makes clear many classical spatial and kinematic transformations described in the PLD literature. Furthermore, given its optimized interface, PLAViMOP makes these transformations easy and fast to achieve. Overall, PLAViMoP could directly help scientists avoid technical difficulties and make possible the use of PLDs for nonacademic applications.

A Causal Role of the Right Superior Temporal Sulcus in Emotion Recognition From Biological Motion

Understanding the emotions of others through nonverbal cues is critical for successful social interactions. The right posterior superior temporal sulcus (pSTS) is one brain region thought to be key in the recognition of the mental states of others based on body language and facial expression. In the present study, we temporarily disrupted functional activity of the right pSTS by using continuous, theta-burst transcranial magnetic stimulation (cTBS) to test the hypothesis that the right pSTS plays a causal role in emotion recognition from body movements. Participants ( N = 23) received cTBS to the right pSTS, which was individually localized using fMRI, and a vertex control site. Before and after cTBS, we tested participants’ ability to identify emotions from point-light displays (PLDs) of biological motion stimuli and a nonbiological global motion identification task. Results revealed that accurate identification of emotional states from biological motion was reduced following cTBS to the right pSTS, but accuracy was not impaired following vertex stimulation. Accuracy on the global motion task was unaffected by cTBS to either site. These results support the causal role of the right pSTS in decoding information about others’ emotional state from their body movements and gestures.

Visuomotor effects of body part movements presented in the first-person perspective on imitative behavior

Imitative stimuli presented from a first-person perspective (FPP) produce stronger visuomotor effects than those presented from a third-person perspective (TPP) due to the relatively greater response of the mirror neuron system (MNS) to FPP stimuli. Some previous studies utilizing TPP stimuli have reported no differences in MNS activity between moving and static bodies' stimuli. However, few studies have compared visuomotor effects of such stimuli when presented in the FPP. To clarify this issue, we measured cortical activation in 17 participants during a functional magnetic resonance imaging (MRI) imitation task involving three conditions: moving (a lifting finger was presented), static (an "X" appeared on a static finger), and control (an "X" appeared on a button). All stimuli were presented from the FPP or TPP. Participants were asked to lift the finger corresponding to the imitative stimulus. In the FPP condition, moving stimuli elicited greater MNS activation than static stimuli. Furthermore, such movement effects were stronger in the MNS and insula (a region associated with body-ownership) for FPP stimuli than for TPP stimuli. Psychophysiological interaction analysis revealed increased connectivity between the MNS and insula for moving stimuli in the FPP condition. These findings suggest that bodily movements presented in the FPP elicit a greater visuomotor response than static body presented in the FPP, and that the visuomotor effects of bodily movements were greater in the FPP condition than in the TPP condition. Our analyses further indicated that such responses are processed via the neural system underlying body-ownership. Hum Brain Mapp 38:6218-6229, 2017. © 2017 Wiley Periodicals, Inc.

State-Dependent TMS Reveals Representation of Affective Body Movements in the Anterior Intraparietal Cortex

In humans, recognition of others' actions involves a cortical network that comprises, among other cortical regions, the posterior superior temporal sulcus (pSTS), where biological motion is coded and the anterior intraparietal sulcus (aIPS), where movement information is elaborated in terms of meaningful goal-directed actions. This action observation system (AOS) is thought to encode neutral voluntary actions, and possibly some aspects of affective motor repertoire, but the role of the AOS' areas in processing affective kinematic information has never been examined. Here we investigated whether the AOS plays a role in representing dynamic emotional bodily expressions. In the first experiment, we assessed behavioral adaptation effects of observed affective movements. Participants watched series of happy or fearful whole-body point-light displays (PLDs) as adapters and were then asked to perform an explicit categorization of the emotion expressed in test PLDs. Participants were slower when categorizing any of the two emotions as long as it was congruent with the emotion in the adapter sequence. We interpreted this effect as adaptation to the emotional content of PLDs. In the second experiment, we combined this paradigm with TMS applied over either the right aIPS, pSTS, and the right half of the occipital pole (corresponding to Brodmann's area 17 and serving as control) to examine the neural locus of the adaptation effect. TMS over the aIPS (but not over the other sites) reversed the behavioral cost of adaptation, specifically for fearful contents. This demonstrates that aIPS contains an explicit representation of affective body movements.SIGNIFICANCE STATEMENT In humans, a network of areas, the action observation system, encodes voluntary actions. However, the role of these brain regions in processing affective kinematic information has not been investigated. Here we demonstrate that the aIPS contains a representation of affective body movements. First, in a behavioral experiment, we found an adaptation after-effect for emotional PLDs, indicating the existence of a neural representation selective for affective information in biological motion. To examine the neural locus of this effect, we then combined the adaptation paradigm with TMS. Stimulation of the aIPS (but not over pSTS and control site) reversed the behavioral cost of adaptation, specifically for fearful contents, demonstrating that aIPS contains a representation of affective body movements.

The Impact of Single Session Intermittent Theta-Burst Stimulation over the Dorsolateral Prefrontal Cortex and Posterior Superior Temporal Sulcus on Adults with Autism Spectrum Disorder

Intermittent theta burst stimulation (iTBS), a patterned repetitive transcranial magnetic stimulation, was applied over the posterior superior temporal sulcus (pSTS) or dorsolateral prefrontal cortex (DLPFC) to explore its impact in adults with autism spectrum disorder (ASD). Among 25 adults with ASD, 19 (mean age: 20.8 years) completed the randomized, sham-controlled, crossover trial. Every participant received iTBS over the bilateral DLPFC, bilateral pSTS and inion (as a sham control stimulation) in a randomized order with a 1-week interval. Neuropsychological functions were assessed using the Conners' Continuous Performance Test (CCPT) and the Wisconsin Card Sorting Test (WCST). Behavioral outcomes were measured using the Yale-Brown Obsessive Compulsive Scale (Y-BOCS) and the Social Responsiveness Scale (SRS). In comparison to that in the sham stimulation, the reaction time in the CCPT significantly decreased following single DLPFC session (p = 0.04, effect size = 0.71) while there were no significant differences in the CCPT and WCST following single pSTS session. Besides, the results in behavioral outcomes were inconsistent and had discrepancy between reports of parents and patients. In conclusion, a single session of iTBS over the bilateral DLPFC may alter the neuropsychological function in adults with ASD. The impacts of multiple-sessions iTBS over the DLPFC or pSTS deserve further investigations.

Using a Kinect sensor to acquire biological motion: Toolbox and evaluation

Biological motion (BM) is the movement of animate entities, which conveys rich social information. To obtain pure BM, researchers nowadays predominantly use point-light displays (PLDs), which depict BM through a set of light points (e.g., 12 points) placed at distinct joints of a moving human body. Most prevalent BM stimuli are created by state-of-the-art motion capture systems. Although these stimuli are highly precise, the motion capture system is expensive and bulky, and its process of constructing a PLD-based BM is time-consuming and complex. These factors impede the investigation of BM mechanisms. In this study, we propose a free Kinect-based biological motion capture (KBC) toolbox based on the Kinect Sensor 2.0 in C++. The KBC toolbox aims to help researchers acquire PLD-based BM in an easy, low-cost, and user-friendly way. We conducted three experiments to examine whether KBC-generated BM can genuinely reflect the processing characteristics of BM: (1) Is BM from this source processed globally in vision? (2) Does its BM (e.g., from the feet) retain detailed local information? and (3) Does the BM convey emotional information? We obtained positive results in response to all three questions. Therefore, we think that the KBC toolbox can be useful in generating BM for future research.

Priming biological motion changes extrapersonal space categorization

Recent results have shown that the way we categorize space varies as a function of the frame of reference. If the reference frame (RF) is another person vs. an object, the distance is judged as reduced. It has been suggested that such an effect is due to the spontaneous processing of the other's motor potentialities. To investigate the impact of movement representation on space perception, we used biological motion displays as a prime for a spatial categorization task. In Exp. 1, participants were presented with a point-light walker or a scrambled motion, and then judged the location ("Near" or "Far") of a target with a human body or an inanimate object as RF. In Exp. 2, participants were primed with point-light walkers of different speeds: a runner, a normal walker and a slow walker. In Exp. 3 they were primed with a point-light display depicting a human body sitting down on or standing up from a chair, with a human body RF either oriented or not oriented towards the target. Results showed a reduced judged distance when the human body RF was primed with a point-light walker (Exp. 1). Furthermore, we found an additional reduction of the judged distance when priming with a runner (Exp. 2). Finally, Exp. 3 showed that the human body RF has to be target oriented as a precondition for priming effects of the point-light walker.

Network Connectivity of the Right STS in Three Social Perception Localizers

The posterior STS (pSTS) is an important brain region for perceptual analysis of social cognitive cues. This study seeks to characterize the pattern of network connectivity emerging from the pSTS in three core social perception localizers: biological motion perception, gaze recognition, and the interpretation of moving geometric shapes as animate. We identified brain regions associated with all three of these localizers and computed the functional connectivity pattern between them and the pSTS using a partial correlations metric that characterizes network connectivity. We find a core pattern of cortical connectivity that supports the hypothesis that the pSTS serves as a hub of the social brain network. The right pSTS was the most highly connected of the brain regions measured, with many long-range connections to pFC. Unlike other highly connected regions, connectivity to the pSTS was distinctly lateralized. We conclude that the functional importance of right pSTS is revealed when considering its role in the large-scale network of brain regions involved in various aspects of social cognition.

Influence of oxytocin on emotion recognition from body language: A randomized placebo-controlled trial

The neuropeptide 'oxytocin' (OT) is known to play a pivotal role in a variety of complex social behaviors by promoting a prosocial attitude and interpersonal bonding. One mechanism by which OT is hypothesized to promote prosocial behavior is by enhancing the processing of socially relevant information from the environment. With the present study, we explored to what extent OT can alter the 'reading' of emotional body language as presented by impoverished biological motion point light displays (PLDs). To do so, a double-blind between-subjects randomized placebo-controlled trial was conducted, assessing performance on a bodily emotion recognition task in healthy adult males before and after a single-dose of intranasal OT (24 IU). Overall, a single-dose of OT administration had a significant effect of medium size on emotion recognition from body language. OT-induced improvements in emotion recognition were not differentially modulated by the emotional valence of the presented stimuli (positive versus negative) and also, the overall tendency to label an observed emotional state as 'happy' (positive) or 'angry' (negative) was not modified by the administration of OT. Albeit moderate, the present findings of OT-induced improvements in bodily emotion recognition from whole-body PLD provide further support for a link between OT and the processing of socio-communicative cues originating from the body of others.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

Investigating the Causal Role of rOFA in Holistic Detection of Mooney Faces and Objects: An fMRI-guided TMS Study

BACKGROUND

The right occipital face area (rOFA) is known to be involved in face discrimination based on local featural information. Whether this region is also involved in global, holistic stimulus processing is not known.

OBJECTIVE

We used fMRI-guided transcranial magnetic stimulation (TMS) to investigate whether rOFA is causally implicated in stimulus detection based on holistic processing, by the use of Mooney stimuli.

METHODS

Two studies were carried out: In Experiment 1, participants performed a detection task involving Mooney faces and Mooney objects; Mooney stimuli lack distinguishable local features and can be detected solely via holistic processing (i.e. at a global level) with top-down guidance from previously stored representations. Experiment 2 required participants to detect shapes which are recognized via bottom-up integration of local (collinear) Gabor elements and was performed to control for specificity of rOFA's implication in holistic detection.

RESULTS

In Experiment 1, TMS over rOFA and rLO impaired detection of all stimulus categories, with no category-specific effect. In Experiment 2, shape detection was impaired when TMS was applied over rLO but not over rOFA.

CONCLUSIONS

Our results demonstrate that rOFA is causally implicated in the type of top-down holistic detection required by Mooney stimuli and that such role is not face-selective. In contrast, rOFA does not appear to play a causal role in detection of shapes based on bottom-up integration of local components, demonstrating that its involvement in processing non-face stimuli is specific for holistic processing.

TMS reveals flexible use of form and motion cues in biological motion perception

The perception of human movement is a key component of daily social interactions. Although extrastriate area MT+/V5 is closely associated with motion processing, its role in the processing of sparse 'biological motion' displays is still unclear. We developed two closed matched psychophysical tasks to assess simple coherent motion perception and biological motion perception, and measured changes in performance caused by application of TMS over MT+/V5. Performance of the simple motion discrimination task was significantly depressed by TMS stimulation, and highly correlated within observers in TMS conditions, but there was no significant decrement in performance of the biological motion task, despite low intra-observer correlations across TMS conditions. We conclude that extrastriate area MT+/V5 is an obligatory waypoint in the neural processing of simple coherent motion, but is not obligatory for the processing of biological motion. Results are consistent with a dual neural processing route for biological motion processing.

Typical action perception and interpretation without motor simulation

Every day, we interact with people synchronously, immediately understand what they are doing, and easily infer their mental state and the likely outcome of their actions from their kinematics. According to various motor simulation theories of perception, such efficient perceptual processing of others' actions cannot be achieved by visual analysis of the movements alone but requires a process of motor simulation--an unconscious, covert imitation of the observed movements. According to this hypothesis, individuals incapable of simulating observed movements in their motor system should have difficulty perceiving and interpreting observed actions. Contrary to this prediction, we found across eight sensitive experiments that individuals born with absent or severely shortened upper limbs (upper limb dysplasia), despite some variability, could perceive, anticipate, predict, comprehend, and memorize upper limb actions, which they cannot simulate, as efficiently as typically developed participants. We also found that, like the typically developed participants, the dysplasic participants systematically perceived the position of moving upper limbs slightly ahead of their real position but only when the anticipated position was not biomechanically awkward. Such anticipatory bias and its modulation by implicit knowledge of the body biomechanical constraints were previously considered as indexes of the crucial role of motor simulation in action perception. Our findings undermine this assumption and the theories that place the locus of action perception and comprehension in the motor system and invite a shift in the focus of future research to the question of how the visuo-perceptual system represents and processes observed body movements and actions.

Neuronal bases of structural coherence in contemporary dance observation

The neuronal processes underlying dance observation have been the focus of an increasing number of brain imaging studies over the past decade. However, the existing literature mainly dealt with effects of motor and visual expertise, whereas the neural and cognitive mechanisms that underlie the interpretation of dance choreographies remained unexplored. Hence, much attention has been given to the action observation network (AON) whereas the role of other potentially relevant neuro-cognitive mechanisms such as mentalizing (theory of mind) or language (narrative comprehension) in dance understanding is yet to be elucidated. We report the results of an fMRI study where the structural coherence of short contemporary dance choreographies was manipulated parametrically using the same taped movement material. Our participants were all trained dancers. The whole-brain analysis argues that the interpretation of structurally coherent dance phrases involves a subpart (superior parietal) of the AON as well as mentalizing regions in the dorsomedial prefrontal cortex. An ROI analysis based on a similar study using linguistic materials (Pallier et al., 2011) suggests that structural processing in language and dance might share certain neural mechanisms.

Effects of Transcranial Direct Current Stimulation on the Recognition of Bodily Emotions from Point-Light Displays

Perceiving human motion, recognizing actions, and interpreting emotional body language are tasks we perform daily and which are supported by a network of brain areas including the human posterior superior temporal sulcus (pSTS). Here, we applied transcranial direct current stimulation (tDCS) with anodal (excitatory) or cathodal (inhibitory) electrodes mounted over right pSTS (target) and orbito-frontal cortex (reference) while healthy participants performed a bodily emotion recognition task using biological motion point-light displays (PLDs). Performance (accuracy and reaction times) was also assessed on a control task which was matched to the emotion recognition task in terms of cognitive and motor demands. Each subject participated in two experimental sessions, receiving either anodal or cathodal stimulation, which were separated by one week to avoid residual effects of previous stimulations. Overall, tDCS brain stimulation did not affect the recognition of emotional states from PLDs. However, when emotions with a negative or positive-neutral emotional valence were analyzed separately, effects of stimulation were shown for recognizing emotions with a negative emotional valence (sadness and anger), indicating increased recognition performance when receiving anodal (excitatory) stimulation compared to cathodal (inhibitory) stimulation over pSTS. No stimulation effects were shown for the recognition of emotions with positive-neutral emotional valences. These findings extend previous studies showing structure-function relationships between STS and biological motion processing from PLDs and provide indications that stimulation effects may be modulated by the emotional valence of the stimuli.

Rehearsing biological motion in working memory: an EEG study

Holding biological motion (BM), the movements of animate entities, in working memory (WM) is important to our daily social life. However, how BM is maintained in WM remains unknown. The current study investigated this issue and hypothesized that, analogous to BM perception, the human mirror neuron system (MNS) is involved in rehearsing BM in WM. To examine the MNS hypothesis of BM rehearsal, we used an EEG index of mu suppression (8-12 Hz), which has been linked to the MNS. Using a change detection task, we manipulated the BM memory load in three experiments. We predicted that mu suppression in the maintenance phase of WM would be modulated by the BM memory load; moreover, a negative correlation between the number of BM stimuli in WM and the degree of mu suppression may emerge. The results of Experiment 1 were in line with our predictions and revealed that mu suppression increased as the memory load increased from two to four BM stimuli; however, mu suppression then plateaued, as WM could only hold, at most, four BM stimuli. Moreover, the predicted negative correlation was observed. Corroborating the findings of Experiment 1, Experiment 2 further demonstrated that once participants used verbal codes to process the motion information, the mu suppression or modulation by memory load vanished. Finally, Experiment 3 demonstrated that the findings in Experiment 1 were not limited to one specific type of stimuli. Together, these results provide evidence that the MNS underlies the process of rehearsing BM in WM.

Observation and imitation of actions performed by humans, androids, and robots: an EMG study

Understanding others' actions is essential for functioning in the physical and social world. In the past two decades research has shown that action perception involves the motor system, supporting theories that we understand others' behavior via embodied motor simulation. Recently, empirical approach to action perception has been facilitated by using well-controlled artificial stimuli, such as robots. One broad question this approach can address is what aspects of similarity between the observer and the observed agent facilitate motor simulation. Since humans have evolved among other humans and animals, using artificial stimuli such as robots allows us to probe whether our social perceptual systems are specifically tuned to process other biological entities. In this study, we used humanoid robots with different degrees of human-likeness in appearance and motion along with electromyography (EMG) to measure muscle activity in participants' arms while they either observed or imitated videos of three agents produce actions with their right arm. The agents were a Human (biological appearance and motion), a Robot (mechanical appearance and motion), and an Android (biological appearance and mechanical motion). Right arm muscle activity increased when participants imitated all agents. Increased muscle activation was found also in the stationary arm both during imitation and observation. Furthermore, muscle activity was sensitive to motion dynamics: activity was significantly stronger for imitation of the human than both mechanical agents. There was also a relationship between the dynamics of the muscle activity and motion dynamics in stimuli. Overall our data indicate that motor simulation is not limited to observation and imitation of agents with a biological appearance, but is also found for robots. However we also found sensitivity to human motion in the EMG responses. Combining data from multiple methods allows us to obtain a more complete picture of action understanding and the underlying neural computations.

Ventral aspect of the visual form pathway is not critical for the perception of biological motion

Identifying the movements of those around us is fundamental for many daily activities, such as recognizing actions, detecting predators, and interacting with others socially. A key question concerns the neurobiological substrates underlying biological motion perception. Although the ventral "form" visual cortex is standardly activated by biologically moving stimuli, whether these activations are functionally critical for biological motion perception or are epiphenomenal remains unknown. To address this question, we examined whether focal damage to regions of the ventral visual cortex, resulting in significant deficits in form perception, adversely affects biological motion perception. Six patients with damage to the ventral cortex were tested with sensitive point-light display paradigms. All patients were able to recognize unmasked point-light displays and their perceptual thresholds were not significantly different from those of three different control groups, one of which comprised brain-damaged patients with spared ventral cortex (n > 50). Importantly, these six patients performed significantly better than patients with damage to regions critical for biological motion perception. To assess the necessary contribution of different regions in the ventral pathway to biological motion perception, we complement the behavioral findings with a fine-grained comparison between the lesion location and extent, and the cortical regions standardly implicated in biological motion processing. This analysis revealed that the ventral aspects of the form pathway (e.g., fusiform regions, ventral extrastriate body area) are not critical for biological motion perception. We hypothesize that the role of these ventral regions is to provide enhanced multiview/posture representations of the moving person rather than to represent biological motion perception per se.

Visual and Sensorimotor Contributions to the Esthetic Appraisal of Body Form, Motion, and Emotion

Recent neuroscience studies indicate that the visual processing of human bodies relies on a cortical network comprising different sensorimotor regions (extrastriate body area [EBA], superior temporal sulcus [STS], parietal cortex [PC], and premotor cortex [PM]). These regions seem to be specifically involved in the processing of morphological (form) and dynamic (movement) cues of the body. Importantly, the integrated activity within the network dedicated to body processing seems to underpin the unified perception of the body and its movements via simulation-like mechanisms (“cold embodiment”). Studies also suggest that regions within the body-related network are involved in the esthetic appreciation of human bodies together with a variety of cortical and subcortical regions associated to the emotional reward coding of stimuli (e.g., the amygdala for fear/disgust and the nucleus accumbens, the insula, and the cingulate cortex for pleasure reward), which may drive a form of “hot embodiment.” Thus, the esthetic evaluation of human bodies may rely upon a large cortico-subcortical network. Here we review evidence concerning the role of specific sensorimotor cortical and subcortical regions in the perception of beauty and attractiveness of the body. We conclude that exploring the way in which visual, sensorimotor, affective, and multisensory information in art and ecological life in general perturb our body representations is crucial for understanding the neural foundations of esthetic body appreciation.