The role of the extrastriate body area in action perception

The neural representation of body part concepts

Neuropsychological and neuroimaging studies provide evidence for a degree of category-related organization of conceptual knowledge in the brain. Some of this evidence indicates that body part concepts are distinctly represented from other categories; yet, the neural correlates and mechanisms underlying these dissociations are unclear. We expand on the limited prior data by measuring functional magnetic resonance imaging responses induced by body part words and performing a series of analyses investigating the cortical representation of this semantic category. Across voxel-level contrasts, pattern classification, representational similarity analysis, and vertex-wise encoding analyses, we find converging evidence that the posterior middle temporal gyrus, the supramarginal gyrus, and the ventral premotor cortex in the left hemisphere play important roles in the preferential representation of this category compared to other concrete objects.

Audiovisual integration of rhythm in musicians and dancers

Music training is associated with better beat processing in the auditory modality. However, it is unknown how rhythmic training that emphasizes visual rhythms, such as dance training, might affect beat processing, nor whether training effects in general are modality specific. Here we examined how music and dance training interacted with modality during audiovisual integration and synchronization to auditory and visual isochronous sequences. In two experiments, musicians, dancers, and controls completed an audiovisual integration task and an audiovisual target-distractor synchronization task using dynamic visual stimuli (a bouncing figure). The groups performed similarly on the audiovisual integration tasks (Experiments 1 and 2). However, in the finger-tapping synchronization task (Experiment 1), musicians were more influenced by auditory distractors when synchronizing to visual sequences, while dancers were more influenced by visual distractors when synchronizing to auditory sequences. When participants synchronized with whole-body movements instead of finger-tapping (Experiment 2), all groups were more influenced by the visual distractor than the auditory distractor. Taken together, this study highlights how training is associated with audiovisual processing, and how different types of visual rhythmic stimuli and different movements alter beat perception and production outcome measures. Implications for the modality appropriateness hypothesis are discussed.

Don't look now! Social elements are harder to avoid during scene viewing

Regions of social importance (i.e., other people) attract attention in real world scenes, but it is unclear how automatic this bias is and how it might interact with other guidance factors. To investigate this, we recorded eye movements while participants were explicitly instructed to avoid looking at one of two objects in a scene (either a person or a non-social object). The results showed that, while participants could follow these instructions, they still made errors (especially on the first saccade). Crucially, there were about twice as many erroneous looks towards the person than there were towards the other object. This indicates that it is hard to suppress the prioritization of social information during scene viewing, with implications for how quickly and automatically this information is perceived and attended to.

The Cerebral Cortex and the Songs of Homer: When Neuroscience Meets History and Literature

In this article we reconsider Homer's poetry in the light of modern achievements in neuroscience. This perspective offers some clues for examining specific patterns of brain functioning. Homer's epics, for instance, painted a synthetic picture of the human body, emphasizing some parts and neglecting others. This led to the formation of a body schema reminiscent of a homunculus, which we call the "Homeric homunculus." Both poems were largely the product of centuries of oral tradition, in which the prodigious memory of courtly rhapsodists was essential to the performance of the epics. The underlying cognitive functions required a close interplay of memory and language skills, supported by the musical and rhythmic cadence of Homeric verse.

Brain dynamics of visual anticipation during spatial occlusion tasks in expert tennis players

Stimulus identification and action outcome understanding for a rapid and accurate response selection, play a fundamental role in racquet sports. Here, we investigated the neurodynamics of visual anticipation in tennis manipulating the postural and kinematic information associated with the body of opponents by means of a spatial occlusion protocol. Event Related Potentials (ERPs) were evaluated in two groups of professional tennis players (N = 37) with different levels of expertise, while they observed pictures of opponents and predicted the landing position as fast and accurately as possible. The observed action was manipulated by deleting different body districts of the opponent (legs, ball, racket and arm, trunk). Full body image (no occlusion) was used as control condition. The worst accuracy and the slowest response time were observed in the occlusion of trunk and ball. The former was associated with a reduced amplitude of the ERP components likely linked to body processing (the N1 in the right hemisphere) and visual-motor integration awareness (the pP1), as well as with an increase of the late frontal negativity (the pN2), possibly reflecting an effort by the insula to recover and/or complete the most correct sensory-motor representation. In both occlusions, a decrease in the pP2 may reflect an impairment of decisional processes upon action execution following sensory evidence accumulation. Enhanced amplitude of the P3 and the pN2 components were found in more experienced players, suggesting a greater allocation of resources in the process connecting sensory encoding and response execution, and sensory-motor representation.

Two distinct networks containing position-tolerant representations of actions in the human brain

Humans can recognize others' actions in the social environment. This action recognition ability is rarely hindered by the movement of people in the environment. The neural basis of this position tolerance for observed actions is not fully understood. Here, we aimed to identify brain regions capable of generalizing representations of actions across different positions and investigate the representational content of these regions. In a functional magnetic resonance imaging experiment, participants viewed point-light displays of different human actions. Stimuli were presented in either the upper or the lower visual field. Multivariate pattern analysis and a surface-based searchlight approach were employed to identify brain regions that contain position-tolerant action representation: Classifiers were trained with patterns in response to stimuli presented in one position and were tested with stimuli presented in another position. Results showed above-chance classification in the left and right lateral occipitotemporal cortices, right intraparietal sulcus, and right postcentral gyrus. Further analyses exploring the representational content of these regions showed that responses in the lateral occipitotemporal regions were more related to subjective judgments, while those in the parietal regions were more related to objective measures. These results provide evidence for two networks that contain abstract representations of human actions with distinct representational content.

How are patterned movements stored in working memory?

Introduction

In this study, the change detection paradigm was used to study the working memory of patterned movements and the relationship of this type of memory with the visuospatial sketchpad in three experiments.

Methods

Experiment 1 measured participants' working memory capacity for patterned movements and explored the influence of stimulus type with indicators such as response time and accuracy rate. Experiments 2 and 3 explored the relationship between patterned movements and the visual and spatial subsystems, respectively.

Results

The results of Experiment 1 indicated that individuals can store 3-4 patterned movements in working memory; however, a change in stimulus format or an increase in memory load may decrease the speed and efficiency of working memory processing. The results of Experiment 2 showed that working memory and visual working memory are independent when processing patterned movements. The results of Experiment 3 showed that the working memory of patterned movements was affected by spatial working memory.

Discussion

Changes in stimulus type and memory load exerted different effects on the working memory capacity of participants. These results provide behavioral evidence that the storage of patterned movement information is independent of the visual subsystem but requires the spatial subsystem of the visuospatial sketchpad.

The role of motion in the neural representation of social interactions in the posterior temporal cortex

Humans are an inherently social species, with multiple focal brain regions sensitive to various visual social cues such as faces, bodies, and biological motion. More recently, research has begun to investigate how the brain responds to more complex, naturalistic social scenes, identifying a region in the posterior superior temporal sulcus (SI-pSTS; i.e., social interaction pSTS), amongst others, as an important region for processing social interaction. This research, however, has presented images or videos, and thus the contribution of motion to social interaction perception in these brain regions is not yet understood. In the current study, 22 participants viewed videos, image sequences, scrambled image sequences and static images of either social interactions or non-social independent actions. Combining univariate and multivariate analyses, we confirm that bilateral SI-pSTS plays a central role in dynamic social interaction perception but is much less involved when 'interactiveness' is conveyed solely with static cues. Regions in the social brain, including SI-pSTS and extrastriate body area (EBA), showed sensitivity to both motion and interactive content. While SI-pSTS is somewhat more tuned to video interactions than is EBA, both bilateral SI-pSTS and EBA showed a greater response to social interactions compared to non-interactions and both regions responded more strongly to videos than static images. Indeed, both regions showed higher responses to interactions than independent actions in videos and intact sequences, but not in other conditions. Exploratory multivariate regression analyses suggest that selectivity for simple visual motion does not in itself drive interactive sensitivity in either SI-pSTS or EBA. Rather, selectivity for interactions expressed in point-light animations, and selectivity for static images of bodies, make positive and independent contributions to this effect across the LOTC region. Our results strongly suggest that EBA and SI-pSTS work together during dynamic interaction perception, at least when interactive information is conveyed primarily via body information. As such, our results are also in line with proposals of a third visual stream supporting dynamic social scene perception.

The cross-domain functional organization of posterior lateral temporal cortex: insights from ALE meta-analyses of 7 cognitive domains spanning 12,000 participants

The posterior lateral temporal cortex is implicated in many verbal, nonverbal, and social cognitive domains and processes. Yet without directly comparing these disparate domains, the region's organization remains unclear; do distinct processes engage discrete subregions, or could different domains engage shared neural correlates and processes? Here, using activation likelihood estimation meta-analyses, the bilateral posterior lateral temporal cortex subregions engaged in 7 domains were directly compared. These domains comprised semantics, semantic control, phonology, biological motion, face processing, theory of mind, and representation of tools. Although phonology and biological motion were predominantly associated with distinct regions, other domains implicated overlapping areas, perhaps due to shared underlying processes. Theory of mind recruited regions implicated in semantic representation, tools engaged semantic control areas, and faces engaged subregions for biological motion and theory of mind. This cross-domain approach provides insight into how posterior lateral temporal cortex is organized and why.

More Than the Face: Representations of Bodies in the Inferior Temporal Cortex

Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

How the motor system copes with aging: a quantitative meta-analysis of the effect of aging on motor function control

Motor cognitive functions and their neurophysiology evolve and degrade along the lifespan in a dramatic fashion. Current models of how the brain adapts to aging remain inspired primarily by studies on memory or language processes. Yet, aging is strongly associated with reduced motor independence and the associated degraded interaction with the environment: accordingly, any neurocognitive model of aging not considering the motor system is, ipso facto, incomplete. Here we present a meta-analysis of forty functional brain-imaging studies to address aging effects on motor control. Our results indicate that motor control is associated with aging-related changes in brain activity, involving not only motoric brain regions but also posterior areas such as the occipito-temporal cortex. Notably, some of these differences depend on the specific nature of the motor task and the level of performance achieved by the participants. These findings support neurocognitive models of aging that make fewer anatomical assumptions while also considering tasks-dependent and performance-dependent manifestations. Besides the theoretical implications, the present data also provide additional information for the motor rehabilitation domain, indicating that motor control is a more complex phenomenon than previously understood, to which separate cognitive operations can contribute and decrease in different ways with aging.

Many aspects of neuronal control degrade with ageing, including motor control. Using a meta-analysis of functional MRI images, it is made apparent that the ageing brain relies more on visual strategies than sensory stimuli to maintain motor function.

EEG Frequency Tagging Reveals the Integration of Form and Motion Cues into the Perception of Group Movement

The human brain has dedicated mechanisms for processing other people’s movements. Previous research has revealed how these mechanisms contribute to perceiving the movements of individuals but has left open how we perceive groups of people moving together. Across three experiments, we test whether movement perception depends on the spatiotemporal relationships among the movements of multiple agents. In Experiment 1, we combine EEG frequency tagging with apparent human motion and show that posture and movement perception can be dissociated at harmonically related frequencies of stimulus presentation. We then show that movement but not posture processing is enhanced when observing multiple agents move in synchrony. Movement processing was strongest for fluently moving synchronous groups (Experiment 2) and was perturbed by inversion (Experiment 3). Our findings suggest that processing group movement relies on binding body postures into movements and individual movements into groups. Enhanced perceptual processing of movement synchrony may form the basis for higher order social phenomena such as group alignment and its social consequences.

Photographs of Actions: What Makes Them Special Cues to Social Perception

I have reviewed studies on neural responses to pictured actions in the action observation network (AON) and the cognitive functions of these responses. Based on this review, I have analyzed the specific representational characteristics of action photographs. There has been consensus that AON responses provide viewers with knowledge of observed or pictured actions, but there has been controversy about the properties of this knowledge. Is this knowledge causally provided by AON activities or is it dependent on conceptual processing? What elements of actions does it refer to, and how generalized or specific is it? The answers to these questions have come from studies that used transcranial magnetic stimulation (TMS) to stimulate motor or somatosensory cortices. In conjunction with electromyography (EMG), TMS allows researchers to examine changes of the excitability in the corticospinal tract and muscles of people viewing pictured actions. The timing of these changes and muscle specificity enable inferences to be drawn about the cognitive products of processing pictured actions in the AON. Based on a review of studies using TMS and other neuroscience methods, I have proposed a novel hypothetical account that describes the characteristics of action photographs that make them effective cues to social perception. This account includes predictions that can be tested experimentally.

Perspective-dependent activation of frontoparietal circuits during the observation of a static body effector

The perspective from which body-related stimuli are observed plays a fundamental role in modulating cerebral activity during the processing of others' bodies and actions. Previous research has shown perspective-dependent cerebral responses during the observation of both ongoing actions and static images of an acting body with implied motion information, with an advantage for the egocentric viewpoint. The present high-density EEG study assessed event-related potentials triggered by the presentation of a forearm at rest before reach-to-grasp actions, shown from four different viewpoints. Through a spatiotemporal analysis of the scalp electric field and the localization of cortical generators, our study revealed overall different processing for the third-person perspective relative to other viewpoints, mainly due to a later activation of motor-premotor regions. Since observing a static body effector often precedes action observation, our results integrate previous evidence of perspective-dependent encoding, with cascade implications on the design of neurorehabilitative or motor learning interventions based on action observation.

Anatomical correlates of recovery in apraxia: A longitudinal lesion-mapping study in stroke patients

OBJECTIVE

This study investigates the clinical course of recovery of apraxia after left-hemisphere stroke and the underlying neuroanatomical correlates for persisting or recovering deficits in relation to the major processing streams in the network for motor cognition.

METHODS

90 patients were examined during the acute (4.74 ± 2.73 days) and chronic (14.3 ± 15.39 months) stage after left-hemisphere stroke for deficits in meaningless imitation, as well as production and conceptual errors in tool use pantomime. Lesion correlates for persisting or recovering deficits were analyzed with an extension of the non-parametric Brunner-Munzel rank-order test for multi-factorial designs (two-way repeated-measures ANOVA) using acute images.

RESULTS

Meaningless imitation and tool use production deficits persisted into the chronic stage. Conceptual errors in tool use pantomime showed an almost complete recovery. Imitation errors persisted after occipitotemporal and superior temporal lesions in the dorso-dorsal stream. Chronic pantomime production errors were related to the supramarginal gyrus, the key structure of the ventro-dorsal stream. More anterior lesions in the ventro-dorsal stream (ventral premotor cortex) were additionally associated with poor recovery of production errors in pantomime. Conceptual errors in pantomime after temporal and supramarginal gyrus lesions persisted into the chronic stage. However, they resolved completely when related to angular gyrus or insular lesions.

CONCLUSION

The diverging courses of recovery in different apraxia tasks can be related to different mechanisms. Critical lesions to key structures of the network or entrance areas of the processing streams lead to persisting deficits in the corresponding tasks. Contrary, lesions located outside the core network but inducing a temporary network dysfunction allow good recovery e.g., of conceptual errors in pantomime. The identification of lesion correlates for different long-term recovery patterns in apraxia might also allow early clinical prediction of the course of recovery.

Lewis J. The structural and functional connectivity neural underpinnings of body image

How we perceive our bodies is fundamental to our self-consciousness and our experience in the world. There are two types of interrelated internal body representations-a subjective experience of the position of a limb in space (body schema) and the subjective experience of the shape and size of the limb (body image). Body schema has been extensively studied, but there is no evidence of the brain structure and network dynamics underpinning body image. Here, we provide the first evidence for the extrastriate body area (EBA), a multisensory brain area, as the structural and functional neural substrate for body shape and size. We performed a multisensory finger-stretch illusion that elongated the index finger. EBA volume and functional connectivity to the posterior parietal cortex are both related to the participants' susceptibility to the illusion. Taken together, these data suggest that EBA structure and connectivity encode body representation and body perception disturbances.

The Extrastriate Body Area and identity processing: An fMRI guided TMS study

The extrastriate body area (EBA) is a body‐selective focal region located in the lateral occipito‐temporal cortex that responds strongly to images of human bodies and body parts in comparison with other classes of stimuli. Whether EBA contributes also to the body recognition of self versus others remains in debate. We investigated whether EBA contributes to self‐other distinction and whether there might be a hemispheric‐side specificity to that contribution using double‐pulse transcranial magnetic stimulation (TMS) in right‐handed participants. Prior to the TMS experiment, all participants underwent an fMRI localizer task to determine individual EBA location. TMS was then applied over either right EBA, left EBA or vertex, while participants performed an identification task in which images of self or others' right, or left hands were presented. TMS over both EBAs slowed responses, with no identity‐specific effect. However, TMS applied over right EBA induced significantly more errors on other's hands than noTMS, TMS over left EBA or over the Vertex, when applied at 100–110 ms after image onset. The last three conditions did not differ, nor was there any difference for self‐hands. These findings suggest that EBA participates in self/other discrimination.

Neural interactions in occipitotemporal cortex during basic human movement perception by dynamic causal modeling

Action recognition is an essential component of our daily life. The occipitotemporal cortex (OTC) is an important area in human movement perception. The previous studies have revealed that three vital regions including the extrastriate body area (EBA), human middle temporal complex (hMT+), and posterior superior temporal sulcus (pSTS) in OTC play an important role in motion perception. The aim of the current study is to explore the neural interactions between these three regions during basic human movement perception. Functional magnetic resonance imaging data were acquired when participants viewed dynamic videos depicting basic human movements. By the dynamic causal modeling analysis, a model space consisting of 576 models was constructed and evaluated to select the optimal model given the data. The information of the visual movement was found to enter the system through hMT+. We speculated that hMT+ would be the region to show sensitivity to the presence of motion and it subsequently influence and be influenced by the other two regions. Our results also revealed the manner in which the three regions interact during action recognition. Furthermore, We found significantly enhanced modulated connectivity from hMT+ to both EBA and pSTS, as well as from EBA to both hMT+ and pSTS. We inferred that there may be multiple routes for human action perception. One responsible route for processing motion signals is through hMT+ to pSTS, and the other projects information to pSTS may be via the form-processing route. In addition, pSTS may integrate and mediate visual signals and possibly convey them to distributed areas to maintain high-order cognitive tasks.

The Representation of Two-Body Shapes in the Human Visual Cortex

Human social nature has shaped visual perception. A signature of the relationship between vision and sociality is a particular visual sensitivity to social entities such as faces and bodies. We asked whether human vision also exhibits a special sensitivity to spatial relations that reliably correlate with social relations. In general, interacting people are more often situated face-to-face than back-to-back. Using functional MRI and behavioral measures in female and male human participants, we show that visual sensitivity to social stimuli extends to images including two bodies facing toward (vs away from) each other. In particular, the inferior lateral occipital cortex, which is involved in visual-object perception, is organized such that the inferior portion encodes the number of bodies (one vs two) and the superior portion is selectively sensitive to the spatial relation between bodies (facing vs nonfacing). Moreover, functionally localized, body-selective visual cortex responded to facing bodies more strongly than identical, but nonfacing, bodies. In this area, multivariate pattern analysis revealed an accurate representation of body dyads with sharpening of the representation of single-body postures in facing dyads, which demonstrates an effect of visual context on the perceptual analysis of a body. Finally, the cost of body inversion (upside-down rotation) on body recognition, a behavioral signature of a specialized mechanism for body perception, was larger for facing versus nonfacing dyads. Thus, spatial relations between multiple bodies are encoded in regions for body perception and affect the way in which bodies are processed.SIGNIFICANCE STATEMENT Human social nature has shaped visual perception. Here, we show that human vision is not only attuned to socially relevant entities, such as bodies, but also to socially relevant spatial relations between those entities. Body-selective regions of visual cortex respond more strongly to multiple bodies that appear to be interacting (i.e., face-to-face), relative to unrelated bodies, and more accurately represent single body postures in interacting scenarios. Moreover, recognition of facing bodies is particularly susceptible to perturbation by upside-down rotation, indicative of a particular visual sensitivity to the canonical appearance of facing bodies. This encoding of relations between multiple bodies in areas for body-shape recognition suggests that the visual context in which a body is encountered deeply affects its perceptual analysis.

Agent identity drives adaptive encoding of biological motion into working memory

To engage in normal social interactions, we have to encode human biological motions (BMs, e.g., walking and jumping), which is one of the most salient and biologically significant types of kinetic information encountered in everyday life, into working memory (WM). Critically, each BM in real life is produced by a distinct person, carrying a dynamic motion signature (i.e., identity). Whether agent identity influences the WM processing of BMs remains unknown. Here, we addressed this question by examining whether memorizing BMs with different identities promoted the WM processing of task-irrelevant clothing colors. Two opposing hypotheses were tested: (a) WM only stores the target action (element-based hypothesis) and (b) WM stores both action and irrelevant clothing color (event-based hypothesis), interpreting each BM as an event. We required participants to memorize actions that either performed by one agent or distinct agents, while ignoring clothing colors. Then we examined whether the irrelevant color was also stored in WM by probing a distracting effect: If the color was extracted into WM, the change of irrelevant color in the probe would lead to a significant distracting effect on action performance. We found that WM encoding of BMs was adaptive: Once the memorized actions had different identities, WM adopted an event-based encoding mode regardless of memory load and probe identity (Experiment 1, different-identity group of Experiment 2, and Experiment 3). However, WM used an element-based encoding mode when memorized-actions shared the same identity (same-identity group of Experiment 2) or were inverted (Experiment 4). Overall, these findings imply that agent identity information has a significant effect on the WM processing of BMs.

Distinct neural response to visual perspective and body size in the extrastriate body area

Neuroimaging research has independently implicated the extrastriate body area (EBA) in distinguishing between different visual perspectives and morphologies of bodies within visual processing. However, the combined processing of these physical attributes towards neural EBA response remains unclear, and may be crucial in influencing higher-order, aesthetic evaluation of bodies. Indeed, EBA alterations amongst eating disorder patients have been associated with disturbances in body image, and disruption to EBA activity amongst healthy individuals has been shown to influence aesthetic evaluations made towards bodies. Therefore, the present study used images of slim and large female bodies viewed from egocentric and allocentric perspectives, to investigate neural EBA response amongst healthy females (N = 30). In addition, participants provided behavioural aesthetic and weight evaluations of all model stimuli. Results revealed an interaction, bilaterally, between visual perspective and body size towards EBA activity, with multi-voxel pattern analysis revealing distinct neural patterns between the four conditions. However, EBA activity did not relate to non-clinical eating disorder psychopathology. No direct relationship was found between EBA activity and behavioural evaluations of model stimuli; however, a whole brain analysis revealed that higher-order, prefrontal regions were associated with cognitive evaluations of large bodies. Taken together, our results suggest that the EBA is an integral core region in discriminating between multiple physical attributes of the body, which is likely to provide important information to higher-order brain regions which make aesthetic evaluations towards bodies.

Speech-accompanying gestures are not processed by the language-processing mechanisms

Speech-accompanying gestures constitute one information channel during communication. Some have argued that processing gestures engages the brain regions that support language comprehension. However, studies that have been used as evidence for shared mechanisms suffer from one or more of the following limitations: they (a) have not directly compared activations for gesture and language processing in the same study and relied on the fallacious reverse inference (Poldrack, 2006) for interpretation, (b) relied on traditional group analyses, which are bound to overestimate overlap (e.g., Nieto-Castañon and Fedorenko, 2012), (c) failed to directly compare the magnitudes of response (e.g., Chen et al., 2017), and (d) focused on gestures that may have activated the corresponding linguistic representations (e.g., "emblems"). To circumvent these limitations, we used fMRI to examine responses to gesture processing in language regions defined functionally in individual participants (e.g., Fedorenko et al., 2010), including directly comparing effect sizes, and covering a broad range of spontaneously generated co-speech gestures. Whenever speech was present, language regions responded robustly (and to a similar degree regardless of whether the video contained gestures or grooming movements). In contrast, and critically, responses in the language regions were low - at or slightly above the fixation baseline - when silent videos were processed (again, regardless of whether they contained gestures or grooming movements). Brain regions outside of the language network, including some in close proximity to its regions, differentiated between gestures and grooming movements, ruling out the possibility that the gesture/grooming manipulation was too subtle. Behavioral studies on the critical video materials further showed robust differentiation between the gesture and grooming conditions. In summary, contra prior claims, language-processing regions do not respond to co-speech gestures in the absence of speech, suggesting that these regions are selectively driven by linguistic input (e.g., Fedorenko et al., 2011). Although co-speech gestures are uncontroversially important in communication, they appear to be processed in brain regions distinct from those that support language comprehension, similar to other extra-linguistic communicative signals, like facial expressions and prosody.

Perceiving emotion and sex from the body: evidence from the Garner task for independent processes

The appearance of the body signals socially relevant states and traits, but the how these cues are perceived is not well understood. Here we examined judgments of emotion and sex from the body's appearance. Understanding how we extract these cues is important because they are both salient and socially relevant. Participants viewed body images and either reported the emotion expressed by each body while ignoring its sex, or else reported the sex while ignoring its emotion. Following Garner's logic, two types of blocks were compared. In control blocks, the task-irrelevant dimension was fixed (e.g. all male in an emotion judgment task), whereas in orthogonal blocks it varied orthogonally to the task-relevant dimension (e.g. male-female). Where two dimensions draw on shared processes, interference results in relatively slower responses during orthogonal blocks. In contrast, a finding of no Garner interference - efficient selection of the task-relevant dimension - is taken to reflect independent processes. Bayesian analyses revealed evidence of no Garner interference between sex and emotion judgments, showing that extraction of these distinct signals from the body's appearance proceeds along largely parallel processing streams. These findings are informative about the mental architecture behind our perception of socially relevant characteristics of other people.

The role of the cerebellum in adaptation: ALE meta-analyses on sensory feedback error

It is widely accepted that unexpected sensory consequences of self‐action engage the cerebellum. However, we currently lack consensus on where in the cerebellum, we find fine‐grained differentiation to unexpected sensory feedback. This may result from methodological diversity in task‐based human neuroimaging studies that experimentally alter the quality of self‐generated sensory feedback. We gathered existing studies that manipulated sensory feedback using a variety of methodological approaches and performed activation likelihood estimation (ALE) meta‐analyses. Only half of these studies reported cerebellar activation with considerable variation in spatial location. Consequently, ALE analyses did not reveal significantly increased likelihood of activation in the cerebellum despite the broad scientific consensus of the cerebellum's involvement. In light of the high degree of methodological variability in published studies, we tested for statistical dependence between methodological factors that varied across the published studies. Experiments that elicited an adaptive response to continuously altered sensory feedback more frequently reported activation in the cerebellum than those experiments that did not induce adaptation. These findings may explain the surprisingly low rate of significant cerebellar activation across brain imaging studies investigating unexpected sensory feedback. Furthermore, limitations of functional magnetic resonance imaging to probe the cerebellum could play a role as climbing fiber activity associated with feedback error processing may not be captured by it. We provide methodological recommendations that may guide future studies.

The Neural Representations of Movement across Semantic Categories

Previous evidence from neuropsychological and neuroimaging studies suggests functional specialization for tools and related semantic knowledge in a left frontoparietal network. It is still debated whether these areas are involved in the representation of rudimentary movement-relevant knowledge regardless of semantic domains (animate vs. inanimate) or categories (tools vs. nontool objects). Here, we used fMRI to record brain activity while 13 volunteers performed two semantic judgment tasks on visually presented items from three different categories: animals, tools, and nontool objects. Participants had to judge two distinct semantic features: whether two items typically move in a similar way (e.g., a fan and a windmill move in circular motion) or whether they are usually found in the same environment (e.g., a seesaw and a swing are found in a playground). We investigated differences in overall activation (which areas are involved) as well as representational content (which information is encoded) across semantic features and categories. Results of voxel-wise mass univariate analysis showed that, regardless of semantic category, a dissociation emerges between processing information on prototypical location (involving the anterior temporal cortex and the angular gyrus) and movement (linked to left inferior parietal and frontal activation). Multivoxel pattern correlation analyses confirmed the representational segregation of networks encoding task- and category-related aspects of semantic processing. Taken together, these findings suggest that the left frontoparietal network is recruited to process movement properties of items (including both biological and nonbiological motion) regardless of their semantic category.

Dyadic interaction processing in the posterior temporal cortex

Recent behavioural evidence shows that visual displays of two individuals interacting are not simply encoded as separate individuals, but as an interactive unit that is 'more than the sum of its parts'. Recent functional magnetic resonance imaging (fMRI) evidence shows the importance of the posterior superior temporal sulcus (pSTS) in processing human social interactions, and suggests that it may represent human-object interactions as qualitatively 'greater' than the average of their constituent parts. The current study aimed to investigate whether the pSTS or other posterior temporal lobe region(s): 1) Demonstrated evidence of a dyadic information effect - that is, qualitatively different responses to an interacting dyad than to averaged responses of the same two interactors, presented in isolation, and; 2) Significantly differentiated between different types of social interactions.

Multivoxel pattern analysis was performed in which a classifier was trained to differentiate between qualitatively different types of dyadic interactions. Above-chance classification of interactions was observed in 'interaction selective' pSTS-I and extrastriate body area (EBA), but not in other regions of interest (i.e. face-selective STS and mentalizing-selective temporo-parietal junction). A dyadic information effect was not observed in the pSTS-I, but instead was shown in the EBA; that is, classification of dyadic interactions did not fully generalise to averaged responses to the isolated interactors, indicating that dyadic representations in the EBA contain unique information that cannot be recovered from the interactors presented in isolation. These findings complement previous observations for congruent grouping of human bodies and objects in the broader lateral occipital temporal cortex area.

•

pSTS and EBA classify between different dynamic interactions.

•

EBA is sensitive to (uniquely) dyadic interaction information.

•

These findings support previous evidence for grouping of interacting people/objects in LOTC.

Predicting Blood Oxygenation Level-Dependent Activity in Fusiform Face Area from the Activity in Other Visual Areas

Neuroimaging studies have shown that discrete regions in ventral visual pathway respond selectively to specific object categories. For example, the fusiform face area (FFA) in humans is consistently more responsive to face than nonface images. However, it is not clear how other cortical regions contribute to this preferential response in FFA. To address this question, we performed a functional magnetic resonance imaging study on human subjects watching naturalistic movie clips from human actions. We then used correlation and multivariate regression (partial least-squares regression) analyses to estimate/predict the mean BOLD (blood oxygenation level-dependent) activity in FFA, from the mean and pattern of responses in 24 visual cortical areas. Higher tier retinotopic areas V3, hV4, and LO2, motion-selective area middle temporal, body-selective areas, and non-FFA face-selective areas had the best prediction accuracy particularly when they were located ipsilateral to FFA. All non-FFA collectively could explain up to 75% of variance in the FFA response. The regression models were also designed to predict the mean activity in one face area from the pattern of activity in another face area. The prediction power was significantly higher between the occipital face area and FFA. The multivariate regression analysis provides a new framework for investigating functional connectivity between cortical areas, and it could inform hierarchical models of visual cortex.

Neural correlates of body comparison and weight estimation in weight-recovered anorexia nervosa: a functional magnetic resonance imaging study

Background

The neural mechanisms underlying body dissatisfaction and emotional problems evoked by social comparisons in patients with anorexia nervosa (AN) are currently unclear. Here, we elucidate patterns of brain activation among recovered patients with AN (recAN) during body comparison and weight estimation with functional magnetic resonance imaging (fMRI).

Methods

We used fMRI to examine 12 patients with recAN and 13 healthy controls while they performed body comparison and weight estimation tasks with images of underweight, healthy weight, and overweight female bodies. In the body comparison task, participants rated their anxiety levels while comparing their own body with the presented image. In the weight estimation task, participants estimated the weight of the body in the presented image. We used between-group region of interest (ROI) analyses of the blood oxygen level dependent (BOLD) signal to analyze differences in brain activation patterns between the groups. In addition, to investigate activation outside predetermined ROIs, we performed an exploratory whole-brain analysis to identify group differences.

Results

We found that, compared to healthy controls, patients with recAN exhibited significantly greater activation in the pregenual anterior cingulate cortex (pgACC) when comparing their own bodies with images of underweight female bodies. In addition, we found that, compared with healthy controls, patients with recAN exhibited significantly smaller activation in the middle temporal gyrus corresponding to the extrastriate body area (EBA) when comparing their own bodies, irrespective of weight, during self-other comparisons of body shape.

Conclusions

Our findings from a group of patients with recAN suggest that the pathology of AN may lie in an inability to regulate negative affect in response to body images via pgACC activation during body comparisons. The findings also suggest that altered body image processing in the brain persists even after recovery from AN.

Electronic supplementary material

The online version of this article (10.1186/s13030-018-0134-z) contains supplementary material, which is available to authorized users.

Altered perspective-dependent brain activation while viewing hands and associated imitation difficulties in individuals with autism spectrum disorder

Background

Individuals with autism spectrum disorder (ASD) appear to have a unique awareness of their own body, which may be associated with difficulties of gestural interaction. In typically developing (TD) individuals, the perception of body parts is processed in various brain regions. For instance, activation of the lateral occipito-temporal cortex (LOTC) is known to depend on perspective (i.e., first- or third-person perspective) and identity (i.e., own vs. another person's body). In the present study, we examined how perspective and identity affect brain activation in individuals with ASD, and how perspective- and identity-dependent brain activation is associated with gestural imitation abilities.

Methods

Eighteen young adults with ASD and 18 TD individuals participated in an fMRI study in which the participants observed their own or another person's hands from the first- and third-person perspectives. We examined whether the brain activation associated with perspective and identity was altered in individuals with ASD. Furthermore, we identified the brain regions the activity of which correlated with gestural imitation difficulties in individuals with ASD.

Results

In the TD group, the left LOTC was more strongly activated by viewing a hand from the third-person perspective compared with the first-person perspective. This perspective effect in the left LOTC was significantly attenuated in the ASD group. We also observed significant group differences in the perspective effect in the medial prefrontal cortex (mPFC). Correlation analysis revealed that the perspective effect in the inferior parietal lobule (IPL) and cerebellum was associated with the gestural imitation ability in individuals with ASD.

Conclusions

Our study suggests that atypical visual self-body recognition in individuals with ASD is associated with an altered perspective effect in the LOTC and mPFC, which are thought to be involved in the physical and core selves, respectively. Furthermore, the gestural imitation difficulty in individuals with ASD might be associated with the altered activation in the IPL and cerebellum, but not in the LOTC. These findings shed light on common and divergent neural mechanisms underlying atypical visual self-body awareness and gestural interaction in ASD.

The iconography of mourning and its neural correlates: a functional neuroimaging study

The present functional neuroimaging study focuses on the iconography of mourning. A culture-specific pattern of body postures of mourning individuals, mostly suggesting withdrawal, emerged from a survey of visual material. When used in different combinations in stylized drawings in our neuroimaging study, this material activated cortical areas commonly seen in studies of social cognition (temporo-parietal junction, superior temporal gyrus, and inferior temporal lobe), empathy for pain (somatosensory cortex), and loss (precuneus, middle/posterior cingular gyrus). This pattern of activation developed over time. While in the early phases of exposure lower association areas, such as the extrastriate body area, were active, in the late phases activation in parietal and temporal association areas and the prefrontal cortex was more prominent. These findings are consistent with the conventional and contextual character of iconographic material, and further differentiate it from emotionally negatively valenced and high-arousing stimuli. In future studies, this neuroimaging assay may be useful in characterizing interpretive appraisal of material of negative emotional valence.

Left extrastriate body area is sensitive to the meaning of symbolic gesture: evidence from fMRI repetition suppression

Functional magnetic resonance imaging (fMRI) adaptation (a.k.a. repetition suppression) paradigm was used to test if semantic information contained in object-related (transitive) pantomimes and communicative (intransitive) gestures is represented differently in the occipito-temporal cortex. Participants watched 2.75 s back-to-back videos where the meaning of gesture was either repeated or changed. The just observed (typically second) gesture was then imitated. To maintain participants’ attention, some trials contained a single video. fMRI adaptation –signal decreases– for watching both movement categories were observed particularly in the lateral occipital cortex, including the extrastriate body area (EBA). Yet, intransitive (vs. transitive) gesture specific repetition suppression was found mainly in the left rostral EBA and caudal middle temporal gyrus- the rEBA/cMTG complex. Repetition enhancement (signal increase) was revealed in the precuneus. While the whole brain and region-of-interest analyses indicate that the precuneus is involved only in visuospatial action processing for later imitation, the common EBA repetition suppression discloses sensitivity to the meaning of symbolic gesture, namely the “semantic what” of actions. Moreover, the rEBA/cMTG suppression reveals greater selectivity for conventionalized communicative gesture. Thus, fMRI adaptation shows higher-order functions of EBA, its role in the semantic network, and indicates that its functional repertoire is wider than previously thought.

Different contributions of visual and motor brain areas during liking judgments of same- and different-gender bodies

Previous neuroimaging studies have shown that body aesthetic appreciation involves the activation of both visual and motor areas, supporting a role of sensorimotor embodiment in aesthetic processing. Causative evidence, however, that neural activity in these areas is crucial for reliable aesthetic body appreciation has so far provided only for extrastriate body area (EBA), while the functional role played by premotor regions remained less clear. Here, we applied short trains of repetitive transcranial magnetic stimulation (rTMS) over bilateral dorsal premotor cortex (dPMC) and EBA during liking judgments of female and male bodies varying in weight and implied motion. We found that both dPMC and EBA are necessary for aesthetic body appreciation, but their relative contribution depends on the model's gender. While dPMC-rTMS decreased the liking judgments of same-, but not of different-gender models, EBA-rTMS increased the liking judgments of different-, but not of same-gender models. Relative contributions of motor and visual areas may reflect processing of diverse aesthetic properties, respectively implied motion vs. body form, and/or greater sensorimotor embodiment of same- vs. different-gender bodies. Results suggest that aesthetic body processing is subserved by a network of motor and visual areas, whose relative contribution may depend on the specific stimulus and task.

A third-person perspective on co-speech action gestures in Parkinson's disease

A combination of impaired motor and cognitive function in Parkinson's disease (PD) can impact on language and communication, with patients exhibiting a particular difficulty processing action verbs. Co-speech gestures embody a link between action and language and contribute significantly to communication in healthy people. Here, we investigated how co-speech gestures depicting actions are affected in PD, in particular with respect to the visual perspective—or the viewpoint – they depict. Gestures are closely related to mental imagery and motor simulations, but people with PD may be impaired in the way they simulate actions from a first-person perspective and may compensate for this by relying more on third-person visual features. We analysed the action-depicting gestures produced by mild-moderate PD patients and age-matched controls on an action description task and examined the relationship between gesture viewpoint, action naming, and performance on an action observation task (weight judgement). Healthy controls produced the majority of their action gestures from a first-person perspective, whereas PD patients produced a greater proportion of gestures produced from a third-person perspective. We propose that this reflects a compensatory reliance on third-person visual features in the simulation of actions in PD. Performance was also impaired in action naming and weight judgement, although this was unrelated to gesture viewpoint. Our findings provide a more comprehensive understanding of how action-language impairments in PD impact on action communication, on the cognitive underpinnings of this impairment, as well as elucidating the role of action simulation in gesture production.

Distinct contributions of extrastriate body area and temporoparietal junction in perceiving one's own and others' body

The right temporoparietal cortex plays a critical role in body representation. Here, we applied repetitive transcranial magnetic stimulation (rTMS) over right extrastriate body area (EBA) and temporoparietal junction (TPJ) to investigate their causative roles in perceptual representations of one's own and others' body. Healthy women adjusted size-distorted pictures of their own body or of the body of another person according to how they perceived the body (subjective task) or how others perceived it (intersubjective task). In keeping with previous reports, at baseline, we found an overall underestimation of body size. Crucially, EBA-rTMS increased the underestimation bias when participants adjusted the images according to how others perceived their own or the other woman's body, suggesting a specific role of EBA in allocentric body representations. Conversely, TPJ-rTMS increased the underestimation bias when participants adjusted the body of another person, either a familiar other or a close friend, in both subjective and intersubjective tasks, suggesting an involvement of TPJ in representing others' bodies. These effects were body-specific, since no TMS-induced modulation was observed when participants judged a familiar object. The results suggest that right EBA and TPJ play active and complementary roles in the complex interaction between the perceptions of one's own and other people's body.

Constructing Visual Perception of Body Movement with the Motor Cortex

The human brain readily perceives fluent movement from static input. Using functional magnetic resonance imaging, we investigated brain mechanisms that mediate fluent apparent biological motion (ABM) perception from sequences of body postures. We presented body and nonbody stimuli varying in objective sequence duration and fluency of apparent movement. Three body postures were ordered to produce a fluent (ABC) or a nonfluent (ACB) apparent movement. This enabled us to identify brain areas involved in the perceptual reconstruction of body movement from identical lower-level static input. Participants judged the duration of a rectangle containing body/nonbody sequences, as an implicit measure of movement fluency. For body stimuli, fluent apparent motion sequences produced subjectively longer durations than nonfluent sequences of the same objective duration. This difference was reduced for nonbody stimuli. This body-specific bias in duration perception was associated with increased blood oxygen level-dependent responses in the primary (M1) and supplementary motor areas. Moreover, fluent ABM was associated with increased functional connectivity between M1/SMA and right fusiform body area. We show that perceptual reconstruction of fluent movement from static body postures does not merely enlist areas traditionally associated with visual body processing, but involves cooperative recruitment of motor areas, consistent with a "motor way of seeing".

Recognition of dance-like actions: memory for static posture or dynamic movement?

Dance-like actions are complex visual stimuli involving multiple changes in body posture across time and space. Visual perception research has demonstrated a difference between the processing of dynamic body movement and the processing of static body posture. Yet, it is unclear whether this processing dissociation continues during the retention of body movement and body form in visual working memory (VWM). When observing a dance-like action, it is likely that static snapshot images of body posture will be retained alongside dynamic images of the complete motion. Therefore, we hypothesized that, as in perception, posture and movement would differ in VWM. Additionally, if body posture and body movement are separable in VWM, as form- and motion-based items, respectively, then differential interference from intervening form and motion tasks should occur during recognition. In two experiments, we examined these hypotheses. In Experiment 1, the recognition of postures and movements was tested in conditions in which the formats of the study and test stimuli matched (movement-study to movement-test, posture-study to posture-test) or mismatched (movement-study to posture-test, posture-study to movement-test). In Experiment 2, the recognition of postures and movements was compared after intervening form and motion tasks. These results indicated that (1) the recognition of body movement based only on posture is possible, but it is significantly poorer than recognition based on the entire movement stimulus, and (2) form-based interference does not impair memory for movements, although motion-based interference does. We concluded that, whereas static posture information is encoded during the observation of dance-like actions, body movement and body posture differ in VWM.

Semantic brain areas are involved in gesture comprehension: An electrical neuroimaging study

While the mechanism of sign language comprehension in deaf people has been widely investigated, little is known about the neural underpinnings of spontaneous gesture comprehension in healthy speakers. Bioelectrical responses to 800 pictures of actors showing common Italian gestures (e.g., emblems, deictic or iconic gestures) were recorded in 14 persons. Stimuli were selected from a wider corpus of 1122 gestures. Half of the pictures were preceded by an incongruent description. ERPs were recorded from 128 sites while participants decided whether the stimulus was congruent. Congruent pictures elicited a posterior P300 followed by late positivity, while incongruent gestures elicited an anterior N400 response. N400 generators were investigated with swLORETA reconstruction. Processing of congruent gestures activated face- and body-related visual areas (e.g., BA19, BA37, BA22), the left angular gyrus, mirror fronto/parietal areas. The incongruent-congruent contrast particularly stimulated linguistic and semantic brain areas, such as the left medial and the superior temporal lobe.

Body selectivity in occipitotemporal cortex: Causal evidence

Perception of others' bodies provides information that is useful for a number of important social-cognitive processes. Evidence from neuroimaging methods has identified focal cortical regions that are highly selective for perceiving bodies and body parts, including the extrastriate body area (EBA) and fusiform body area (FBA). Our understanding of the functional properties of these regions, and their causal contributions to behavior, has benefitted from the study of neuropsychological patients and particularly from investigations using transcranial magnetic stimulation (TMS). We review this evidence, focusing on TMS studies that are revealing of how (and when) activity in EBA contributes to detecting people in natural scenes; to resolving their body shape, movements, actions, individual parts, and identities; and to guiding goal-directed behavior. These findings are considered in reference to a framework for body perception in which the patterns of neural activity in EBA and FBA jointly serve to make explicit the elements of the visual scene that correspond to the body and its parts. These representations are modulated by other sources of information such as prior knowledge, and are shared with wider brain networks involved in many aspects of social cognition.

From personal fear to mass panic: The neurological basis of crowd perception

Recent studies have investigated the neural correlates of how we perceive emotions of individuals or a group of individuals using images of individual bodily expressions. However, it is still largely unknown how we perceive the emotion of a dynamic crowd. This fMRI study used realistic videos of a large group of people expressing fearful, happy or neutral emotions. Furthermore, the emotions were expressed by either unrelated individuals in the group or by an interacting group. It was hypothesized that the dynamics between the people in a crowd is a more salient signal than merely the emotion of the crowd. Second, it was expected that the group interaction is of special importance in a fearful or "panic" situation, as opposed to a happy or neutral situation. Using a fast-event related design, it was revealed that observing interactive individuals, more so than independently expressive individuals, activated networks related to the perception, execution and integration of action and emotion. Most importantly, the interactive or panicked crowds, as opposed to the individually fearful crowds, triggered more anticipatory and action preparation activity, whereas the brain was less sensitive to the dynamics of individuals in a happy or neutral crowd. This is the first study to assess the effect of the dynamics between people and the collectively displayed emotion as an important aspect of emotional crowd perception.

Self-recognition of one's own fall recruits the genuine bodily crisis-related brain activity

While bipedalism is a fundamental evolutionary adaptation thought to be essential for the development of the human brain, the erect body is always an inch or two away from falling. Although the neural mechanism for automatically detecting one's own body instability is an important consideration, there have thus far been few functional neuroimaging studies because of the restrictions placed on participants' movements. Here, we used functional magnetic resonance imaging to investigate the neural substrate underlying whole body instability, based on the self-recognition paradigm that uses video stimuli consisting of one's own and others' whole bodies depicted in stable and unstable states. Analyses revealed significant activity in the regions which would be activated during genuine unstable bodily states: The right parieto-insular vestibular cortex, inferior frontal junction, posterior insula and parabrachial nucleus. We argue that these right-lateralized cortical and brainstem regions mediate vestibular information processing for detection of vestibular anomalies, defensive motor responding in which the necessary motor responses are automatically prepared/simulated to protect one's own body, and sympathetic activity as a form of alarm response during whole body instability.

The role of mirroring and mentalizing networks in mediating action intentions in autism

BACKGROUND

The ability to interpret agents' intent from their actions is a vital skill in successful social interaction. However, individuals with autism spectrum disorders (ASD) have been found to have difficulty in attributing intentions to others. The present study investigated the neural mechanisms of inferring intentions from actions in individuals with ASD.

METHODS

Functional magnetic resonance imaging (fMRI) data were acquired from 21 high-functioning young adults with ASD and 22 typically developing (TD) control participants, while making judgments about the means (how an action is performed) and intention (why an action is performed) of a model's actions.

RESULTS

Across both groups of participants, the middle and superior temporal cortex, extending to temporoparietal junction, and posterior cingulate cortex, responded significantly to inferring the intent of an action, while inferior parietal lobule and occipital cortices were active for judgments about the means of an action. Participants with ASD had significantly reduced activation in calcarine sulcus and significantly increased activation in left inferior frontal gyrus, compared to TD peers, while attending to the intentions of actions. Also, ASD participants had weaker functional connectivity between frontal and posterior temporal regions while processing intentions.

CONCLUSIONS

These results suggest that processing actions and intentions may not be mutually exclusive, with reliance on mirroring and mentalizing mechanisms mediating action understanding. Overall, inferring information about others' actions involves activation of the mirror neuron system and theory-of-mind regions, and this activation (and the synchrony between activated brain regions) appears altered in young adults with ASD.

Posture-based processing in visual short-term memory for actions

Visual perception of human action involves both form and motion processing, which may rely on partially dissociable neural networks. If form and motion are dissociable during visual perception, then they may also be dissociable during their retention in visual short-term memory (VSTM). To elicit form-plus-motion and form-only processing of dance-like actions, individual action frames can be presented in the correct or incorrect order. The former appears coherent and should elicit action perception, engaging both form and motion pathways, whereas the latter appears incoherent and should elicit posture perception, engaging form pathways alone. It was hypothesized that, if form and motion are dissociable in VSTM, then recognition of static body posture should be better after viewing incoherent than after viewing coherent actions. However, as VSTM is capacity limited, posture-based encoding of actions may be ineffective with increased number of items or frames. Using a behavioural change detection task, recognition of a single test posture was significantly more likely after studying incoherent than after studying coherent stimuli. However, this effect only occurred for spans of two (but not three) items and for stimuli with five (but not nine) frames. As in perception, posture and motion are dissociable in VSTM.

Action Sentences Activate Sensory Motor Regions in the Brain Independently of Their Status of Reality

Some studies have reported that understanding concrete action-related words and sentences elicits activations of motor areas in the brain. The present fMRI study goes one step further by testing whether this is also the case for comprehension of nonfactual statements. Three linguistic structures were used (factuals, counterfactuals, and negations), referring either to actions or, as a control condition, to visual events. The results showed that action sentences elicited stronger activations than visual sentences in the SMA, extending to the primary motor area, as well as in regions generally associated with the planning and understanding of actions (left superior temporal gyrus, left and right supramarginal gyri). Also, we found stronger activations for action sentences than for visual sentences in the extrastriate body area, a region involved in the visual processing of human body movements. These action-related effects occurred not only in factuals but also in negations and counterfactuals, suggesting that brain regions involved in action understanding and planning are activated by default even when the actions are described as hypothetical or as not happening. Moreover, some of these regions overlapped with those activated during the observation of action videos, indicating that the act of understanding action language and that of observing real actions share neural networks. These results support the claim that embodied representations of linguistic meaning are important even in abstract linguistic contexts.

Objects tell us what action we can expect: dissociating brain areas for retrieval and exploitation of action knowledge during action observation in fMRI

Objects are reminiscent of actions often performed with them: knife and apple remind us on peeling the apple or cutting it. Mnemonic representations of object-related actions (action codes) evoked by the sight of an object may constrain and hence facilitate recognition of unrolling actions. The present fMRI study investigated if and how action codes influence brain activation during action observation. The average number of action codes (NAC) of 51 sets of objects was rated by a group of n = 24 participants. In an fMRI study, different volunteers were asked to recognize actions performed with the same objects presented in short videos. To disentangle areas reflecting the storage of action codes from those exploiting them, we showed object-compatible and object-incompatible (pantomime) actions. Areas storing action codes were considered to positively co-vary with NAC in both object-compatible and object-incompatible action; due to its role in tool-related tasks, we here hypothesized left anterior inferior parietal cortex (aIPL). In contrast, areas exploiting action codes were expected to show this correlation only in object-compatible but not incompatible action, as only object-compatible actions match one of the active action codes. For this interaction, we hypothesized ventrolateral premotor cortex (PMv) to join aIPL due to its role in biasing competition in IPL. We found left anterior intraparietal sulcus (IPS) and left posterior middle temporal gyrus (pMTG) to co-vary with NAC. In addition to these areas, action codes increased activity in object-compatible action in bilateral PMv, right IPS, and lateral occipital cortex (LO). Findings suggest that during action observation, the brain derives possible actions from perceived objects, and uses this information to shape action recognition. In particular, the number of expectable actions quantifies the activity level at PMv, IPL, and pMTG, but only PMv reflects their biased competition while observed action unfolds.

Critical brain regions for tool-related and imitative actions: a componential analysis

Numerous functional neuroimaging studies suggest that widespread bilateral parietal, temporal, and frontal regions are involved in tool-related and pantomimed gesture performance, but the role of these regions in specific aspects of gestural tasks remains unclear. In the largest prospective study of apraxia-related lesions to date, we performed voxel-based lesion-symptom mapping with data from 71 left hemisphere stroke participants to assess the critical neural substrates of three types of actions: gestures produced in response to viewed tools, imitation of tool-specific gestures demonstrated by the examiner, and imitation of meaningless gestures. Thus, two of the three gesture types were tool-related, and two of the three were imitative, enabling pairwise comparisons designed to highlight commonalities and differences. Gestures were scored separately for postural (hand/arm positioning) and kinematic (amplitude/timing) accuracy. Lesioned voxels in the left posterior temporal gyrus were significantly associated with lower scores on the posture component for both of the tool-related gesture tasks. Poor performance on the kinematic component of all three gesture tasks was significantly associated with lesions in left inferior parietal and frontal regions. These data enable us to propose a componential neuroanatomic model of action that delineates the specific components required for different gestural action tasks. Thus, visual posture information and kinematic capacities are differentially critical to the three types of actions studied here: the kinematic aspect is particularly critical for imitation of meaningless movement, capacity for tool-action posture representations are particularly necessary for pantomimed gestures to the sight of tools, and both capacities inform imitation of tool-related movements. These distinctions enable us to advance traditional accounts of apraxia.

The left inferior parietal lobe represents stored hand-postures for object use and action prediction

Action semantics enables us to plan actions with objects and to predict others' object-directed actions as well. Previous studies have suggested that action semantics are represented in a fronto-parietal action network that has also been implicated to play a role in action observation. In the present fMRI study it was investigated how activity within this network changes as a function of the predictability of an action involving multiple objects and requiring the use of action semantics. Participants performed an action prediction task in which they were required to anticipate the use of a centrally presented object that could be moved to an associated target object (e.g., hammer—nail). The availability of actor information (i.e., presenting a hand grasping the central object) and the number of possible target objects (i.e., 0, 1, or 2 target objects) were independently manipulated, resulting in different levels of predictability. It was found that making an action prediction based on actor information resulted in an increased activation in the extrastriate body area (EBA) and the fronto-parietal action observation network (AON). Predicting actions involving a target object resulted in increased activation in the bilateral IPL and frontal motor areas. Within the AON, activity in the left inferior parietal lobe (IPL) and the left premotor cortex (PMC) increased as a function of the level of action predictability. Together these findings suggest that the left IPL represents stored hand-postures that can be used for planning object-directed actions and for predicting other's actions as well.