Perceived causality influences brain activity evoked by biological motion

Top-Down Attention Guidance Shapes Action Encoding in the pSTS

The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

Transitive Versus Intransitive Complex Gesture Representation: A Comparison Between Execution, Observation and Imagination by fNIRS

The aim of the present study was to examine cortical correlates of motor execution, motor observation and motor imagery of hand complex gestures, in particular by comparing meaningful gestures implying the use of an object (transitive action) or not (intransitive action). Functional near-infrared spectroscopy (fNIRS) was used to verify the presence of partial overlapping between some cortical areas involved in those different tasks. Participants were instructed to observe videos of transitive vs. intransitive gestures and then to execute or imagine them. Gesture execution was associated to greater brain activity (increased oxygenated hemoglobin levels) with respect to observation and imagination in motor areas (premotor cortex, PMC; primary sensorimotor cortex, SM1). In contrast, the posterior parietal cortex (PPC) was more relevantly involved in both execution and observation tasks compared to gesture imagination. Moreover, execution and observation of transitive gestures seemed primarily supported by similar parietal posterior areas when compared with intransitive gestures, which do not imply the presence on a object.

Neural Response to Biological Motion in Healthy Adults Varies as a Function of Autistic-Like Traits

Perception of biological motion is an important social cognitive ability that has been mapped to specialized brain regions. Perceptual deficits and neural differences during biological motion perception have previously been associated with autism, a disorder classified by social and communication difficulties and repetitive and restricted interests and behaviors. However, the traits associated with autism are not limited to diagnostic categories, but are normally distributed within the general population and show the same patterns of heritability across the continuum. In the current study, we investigate whether self-reported autistic-like traits in healthy adults are associated with variable neural response during passive viewing of biological motion displays. Results show that more autistic-like traits, particularly those associated with the communication domain, are associated with increased neural response in key regions involved in social cognitive processes, including prefrontal and left temporal cortices. This distinct pattern of activation might reflect differential neurodevelopmental processes for individuals with varying autistic-like traits, and highlights the importance of considering the full trait continuum in future work.

On the other hand: Increased cortical activation to human versus mechanical hands in infants

There is a large body of work demonstrating that infants are sensitive to the distinction between human and mechanical entities from the early months of life, and have different expectations for the way these entities move and interact. The current work investigates the extent to which the functional organization of the immature brain reflects these early emerging sensitivities. Infants aged 8months watched two kinds of hands (human or mechanical) engage in two kinds of events (one with a functional outcome and one without). Using functional near-infrared spectroscopy (fNIRS), we assessed hemodynamic activation in the left and right temporal and temporal-occipital cortex in response to these events. The neuroimaging data revealed a significantly greater increase in activation in the right middle-posterior temporal cortex to events executed by the human than the mechanical hand; the event in which the hand engaged (function or non-function) did not significantly influence hemodynamic responses. In comparison, the left middle-temporal cortex showed significantly greater activation to events executed by the human than mechanical hand, but only when the events were functionally relevant. That is, the left middle-posterior temporal cortex responded selectively to human (as compared to mechanical) agents, but only in the context of functionally relevant actions on objects. These results reveal that the immature brain is functionally specialized to support infants' processing of human and non-human agents as distinct entities. These results also shed light on the cognitive and cortical mechanisms that guide infants' learning about agentive action and object function.

fNIRS in the developmental sciences

With the introduction of functional near-infrared spectroscopy (fNIRS) into the experimental setting, developmental scientists have, for the first time, the capacity to investigate the functional activation of the infant brain in awake, engaged participants. The advantages of fNIRS clearly outweigh the limitations, and a description of how this technology is implemented in infant populations is provided. Most fNIRS research falls into one of three content domains: object processing, processing of biologically and socially relevant information, and language development. Within these domains, there are ongoing debates about the origins and development of human knowledge, making early neuroimaging particularly advantageous. The use of fNIRS has allowed investigators to begin to identify the localization of early object, social, and linguistic knowledge in the immature brain and the ways in which this changes with time and experience. In addition, there is a small but growing body of research that provides insight into the neural mechanisms that support and facilitate learning during the first year of life. At the same time, as with any emerging field, there are limitations to the conclusions that can be drawn on the basis of current findings. We offer suggestions as to how to optimize the use of this technology to answer questions of theoretical and practical importance to developmental scientists.

The theory-of-mind network in support of action verb comprehension: evidence from an fMRI study

The theory-of-mind (ToM) network refers to a specific group of brain regions implicated in the thinking of people's mental states. It remains unclear how this network contributes to verb comprehension. In the present study, we compared brain activations evoked by verbs that refer to social actions, private actions, and nonhuman events. All classic regions of the ToM network, including the posterior superior temporal sulcus (pSTS) whose activation during word comprehension is typically interpreted as the processing of motion properties, showed stronger activations to social action verbs than the others. These findings indicate that the ToM network is involved in the processing of social/mental knowledge of verb meanings. Furthermore, the activation of the pSTS during word comprehension mainly reflects the processing of social/mental properties but not that of biological-motion properties.

Neural signatures of autism spectrum disorders: insights into brain network dynamics

Neuroimaging investigations of autism spectrum disorders (ASDs) have advanced our understanding of atypical brain function and structure, and have recently converged on a model of altered network-level connectivity. Traditional task-based functional magnetic resonance imaging (MRI) and volume-based structural MRI studies have identified widespread atypicalities in brain regions involved in social behavior and other core ASD-related behavioral deficits. More recent advances in MR-neuroimaging methods allow for quantification of brain connectivity using diffusion tensor imaging, functional connectivity, and graph theoretic methods. These newer techniques have moved the field toward a systems-level understanding of ASD etiology, integrating functional and structural measures across distal brain regions. Neuroimaging findings in ASD as a whole have been mixed and at times contradictory, likely due to the vast genetic and phenotypic heterogeneity characteristic of the disorder. Future longitudinal studies of brain development will be crucial to yield insights into mechanisms of disease etiology in ASD sub-populations. Advances in neuroimaging methods and large-scale collaborations will also allow for an integrated approach linking neuroimaging, genetics, and phenotypic data.

Anterior insula activity reflects the effects of intentionality on the anticipation of aversive stimulation

If someone causes you harm, your affective reaction to that person might be profoundly influenced by your inferences about the intentionality of their actions. In the present study, we aimed to understand how affective responses to a biologically salient aversive outcome administered by others are modulated by the extent to which a given individual is judged to have deliberately or inadvertently delivered the outcome. Using fMRI, we examined how neural responses to anticipation and receipt of an aversive stimulus are modulated by this fundamental social judgment. We found that affective evaluations about an individual whose actions led to either noxious or neutral consequences for the subject did indeed depend on the perceived intentions of that individual. At the neural level, activity in the anterior insula correlated with the interaction between perceived intentionality and anticipated outcome valence, suggesting that this region reflects the influence of mental state attribution on aversive expectations.

Neocerebellar contributions to social perception in adolescents with autism spectrum disorder

•

Previous work shows cerebellar Crus I supports imitation via interaction with pSTS.

•

Teens with (ASD) and without (TD) autism completed an imitation task in the scanner.

•

Teens with ASD recruited Crus I less strongly during imitation than TD teens.

•

PPI strength between pSTS and Crus I predicted mentalizing in teens with ASD.

Posterior superior temporal sulcus (pSTS) is specialized for interpreting perceived human actions, and disruptions to its function occur in autism spectrum disorder (ASD). Here we consider the role of Crus I of neocerebellum in supporting pSTS function. Research has associated Crus I activity with imitation and biological motion perception, and neocerebellum is theorized to coordinate activity among cerebral sites more generally. Moreover, cerebellar abnormalities have been associated with ASD. We hypothesized that disordered Crus I–pSTS interactions could predict social deficits in ASD. 15 high functioning adolescents with ASD and 15 same-age comparison youth participated in an fMRI imitation paradigm; ratings of mentalizing ability were collected via parent report. We predicted that stronger Crus I–pSTS interactions would be associated with better mentalizing ability. Consistent with these hypotheses, stronger psychophysiological interactions between Crus I and right pSTS were associated with greater mentalizing ability among adolescents with ASD. Whole-brain analyses also indicated that typically developing youth recruited right inferior frontal gyrus, left pSTS, medial occipital regions, and precuneus more strongly during imitation than did youth with ASD. Overall, these results indicate that variability in neocerebellar interactions with key cortical social brain sites may help explain individual differences in social perceptual outcomes in ASD.

Social cognition and the cerebellum: a meta-analysis of over 350 fMRI studies

This meta-analysis explores the role of the cerebellum in social cognition. Recent meta-analyses of neuroimaging studies since 2008 demonstrate that the cerebellum is only marginally involved in social cognition and emotionality, with a few meta-analyses pointing to an involvement of at most 54% of the individual studies. In this study, novel meta-analyses of over 350 fMRI studies, dividing up the domain of social cognition in homogeneous subdomains, confirmed this low involvement of the cerebellum in conditions that trigger the mirror network (e.g., when familiar movements of body parts are observed) and the mentalizing network (when no moving body parts or unfamiliar movements are present). There is, however, one set of mentalizing conditions that strongly involve the cerebellum in 50-100% of the individual studies. In particular, when the level of abstraction is high, such as when behaviors are described in terms of traits or permanent characteristics, in terms of groups rather than individuals, in terms of the past (episodic autobiographic memory) or the future rather than the present, or in terms of hypothetical events that may happen. An activation likelihood estimation (ALE) meta-analysis conducted in this study reveals that the cerebellum is critically implicated in social cognition and that the areas of the cerebellum which are consistently involved in social cognitive processes show extensive overlap with the areas involved in sensorimotor (during mirror and self-judgments tasks) as well as in executive functioning (across all tasks). We discuss the role of the cerebellum in social cognition in general and in higher abstraction mentalizing in particular. We also point out a number of methodological limitations of some available studies on the social brain that hamper the detection of cerebellar activity.

DNA methylation of the oxytocin receptor gene predicts neural response to ambiguous social stimuli

Oxytocin and its receptor (OXTR) play an important role in a variety of social perceptual and affiliative processes. Individual variability in social information processing likely has a strong heritable component, and as such, many investigations have established an association between common genetic variants of OXTR and variability in the social phenotype. However, to date, these investigations have primarily focused only on changes in the sequence of DNA without considering the role of epigenetic factors. DNA methylation is an epigenetic mechanism by which cells control transcription through modification of chromatin structure. DNA methylation of OXTR decreases expression of the gene and high levels of methylation have been associated with autism spectrum disorders (ASD). This link between epigenetic variability and social phenotype allows for the possibility that social processes are under epigenetic control. We hypothesized that the level of DNA methylation of OXTR would predict individual variability in social perception. Using the brain's sensitivity to displays of animacy as a neural endophenotype of social perception, we found significant associations between the degree of OXTR methylation and brain activity evoked by the perception of animacy. Our results suggest that consideration of DNA methylation may substantially improve our ability to explain individual differences in imaging genetic association studies.

Brain network involved in visual processing of movement stimuli used in upper limb robotic training: an fMRI study

Background

The potential of robot-mediated therapy and virtual reality in neurorehabilitation is becoming of increasing importance. However, there is limited information, using neuroimaging, on the neural networks involved in training with these technologies. This study was intended to detect the brain network involved in the visual processing of movement during robotic training. The main aim was to investigate the existence of a common cerebral network able to assimilate biological (human upper limb) and non-biological (abstract object) movements, hence testing the suitability of the visual non-biological feedback provided by the InMotion2 Robot.

Methods

A visual functional Magnetic Resonance Imaging (fMRI) task was administered to 22 healthy subjects. The task required observation and retrieval of motor gestures and of the visual feedback used in robotic training. Functional activations of both biological and non-biological movements were examined to identify areas activated in both conditions, along with differential activity in upper limb vs. abstract object trials. Control of response was also tested by administering trials with congruent and incongruent reaching movements.

Results

The observation of upper limb and abstract object movements elicited similar patterns of activations according to a caudo-rostral pathway for the visual processing of movements (including specific areas of the occipital, temporal, parietal, and frontal lobes). Similarly, overlapping activations were found for the subsequent retrieval of the observed movement. Furthermore, activations of frontal cortical areas were associated with congruent trials more than with the incongruent ones.

Conclusions

This study identified the neural pathway associated with visual processing of movement stimuli used in upper limb robot-mediated training and investigated the brain’s ability to assimilate abstract object movements with human motor gestures. In both conditions, activations were elicited in cerebral areas involved in visual perception, sensory integration, recognition of movement, re-mapping on the somatosensory and motor cortex, storage in memory, and response control. Results from the congruent vs. incongruent trials revealed greater activity for the former condition than the latter in a network including cingulate cortex, right inferior and middle frontal gyrus that are involved in the go-signal and in decision control. Results on healthy subjects would suggest the appropriateness of an abstract visual feedback provided during motor training. The task contributes to highlight the potential of fMRI in improving the understanding of visual motor processes and may also be useful in detecting brain reorganisation during training.

Hippocampal temporal-parietal junction interaction in the production of psychotic symptoms: a framework for understanding the schizophrenic syndrome

A framework is described for understanding the schizophrenic syndrome at the brain systems level. It is hypothesized that over-activation of dynamic gesture and social perceptual processes in the temporal-parietal occipital junction (TPJ), posterior superior temporal sulcus (PSTS) and surrounding regions produce the syndrome (including positive and negative symptoms, their prevalence, prodromal signs, and cognitive deficits). Hippocampal system hyper-activity and atrophy have been consistently found in schizophrenia. Hippocampal activity is highly correlated with activity in the TPJ and may be a source of over-excitation of the TPJ and surrounding regions. Strong evidence for this comes from in-vivo recordings in humans during psychotic episodes. Many positive symptoms of schizophrenia can be reframed as the erroneous sense of a presence or other who is observing, acting, speaking, or controlling; these qualia are similar to those evoked during abnormal activation of the TPJ. The TPJ and PSTS play a key role in the perception (and production) of dynamic social, emotional, and attentional gestures for the self and others (e.g., body/face/eye gestures, audiovisual speech and prosody, and social attentional gestures such as eye gaze). The single cell representation of dynamic gestures is multimodal (auditory, visual, tactile), matching the predominant hallucinatory categories in schizophrenia. Inherent in the single cell perceptual signal of dynamic gesture representations is a computation of intention, agency, and anticipation or expectancy (for the self and others). Stimulation of the TPJ resulting in activation of the self representation has been shown to result a feeling of a presence or multiple presences (due to heautoscopy) and also bizarre tactile experiences. Neurons in the TPJ are also tuned, or biased to detect threat related emotions. Abnormal over-activation in this system could produce the conscious hallucination of a voice (audiovisual speech), a person or a touch. Over-activation could interfere with attentional/emotional gesture perception and production (negative symptoms). It could produce the unconscious feeling of being watched, followed, or of a social situation unfolding along with accompanying abnormal perception of intent and agency (delusions). Abnormal activity in the TPJ would also be predicted to create several cognitive disturbances that are characteristic of schizophrenia, including abnormalities in attention, predictive social processing, working memory, and a bias to erroneously perceive threat.

The superior temporal sulcus differentiates communicative and noncommunicative auditory signals

Processing the vocalizations of conspecifics is critical for adaptive social interaction. A species-specific voice-selective region has been identified in the right STS that responds more strongly to human vocal sounds compared with a variety of nonvocal sounds. However, the STS also activates in response to a wide range of signals used in communication, such as eye gaze, biological motion, and speech. These findings raise the possibility that the voice-selective region of the STS may be especially sensitive to vocal sounds that are communicative, rather than to all human vocal sounds. Using fMRI, we demonstrate that the voice-selective region of the STS responds more strongly to communicative vocal sounds (such as speech and laughter) compared with noncommunicative vocal sounds (such as coughing and sneezing). The implications of these results for understanding the role of the STS in voice processing and in disorders of social communication, such as autism spectrum disorder, are discussed.

Schizophrenia as a disorder of social communication

Evidence is reviewed for the existence of a core system for moment-to-moment social communication that is based on the perception of dynamic gestures and other social perceptual processes in the temporal-parietal occipital junction (TPJ), including the posterior superior temporal sulcus (PSTS) and surrounding regions. Overactivation of these regions may produce the schizophrenic syndrome. The TPJ plays a key role in the perception and production of dynamic social, emotional, and attentional gestures for the self and others. These include dynamic gestures of the body, face, and eyes as well as audiovisual speech and prosody. Many negative symptoms are characterized by deficits in responding within these domains. Several properties of this system have been discovered through single neuron recording, brain stimulation, neuroimaging, and the study of neurological impairment. These properties map onto the schizophrenic syndrome. The representation of dynamic gestures is multimodal (auditory, visual, and tactile), matching the predominant hallucinatory categories in schizophrenia. Inherent in the perceptual signal of gesture representation is a computation of intention, agency, and anticipation or expectancy (for the self and others). The neurons are also tuned or biased to rapidly detect threat-related emotions. I review preliminary evidence that overactivation of this system can result in schizophrenia.

ALE meta-analysis of action observation and imitation in the human brain

Over the last decade, many neuroimaging studies have assessed the human brain networks underlying action observation and imitation using a variety of tasks and paradigms. Nevertheless, questions concerning which areas consistently contribute to these networks irrespective of the particular experimental design and how such processing may be lateralized remain unresolved. The current study aimed at identifying cortical areas consistently involved in action observation and imitation by combining activation likelihood estimation (ALE) meta-analysis with probabilistic cytoarchitectonic maps. Meta-analysis of 139 functional magnetic resonance and positron emission tomography experiments revealed a bilateral network for both action observation and imitation. Additional subanalyses for different effectors within each network revealed highly comparable activation patterns to the overall analyses on observation and imitation, respectively, indicating an independence of these findings from potential confounds. Conjunction analysis of action observation and imitation meta-analyses revealed a bilateral network within frontal premotor, parietal, and temporo-occipital cortex. The most consistently rostral inferior parietal area was PFt, providing evidence for a possible homology of this region to macaque area PF. The observation and imitation networks differed particularly with respect to the involvement of Broca's area: whereas both networks involved a caudo-dorsal part of BA 44, activation during observation was most consistent in a more rostro-dorsal location, i.e., dorsal BA 45, while activation during imitation was most consistent in a more ventro-caudal aspect, i.e., caudal BA 44. The present meta-analysis thus summarizes and amends previous descriptions of the human brain networks related to action observation and imitation.