Understanding intentions from actions: Direct perception, inference, and the roles of mirror and mentalizing systems

Online chasing action recruits both mirror neuron and mentalizing systems: A pilot fNIRS study

Engaging in chasing, where an actor actively pursues a target, is considered a crucial activity for the development of social skills. Previous studies have focused predominantly on understanding the neural correlates of chasing from an observer's perspective, but the neural mechanisms underlying the real-time implementation of chasing action remain poorly understood. To gain deeper insights into this phenomenon, the current study employed functional near-infrared spectroscopy (fNIRS) techniques and a novel interactive game. In this interactive game, participants (N = 29) were tasked to engage in chasing behavior by controlling an on-screen character using a gamepad, with the goal of catching a virtual partner. To specifically examine the brain activations associated with the interactive nature of chasing, we included two additional interactive actions: following action of following the path of a virtual partner and free action of moving without a specific pursuit goal. The results revealed that chasing and following actions elicited activation in a broad and overlapping network of brain regions, including the temporoparietal junction (TPJ), medial prefrontal cortex (mPFC), premotor cortex (PMC), primary somatosensory cortex (SI), and primary motor cortex (M1). Crucially, these regions were found to be modulated by the type of interaction, with greater activation and functional connectivity during the chasing interaction than during the following and free interactions. These findings suggested that both the MNS, encompassing regions such as the PMC, M1 and SI, and the mentalizing system (MS), involving the TPJ and mPFC, contribute to the execution of online chasing actions. Thus, the present study represents an initial step toward future investigations into the roles of MNS and MS in real-time chasing interactions.

Three-stage Dynamic Brain-cognitive Model of Understanding Action Intention Displayed by Human Body Movements

The ability to comprehend the intention conveyed through human body movements is crucial for effective interpersonal interactions. If people can't understand the intention behind other individuals' isolated or interactive actions, their actions will become meaningless. Psychologists have investigated the cognitive processes and neural representations involved in understanding action intention, yet a cohesive theoretical explanation remains elusive. Hence, we mainly review existing literature related to neural correlates of action intention, and primarily propose a putative Three-stage Dynamic Brain-cognitive Model of understanding action intention, which involves body perception, action identification and intention understanding. Specifically, at the first stage, body parts/shapes are processed by those brain regions such as extrastriate and fusiform body areas; During the second stage, differentiating observed actions relies on configuring relationships between body parts, facilitated by the activation of the Mirror Neuron System; The last stage involves identifying various intention categories, utilizing the Mentalizing System for recruitment, and different activation patterns concerning the nature of the intentions participants dealing with. Finally, we delves into the clinical practice, like intervention training based on a theoretical model for individuals with autism spectrum disorders who encounter difficulties in interpersonal communication.

People can reliably detect action changes and goal changes during naturalistic perception

As a part of ongoing perception, the human cognitive system segments others' activities into discrete episodes (event segmentation). Although prior research has shown that this process is likely related to changes in an actor's actions and goals, it has not yet been determined whether untrained observers can reliably identify action and goal changes as naturalistic activities unfold, or whether the changes they identify are tied to visual features of the activity (e.g., the beginnings and ends of object interactions). This study addressed these questions by examining untrained participants' identification of action changes, goal changes, and event boundaries while watching videos of everyday activities that were presented in both first-person and third-person perspectives. We found that untrained observers can identify goal changes and action changes consistently, and these changes are not explained by visual change and the onsets or offsets of contact with objects. Moreover, the action and goal changes identified by untrained observers were associated with event boundaries, even after accounting for objective visual features of the videos. These findings suggest that people can identify action and goal changes consistently and with high agreement, that they do so by using sensory information flexibly, and that the action and goal changes they identify may contribute to event segmentation.

Functional role of the theory of mind network in integrating mentalistic prior information with action kinematics during action observation

Inferring intentions from verbal and nonverbal human behaviour is critical for everyday social life. Here, we combined Transcranial Magnetic Stimulation (TMS) with a behavioural priming paradigm to test whether key nodes of the Theory of Mind network (ToMn) contribute to understanding others' intentions by integrating prior knowledge about an agent with the observed action kinematics. We used a modified version of the Faked-Action Discrimination Task (FAD), a forced-choice paradigm in which participants watch videos of actors lifting a cube and judge whether the actors are trying to deceive them concerning the weight of the cube. Videos could be preceded or not by verbal description (prior) about the agent's truthful or deceitful intent. We applied single pulse TMS over three key nodes of the ToMn, namely dorsomedial prefrontal cortex (dmPFC), right posterior superior temporal sulcus (pSTS) and right temporo-parietal junction (rTPJ). Sham-TMS served as a control (baseline) condition. Following sham or rTPJ stimulation, we observed no consistent influence of priors on FAD performance. In contrast, following dmPFC stimulation, and to a lesser extent pSTS stimulation, truthful and deceitful actions were perceived as more deceptive only when the prior suggested a dishonest intention. These findings highlight a functional role of dmPFC and pSTS in coupling prior knowledge about deceptive intents with observed action kinematics in order to judge faked actions. Our study provides causal evidence that fronto-temporal nodes of the ToMn are functionally relevant to mental state inference during action observation.

Kinematic priming of action predictions

The ability to anticipate what others will do next is crucial for navigating social, interactive environments. Here, we develop an experimental and analytical framework to measure the implicit readout of prospective intention information from movement kinematics. Using a primed action categorization task, we first demonstrate implicit access to intention information by establishing a novel form of priming, which we term kinematic priming: subtle differences in movement kinematics prime action prediction. Next, using data collected from the same participants in a forced-choice intention discrimination task 1 h later, we quantify single-trial intention readout-the amount of intention information read by individual perceivers in individual kinematic primes-and assess whether it can be used to predict the amount of kinematic priming. We demonstrate that the amount of kinematic priming, as indexed by both response times (RTs) and initial fixations to a given probe, is directly proportional to the amount of intention information read by the individual perceiver at the single-trial level. These results demonstrate that human perceivers have rapid, implicit access to intention information encoded in movement kinematics and highlight the potential of our approach to reveal the computations that permit the readout of this information with single-subject, single-trial resolution.

Attachment, Mentalizing and Trauma: Then (1992) and Now (2022)

This article reviews the current status of research on the relationship between attachment and trauma in developmental psychopathology. Beginning with a review of the major issues and the state-of-the-art in relation to current thinking in the field of attachment about the impact of trauma and the inter-generational transmission of trauma, the review then considers recent neurobiological work on mentalizing and trauma and suggests areas of new development and implications for clinical practice.

Spatio-temporal dynamics of oscillatory brain activity during the observation of actions and interactions between point-light agents

Predicting actions from non-verbal cues and using them to optimise one's response behaviour (i.e. interpersonal predictive coding) is essential in everyday social interactions. We aimed to investigate the neural correlates of different cognitive processes evolving over time during interpersonal predictive coding. Thirty-nine participants watched two agents depicted by moving point-light stimuli while an electroencephalogram (EEG) was recorded. One well-recognizable agent performed either a 'communicative' or an 'individual' action. The second agent either was blended into a cluster of noise dots (i.e. present) or was entirely replaced by noise dots (i.e. absent), which participants had to differentiate. EEG amplitude and coherence analyses for theta, alpha and beta frequency bands revealed a dynamic pattern unfolding over time: Watching communicative actions was associated with enhanced coupling within medial anterior regions involved in social and mentalising processes and with dorsolateral prefrontal activation indicating a higher deployment of cognitive resources. Trying to detect the agent in the cluster of noise dots without having seen communicative cues was related to enhanced coupling in posterior regions for social perception and visual processing. Observing an expected outcome was modulated by motor system activation. Finally, when the agent was detected correctly, activation in posterior areas for visual processing of socially relevant features was increased. Taken together, our results demonstrate that it is crucial to consider the temporal dynamics of social interactions and of their neural correlates to better understand interpersonal predictive coding. This could lead to optimised treatment approaches for individuals with problems in social interactions.

The implicit effect of action mental simulation on action evaluation

The main assumption underlying the present investigation is that action observation elicits a mandatory mental simulation representing the action forward in time. In Experiment 1, participants observed pairs of photos portraying the initial and the final still frames of an action video; then they observed a photo depicting the very same action but either forward or backward in time. Their task was to tell whether the action in the photo portrayed something happened before or after the action seen at encoding. In this explicit task, the evaluation was faster for forward photos than for backward photos. Crucially, the effect was replicated when instructions asked only to evaluate at test whether the photo depicted a scene congruent with the action seen at encoding (implicit task from two still frames, Experiment 2), and when at encoding, they were presented a single still frame and evaluated at test whether a photo depicted a scene congruent with the action seen at encoding (implicit task from single still frame; Experiment 3). Overall, the results speak in favour of a mandatory mechanism through which our brain simulates the action also in tasks that do not explicitly require action simulation.

Human but not robotic gaze facilitates action prediction

Do people ascribe intentions to humanoid robots as they would to humans or non-human-like animated objects? In six experiments, we compared people’s ability to extract non-mentalistic (i.e., where an agent is looking) and mentalistic (i.e., what an agent is looking at; what an agent is going to do) information from gaze and directional cues performed by humans, human-like robots, and a non-human-like object. People were faster to infer the mental content of human agents compared to robotic agents. Furthermore, although the absence of differences in control conditions rules out the use of non-mentalizing strategies, the human-like appearance of non-human agents may engage mentalizing processes to solve the task. Overall, results suggest that human-like robotic actions may be processed differently from humans’ and objects’ behavior. These findings inform our understanding of the relevance of an object’s physical features in triggering mentalizing abilities and its relevance for human–robot interaction.

•

People differently ascribe mental content to human-like and non-human-like agents

•

A human-like shape may automatically engage mentalizing processes

•

Human actions are interpreted faster than non-human actions

Electrocorticographic evidence of a common neurocognitive sequence for mentalizing about the self and others

Neuroimaging studies of mentalizing (i.e., theory of mind) consistently implicate the default mode network (DMN). Nevertheless, the social cognitive functions of individual DMN regions remain unclear, perhaps due to limited spatiotemporal resolution in neuroimaging. Here we use electrocorticography (ECoG) to directly record neuronal population activity while 16 human participants judge the psychological traits of themselves and others. Self- and other-mentalizing recruit near-identical cortical sites in a common spatiotemporal sequence. Activations begin in the visual cortex, followed by temporoparietal DMN regions, then finally in medial prefrontal regions. Moreover, regions with later activations exhibit stronger functional specificity for mentalizing, stronger associations with behavioral responses, and stronger self/other differentiation. Specifically, other-mentalizing evokes slower and longer activations than self-mentalizing across successive DMN regions, implying lengthier processing at higher levels of representation. Our results suggest a common neurocognitive pathway for self- and other-mentalizing that follows a complex spatiotemporal gradient of functional specialization across DMN and beyond.

Multi-class classification of action intention understanding brain signals based on thresholding graph metric

BACKGROUND: Classification of action intention understanding is extremely important for human computer interaction. Many studies on the action intention understanding classification mainly focus on binary classification, while the classification accuracy is often unsatisfactory, not to mention multi-class classification. METHOD: To complete the multi-class classification task of action intention understanding brain signals effectively, we propose a novel feature extraction procedure based on thresholding graph metric. RESULTS: Both the alpha frequency band and full-band obtained considerable classification accuracies. Compared with other methods, the novel method has better classification accuracy. CONCLUSIONS: Brain activity of action intention understanding is closely related to the alpha band. The new feature extraction procedure is an effective method for the multi-class classification of action intention understanding brain signals.

Action Intention Understanding EEG Signal Classification Based on Improved Discriminative Spatial Patterns

Objective

Action intention understanding EEG signal classification is indispensable for investigating human-computer interactions and intention understanding mechanisms. Numerous investigations on classification tasks extract classification features by using graph theory metrics; however, the classification results are usually not good.

Method

To effectively implement the task of action intention understanding EEG signal classification, we proposed a new feature extraction method by improving discriminative spatial patterns.

Results

The whole frequency band and fusion band achieved satisfactory classification accuracies. Compared with other authors' methods for action intention understanding EEG signal classification, the new method performs more satisfactorily in some aspects.

Conclusions

The new feature extraction method not only effectively avoids complex values when solving the generalized eigenvalue problem but also perfectly realizes appreciable classification accuracies. Fusing the classification features of different frequency bands is a useful strategy for the classification task.

Photographs of Actions: What Makes Them Special Cues to Social Perception

I have reviewed studies on neural responses to pictured actions in the action observation network (AON) and the cognitive functions of these responses. Based on this review, I have analyzed the specific representational characteristics of action photographs. There has been consensus that AON responses provide viewers with knowledge of observed or pictured actions, but there has been controversy about the properties of this knowledge. Is this knowledge causally provided by AON activities or is it dependent on conceptual processing? What elements of actions does it refer to, and how generalized or specific is it? The answers to these questions have come from studies that used transcranial magnetic stimulation (TMS) to stimulate motor or somatosensory cortices. In conjunction with electromyography (EMG), TMS allows researchers to examine changes of the excitability in the corticospinal tract and muscles of people viewing pictured actions. The timing of these changes and muscle specificity enable inferences to be drawn about the cognitive products of processing pictured actions in the AON. Based on a review of studies using TMS and other neuroscience methods, I have proposed a novel hypothetical account that describes the characteristics of action photographs that make them effective cues to social perception. This account includes predictions that can be tested experimentally.

Social prediction in pediatric patients with congenital, non-progressive malformations of the cerebellum: From deficits in predicting movements to rehabilitation in virtual reality

It has been proposed that impairments of the predictive function exerted by the cerebellum may account for social cognition deficits. Here, we integrated cerebellar functions in a predictive coding framework to elucidate how congenital, non-progressive cerebellar alterations could affect the predictive processing of others' behavior. Experiment 1 demonstrated that cerebellar patients were impaired in relying on contextual information during prediction of other persons' movement, and this impairment was significantly associated with social cognition abilities. Experiment 2 indicated that children and adolescents with congenital, non-progressive cerebellar malformation showed a domain-general deficit in using contextual information to predict both others' movements and physical events, and that this impairment was independent from patients' cognitive abilities. Experiment 3 provided first evidence that a social-prediction training in virtual reality could boost the ability to use context-based predictions to understand others' intentions. These findings shed new light on the predictive role of the cerebellum and its contribution to social cognition, paving the way for new approaches to the rehabilitation of the Cerebellar Cognitive Affective Syndrome.

Dedicated Representation of Others in the Macaque Frontal Cortex: From Action Monitoring and Prediction to Outcome Evaluation

Social neurophysiology has increasingly addressed how several aspects of self and other are distinctly represented in the brain. In social interactions, the self–other distinction is fundamental for discriminating one’s own actions, intentions, and outcomes from those that originate in the external world. In this paper, we review neurophysiological experiments using nonhuman primates that shed light on the importance of the self–other distinction, focusing mainly on the frontal cortex. We start by examining how the findings are impacted by the experimental paradigms that are used, such as the type of social partner or whether a passive or active interaction is required. Next, we describe the 2 sociocognitive systems: mirror and mentalizing. Finally, we discuss how the self–other distinction can occur in different domains to process different aspects of social information: the observation and prediction of others’ actions and the monitoring of others’ rewards.

Action Observation Responses Are Influenced by Movement Kinematics and Target Identity

In order to inform the debate whether cortical areas related to action observation provide a pragmatic or a semantic representation of goal-directed actions, we performed 2 functional magnetic resonance imaging (fMRI) experiments in humans. The first experiment, involving observation of aimless arm movements, resulted in activation of most of the components known to support action execution and action observation. Given the absence of a target/goal in this experiment and the activation of parieto-premotor cortical areas, which were associated in the past with direction, amplitude, and velocity of movement of biological effectors, our findings suggest that during action observation we could be monitoring movement kinematics. With the second, double dissociation fMRI experiment, we revealed the components of the observation-related cortical network affected by 1) actions that have the same target/goal but different reaching and grasping kinematics and 2) actions that have very similar kinematics but different targets/goals. We found that certain areas related to action observation, including the mirror neuron ones, are informed about movement kinematics and/or target identity, hence providing a pragmatic rather than a semantic representation of goal-directed actions. Overall, our findings support a process-driven simulation-like mechanism of action understanding, in agreement with the theory of motor cognition, and question motor theories of action concept processing.

Doctors inhibit social threat empathy in the later stage of cognitive processing: Electrophysiological evidence

Previous studies have found that repeatedly exposed to a threatening situation may reduce doctors' level of empathy, reducing psychological stress and avoiding burnout and compassion fatigue. However, many essential studies found that it does not seem universal but rather modulated by group membership. In this study, we recorded event-related potentials (ERP) when doctors and controls watched visual stimuli describing patients attacking doctors (Threat events) or shaking hands with doctors (Neutral events). The present study showed an early N190 and a later centro-parietal P3 differential amplitude between threat stimuli and neutral stimuli were observed in the controls. For the doctors, there was such ERP differentiation in early N190. However, later stage P3 differential amplitude was not observed. The current research suggests that doctors could regulate empathy and avoid allocating more attention resources when processing social threats to ensure treatment efficiency and avoid burnout.

Theories of Autism and Autism Treatment from the DSM III Through the Present and Beyond: Impact on Research and Practice

The purely descriptive definition of autism introduced by the DSM III in 1980 marked a departure from previous DSM editions, which mixed phenomenological descriptions with psychoanalytic theories of etiology. This provided a blank slate upon which a variety of novel theories emerged to conceptualize autism and its treatment in the following four decades. In this article we examine the contribution of these different theoretical orientations with a focus on their impact on research and practice, areas of overlap and conflict between current theories, and their relevance in the context of the evolving landscape of scientific knowledge and societal views of autism.

Weighted Brain Network Metrics for Decoding Action Intention Understanding Based on EEG

Background: Understanding the action intentions of others is important for social and human-robot interactions. Recently, many state-of-the-art approaches have been proposed for decoding action intention understanding. Although these methods have some advantages, it is still necessary to design other tools that can more efficiently classify the action intention understanding signals.

New Method: Based on EEG, we first applied phase lag index (PLI) and weighted phase lag index (WPLI) to construct functional connectivity matrices in five frequency bands and 63 micro-time windows, then calculated nine graph metrics from these matrices and subsequently used the network metrics as features to classify different brain signals related to action intention understanding.

Results: Compared with the single methods (PLI or WPLI), the combination method (PLI+WPLI) demonstrates some overwhelming victories. Most of the average classification accuracies exceed 70%, and some of them approach 80%. In statistical tests of brain network, many significantly different edges appear in the frontal, occipital, parietal, and temporal regions.

Conclusions: Weighted brain networks can effectively retain data information. The integrated method proposed in this study is extremely effective for investigating action intention understanding. Both the mirror neuron and mentalizing systems participate as collaborators in the process of action intention understanding.

Muscular effort coding in action representation in ballet dancers and controls: Electrophysiological evidence

The present electrophysiological (EEG) study investigated the neural correlates of perceiving effortful vs. effortless movements belonging to a specific repertoire (ballet). Previous evidence has shown an increased heart and respiratory rate during the observation and imagination of human actions that require a great muscular effort. In addition, TMS (transcranial magnetic stimulation) and EEG studies have evidenced a greater muscle-specific cortical excitability and an increase in late event-related potentials during the observation of effortful actions. In this investigation, fifteen professional female ballet dancers and 15 controls with no experience whatsoever with dance, gymnastics, or martial arts were recruited. They were shown 326 short videos displaying a male dancer performing standard ballet steps that could be either effortful or relatively effortless. Participants were instructed to observe each clip and imagine themselves physically executing the same movement. Importantly, they were blinded to the stimuli properties. The observation of effortful compared with effortless movements resulted in a larger P300 over frontal sites in dancers only, likely because of their visuomotor expertise with the specific steps. Moreover, an enhanced Late Positivity was identified over posterior sites in response to effortful stimuli in both groups, possibly reflecting the processing of larger quantities of visual kinematic information. The source reconstruction swLORETA performed on the Late Positivity component showed greater engagement of frontoparietal regions in dancers, while task-related frontal and occipitotemporal visual regions were more active in controls. It, therefore, appears that, in dancers, effort information was encoded in a more refined manner during action observation and in the absence of explicit instruction. Acquired motor knowledge seems to result in visuomotor resonance processes, which, in turn, underlies enhanced action representation of the observed movements.

Neural dynamics of grip and goal integration during the processing of others' actions with objects: An ERP study

Recent behavioural evidence suggests that when processing others’ actions, motor acts and goal-related information both contribute to action recognition. Yet the neuronal mechanisms underlying the dynamic integration of the two action dimensions remain unclear. This study aims to elucidate the ERP components underlying the processing and integration of grip and goal-related information. The electrophysiological activity of 28 adults was recorded during the processing of object-directed action photographs (e.g., writing with pencil) containing either grip violations (e.g. upright pencil grasped with atypical-grip), goal violations (e.g., upside-down pencil grasped with typical-grip), both grip and goal violations (e.g., upside-down pencil grasped with atypical-grip), or no violations. Participants judged whether actions were overall typical or not according to object typical use. Brain activity was sensitive to the congruency between grip and goal information on the N400, reflecting the semantic integration between the two dimensions. On earlier components, brain activity was affected by grip and goal typicality independently. Critically, goal typicality but not grip typicality affected brain activity on the N300, supporting an earlier role of goal-related representations in action recognition. Findings provide new insights on the neural temporal dynamics of the integration of motor acts and goal-related information during the processing of others’ actions.

What first drives visual attention during the recognition of object-directed actions? The role of kinematics and goal information

The recognition of others' object-directed actions is known to involve the decoding of both the visual kinematics of the action and the action goal. Yet whether action recognition is first guided by the processing of visual kinematics or by a prediction about the goal of the actor remains debated. In order to provide experimental evidence to this issue, the present study aimed at investigating whether visual attention would be preferentially captured by visual kinematics or by action goal information when processing others' actions. In a visual search task, participants were asked to find correct actions (e.g., drinking from glass) among distractor actions. Distractors actions contained grip and/or goal violations and could therefore share the correct goal and/or the correct grip with the target. The time course of fixation proportion on each distractor action has been taken as an indicator of visual attention allocation. Results show that visual attention is first captured by the distractor action with similar goal. Then the withdrawal of visual attention from the action distractor with similar goal suggests a later attentional capture by the action distractor with similar grip. Overall, results are in line with predictive approaches of action understanding, which assume that observers first make a prediction about the actor's goal before verifying this prediction using the visual kinematics of the action.

The last chance to pass the ball: investigating the role of temporal expectation and motor resonance in processing temporal errors in motor actions

Humans can acquire information on others' motor outputs (action prediction) and intentions (action understanding) according to their individual motor repertoire and to the detected gesture's features (e.g. temporal patterns). We aimed at dissociating between action prediction and action understanding abilities in soccer players and novices observing soccer action videos including correct timing pass (CTP) or delayed pass (DP). First, we used an occluding paradigm to evaluate participants' ability to predict the correct time to pass the ball. Although soccer players showed reduced reaction times, all subjects showed a similar pattern of performance: during DP observation, responses appeared delayed with respect to the other conditions but anticipated with respect to the observed DP. In a separate experiment, we investigated the ability to recognize CTP vs DP and the modulation of primary motor cortex (M1) excitability associated to video observation. Only soccer players showed selective modulation of M1 according to the plausibility of the observed action, with increased excitability during the observation of the CTP and in a phase preceding the DP. In conclusion, action prediction ability seems to be independent from the individual motor repertoire. By contrast, only subjects with previously acquired sensorimotor skills are able to infer the observed action's long-term intention.

Intersections and Divergences Between Empathizing and Mentalizing: Development, Recent Advancements by Neuroimaging and the Future of Animal Modeling

Both mentalization and empathy allow humans to understand others, through the representation of their mental states or their mood, respectively. The present review aims to explain those characteristics which are shared between empathy and the Theory of Mind. Research in neuroscience, based on naturalistic paradigms, has shown that abilities to mentalize and to empathize are associated with the activation of different neuro-cognitive circuits. As far as mirror-neuron processes are concerned, some structures (like Anterior Insula, AI; Anterior Cingulate Cortex, ACC) play a role both in the representation of one's own affective states and in comprehension of the same affective state when experienced by others. As for mentalization, the temporal parietal junction (TPj) and temporal poles (TP), the upper posterior temporal sulcus (pSTS) and the medial prefrontal cortex (mPFC) are greatly involved: the latter appears involved in the attribution of one's own and others' temperaments. Interestingly, the ventral/orbital portion of the PFC (orbito-frontal cortex, OFC) is involved in subserving shared affective experience during cognitive mentalizing. This brain region represents a point of overlap, from a psycho-biological point of view, where emotional mirroring and affective cognition meet up. As for animal models, laboratory rodents can well be tested for prosocial behavior. Some examples include deliberate actions, allowing another conspecific the possibility to feed ("giving food"): this willingness can vary across donors, depending on how the recipient is perceived. Other examples include the possibility to let a trapped conspecific come out ("giving help"). The state-of-the-art knowledge about this theme can inform the programming of specific clinical interventions, based on the reinforcement of empathic and/or mentalization abilities.

Auditory-Motor Matching in Vocal Recognition and Imitative Learning

Songbirds possess mirror neurons (MNs) activating during the perception and execution of specific features of songs. These neurons are located in high vocal center (HVC), a premotor nucleus implicated in song perception, production and learning, making worth to inquire their properties and functions in vocal recognition and imitative learning. By integrating a body of brain and behavioral data, we discuss neurophysiology, anatomical, computational properties and possible functions of songbird MNs. We state that the neurophysiological properties of songbird MNs depends on sensorimotor regions that are outside the auditory neural system. Interestingly, songbirds MNs can be the result of the specific type of song representation possessed by some songbird species. At the functional level, we discuss whether songbird MNs are involved in others' song recognition, by dissecting the function of recognition in various different but possible overlapping processes: action-oriented perception, discriminative-oriented perception and identification of the signaler. We conclude that songbird MNs may be involved in recognizing other singer's vocalizations, while their role in imitative learning still require to solve how auditory feedback are used to correct own vocal performance to match the tutor song. Finally, we compare songbird and human mirror responses, hypothesizing a case of convergent evolution, and proposing new experimental directions.

Neural processing of social interaction: Coordinate-based meta-analytic evidence from human neuroimaging studies

While the action observation and mentalizing networks are considered to play complementary roles in understanding others' goals and intentions, they might be concurrently engaged when processing social interactions. We assessed this hypothesis via three activation-likelihood-estimation meta-analyses of neuroimaging studies on the neural processing of: (a) social interactions, (b) individual actions by the action observation network, and (c) mental states by the mentalizing network. Conjunction analyses and direct comparisons unveiled overlapping and specific regions among the resulting maps. We report quantitative meta-analytic evidence for a "social interaction network" including key nodes of the action observation and mentalizing networks. An action-social interaction-mentalizing gradient of activity along the posterior temporal cortex highlighted a hierarchical processing of interactions, from visuomotor analyses decoding individual and shared intentions to in-depth inferences on actors' intentional states. The medial prefrontal cortex, possibly in conjunction with the amygdala, might provide additional information concerning the affective valence of the interaction. This evidence suggests that the functional architecture underlying the neural processing of interactions involves the joint involvement of the action observation and mentalizing networks. These data might inform the design of rehabilitative treatments for social cognition disorders in pathological conditions, and the assessment of their outcome in randomized controlled trials.

Thinking about what he thinks of what I think: Assessing higher theory of mind abilities in Indian bilingual children between 3.0 and 8.11 years of age

CONTEXT

The competence in theory of mind (ToM) abilities occurs in parallel with the development of language. To gain a deeper discernment about its proficiency, tasks tapping on higher-order ToM abilities have been implemented.

AIMS

This study aims to explore the development of higher-order ToM abilities in bilingual Indian children between 3.0 and 8.11 years of age, to achieve an insight into the influence of language on ToM abilities.

SETTINGS AND DESIGN

The current study followed a cross-sectional design along with an employment of a random convenient sampling procedure. The study was conducted in regular English medium schools with each participant individually being assessed.

MATERIALS AND METHODS

The study was done on 60 Kannada-English bilingual children, with each participant being assessed using two sets of stories (English and Kannada) that were constructed based on two different central themes which were verbally narrated. The stimulus of each set consisted of questions tapping on three levels (first-second-third orders) of ToM abilities.

STATISTICAL ANALYSIS

Descriptive statistics determined the mean and standard deviation of the total ToM scores (in both languages). Wilcoxon Signed-Rank and Mann-Whitney U-tests were done to determine the level of significance across and between the age groups (in both languages), respectively.

RESULTS

The results revealed a significant difference across the age groups. In addition, a significant difference between the responses in English and Kannada were obtained.

CONCLUSIONS

The development of metalinguistic abilities is influenced by socioenvironmental factors as well as the language maturity of the child.

Action perception and motor imagery: Mental practice of action

Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative ¹⁴C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.

What Are You Doing With That Object? Comparing the Neural Responses of Action Understanding in Adolescents With and Without Autism

Understanding another's actions, including what they are doing and why they are doing it, can be difficult for individuals with autism spectrum disorder (ASD). This understanding is supported by the action observation (AON) and mentalizing (MZN) networks, as well as the superior temporal sulcus. We examined these areas in children with ASD and typically developing controls by having participants view eating and placing actions performed in conventional and unconventional ways while functional magnetic resonance images were collected. We found an effect of action-type, but not conventionality, in both groups, and a between groups difference only when viewing conventional eating actions. Findings suggest there are not global AON/MZN deficits in ASD, and observing unconventional actions may not spontaneously activate the MZN.

Mirror neurons and intention understanding: Dissociating the contribution of object type and intention to mirror responses using electromyography

Since their discovery in the monkey and human brain, mirror neurons have been claimed to play a key role in understanding others' intentions. For example, "action-constrained" mirror neurons in inferior parietal lobule fire when the monkey observes a grasping movement that is followed by an eating action, but not when it is followed by a placing action. It is claimed these responses enable the monkey to predict the intentions of the actor. These findings have been replicated in human observers by recording electromyography responses of the mouth-opening mylohyoid muscle during action observation. Mylohyoid muscle activity was greater during the observation of actions performed with the intention to eat than of actions performed with the intention to place, again suggesting an ability to predict the actor's intentions. However, in previous studies, intention was confounded with object type (food for eating actions, nonfood for placing actions). We therefore used electromyography to measure mylohyoid activity in participants observing eating and placing actions. Unlike previous studies, we used a design in which each object (food, nonfood) could be both eaten and placed, and thus participants could not predict the actor's intention at the onset of the action. Greater mylohyoid activity was found for the observation of actions performed on food objects, irrespective of intention, indicating that the object type, not the actor's intention, drives the mirror response. This result suggests that observers' motor responses during action observation reflect the presence of a particular object, rather than the actor's underlying intentions.

Spatiotemporal Phase Synchronization in Adaptive Reconfiguration from Action Observation Network to Mentalizing Network for Understanding Other's Action Intention

In action intention understanding, the mirror system is involved in perception-action matching process and the mentalizing system underlies higher-level intention inference. By analyzing the dynamic functional connectivity in α (8-12 Hz) and β (12-30 Hz) frequency bands over a "hand-cup interaction" observation task, this study investigates the topological transition from the action observation network (AON) to the mentalizing network (MZN), and estimates their functional relevance for intention identification from other's different action kinematics. Sequential brain microstates were extracted based on event-related potentials (ERPs), in which significantly differing neuronal responses were found in N170-P200 related to perceptually matching kinematic profiles and P400-700 involved in goal inference. Inter-electrode weighted phase lag index analysis on the ERP microstates revealed a shift of hub centrality salient in α frequency band, from the AON dominated by left-lateral frontal-premotor-temporal and temporal-parietooccipital synchronizations to the MZN consisting of more bilateral frontal-parietal and temporal-parietal synchronizations. As compared with usual actions, intention identification of unintelligible actions induces weaker synchronizations in the AON but dramatically increased connectivity in right frontal-temporal-parietal regions of the MZN, indicating a spatiotemporally complementary effect between the functional network configurations involved in mirror and mentalizing processes. Perceptual processing in observing usual/unintelligible actions decreases/increases requirements for intention inference, which would induce less/greater functional network reorganization on the way to mentalization. From the comparison, our study suggests that the adaptive topological changes from the AON to the MZN indicate implicit causal association between the mirror and mentalizing systems for decoding others' intentionality.

Affective and cooperative social interactions modulate effective connectivity within and between the mirror and mentalizing systems

Decoding the meaning of others' actions, a crucial step for social cognition, involves different neural mechanisms. While the "mirror" and "mentalizing" systems have been associated with, respectively, the processing of biological actions versus more abstract information, their respective contribution to intention understanding is debated. Processing social interactions seems to recruit both neural systems, with a different weight depending on cues emphasizing either shared action goals or shared mental states. We have previously shown that observing cooperative and affective social interactions elicits stronger activity in key nodes of, respectively, the mirror (left posterior superior temporal sulcus (pSTS), superior parietal cortex (SPL), and ventral/dorsal premotor cortex (vPMC/dPMC)) and mentalizing (ventromedial prefrontal cortex (vmPFC)) systems. To unveil their causal organization, we investigated the effective connectivity underlying the observation of human social interactions expressing increasing cooperativity (involving left pSTS, SPL, and vPMC) versus affectivity (vmPFC) via dynamic causal modeling in 36 healthy human subjects. We found strong evidence for a model including the pSTS and vPMC as input nodes for the observed interactions. The extrinsic connectivity of this model undergoes oppositely valenced modulations, with cooperativity promoting positive modulations of connectivity between pSTS and both SPL (forward) and vPMC (mainly backward), and affectivity promoting reciprocal positive modulations of connectivity between pSTS and vmPFC (mainly backward). Alongside fMRI data, such divergent effective connectivity suggests that different dimensions underlying the processing of social interactions recruit distinct, although strongly interconnected, neural pathways associated with, respectively, the bottom-up visuomotor processing of motor intentions, and the top-down attribution of affective/mental states.

Tracking the Time Course of Top-Down Contextual Effects on Motor Responses during Action Comprehension

Context plays a key role in coding high-level components of others' behavior, including the goal and the intention of an observed action. However, little is known about its possible role in shaping lower levels of action processing, such as simulating action kinematics and muscular activity. Furthermore, there is no evidence regarding the time course and the neural mechanisms subserving this modulation. To address these issues, we combined single-pulse transcranial magnetic stimulation and motor-evoked potentials while healthy humans watched videos of everyday actions embedded in congruent, incongruent, or ambiguous contexts. Video endings were occluded from view and participants had to predict action unfolding. Transcranial magnetic stimulation was delivered at 80, 240, and 400 ms after action onset. An earlier selective facilitation of motor resonance occurring at 240 ms was observed for actions embedded in congruent contexts, compared with those occurring in incongruent and ambiguous ones. Later on, at 400 ms, a selective inhibition of motor resonance was found for actions embedded in incongruent contexts, compared with those taking place in congruent and ambiguous ones. No modulations were observed at 80 ms. Together, these findings indicate that motor resonance can be modulated by contextual information with different timings, depending on the (in)congruency between the different levels of action representation. Furthermore, the different time course of these effects suggests that they stem from partially independent mechanisms, with the early facilitation directly involving M1, and the later inhibition recruiting high-level structures outside the motor system.

SIGNIFICANCE STATEMENT

Previous studies indicate that, when we observe other people's actions, the context in which actions take place influences intention understanding. However, little is known about the precise mechanisms involved in the contextual modulation of action representation (i.e., inhibition vs facilitation) and how they unfold in time. The present study sheds light on these aspects. Specifically, we show an early top-down facilitation (at ∼240 ms) and a later inhibition (at ∼400 ms) of motor resonance in response to actions observed in congruent and incongruent contexts, respectively.

Avoidant Responses to Interpersonal Provocation Are Associated with Increased Amygdala and Decreased Mentalizing Network Activity

When intentionally pushed or insulted, one can either flee from the provoker or retaliate. The implementation of such fight-or-flight decisions is a central aspect in the genesis and evolution of aggression episodes, yet it is usually investigated only indirectly or in nonsocial situations. In the present fMRI study, we aimed to distinguish brain regions associated with aggressive and avoidant responses to interpersonal provocation in humans. Participants (thirty-six healthy young women) could either avoid or face a highly (HP) and a lowly (LP) provoking opponent in a competitive reaction time task: the fight-or-escape (FOE) paradigm. Subjects avoided the HP more often, but retaliated when facing her. Moreover, they chose to fight the HP more quickly, and showed increased heart rate (HR) right before confronting her. Orbitofrontal cortex (OFC) and sensorimotor cortex were more active when participants decided to fight, whereas the mentalizing network was engaged when deciding to avoid. Importantly, avoiding the HP relative to the LP was associated with both higher activation in the right basolateral amygdala and lower relative activity in several mentalizing regions [e.g., medial and inferior frontal gyrus (IFG), temporal-parietal junction (TPJ)]. These results suggest that avoidant responses to provocation might result from heightened threat anticipation and are associated with reduced perspective taking. Furthermore, our study helps to reconcile conflicting findings on the role of the mentalizing network, the amygdala, and the OFC in aggression.

Doing It Your Way: How Individual Movement Styles Affect Action Prediction

Individuals show significant variations in performing a motor act. Previous studies in the action observation literature have largely ignored this ubiquitous, if often unwanted, characteristic of motor performance, assuming movement patterns to be highly similar across repetitions and individuals. In the present study, we examined the possibility that individual variations in motor style directly influence the ability to understand and predict others' actions. To this end, we first recorded grasping movements performed with different intents and used a two-step cluster analysis to identify quantitatively 'clusters' of movements performed with similar movement styles (Experiment 1). Next, using videos of the same movements, we proceeded to examine the influence of these styles on the ability to judge intention from action observation (Experiments 2 and 3). We found that motor styles directly influenced observers' ability to 'read' others' intention, with some styles always being less 'readable' than others. These results provide experimental support for the significance of motor variability for action prediction, suggesting that the ability to predict what another person is likely to do next directly depends on her individual movement style.

The right temporoparietal junction encodes efforts of others during action observation

Smooth social interactions require a deep understanding of others’ intentions and feelings. In the present study, to investigate brain regions that respond to inference of others’ effort level, we recorded brain activity during action observation of different effort levels using functional magnetic resonance imaging (fMRI). We used a dumbbell curl movement to depict a movement requiring effort. To dissociate the factors of effort level of the actor and weight of the dumbbell, we used four combinations of dumbbell weight and actor physique: a thin actor or a built actor lifting a heavy or light dumbbell. During observation of dumbbell curls, the bilateral front-parietal action observation network (AON) was activated. This included the premotor cortices, parietal cortices, visual areas 5/superior temporal cortices (STS), amygdalae, hippocampi, right dorsolateral and ventrolateral frontal cortices. When we evaluated brain regions associated with the actor’s effort level, activity in the right temporoparietal junction (TPJ) and STS was observed. However, activity in the front-parietal AON was independent of the actor’s effort during action observation. This finding suggests that the right TPJ and STS play an important role in the inference of others’ effort levels during the observation of others’ movements.

Changing ideas about others' intentions: updating prior expectations tunes activity in the human motor system

Predicting intentions from observing another agent's behaviours is often thought to depend on motor resonance - i.e., the motor system's response to a perceived movement by the activation of its stored motor counterpart, but observers might also rely on prior expectations, especially when actions take place in perceptually uncertain situations. Here we assessed motor resonance during an action prediction task using transcranial magnetic stimulation to probe corticospinal excitability (CSE) and report that experimentally-induced updates in observers' prior expectations modulate CSE when predictions are made under situations of perceptual uncertainty. We show that prior expectations are updated on the basis of both biomechanical and probabilistic prior information and that the magnitude of the CSE modulation observed across participants is explained by the magnitude of change in their prior expectations. These findings provide the first evidence that when observers predict others' intentions, motor resonance mechanisms adapt to changes in their prior expectations. We propose that this adaptive adjustment might reflect a regulatory control mechanism that shares some similarities with that observed during action selection. Such a mechanism could help arbitrate the competition between biomechanical and probabilistic prior information when appropriate for prediction.