Action outcomes are represented in human inferior frontoparietal cortex

Brain to brain musical interaction: A systematic review of neural synchrony in musical activities

The use of hyperscanning technology has revealed the neural mechanisms underlying multi-person interaction in musical activities. However, there is currently a lack of integration among various research findings. This systematic review aims to provide a comprehensive understanding of the social dynamics and brain synchronization in music activities through the analysis of 32 studies. The findings illustrate a strong correlation between inter-brain synchronization (IBS) and various musical activities, with the frontal, central, parietal, and temporal lobes as the primary regions involved. The application of hyperscanning not only advances theoretical research but also holds practical significance in enhancing the effectiveness of music-based interventions in therapy and education. The review also utilizes Predictive Coding Models (PCM) to provide a new perspective for interpreting neural synchronization in music activities. To address the limitations of current research, future studies could integrate multimodal data, adopt novel technologies, use non-invasive techniques, and explore additional research directions.

Perception of robotic actions and the influence of gender

In our society interaction with robots is becoming more and more frequent since robots are not only used in the industry, but increasingly often in assistance and in health system. Perception of robots and their movements is crucial for their acceptance. Here we shortly review basic mechanisms of perception of actions, and then of perception of robotic and human movements. The literature demonstrates that there are commonalities, but also differences in the perception of human and robotic movements. Especially interesting are biologic gender differences in the perception of robotic movements. The results show that males seem to be more sensitive to the differences between robotic and anthropomorphic movements, whereas females seem not to perceive such differences. However, females transfer more anthropomorphic features to robotic movements. While looking at the brain activation during perception of humanoid and robotic movements in different genders one can conclude that different strategies are used; female seem to analyse robotic movements online, while male seem to use previous knowledge from interaction with robots. Further research is needed to specify more such gender differences.

Neural processing of bottom-up perception of biological motion under attentional load

Considering its importance for one's survival and social significance, biological motion (BM) perception is assumed to occur automatically. Previous behavioral results showed that task-irrelevant BM in the periphery interfered with task performance at the fovea. Under selective attention, BM perception is supported by a network of regions including the occipito-temporal (OTC), parietal, and premotor cortices. Retinotopy studies that use BM stimulus showed distinct maps for its processing under and away from selective attention. Based on these findings, we investigated how bottom-up perception of BM would be processed in the human brain under attentional load when it was shown away from the focus of attention as a task-irrelevant stimulus. Participants (N = 31) underwent an fMRI study in which they performed an attentionally demanding visual detection task at the fovea while intact or scrambled point light displays of BM were shown at the periphery. Our results showed the main effect of attentional load in fronto-parietal regions and both univariate activity maps and multivariate pattern analysis results support the attentional load modulation on the task-irrelevant peripheral stimuli. However, this effect was not specific to intact BM stimuli and was generalized to motion stimuli as evidenced by the motion-sensitive OTC involvement during the presence of dynamic stimuli in the periphery. These results confirm and extend previous work by showing that task-irrelevant distractors can be processed by stimulus-specific regions when there are enough attentional resources available. We discussed the implications of these results for future studies.

Configuration of the action observation network depends on the goals of the observer

Observing the actions of others engages a core action observation network (AON) that includes the bilateral inferior frontal cortex (IFC), posterior superior temporal sulcus (pSTS) and inferior parietal lobule (IPL) (Caspers et al., 2010). Each region in the AON has functional properties that are heterogeneous and include representing the perceptual properties of action, predicting action outcomes and making inferences as to the goals of the actor. Critically, recent evidence shows that neural representations within the pSTS are sharpened when attending to the kinematics of the actor, such that the top-down guided attention reshapes underlying neural representations. In this study we evaluate how attention alters network connectivity within the AON as a system. Cues directed participant's attention to the goal, kinematics, or identity depicted in short action animations while brain responses were measured by fMRI. We identified those parcels within the AON with functional connectivity modulated by task. Results show that connectivity between the right pSTS and right IFC, and bilateral extended STS (STS+) were modulated during action observation such that connections were strengthened when the participant was attending to the action than goal. This finding is contrasted by the univariate results, which no univariate modulations in these brain regions except for right IFC. Using the functional networks defined by Yeo et al. (2011), we identified the parcels that are modulated by the attention to consist mainly of the fronto-parietal control network and default mode networks. These results are consistent with models of top-down feedback from executive system in the IFC to pSTS and implicates a right lateralized dual pathway model for action observation when focused on whole-body kinematics.

The Representation of Observed Actions at the Subordinate, Basic, and Superordinate Level

Actions can be planned and recognized at different hierarchical levels, ranging from very specific (e.g., to swim backstroke) to very broad (e.g., locomotion). Understanding the corresponding neural representation is an important prerequisite to reveal how our brain flexibly assigns meaning to the world around us. To address this question, we conducted an event-related fMRI study in male and female human participants in which we examined distinct representations of observed actions at the subordinate, basic and superordinate level. Using multiple regression representational similarity analysis (RSA) in predefined regions of interest, we found that the three different taxonomic levels were best captured by patterns of activations in bilateral lateral occipitotemporal cortex (LOTC), showing the highest similarity with the basic level model. A whole-brain multiple regression RSA revealed that information unique to the basic level was captured by patterns of activation in dorsal and ventral portions of the LOTC and in parietal regions. By contrast, the unique information for the subordinate level was limited to bilateral occipitotemporal cortex, while no single cluster was obtained that captured unique information for the superordinate level. The behaviorally established action space was best captured by patterns of activation in the LOTC and superior parietal cortex, and the corresponding neural patterns of activation showed the highest similarity with patterns of activation corresponding to the basic level model. Together, our results suggest that occipitotemporal cortex shows a preference for the basic level model, with flexible access across the subordinate and the basic level.SIGNIFICANCE STATEMENT The human brain captures information at varying levels of abstraction. It is debated which brain regions host representations across different hierarchical levels, with some studies emphasizing parietal and premotor regions, while other studies highlight the role of the lateral occipitotemporal cortex (LOTC). To shed light on this debate, here we examined the representation of observed actions at the three taxonomic levels suggested by Rosch et al. (1976) Our results highlight the role of the LOTC, which hosts a shared representation across the subordinate and the basic level, with the highest similarity with the basic level model. These results shed new light on the hierarchical organization of observed actions and provide insights into the neural basis underlying the basic level advantage.

Temporal hierarchy of observed goal-directed actions

During social interactions, we continuously integrate current and previous information over varying timescales to infer other people's action intentions. Motor cognition theories argue for a hierarchical organization of goal-directed actions based on temporal scales. Accordingly, transient motor primitives are represented at lower levels of the hierarchy, a combination of primitives building motor sequences at subordinate levels, and more stable overarching action goals at superordinate levels. A neural topography of hierarchal timescales for information accumulation was previously shown in the visual and auditory domains. However, whether such a temporal hierarchy can also account for observed goal-directed action representations in motor pathways remains to be determined. Thus, the current study examined the neural architecture underlying the processing of observed goal-directed actions using inter-subject correlation (ISC) of fMRI activity. Observers (n = 24) viewed sequential hand movements presented in their intact order or piecewise scrambled at three timescales pertaining to goal-directed action evolution (Primitives: ± 1.5 s, Sub-Goals: ± 4 s, and High-Goals: ± 10 s). The results revealed differential intrinsic temporal capacities for integrating goal-directed action information across brain areas engaged in action observation. Longer timescales (> ± 10 s) were found in the posterior parietal and dorsal premotor compared to the ventral premotor (± 4 s) and anterior parietal (± 1.5 s) cortex. Moreover, our results revealed a hemispheric bias with more extended timescales in the right MT+, primary somatosensory, and early visual cortices compared to their homotopic regions in the left hemisphere. Our findings corroborate a hierarchical neural mapping of observed actions based on temporal scales of goals and provide further support for a ubiquitous time-dependent neural organization of information processing across multiple modalities.

Causal effects of nonalcoholic fatty liver disease on cerebral cortical structure: a Mendelian randomization analysis

Background

Previous studies have highlighted changes in the cerebral cortical structure and cognitive function among nonalcoholic fatty liver disease (NAFLD) patients. However, the impact of NAFLD on cerebral cortical structure and specific affected brain regions remains unclear. Therefore, we aimed to explore the potential causal relationship between NAFLD and cerebral cortical structure.

Methods

We conducted a Mendelian randomization (MR) study using genetic predictors of alanine aminotransferase (ALT), NAFLD, and percent liver fat (PLF) and combined them with genome-wide association study (GWAS) summary statistics from the ENIGMA Consortium. Several methods were used to assess the effect of NAFLD on full cortex and specific brain regions, along with sensitivity analyses.

Results

At the global level, PLF nominally decreased SA of full cortex; at the functional level, ALT presented a nominal association with reduced SA of parahippocampal gyrus, TH of pars opercularis, TH of pars orbitalis, and TH of pericalcarine cortex. Besides, NAFLD presented a nominal association with reduced SA of parahippocampal gyrus, TH of pars opercularis, TH of pars triangularis and TH of pericalcarine cortex, but increased TH of entorhinal cortex, lateral orbitofrontal cortex and temporal pole. Furthermore, PLF presented a nominal association with reduced SA of parahippocampal gyrus, TH of pars opercularis, TH of cuneus and lingual gyrus, but increased TH of entorhinal cortex.

Conclusion

NAFLD is suggestively associated with atrophy in specific functional regions of the human brain.

Persuader-receiver neural coupling underlies persuasive messaging and predicts persuasion outcome

Opportunities to persuade and be persuaded are ubiquitous. What interpersonal neural pathway in real-world settings determining successful information propagation in naturalistic two-person persuasion scenarios? Hereby, we extended prior research on a naturalistic dyadic persuasion paradigm (NDP) using dual-fNIRS protocol simultaneously measured the neural activity from persuader-receiver dyads while they engaged in a modified "Arctic Survival Task." Investigating whether neural coupling between persuaders and receivers underpinning of persuading and predict persuasion outcomes (i.e., receiver's compliance). Broadly, we indicated that the persuasive arguments increase neural coupling significantly compared to non-persuasive arguments in the left superior temporal gyrus-superior frontal gyrus and superior frontal gyrus-inferior frontal gyrus. G-causality indices further revealed the coupling directionality of information flows between the persuader and receiver. Critically, the neural coupling could be a better predictor of persuasion outcomes relative to traditional self-report measures. Eventually, temporal dynamics neural coupling incorporating video recording revealed neural coupling marked the micro-level processes in response to persuading messages and possibly reflecting the time that persuasion might occurs. The initial case of the arguments with targeted views is valuable as the first step in encouraging the receiver's compliance. Our investigation represented an innovative interpersonal approach toward comprehending the neuroscience and psychology underlying complex and true persuasion.

Does the threat of COVID-19 modulate automatic imitation?

The tendency to involuntarily imitate the actions of others (automatic imitation) can be modulated by social affiliative cues. Here, we explored whether the disruption to our social lives caused by the COVID-19 pandemic may subsequently influence automatic imitation. Three groups were initially presented a sentence comprehension task that featured either neutral (control), safe or unsafe primes to COVID-19 infection. They then completed an automatic imitation task, where a numeric cue was presented alongside apparent motion of an index or middle finger, which was either compatible or incompatible with the required response. Reaction times were longer for the incompatible compared to compatible trials, and thus demonstrated automatic imitation. However, there was no influence of the primes indicating that automatic imitation was unaffected by the risk of COVID-19. The potential theoretical explanations and practical implications of pathogen avoidance and social bonding incentives are discussed with reference to pandemic events.

The transition from invariant to action-dependent visual object representation in human dorsal pathway

The human brain can efficiently process action-related visual information, which supports our ability to quickly understand and learn others' actions. The visual information of goal-directed action is extensively represented in the parietal and frontal cortex, but how actions and goal-objects are represented within this neural network is not fully understood. Specifically, which part of this dorsal network represents the identity of goal-objects? Is such goal-object information encoded at an abstract level or highly interactive with action representations? Here, we used functional magnetic resonance imaging with a large number of participants (n = 94) to investigate the neural representation of goal-objects and actions when participants viewed goal-directed action videos. Our results showed that the goal-directed action information could be decoded across much of the dorsal pathway, but in contrast, the invariant goal-object information independent of action was mainly localized in the early stage of dorsal pathway in parietal cortex rather than the down-stream areas of the parieto-frontal cortex. These results help us to understand the relationship between action and goal-object representations in the dorsal pathway, and the evolution of interactive representation of goal-objects and actions along the dorsal pathway during goal-directed action observation.

Distinct neural couplings to shared goal and action coordination in joint action: evidence based on fNIRS hyperscanning

Joint action is central to human nature, enabling individuals to coordinate in time and space to achieve a joint outcome. Such interaction typically involves two key elements: shared goal and action coordination. Yet, the substrates entrained to these two components in joint action remained unclear. In the current study, dyads performed two tasks involving both sharing goal and action coordination, i.e. complementary joint action and imitative joint action, a task only involving shared goal and a task only involving action coordination, while their brain activities were recorded by the functional near-infrared spectroscopy hyperscanning technique. The results showed that both complementary and imitative joint action (i.e. involving shared goal and action coordination) elicited better behavioral performance than the task only involving shared goal/action coordination. We observed that the interbrain synchronization (IBS) at the right inferior frontal cortex (IFC) entrained more to shared goal, while left-IFC IBS entrained more to action coordination. We also observed that the right-IFC IBS was greater during completing a complementary action than an imitative action. Our results suggest that IFC plays an important role in joint action, with distinct lateralization for the sub-components of joint action.

Anthropomorphic or non-anthropomorphic? Effects of biological sex in observation of actions in a digital human model and a gantry robot model

Robots are ever more relevant for everyday life, such as healthcare or rehabilitation, as well as for modern industrial environment. One important issue in this context is the way we perceive robots and their actions. From our previous study, evidence exists that sex can affect the way people perceive certain robot's actions. In our fMRI study, we analyzed brain activations of female and male participants, while they observed anthropomorphic and robotic movements performed by a human or a robot model. While lying in the scanner, participants rated the perceived level of anthropomorphic and robotic likeness of movements in the two models. The observation of the human model and the anthropomorphic movements similarly activated the biological motion coding areas in posterior temporal and parietal areas. The observation of the robot model activated predominantly areas of the ventral stream, whereas the observation of robotic movements activated predominantly the primary and higher order motor areas. To note, this later activation originated mainly from female participants, whereas male participants activated, in both robot model and robotic movements contrasts, areas in the posterior parietal cortex. Accordingly, the general contrast of sex suggests that men tend to use the ventro-dorsal stream most plausibly to rely on available previous knowledge to analyze the movements, whereas female participants use the dorso-dorsal and the ventral streams to analyze online the differences between the movement types and between the different models. The study is a first step toward the understanding of sex differences in the processing of anthropomorphic and robotic movements.

Same Action, Different Meaning: Neural Substrates of Action Semantic Meaning

Voluntary actions are shaped by desired goals and internal intentions. Multiple factors, including the planning of subsequent actions and the expectation of sensory outcome, were shown to modulate kinetics and neural activity patterns associated with similar goal-directed actions. Notably, in many real-world tasks, actions can also vary across the semantic meaning they convey, although little is known about how semantic meaning modulates associated neurobehavioral measures. Here, we examined how behavioral and functional magnetic resonance imaging measures are modulated when subjects execute similar actions (button presses) for two different semantic meanings-to answer "yes" or "no" to a binary question. Our findings reveal that, when subjects answer using their right hand, the two semantic meanings are differentiated based on voxel patterns in the frontoparietal cortex and lateral-occipital complex bilaterally. When using their left hand, similar regions were found, albeit only with a more liberal threshold. Although subjects were faster to answer "yes" versus "no" when using their right hand, the neural differences cannot be explained by these kinetic differences. To the best of our knowledge, this is the first evidence showing that semantic meaning is embedded in the neural representation of actions, independent of alternative modulating factors such as kinetic and sensory features.

Contagious Depression: Automatic Mimicry and the Mirror Neuron System - A Review

Contagious depression is a theory proposing that depression can be induced or triggered by our social environment. This theory is based on emotional contagion, the idea that affective states can be transferred during social interaction, since humans can use emotional contagion to communicate feelings and emotions in conscious and unconscious ways. This review presents behavioral, physiological, and neuroanatomical aspects of two essential contagious depression mechanisms, automatic mimicry and the mirror neuron system.

The characterization of actions at the superordinate, basic and subordinate level

Objects can be categorized at different levels of abstraction, ranging from the superordinate (e.g., fruit) and the basic (e.g., apple) to the subordinate level (e.g., golden delicious). The basic level is assumed to play a key role in categorization, e.g., in terms of the number of features used to describe these actions and the speed of processing. To which degree do these principles also apply to the categorization of observed actions? To address this question, we first selected a range of actions at the superordinate (e.g., locomotion), basic (e.g., to swim) and subordinate level (e.g., to swim breaststroke), using verbal material (Experiments 1-3). Experiments 4-6 aimed to determine the characteristics of these actions across the three taxonomic levels. Using a feature listing paradigm (Experiment 4), we determined the number of features that were provided by at least six out of twenty participants (common features), separately for the three different levels. In addition, we examined the number of shared (i.e., provided for more than one category) and distinct (i.e., provided for one category only) features. Participants produced the highest number of common features for actions at the basic level. Actions at the subordinate level shared more features with other actions at the same level than those at the superordinate level. Actions at the superordinate and basic level were described with more distinct features compared to those provided at the subordinate level. Using an auditory priming paradigm (Experiment 5), we observed that participants responded faster to action images preceded by a matching auditory cue corresponding to the basic and subordinate level, but not for superordinate level cues, suggesting that the basic level is the most abstract level at which verbal cues facilitate the processing of an upcoming action. Using a category verification task (Experiment 6), we found that participants were faster and more accurate to verify action categories (depicted as images) at the basic and subordinate level in comparison to the superordinate level. Together, in line with the object categorization literature, our results suggest that information about action categories is maximized at the basic level.

Punishment and reward normalize error-related cognitive control in PTSD by modulating salience network activation and connectivity

Posttraumatic Stress Disorder (PTSD) symptomatology disrupts inhibitory control during sustained attention. However, PTSD-related inhibitory control deficits are partially ameliorated when punishments and rewards are administered based on task performance, which suggests motivational processes contribute to these deficits. Additionally, PTSD may also impair error-related cognitive control following inhibitory control failures as measured by post-error slowing (PES). However, it remains unclear if motivational processes also contribute to impaired error-related cognitive control in PTSD. Using an incentivized sustained attention paradigm in two independent samples of post-9/11 veterans, we characterized PTSD-related differences in PES during both non-motivated conditions (no task-based incentives) and motivated conditions (task-based rewards and punishments). In Study 1 (n = 139), PTSD symptom severity was modestly associated with smaller PES in the non-motivated condition, whereas no PTSD-related association was observed in the motivated condition. In Study 2 (n = 35), we replicated and extended these results by using fMRI to characterize modulation of the triple network system comprised of the Salience Network (SN), Frontoparietal Control Network (FPCN), and Default Mode Network (DMN). In the non-motivated condition, PTSD symptom severity was associated with non-specific SN and FPCN hyperactivation during both failed and successful inhibitory control. In the motivated condition, PTSD symptom severity was associated with greater focal activation of both the SN and Superior Parietal Lobule cluster (an FPCN node) during punished inhibitory control failures and weaker SN-FPCN connectivity during rewarded inhibitory control successes. Together, these results suggest that dysregulated motivational processes in PTSD may contribute to impaired error-related cognitive control.

EEG-Based Evidence of Mirror Neuron Activity from App-Mediated Stroke Patient Observation

Background and Objectives: The mirror neuron system in the sensorimotor region of the cerebral cortex is equally activated during both action observation and execution. Action observation training mimics the functioning of the mirror neuron system, requiring patients to watch and imitate the actions necessary to perform activities of daily living. StrokeCare is a user-friendly application based on the principles of action observation training, designed to assist people recovering from stroke. Therefore, when observing the daily life behavior provided in the StrokeCare app, whether the MNS is activated and mu inhibition appears. Materials and Methods: We performed electroencephalography (EEG) on 24 patients with chronic stroke (infarction: 11, hemorrhage: 13) during tasks closely related to daily activities, such as dressing, undressing, and walking. The StrokeCare app provided action videos for patients to watch. Landscape imagery observation facilitated comparison among tasks. We analyzed the mu rhythm from the C3, CZ, and C4 regions and calculated the mean log ratios for comparison of mu suppression values. Results: The EEG mu power log ratios were significantly suppressed during action observation in dressing, undressing, walking, and landscape conditions, in decreasing order. However, there were no significant activity differences in the C3, C4 and CZ regions. The dressing task showed maximum suppression after a color spectrum was used to map the relative power values of the mu rhythm for each task. Conclusions: These findings reveal that the human mirror neuron system was more strongly activated during observation of actions closely related to daily life activities than landscape images.

Flexible constraint hierarchy during the visual encoding of tool-object interactions

Tools and objects are associated with numerous action possibilities that are reduced depending on the task-related internal and external constraints presented to the observer. Action hierarchies propose that goals represent higher levels of the hierarchy while kinematic patterns represent lower levels of the hierarchy. Prior work suggests that tool-object perception is heavily influenced by grasp and action context. The current study sought to evaluate whether the presence of action hierarchy can be perceptually identified using eye tracking during tool-object observation. We hypothesize that gaze patterns will reveal a perceptual hierarchy based on the observed task context and grasp constraints. Participants viewed tool-objects scenes with two types of constraints: task-context and grasp constraints. Task-context constraints consisted of correct (e.g., frying pan-spatula) and incorrect tool-object pairings (e.g., stapler-spatula). Grasp constraints involved modified tool orientations, which requires participants to understand how initially awkward grasp postures can help achieve the task. The visual scene contained three areas of interests (AOIs): the object, the functional tool-end (e.g., spoon handle) and the manipulative tool-end (e.g., spoon bowl). Results revealed two distinct processes based on stimuli constraints. Goal-oriented encoding, the attentional bias towards the object and manipulative tool-end, was demonstrated when grasp did not lead to meaningful tool-use. In images where grasp postures were critical to action performance, attentional bias was primarily between the object and functional tool-end, which suggests means-related encoding of the graspable properties of the object. This study expands from previous work and demonstrates a flexible constraint hierarchy depending on the observed task constraints.

Decoding grip type and action goal during the observation of reaching-grasping actions: A multivariate fMRI study

During execution and observation of reaching-grasping actions, the brain must encode, at the same time, the final action goal and the type of grip necessary to achieve it. Recently, it has been proposed that the Mirror Neuron System (MNS) is involved not only in coding the final goal of the observed action, but also the type of grip used to grasp the object. However, the specific contribution of the different areas of the MNS, at both cortical and subcortical level, in disentangling action goal and grip type is still unclear. Here, twenty human volunteers participated in an fMRI study in which they performed two tasks: (a) observation of four different types of actions, consisting in reaching-to-grasp a box handle with two possible grips (precision, hook) and two possible goals (open, close); (b) action execution, in which participants performed grasping actions similar to those presented during the observation task. A conjunction analysis revealed the presence of shared activated voxels for both action observation and execution within several cortical areas including dorsal and ventral premotor cortex, inferior and superior parietal cortex, intraparietal sulcus, primary somatosensory cortex, and cerebellar lobules VI and VIII. ROI analyses showed a main effect for grip type in several premotor and parietal areas and cerebellar lobule VI, with higher BOLD activation during observation of precision vs hook actions. A grip x goal interaction was also present in the left inferior parietal cortex, with higher BOLD activity during precision-to-close actions. A multivariate pattern analysis (MVPA) revealed a significant accuracy for the grip model in all ROIs, while for the action goal model, significant accuracy was observed only for left inferior parietal cortex ROI. These findings indicate that a large network involving cortical and cerebellar areas is involved in the processing of type of grip, while final action goal appears to be mainly processed within the inferior parietal region, suggesting a differential contribution of the areas activated in this study.

The relations between cognitive and motivational components of anosognosia for left-sided hemiplegia and the right hemisphere dominance for emotions: A historical survey

Since the description of anosognosia for hemiplegia by Babinski (who also stressed the links between anosognosia and right hemisphere damage) both motivational and cognitive mechanisms have been advanced to explain this awareness disorder. In this review I will discuss first the neurophysiological mechanisms that can impede the discovery of the motor deficits contralateral to the brain lesion and then suggest that some instances of anosognosia for left-sided hemiplegia may also be due to motivational mechanisms of denial. Among the cognitive mechanisms, sensory feedback and intentional feed-forward disorders can lead to a poor awareness of the motor defects, whereas denial mechanisms could result from an interaction between the right hemisphere dominance for emotions and the anxiety raised by the catastrophic consequences of the brain damage. In particular, a maladaptive reaction to the personal implications of the brain lesion could be revealed by the presence of an implicit acknowledgement of the motor defect.

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

Top-Down Attention Guidance Shapes Action Encoding in the pSTS

The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

Sequential aiming in pairs: the multiple levels of joint action

The task constraints imposed upon a co-actor can often influence our own actions. Likewise, the observation of somebody else's movements can involuntarily contaminate the execution of our own movements. These joint action outcomes have rarely been considered in unison. The aim of the present study was to simultaneously examine the underlying processes contributing to joint action. We had pairs of participants work together to execute sequential aiming movements between two targets-the first person's movement was contingent upon the anticipation of the second person's movement (leader), while the second person's movement was contingent upon the direct observation of the first person's movement (follower). Participants executed separate blocks of two-target aiming movements under different contexts; that is, solely on their own using one (2T1L) and two (2T2L) of their upper limbs, or with another person (2T2P). The first movement segment generally indicated a more abrupt approach (shorter time after peak velocity, greater displacement and magnitude of peak velocity), which surprisingly coincided with lower spatial variability, for the 2T2P context. Meanwhile, the second segment indicated a similar kinematic profile as the first segment for the 2T2P context. The first movement of the leader appeared to accommodate the follower for their movement, while the second movement of the follower was primed by the observation of the leader's movement. These findings collectively advocate two distinct levels of joint action including the anticipation (top-down) and mapping (bottom-up) of other people's actions.

Human Chemosignals and Brain Activity: A Preliminary Meta-analysis of the Processing of Human Body Odors

Across phyla, chemosignals are a widely used form of social communication and increasing evidence suggests that chemosensory communication is present also in humans. Chemosignals can transfer, via body odors, socially relevant information, such as specific information about identity or emotional states. However, findings on neural correlates of processing of body odors are divergent. The aims of this meta-analysis were to assess the brain areas involved in the perception of body odors (both neutral and emotional) and the specific activation patterns for the perception of neutral body odor (NBO) and emotional body odor (EBO). We conducted an activation likelihood estimation (ALE) meta-analysis on 16 experiments (13 studies) examining brain activity during body odors processing. We found that the contrast EBO versus NBO resulted in significant convergence in the right middle frontal gyrus and the left cerebellum, whereas the pooled meta-analysis combining all the studies of human odors showed significant convergence in the right inferior frontal gyrus. No significant cluster was found for NBOs. However, our findings also highlight methodological heterogeneity across the existing literature. Further neuroimaging studies are needed to clarify and support the existing findings on neural correlates of processing of body odors.

Transient Disruption of the Inferior Parietal Lobule Impairs the Ability to Attribute Intention to Action

Although it is well established that fronto-parietal regions are active during action observation, whether they play a causal role in the ability to infer others' intentions from visual kinematics remains undetermined. In the experiments reported here, we combined offline continuous theta burst stimulation (cTBS) with computational modeling to reveal and causally probe single-trial computations in the inferior parietal lobule (IPL) and inferior frontal gyrus (IFG). Participants received cTBS over the left anterior IPL and the left IFG pars orbitalis in separate sessions before completing an intention discrimination task (discriminate intention of observed reach-to-grasp acts) or a kinematic discrimination task unrelated to intention (discriminate peak wrist height of the same acts). We targeted intention-sensitive regions whose fMRI activity, recorded when observing the same reach-to-grasp acts, could accurately discriminate intention. We found that transient disruption of activity of the left IPL, but not the IFG, impaired the observer's ability to attribute intention to action. Kinematic discrimination unrelated to intention, in contrast, was largely unaffected. Computational analyses of how encoding (mapping of intention to movement kinematics) and readout (mapping of kinematics to intention choices) intersect at the single-trial level revealed that IPL cTBS did not diminish the overall sensitivity of intention readout to movement kinematics. Rather, it selectively misaligned intention readout with respect to encoding, deteriorating mapping from informative kinematic features to intention choices. These results provide causal evidence of how the left anterior IPL computes mapping from kinematics to intentions.

Dark control: The default mode network as a reinforcement learning agent

The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans.

Activation of cerebellum and basal ganglia during the observation and execution of manipulative actions

Studies on action observation mostly described the activation of a network of cortical areas, while less investigation focused specifically on the activation and role of subcortical nodes. In the present fMRI study, we investigated the recruitment of cerebellum and basal ganglia during the execution and observation of object manipulation performed with the right hand. The observation conditions consisted in: (a) observation of manipulative actions; (b) observation of sequences of random finger movements. In the execution conditions, participants had to perform the same actions or movements as in (a) and (b), respectively. The results of conjunction analysis showed significant shared activations during both observation and execution of manipulation in several subcortical structures, including: (1) cerebellar lobules V, VI, crus I, VIIIa and VIIIb (bilaterally); (2) globus pallidus, bilaterally, and left subthalamic nucleus; (3) red nucleus (bilaterally) and left thalamus. These findings support the hypothesis that the action observation/execution network also involves subcortical structures, such as cerebellum and basal ganglia, forming an integrated network. This suggests possible mechanisms, involving these subcortical structures, underlying learning of new motor skills, through action observation and imitation.

Representing Multiple Observed Actions in the Motor System

There is now converging evidence that others' actions are represented in the motor system. However, social cognition requires us to represent not only the actions but also the interactions of others. To do so, it is imperative that the motor system can represent multiple observed actions. The current fMRI study investigated whether this is possible by measuring brain activity from 29 participants while they observed 2 right hands performing sign language gestures. Three key results were obtained. First, brain activity in the premotor and parietal motor cortex was stronger when 2 hands performed 2 different gestures than when 1 hand performed a single gesture. Second, both individual observed gestures could be decoded from brain activity in the same 2 regions. Third, observing 2 different gestures compared with 2 identical gestures activated brain areas related to motor conflict, and this activity was correlated with parietal motor activity. Together, these results show that the motor system is able to represent multiple observed actions, and as such reveal a potential mechanism by which third-party social encounters could be processed in the brain.

I See Your Effort: Force-Related BOLD Effects in an Extended Action Execution-Observation Network Involving the Cerebellum

Action observation (AO) is crucial for motor planning, imitation learning, and social interaction, but it is not clear whether and how an action execution–observation network (AEON) processes the effort of others engaged in performing actions. In this functional magnetic resonance imaging (fMRI) study, we used a “squeeze ball” task involving different grip forces to investigate whether AEON activation showed similar patterns when executing the task or observing others performing it. Both in action execution, AE (subjects performed the visuomotor task) and action observation, AO (subjects watched a video of the task being performed by someone else), the fMRI signal was detected in cerebral and cerebellar regions. These responses showed various relationships with force mapping onto specific areas of the sensorimotor and cognitive systems. Conjunction analysis of AE and AO was repeated for the “0th” order and linear and nonlinear responses, and revealed multiple AEON nodes remapping the detection of actions, and also effort, of another person onto the observer’s own cerebrocerebellar system. This result implies that the AEON exploits the cerebellum, which is known to process sensorimotor predictions and simulations, performing an internal assessment of forces and integrating information into high-level schemes, providing a crucial substrate for action imitation.

Muscular effort coding in action representation in ballet dancers and controls: Electrophysiological evidence

The present electrophysiological (EEG) study investigated the neural correlates of perceiving effortful vs. effortless movements belonging to a specific repertoire (ballet). Previous evidence has shown an increased heart and respiratory rate during the observation and imagination of human actions that require a great muscular effort. In addition, TMS (transcranial magnetic stimulation) and EEG studies have evidenced a greater muscle-specific cortical excitability and an increase in late event-related potentials during the observation of effortful actions. In this investigation, fifteen professional female ballet dancers and 15 controls with no experience whatsoever with dance, gymnastics, or martial arts were recruited. They were shown 326 short videos displaying a male dancer performing standard ballet steps that could be either effortful or relatively effortless. Participants were instructed to observe each clip and imagine themselves physically executing the same movement. Importantly, they were blinded to the stimuli properties. The observation of effortful compared with effortless movements resulted in a larger P300 over frontal sites in dancers only, likely because of their visuomotor expertise with the specific steps. Moreover, an enhanced Late Positivity was identified over posterior sites in response to effortful stimuli in both groups, possibly reflecting the processing of larger quantities of visual kinematic information. The source reconstruction swLORETA performed on the Late Positivity component showed greater engagement of frontoparietal regions in dancers, while task-related frontal and occipitotemporal visual regions were more active in controls. It, therefore, appears that, in dancers, effort information was encoded in a more refined manner during action observation and in the absence of explicit instruction. Acquired motor knowledge seems to result in visuomotor resonance processes, which, in turn, underlies enhanced action representation of the observed movements.

Observer-Agent Kinematic Similarity Facilitates Action Intention Decoding

It is well known that the kinematics of an action is modulated by the underlying motor intention. In turn, kinematics serves as a cue also during action observation, providing hints about the intention of the observed action. However, an open question is whether decoding others’ intentions on the basis of their kinematics depends solely on how much the kinematics varies across different actions, or rather it is also influenced by its similarity with the observer motor repertoire. The execution of reach-to-grasp and place actions, differing for target size and context, was recorded in terms of upper-limb kinematics in 21 volunteers and in an actor. Volunteers had later to observe the sole reach-to-grasp phase of the actor’s actions, and predict the underlying intention. The potential benefit of the kinematic actor-participant similarity for recognition accuracy was evaluated. In execution, both target size and context modulated specific kinematic parameters. More importantly, although participants performed above chance in intention recognition, the similarity of motor patterns positively correlated with recognition accuracy. Overall, these data indicate that kinematic similarity exerts a facilitative role in intention recognition, providing further support to the view of action intention recognition as a visuo-motor process grounded in motor resonance.

The last chance to pass the ball: investigating the role of temporal expectation and motor resonance in processing temporal errors in motor actions

Humans can acquire information on others' motor outputs (action prediction) and intentions (action understanding) according to their individual motor repertoire and to the detected gesture's features (e.g. temporal patterns). We aimed at dissociating between action prediction and action understanding abilities in soccer players and novices observing soccer action videos including correct timing pass (CTP) or delayed pass (DP). First, we used an occluding paradigm to evaluate participants' ability to predict the correct time to pass the ball. Although soccer players showed reduced reaction times, all subjects showed a similar pattern of performance: during DP observation, responses appeared delayed with respect to the other conditions but anticipated with respect to the observed DP. In a separate experiment, we investigated the ability to recognize CTP vs DP and the modulation of primary motor cortex (M1) excitability associated to video observation. Only soccer players showed selective modulation of M1 according to the plausibility of the observed action, with increased excitability during the observation of the CTP and in a phase preceding the DP. In conclusion, action prediction ability seems to be independent from the individual motor repertoire. By contrast, only subjects with previously acquired sensorimotor skills are able to infer the observed action's long-term intention.

Activation of Mirror Neuron Regions Is Altered in Developmental Coordination Disorder (DCD)-Neurophysiological Evidence Using an Action Observation Paradigm

Children with Developmental Coordination Disorder (DCD) have difficulty performing and learning motor skills. Automatic activation of the mirror neuron system (MNS) during action observation and its coupling to the motor output system are important neurophysiological processes that underpin observational motor learning. In the present study, we tested the hypothesis that MNS function is disrupted in children with DCD by using sensitive electroencephalography (EEG)-based measures of MNS activation during action observation. Specifically, we predicted reduced mu-suppression and coherence in DCD compared with typically developing children. Neural activation of the motor network was measured by EEG, specifically event-related desynchronization (ERD) of mu rhythms and fronto-parietal coherence. Children (15 DCD/15 controls) were tested under two task conditions: observational learning (imitation of an observed action) and detection (report a deviant movement after observation). EEG-metrics were compared between groups using linear mixed-effects models. As predicted, children with DCD showed lower levels of mu suppression and reduced modulation of coherence during the observational learning task compared with their non-DCD peers. Notably, mu suppression was reduced in DCD over the entire imitation task (repetitions, and both observation and pause intervals). Action observation can be used for the acquisition of new motor skills. This form of learning entails the transposition of the observed action to the existing internal representations of the observer’s own motor system. The present neurophysiological results suggest that this process of learning is impaired in children with DCD. The results are discussed in relation to current hypotheses on mechanisms of DCD.

Mirror Neuron System Activation in Children With Unilateral Cerebral Palsy During Observation of Actions Performed by a Pathological Model

Background. Recent evidence suggested that Action Observation Therapy (AOT), based on observation of actions followed by immediate reproduction, could be a useful rehabilitative strategy for promoting functional recovery of children affected by unilateral cerebral palsy (UCP). AOT most likely exploits properties of the parieto-premotor mirror neuron system (MNS). This is more intensely activated when participants observe actions belonging to their own motor repertoire. Objective. The aim of the present study was to investigate the issue of whether MNS of UCP children is better activated by actions performed by a paretic hand rather than a healthy one. Methods. Using functional magnetic resonance imaging, we assessed brain activation in a homogeneous group of 10 right UCP children compared with that of 10 right-handed typically developing (TD) children, during observation of grasping actions performed by a healthy or a paretic hand. Results. The results revealed a significant activation within the MNS in both UCP and TD children, more lateralized to the left hemisphere in the TD group. Most important, region of interest (ROI) analysis on parietal and premotor regions showed that, in UCP, the MNS was more strongly activated by observation of actions performed by the paretic hand, a motor model more similar to the observer’s motor repertoire. Conclusions. This study shows that children affected by spastic UCP exhibit enhanced activation of the MNS during observation of goal-directed actions performed by a pathological model with respect to a healthy one.

A Review of Functional and Structural Neurobiology of the Action Observation Network in Autism Spectrum Disorder and Developmental Coordination Disorder

Recent research has reported motor impairment similarities between children with developmental coordination disorder (DCD) and a subgroup of individuals with autism spectrum disorder (ASD). However, there is a debate as to whether DCD is a co-occurring diagnosis in individuals with ASD and motor impairments (ASDd), or if motor impairments in ASD are distinct from DCD. However, the etiology of motor impairments is not well understood in either disorder. Clarifying comorbidities in ASD is important to determine different etiopathological phenotyping clusters in ASD and to understand the variety of genetic and environmental factors that contribute to the disorder. Furthermore, this distinction has important therapeutic relevance. Here we explore the current neuroimaging findings in ASD and DCD and discusses possible neural mechanisms that underlie similarities and differences between the disorders.

Action representations in robotics: A taxonomy and systematic classification

Understanding and defining the meaning of “action” is substantial for robotics research. This becomes utterly evident when aiming at equipping autonomous robots with robust manipulation skills for action execution. Unfortunately, to this day we still lack both a clear understanding of the concept of an action and a set of established criteria that ultimately characterize an action. In this survey, we thus first review existing ideas and theories on the notion and meaning of action. Subsequently, we discuss the role of action in robotics and attempt to give a seminal definition of action in accordance with its use in robotics research. Given this definition we then introduce a taxonomy for categorizing action representations in robotics along various dimensions. Finally, we provide a meticulous literature survey on action representations in robotics where we categorize relevant literature along our taxonomy. After discussing the current state of the art we conclude with an outlook towards promising research directions.

How face blurring affects body language processing of static gestures in women and men

The role of facial coding in body language comprehension was investigated by event-related potential recordings in 31 participants viewing 800 photographs of gestures (iconic, deictic and emblematic), which could be congruent or incongruent with their caption. Facial information was obscured by blurring in half of the stimuli. The task consisted of evaluating picture/caption congruence. Quicker response times were observed in women than in men to congruent stimuli, and a cost for incongruent vs congruent stimuli was found only in men. Face obscuration did not affect accuracy in women as reflected by omission percentages, nor reduced their cognitive potentials, thus suggesting a better comprehension of face deprived pantomimes. N170 response (modulated by congruity and face presence) peaked later in men than in women. Late positivity was much larger for congruent stimuli in the female brain, regardless of face blurring. Face presence specifically activated the right superior temporal and fusiform gyri, cingulate cortex and insula, according to source reconstruction. These regions have been reported to be insufficiently activated in face-avoiding individuals with social deficits. Overall, the results corroborate the hypothesis that females might be more resistant to the lack of facial information or better at understanding body language in face-deprived social information.

Parieto-frontal mechanisms underlying observation of complex hand-object manipulation

The observation of actions performed by others is believed to activate the Action Observation Network (AON). Previous evidence suggests that subjects with a specific motor skill show increased activation of the AON during observation of the same skill. The question arises regarding which modulation of the AON occurs during observation of novel complex manipulative actions that are beyond the personal motor repertoire. To address this issue, we carried out a functional MRI study in which healthy volunteers without specific hand motor skills observed videos displaying hand-object manipulation executed by an expert with high manual dexterity, by an actor with intermediate ability or by a naïve subject. The results showed that the observation of actions performed by a naïve model produced stronger activation in a dorso-medial parieto-premotor circuit including the superior parietal lobule and dorsal premotor cortex, compared to observation of an expert actor. Functional connectivity analysis comparing the observation of the naïve model with that of the expert model, revealed increased connectivity between dorsal areas of the AON. This suggests a possible distinction between ventral and dorsal brain circuits involved in the processing of different aspects of action perception, such as kinematics and final action goal.

Multiple-command single-frequency SSVEP-based BCI system using flickering action video

BACKGROUND

The number of commands in a brain-computer interface (BCI) system is important. This study proposes a new BCI technique to increase the number of commands in a single BCI system without loss of accuracy.

NEW METHOD

We expected that a flickering action video with left and right elbow movements could simultaneously activate the different pattern of event-related desynchronization (ERD) according to the video contents (e.g., left or right) and steady-state visually evoked potential (SSVEP). The classification accuracy to discriminate left, right, and rest states was compared under the three following feature combinations: SSVEP power (19-21 Hz), Mu power (8-13 Hz), and simultaneous SSVEP and Mu power.

RESULTS

The SSVEP feature could discriminate the stimulus condition, regardless of left or right, from the rest condition, while the Mu feature discriminated left or right, but was relatively poor in discriminating stimulus from rest. However, combining the SSVEP and Mu features, which were evoked by the stimulus with a single frequency, showed superior performance for discriminating all the stimuli among rest, left, or right.

COMPARISON WITH THE EXISTING METHOD

The video contents could activate the ERD differently, and the flickering component increased its accuracy, such that it revealed a better performance to discriminate when considering together.

CONCLUSIONS

This paradigm showed possibility of increasing performance in terms of accuracy and number of commands with a single frequency by applying flickering action video paradigm and applicability to rehabilitation systems used by patients to facilitate their mirror neuron systems while training.

Parietal Activation Associated With Target-Directed Right Hand Movement Is Lateralized by Mirror Feedback to the Ipsilateral Hemisphere

Current research shows promise in restoring impaired hand function after stroke with the help of Mirror Visual Feedback (MVF), putatively by facilitating activation of sensorimotor areas of the brain ipsilateral to the moving limb. However, the MVF related clinical effects show variability across studies. MVF tasks that have been used place varying amounts of visuomotor demand on one’s ability to complete the task. Therefore, we ask here whether varying visuomotor demand during MVF may translate to differences in brain activation patterns. If so, we argue that this may provide a mechanistic explanation for variable clinical effects. To address this, we used functional magnetic resonance imaging (fMRI) to investigate the interaction of target directed movement and MVF on the activation of, and functional connectivity between, regions within the visuomotor network. In an event-related fMRI design, twenty healthy subjects performed finger flexion movements using their dominant right hand, with feedback presented in a virtual reality (VR) environment. Visual feedback was presented in real time VR as either veridical feedback with and without a target (VT+ and VT-, respectively), or MVF with and without a target (MT+ and MT-, respectively). fMRI contrasts revealed predominantly activation in the ipsilateral intraparietal sulcus for the main effect of MVF and bilateral superior parietal activation for the main effect of target. Importantly, we noted significant and robust activation lateralized to the ipsilateral parietal cortex alone in the MT+ contrast with respect to the other conditions. This suggests that combining MVF with targeted movements performed using the right hand may redirect enhanced bilateral parietal activation due to target presentation to the ipsilateral cortex. Moreover, functional connectivity analysis revealed that the interaction between the ipsilateral parietal lobe and the motor cortex was significantly greater during target-directed movements with mirror feedback compared to veridical feedback. These findings provide a normative basis to investigate the integrity of these networks in patient populations. Identification of the brain regions involved in target directed movement with MVF in stroke may have important implications for optimal delivery of MVF based therapy.

Decoding Brain States for Planning Functional Grasps of Tools: A Functional Magnetic Resonance Imaging Multivoxel Pattern Analysis Study

OBJECTIVES

We used multivoxel pattern analysis (MVPA) to investigate neural selectivity for grasp planning within the left-lateralized temporo-parieto-frontal network of areas (praxis representation network, PRN) typically associated with tool-related actions, as studied with traditional neuroimaging contrasts.

METHODS

We used data from 20 participants whose task was to plan functional grasps of tools, with either right or left hands. Region of interest and whole-brain searchlight analyses were performed to show task-related neural patterns.

RESULTS

MVPA revealed significant contributions to functional grasp planning from the anterior intraparietal sulcus (aIPS) and its immediate vicinities, supplemented by inputs from posterior subdivisions of IPS, and the ventral lateral occipital complex (vLOC). Moreover, greater local selectivity was demonstrated in areas near the superior parieto-occipital cortex and dorsal premotor cortex, putatively forming the dorso-dorsal stream.

CONCLUSIONS

A contribution from aIPS, consistent with its role in prospective grasp formation and/or encoding of relevant tool properties (e.g., potential graspable parts), is likely to accompany the retrieval of manipulation and/or mechanical knowledge subserved by the supramarginal gyrus for achieving action goals. An involvement of vLOC indicates that MVPA is particularly sensitive to coding of object properties, their identities and even functions, for a support of grip formation. Finally, the engagement of the superior parieto-frontal regions as revealed by MVPA is consistent with their selectivity for transient features of tools (i.e., variable affordances) for anticipatory hand postures. These outcomes support the notion that, compared to traditional approaches, MVPA can reveal more fine-grained patterns of neural activity. (JINS, 2018, 24, 1013-1025).

A Brain-Computer Interface-Based Action Observation Game That Enhances Mu Suppression

Action observation training based on the theory of activation of the mirror-neuron system has been used for the rehabilitation of patients with stroke. In this paper, we sought to assess whether a brain-computer interface (BCI)-based action observation rehabilitation game, using a flickering action video, could preferentially activate the mirror-neuron system. Feedback of stimulus observation, evoked by the flickering action video, was provided using steady state visually evoked potential and event-related desynchronization. Fifteen healthy subjects have experienced the game with BCI interaction (game and interaction), without BCI interaction (game without interaction), observed non-flickering stimuli, and flickering stimuli without the game background (stimuli only) in a counter-balanced order. The game and interface condition was resulted in significantly stronger activation of the mirror-neuron system than did the other three conditions. In addition, the amount of mirror-neuron system activation is gradually decreased in the game without interface, non-flickering stimuli, and stimuli only conditions in a time-dependent manner; however, in the game and interface condition, the amount of mirror-neuron system activation was maintained until the end of the training. Taken together, these data suggest that the proposed game paradigm, which integrates the action observation paradigm with BCI technology, could provide interactive responses for whether watching video clips can engage patients and enhance rehabilitation.

Distinct sensitivities of the lateral prefrontal cortex and extrastriate body area to contingency between executed and observed actions

Detecting relationships between our own actions and the subsequent actions of others is critical for our social behavior. Self-actions differ from those of others in terms of action kinematics, body identity, and feedback timing. Thus, the detection of social contingency between self-actions and those of others requires comparison and integration of these three dimensions. Neuroimaging studies have highlighted the role of the frontotemporal network in action representation, but the role of each node and their relationships are still controversial. Here, we conducted a functional MRI experiment to test the hypothesis that the lateral prefrontal cortex and lateral occipito-temporal cortex are critical for the integration processes for social contingency. Twenty-four adults performed right finger gestures and then observed them as feedback. We manipulated three parameters of visual feedback: action kinematics (same or different gestures), body identity (self or other), and feedback timing (simultaneous or delayed). Three-way interactions of these factors were observed in the left inferior and middle frontal gyrus (IFG/MFG). These areas were active when self-actions were directly fed back in real-time (i.e., the condition causing a sense of agency), and when participants observed gestures performed by others after a short delay (i.e., the condition causing social contingency). In contrast, the left extrastriate body area (EBA) was sensitive to the concordance of action kinematics regardless of body identity or feedback timing. Body identity × feedback timing interactions were observed in regions including the superior parietal lobule (SPL). An effective connectivity analysis supported the model wherein experimental parameters modulated connections from the occipital cortex to the IFG/MFG via the EBA and SPL. These results suggest that both social contingency and the sense of agency are achieved by hierarchical processing that begins with simple concordance coding in the left EBA, leading to the complex coding of social relevance in the left IFG/MFG.

Adaptation aftereffects reveal representations for encoding of contingent social actions

A hallmark of human social behavior is the effortless ability to relate one's own actions to that of the interaction partner, e.g., when stretching out one's arms to catch a tripping child. What are the behavioral properties of the neural substrates that support this indispensable human skill? Here we examined the processes underlying the ability to relate actions to each other, namely the recognition of spatiotemporal contingencies between actions (e.g., a "giving" that is followed by a "taking"). We used a behavioral adaptation paradigm to examine the response properties of perceptual mechanisms at a behavioral level. In contrast to the common view that action-sensitive units are primarily selective for one action (i.e., primary action, e.g., 'throwing"), we demonstrate that these processes also exhibit sensitivity to a matching contingent action (e.g., "catching"). Control experiments demonstrate that the sensitivity of action recognition processes to contingent actions cannot be explained by lower-level visual features or amodal semantic adaptation. Moreover, we show that action recognition processes are sensitive only to contingent actions, but not to noncontingent actions, demonstrating their selective sensitivity to contingent actions. Our findings show the selective coding mechanism for action contingencies by action-sensitive processes and demonstrate how the representations of individual actions in social interactions can be linked in a unified representation.

Action Observation Areas Represent Intentions From Subtle Kinematic Features

Mirror neurons have been proposed to underlie humans' ability to understand others' actions and intentions. Despite 2 decades of research, however, the exact computational and neuronal mechanisms implied in this ability remain unclear. In the current study, we investigated whether, in the absence of contextual cues, regions considered to be part of the human mirror neuron system represent intention from movement kinematics. A total of 21 participants observed reach-to-grasp movements, performed with either the intention to drink or to pour while undergoing functional magnetic resonance imaging. Multivoxel pattern analysis revealed successful decoding of intentions from distributed patterns of activity in a network of structures comprising the inferior parietal lobule, the superior parietal lobule, the inferior frontal gyrus, and the middle frontal gyrus. Consistent with the proposal that parietal regions play a key role in intention understanding, classifier weights were higher in the inferior parietal region. These results provide the first demonstration that putative mirror neuron regions represent subtle differences in movement kinematics to read the intention of an observed motor act.

MEG adaptation reveals action representations in posterior occipitotemporal regions

When we observe other people's actions, a number of parietal and precentral regions known to be involved in the planning and execution of actions are recruited for example seen as power decreases in alpha and beta frequencies indicative of increased activation. It has been argued that this recruitment reflects the process of simulating the observed action, thereby providing access to the meaning of the action. Alternatively, it has been suggested that rather than providing access to the meaning of an action, parietal and precentral regions might be recruited as a consequence of action understanding. A way to distinguish between these alternatives is to examine where in the brain and at which time point it is possible to discriminate between different types of actions (e.g., pointing or grasping) irrespective of the way these are performed. To this aim, we presented participants with videos of simple hand actions performed with the left or right hand towards a target on the left or the right side while recording magnetoencephalography (MEG) data. In each trial, participants were presented with two subsequent videos (S1, S2) depicting either the same (repeat trials) or different (non-repeat trials) actions. We predicted that areas that are sensitive to the type of action should show stronger adaptation (i.e., a smaller decrease in alpha and beta power) in repeat in comparison to non-repeat trials. Indeed, we observed less alpha and beta power decreases during the presentation of S2 when the action was repeated compared to when two different actions were presented indicating adaptation of neuronal populations that are selective for the type of action. Sources were obtained exclusively in posterior occipitotemporal regions, supporting the notion that an early differentiation of actions occurs outside the motor system.

Mirror neurons and intention understanding: Dissociating the contribution of object type and intention to mirror responses using electromyography

Since their discovery in the monkey and human brain, mirror neurons have been claimed to play a key role in understanding others' intentions. For example, "action-constrained" mirror neurons in inferior parietal lobule fire when the monkey observes a grasping movement that is followed by an eating action, but not when it is followed by a placing action. It is claimed these responses enable the monkey to predict the intentions of the actor. These findings have been replicated in human observers by recording electromyography responses of the mouth-opening mylohyoid muscle during action observation. Mylohyoid muscle activity was greater during the observation of actions performed with the intention to eat than of actions performed with the intention to place, again suggesting an ability to predict the actor's intentions. However, in previous studies, intention was confounded with object type (food for eating actions, nonfood for placing actions). We therefore used electromyography to measure mylohyoid activity in participants observing eating and placing actions. Unlike previous studies, we used a design in which each object (food, nonfood) could be both eaten and placed, and thus participants could not predict the actor's intention at the onset of the action. Greater mylohyoid activity was found for the observation of actions performed on food objects, irrespective of intention, indicating that the object type, not the actor's intention, drives the mirror response. This result suggests that observers' motor responses during action observation reflect the presence of a particular object, rather than the actor's underlying intentions.

Object words modulate the activity of the mirror neuron system during action imitation

BACKGROUND

Although research has demonstrated that the mirror neuron system (MNS) plays a crucial role in both action imitation and action-related semantic processing, whether action-related words can inversely modulate the MNS activity remains unclear.

METHODS

Here, three types of task-irrelevant words (body parts, verbs, and manufactured objects) were presented to examine the modulation effect of these words on the MNS activity during action observation and imitation. Twenty-two participants were recruited for the fMRI scanning and remaining data from 19 subjects were reported here.

RESULTS

Brain activity results showed that word types elicited different modulation effects over nodes of the MNS (i.e., the right inferior frontal gyrus, premotor cortex, inferior parietal lobule, and STS), especially during the imitation stage. Compared with other word conditions, action imitation following manufactured objects words induced stronger activation in these brain regions during the imitation stage. These results were consistent in both task-dependent and -independent ROI analysis.

CONCLUSION

Our findings thus provide evidence for the unique effect of object words on the MNS during imitation of action, which may also confirm the key role of goal inference in action imitation.