The Sound of Actions in Apraxia

Sensitivity and specificity of the action observation network to kinematics, target object, and gesture meaning

Hierarchical models have been proposed to explain how the brain encodes actions, whereby different areas represent different features, such as gesture kinematics, target object, action goal, and meaning. The visual processing of action-related information is distributed over a well-known network of brain regions spanning separate anatomical areas, attuned to specific stimulus properties, and referred to as action observation network (AON). To determine the brain organization of these features, we measured representational geometries during the observation of a large set of transitive and intransitive gestures in two independent functional magnetic resonance imaging experiments. We provided evidence for a partial dissociation between kinematics, object characteristics, and action meaning in the occipito-parietal, ventro-temporal, and lateral occipito-temporal cortex, respectively. Importantly, most of the AON showed low specificity to all the explored features, and representational spaces sharing similar information content were spread across the cortex without being anatomically adjacent. Overall, our results support the notion that the AON relies on overlapping and distributed coding and may act as a unique representational space instead of mapping features in a modular and segregated manner.

The neural correlates of limb apraxia: An anatomical likelihood estimation meta-analysis of lesion-symptom mapping studies in brain-damaged patients

Limb apraxia is a motor disorder frequently observed following a stroke. Apraxic deficits are classically assessed with four tasks: tool use, pantomime of tool use, imitation, and gesture understanding. These tasks are supported by several cognitive processes represented in a left-lateralized brain network including inferior frontal gyrus, inferior parietal lobe (IPL), and lateral occipito-temporal cortex (LOTC). For the past twenty years, voxel-wise lesion symptom mapping (VLSM) studies have been used to unravel the neural correlates associated with apraxia, but none of them has proposed a comprehensive view of the topic. In the present work, we proposed to fill this gap by performing a systematic Anatomic Likelihood Estimation meta-analysis of VLSM studies which included tasks traditionally used to assess apraxia. We found that the IPL was crucial for all the tasks. Moreover, lesions within the LOTC were more associated with imitation deficits than tool use or pantomime, confirming its important role in higher visual processing. Our results questioned traditional neurocognitive models on apraxia and may have important clinical implications.

Language and gesture neural correlates: A meta-analysis of functional magnetic resonance imaging studies

BACKGROUND

Humans often use co-speech gestures to promote effective communication. Attention has been paid to the cortical areas engaged in the processing of co-speech gestures.

AIMS

To investigate the neural network underpinned in the processing of co-speech gestures and to observe whether there is a relationship between areas involved in language and gesture processing.

METHODS & PROCEDURES

We planned to include studies with neurotypical and/or stroke participants who underwent a bimodal task (i.e., processing of co-speech gestures with relative speech) and a unimodal task (i.e., speech or gesture alone) during a functional magnetic resonance imaging (fMRI) session. After a database search, abstract and full-text screening were conducted. Qualitative and quantitative data were extracted, and a meta-analysis was performed with the software GingerALE 3.0.2, performing contrast analyses of uni- and bimodal tasks.

MAIN CONTRIBUTION

The database search produced 1024 records. After the screening process, 27 studies were included in the review. Data from 15 studies were quantitatively analysed through meta-analysis. Meta-analysis found three clusters with a significant activation of the left middle frontal gyrus and inferior frontal gyrus, and bilateral middle occipital gyrus and inferior temporal gyrus.

CONCLUSIONS

There is a close link at the neural level for the semantic processing of auditory and visual information during communication. These findings encourage the integration of the use of co-speech gestures during aphasia treatment as a strategy to foster the possibility to communicate effectively for people with aphasia.

WHAT THIS PAPER ADDS

What is already known on this subject Gestures are an integral part of human communication, and they may have a relationship at neural level with speech processing. What this paper adds to the existing knowledge During processing of bi- and unimodal communication, areas related to semantic processing and multimodal processing are activated, suggesting that there is a close link between co-speech gestures and spoken language at a neural level. What are the potential or actual clinical implications of this work? Knowledge of the functions related to gesture and speech processing neural networks will allow for the adoption of model-based neurorehabilitation programs to foster recovery from aphasia by strengthening the specific functions of these brain networks.

Predicting and coding sound into action translation in spinal cord injured people

Motor activation in response to perception of action-related stimuli may depend on a resonance mechanism subserving action understanding. The extent to which this mechanism is innate or learned from sensorimotor experience is still unclear. Here, we recorded EEG while people with paraplegia or tetraplegia consequent to spinal cord injury (SCI) and healthy control participants were presented with action sounds produced by body parts (mouth, hands or feet) that were or were not affected by SCI. Non-action sounds were used as further control. We observed reduced brain activation in subjects affected by SCI at both pre- and post-stimulus latencies specifically for those actions whose effector was disconnected by the spinal lesion (i.e., hand sound for tetraplegia and leg sound for both paraplegia and tetraplegia). Correlation analyses showed that these modulations were functionally linked with the chronicity of the lesion, indicating that the longer the time the lesion- EEG data acquisition interval and/or the more the lesion occurred at a young age, the weaker was the cortical activity in response to these action sounds. Tellingly, source estimations confirmed that these modulations originated from a deficit in the motor resonance mechanism, by showing diminished activity in premotor (during prediction and perception) and near the primary motor (during perception) areas. Such dissociation along the cortical hierarchy is consistent with both previous reports in healthy subjects and with hierarchical predictive coding accounts. Overall, these data expand on the notion that sensorimotor experience maintains the cortical representations relevant to anticipate and perceive action-related stimuli.

Effector-specific motor simulation supplements core action recognition processes in adverse conditions

Observing other people acting activates imitative motor plans in the observer. Whether, and if so when and how, such 'effector-specific motor simulation' contributes to action recognition remains unclear. We report that individuals born without upper limbs (IDs)-who cannot covertly imitate upper-limb movements-are significantly less accurate at recognizing degraded (but not intact) upper-limb than lower-limb actions (i.e. point-light animations). This finding emphasizes the need to reframe the current controversy regarding the role of effector-specific motor simulation in action recognition: instead of focusing on the dichotomy between motor and non-motor theories, the field would benefit from new hypotheses specifying when and how effector-specific motor simulation may supplement core action recognition processes to accommodate the full variety of action stimuli that humans can recognize.

Electrophysiological correlates of action monitoring in brain-damaged patients: A systematic review

Action monitoring is crucial to the successful execution of an action and understanding the actions of others. It is often impaired due to brain lesions, in particular after stroke. This systematic review aims to map the literature on the neurophysiological correlates of action monitoring in patients with brain lesions. Eighteen studies were identified and divided into two groups: studies on monitoring of one's own actions and studies on monitoring of the actions of others. The first group included EEG studies on monitoring of self-performed erroneous and correct actions. Impaired error detection (decreased error-related negativity) was observed in patients with lesions in the performance-monitoring network, as compared to healthy controls. Less consistent results were shown for error positivity and behavioral error monitoring performance. The second group of studies on monitoring of others' actions reported decreased mu frequency suppression, impaired readiness potential in the affected hemisphere and decreased EEG indices of error observation (observed error positivity and theta power) in stroke patients. As a whole, these results indicate distinct patterns of impaired neurophysiological activity related to monitoring one's own versus others' actions in patients with brain lesions. EEG recordings of this dissociation in the same patients might be a useful index of motor recovery, and therefore, potentially also beneficial in rehabilitation protocols.

What the study of spinal cord injured patients can tell us about the significance of the body in cognition

Although in the last three decades philosophers, psychologists and neuroscientists have produced numerous studies on human cognition, the debate concerning its nature is still heated and current views on the subject are somewhat antithetical. On the one hand, there are those who adhere to a view implying 'disembodiment' which suggests that cognition is based entirely on symbolic processes. On the other hand, a family of theories referred to as the Embodied Cognition Theories (ECT) postulate that creating and maintaining cognition is linked with varying degrees of inherence to somatosensory and motor representations. Spinal cord injury induces a massive body-brain disconnection with the loss of sensory and motor bodily functions below the lesion level but without directly affecting the brain. Thus, SCI may represent an optimal model for testing the role of the body in cognition. In this review, we describe post-lesional cognitive modifications in relation to body, space and action representations and various instances of ECT. We discuss the interaction between body-grounded and symbolic processes in adulthood with relevant modifications after body-brain disconnection.

Brain Dynamics of Action Monitoring in Higher-Order Motor Control Disorders: The Case of Apraxia

Limb apraxia (LA) refers to a high-order motor disorder characterized by the inability to reproduce transitive actions on commands or after observation. Studies demonstrate that action observation and action execution activate the same networks in the human brain, and provides an onlooker’s motor system with appropriate cognitive, motor and sensory-motor cues to flexibly implementing action-sequences and gestures. Tellingly, the temporal dynamics of action monitoring has never been explored in people suffering from LA. To fill this gap, we studied the electro-cortical signatures of error observation in human participants suffering from acquired left-brain lesions with (LA+) and without (LA–) LA, and in a group of healthy controls (H). EEG was acquired while participants observed from a first-person perspective (1PP) an avatar performing correct or incorrect reach-to-grasp a glass action in an immersive-virtual environment. Alterations of typical EEG signatures of error observation in time (early error positivity; Pe) and time-frequency domain (theta band-power) were found reduced in LA+ compared with H. Connectivity analyses showed that LA+ exhibited a decreased theta phase synchronization of both the frontoparietal and frontofrontal network, compared with H and LA–. Moreover, linear regression analysis revealed that the severity of LA [test of upper LA (TULIA) scores] was predicted by mid-frontal error-related theta activity, suggesting a link between error monitoring capacity and apraxic phenotypes. These results provide novel neurophysiological evidence of altered neurophysiological dynamics of action monitoring in individuals with LA and shed light on the performance monitoring changes occurring in this disorder.

What tool representation, intuitive physics, and action have in common: The brain's first-person physics engine

An overlapping set of brain regions in parietal and frontal cortex are engaged by different types of tasks and stimuli: (i) making inferences about the physical structure and dynamics of the world, (ii) passively viewing, or actively interacting with, manipulable objects, and (iii) planning and execution of reaching and grasping actions. We suggest the observed neural overlap is because a common superordinate computation is engaged by each of those different tasks: A forward model of physical reasoning about how first-person actions will affect the world and be affected by unfolding physical events. This perspective offers an account of why some physical predictions are systematically incorrect - there can be a mismatch between how physical scenarios are experimentally framed and the native format of the inferences generated by the brain's first-person physics engine. This perspective generates new empirical expectations about the conditions under which physical reasoning may exhibit systematic biases.

Does embodied cognition allow a better management of neurological diseases? A review on the link between cognitive language processing and motor function

Embodied cognition (EC) refers to the interplay occurring in thinking among individual's sensorimotor capacities (i.e., the ability of the body to respond to its senses with movement), the body itself, and the environment. The aim of the present narrative review is to provide an overall understanding of whether and how motor training could lead to language recovery, consistently with EC theories (action-perception cycle, mirror neuron systems -MNS-, and embodied semantics). We therefore reviewed the works dealing with EC in terms of the link between language processing, mirror neuron system (MNS), and motor function, evaluating the potential clinical implications for better managing neurological deficits. Connections between body and mind were found, as body states influence cognitive functions, such as perception and reasoning, as well as language processing, especially in neurological disorders. In fact, abnormalities in "embodied language" were found in movement disorders and neurodegenerative diseases, negatively affecting patients' rehabilitation outcomes. Understanding the link between language processing and motor outcomes is fundamental in the rehabilitation field, given that EC can be targeted to improve patients' functional recovery and quality of life.

Towards Strong Inference in Research on Embodiment - Possibilities and Limitations of Causal Paradigms

A central question in the cognitive sciences is which role embodiment plays for high-level cognitive functions, such as conceptual processing. Here, we propose that one reason why progress regarding this question has been slow is a lacking focus on what Platt (1964) called “strong inference”. Strong inference is possible when results from an experimental paradigm are not merely consistent with a hypothesis, but they provide decisive evidence for one particular hypothesis compared to competing hypotheses. We discuss how causal paradigms, which test the functional relevance of sensory-motor processes for high-level cognitive functions, can move the field forward. In particular, we explore how congenital sensory-motor disorders, acquired sensory-motor deficits, and interference paradigms with healthy participants can be utilized as an opportunity to better understand the role of sensory experience in conceptual processing. Whereas all three approaches can bring about valuable insights, we highlight that the study of congenitally and acquired sensorimotor disorders is particularly effective in the case of conceptual domains with strong unimodal basis (e.g., colors), whereas interference paradigms with healthy participants have a broader application, avoid many of the practical and interpretational limitations of patient studies, and allow a systematic and step-wise progressive inference approach to causal mechanisms.

Anosognosia for limb and bucco-facial apraxia as inferred from the recognition of gestural errors

Anosognosia is a multifaceted syndrome characterized by a lack of awareness of motor, cognitive, or emotional deficits. While most studies have focused on basic motor disorders such as hemiplegia, only recently, the issue of whether anosognosia also concerns higher-order motor disorders like apraxia has been addressed. Here, we explore the existence of a specific form of anosognosia for apraxia in forty patients with uni-hemispheric vascular lesions. The patients were requested to imitate actions involving upper limb or bucco-facial body parts and then judge their performance. Successively, they were also asked to observe video recordings of the same actions performed by themselves or by other patients and judge the accuracy of the displayed actions. The comparison of participants versus examiner judgement and between error recognition of others' versus self's actions was considered as an index of awareness deficit for the online and offline conditions, respectively. Evidence was found that awareness deficits occurred both immediately after action execution (online anosognosia) and in the video recording task (offline anosognosia). Moreover, bucco-facial and limb apraxic patients were specifically unaware of their errors in bucco-facial and limb actions, respectively, indicating for the first time a topographical organization of the syndrome. Our approach allowed us to distinguish awareness deficits from more general disorders in error recognition; indeed, anosognosic patients were able to identify errors when the same action was executed by another patient but not when the video showed their own actions. Finally, we provide evidence that anosognosia for apraxia might be associated with frontal cortical and subcortical networks.

The Influence of Auditory Cues on Bodily and Movement Perception

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues provide a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar cross-modal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior.

Action Observation for Neurorehabilitation in Apraxia

Neurorehabilitation and brain stimulation studies of post-stroke patients suggest that action-observation effects can lead to rapid improvements in the recovery of motor functions and long-term motor cortical reorganization. Apraxia is a clinically important disorder characterized by marked impairment in representing and performing skillful movements [gestures], which limits many daily activities and impedes independent functioning. Recent clinical research has revealed errors of visuo-motor integration in patients with apraxia. This paper presents a rehabilitative perspective focusing on the possibility of action observation as a therapeutic treatment for patients with apraxia. This perspective also outlines impacts on neurorehabilitation and brain repair following the reinforcement of the perceptual-motor coupling. To date, interventions based primarily on action observation in apraxia have not been undertaken.

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson's disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.

Embodying functionally relevant action sounds in patients with spinal cord injury

Growing evidence indicates that perceptual-motor codes may be associated with and influenced by actual bodily states. Following a spinal cord injury (SCI), for example, individuals exhibit reduced visual sensitivity to biological motion. However, a dearth of direct evidence exists about whether profound alterations in sensorimotor traffic between the body and brain influence audio-motor representations. We tested 20 wheelchair-bound individuals with lower skeletal-level SCI who were unable to feel and move their lower limbs, but have retained upper limb function. In a two-choice, matching-to-sample auditory discrimination task, the participants were asked to determine which of two action sounds matched a sample action sound presented previously. We tested aural discrimination ability using sounds that arose from wheelchair, upper limb, lower limb, and animal actions. Our results indicate that an inability to move the lower limbs did not lead to impairment in the discrimination of lower limb-related action sounds in SCI patients. Importantly, patients with SCI discriminated wheelchair sounds more quickly than individuals with comparable auditory experience (i.e. physical therapists) and inexperienced, able-bodied subjects. Audio-motor associations appear to be modified and enhanced to incorporate external salient tools that now represent extensions of their body schemas.

Distortion of Visuo-Motor Temporal Integration in Apraxia: Evidence From Delayed Visual Feedback Detection Tasks and Voxel-Based Lesion-Symptom Mapping

Limb apraxia is a higher brain dysfunction that typically occurs after left hemispheric stroke and its cause cannot be explained by sensory disturbance or motor paralysis. The comparison of motor signals and visual feedback to generate errors, i.e., visuo-motor integration, is important in motor control and motor learning, which may be impaired in apraxia. However, in apraxia after stroke, it is unknown whether there is a specific deficit in visuo-motor temporal integration compared to visuo-tactile and visuo-proprioceptive temporal integration. We examined the precision of visuo-motor temporal integration and sensory-sensory (visuo-tactile and visuo-proprioception) temporal integration in apraxia after stroke by using a delayed visual feedback detection task with three different conditions (tactile, passive movement, and active movement). The delay detection threshold and the probability curve for delay detection obtained in this task were quantitative indicators of the respective temporal integration functions. In addition, we performed subtraction and voxel-based lesion-symptom mapping to identify the brain lesions responsible for apraxia and deficits in visuo-motor temporal integration. The behavioral experiments showed that the delay detection threshold was extended and that the probability curve for delay detection was less steep in apraxic patients compared to controls (pseudo-apraxic patients and unaffected patients), only for the active movement condition, and not for the tactile and passive movement conditions. Furthermore, the severity of apraxia was significantly correlated with the delay detection threshold and the steepness of the probability curve in the active movement condition. These results indicated that multisensory (i.e., visual, tactile, and proprioception) feedback was normally temporally integrated, but motor prediction and visual feedback were not correctly temporally integrated in apraxic patients. That is, apraxic patients had difficulties with visuo-motor temporal integration. Lesion analyses revealed that both apraxia and the distortion of visuo-motor temporal integration were associated with lesions in the fronto-parietal motor network, including the left inferior parietal lobule and left inferior frontal gyrus. We suppose that damage to the left inferior fronto-parietal network could cause deficits in motor prediction for visuo-motor temporal integration, but not for sensory-sensory (visuo-tactile and visuo-proprioception) temporal integration, leading to the distortion of visuo-motor temporal integration in patients with apraxia.

Sensorimotor Network Crucial for Inferring Amusement from Smiles

Understanding whether another's smile reflects authentic amusement is a key challenge in social life, yet, the neural bases of this ability have been largely unexplored. Here, we combined transcranial magnetic stimulation (TMS) with a novel empathic accuracy (EA) task to test whether sensorimotor and mentalizing networks are critical for understanding another's amusement. Participants were presented with dynamic displays of smiles and explicitly requested to infer whether the smiling individual was feeling authentic amusement or not. TMS over sensorimotor regions representing the face (i.e., in the inferior frontal gyrus (IFG) and ventral primary somatosensory cortex (SI)), disrupted the ability to infer amusement authenticity from observed smiles. The same stimulation did not affect performance on a nonsocial task requiring participants to track the smiling expression but not to infer amusement. Neither TMS over prefrontal and temporo-parietal areas supporting mentalizing, nor peripheral control stimulations, affected performance on either task. Thus, motor and somatosensory circuits for controlling and sensing facial movements are causally essential for inferring amusement from another's smile. These findings highlight the functional relevance of IFG and SI to amusement understanding and suggest that EA abilities may be grounded in sensorimotor networks for moving and feeling the body.

Come together: human-avatar on-line interactions boost joint-action performance in apraxic patients

Limb apraxia (LA) is a high-order motor disorder linked to left-hemisphere damage. It is characterized by defective execution of purposeful actions upon delayed imitation, or verbal command when the actions are performed in isolated, non-naturalistic, conditions. Whether interpersonal interactions provide social affordances that activate neural resources different from those requested by individual action execution, which may improve LA performance, is unknown. To fill this gap, we measured interaction performance, behavioral and kinematic indexes of left-brain damaged patients with/without LA in a social reach-to-grasp task involving two different degrees of spatio-temporal interactivity with an avatar. We found that LA patients' impairment in coordinating with the virtual partner was abolished in highly interactive conditions (where patients selected their actions on-line based on the behavior of the virtual partner) with respect to low interactive conditions (where actions were selected beforehand based on abstract instructions). Voxel-based-Lesion-Symptom-Mapping indicated that impairments in low-interactive conditions were underpinned by lesions of premotor, motor and insular areas, and of the basal ganglia. Our approach expands current understanding of the behavioral and neural correlates of interactive motor performance by highlighting the important role of social affordances, and provides novel, potentially important, views on rehabilitation of higher-order motor cognition disorders.

Mirror and (absence of) counter-mirror responses to action sounds measured with TMS

To what extent is the mirror neuron mechanism malleable to experience? The answer to this question can help characterising its ontogeny and its role in social cognition. Some suggest that it develops through sensorimotor associations congruent with our own actions. Others argue for its extreme volatility that will encode any sensorimotor association in the environment. Here, we added to this debate by exploring the effects of short goal-directed 'mirror' and 'counter-mirror' trainings (a 'mirror' training is defined as the first type of training encountered by the participants) on human auditory mirror motor-evoked potentials (MEPs). We recorded MEPs in response to two tones void of previous motor meaning, before and after mirror and counter-mirror trainings in which participants generated two tones of different pitch by performing free-choice button presses. The results showed that mirror MEPs, once established, were protected against an equivalent counter-mirror experience: they became manifest very rapidly and the same number of training trials that lead to the initial association did not suffice to reverse the MEP pattern. This steadiness of the association argues that, by serving direct-matching purposes, the mirror mechanism is a good solution for social cognition.

From goals to muscles: motor familiarity shapes the representation of action-related sounds in the human motor system

Numerous studies corroborated the idea that the sound of familiar motor acts triggers a muscle-specific replica of the perceived actions in the listener's brain. We recently contradicted this conclusion by demonstrating that the representation of newly-learned action-related sounds is not somatotopically organised but rather it corresponds to the goal a particular action aims to achieve. In the present study, we aimed at reconciling these results. We measured MEPs to TMS as an index of the functional correspondence between the sensory stimulation and the activity in the listener's motor cortex. Participants heard two tones of different pitch, void of previous motor meaning, before and after an acquisition phase in which they generated them by performing 400 free-choice button presses. We then disentangled the representation of the action goal (button-tone association) from the somatotopic (muscle-tone) association by reversing the muscle-button contingencies. Our result supports the hypothesis that the neuronal representations of action-related sounds depends on motor familiarity: perceptuomotor representations of newly-learned actions are muscle-independent and correspond to the button-tone contingencies, whilst longer-term practice results in representations that rely on lower-level intrinsic parameters associated with the kinematics of specific movements.

Unawareness for Motor Impairment and Distorted Perception of Task Difficulty

OBJECTIVES

Anosognosia for motor impairment is a complex syndrome that can manifest itself under different forms, guiding patients' behavior and task decisions. However, current diagnostic tools tend to evaluate only more explicit aspects of anosognosia (asking the patients about their motor abilities) and fail to address more subtle features of awareness. We have developed a new assessment measure, the ECT (Errand Choice Test), where patients are asked to judge task difficulty rather than estimate their own impairment.

METHODS

We assessed awareness in a group of 73 unilateral left- and right-brain damaged (30 LBD and 43 RBD, respectively) patients by means of the VATAm, which explicitly requires them to evaluate their own motor abilities, and the ECT. A control group of 65 healthy volunteers was asked to perform the ECT under two conditions: Current condition (i.e., using both hands) and Simulated conditions (i.e., simulating hemiplegia).

RESULTS

A total of 27% of the patients showed different performance on the VATAm and ECT, 21% of the patients showing lack of awareness only on VATAm and 6% only on ECT. Moreover, despite the ECT identified a higher frequency of anosognosia after RBD (33.3%) than LBD (27.6%), this hemispheric asymmetry was not significant. Remarkably, anosognosic patients performed very similarly to controls in the "current condition", suggesting that anosognosic patients' ability to perceive the complexity of each task per se is not altered.

CONCLUSION

Different methods may be able to tackle different aspects of awareness and the ECT proved to be able to detect less evident forms of awareness. (JINS, 2018, 24, 45-56).

Learning, remembering, and predicting how to use tools: Distributed neurocognitive mechanisms: Comment on Osiurak and Badets (2016)

The reasoning-based approach championed by Francois Osiurak and Arnaud Badets (Osiurak & Badets, 2016) denies the existence of sensory-motor memories of tool use except in limited circumstances, and suggests instead that most tool use is subserved solely by online technical reasoning about tool properties. In this commentary, I highlight the strengths and limitations of the reasoning-based approach and review a number of lines of evidence that manipulation knowledge is in fact used in tool action tasks. In addition, I present a "two route" neurocognitive model of tool use called the "Two Action Systems Plus (2AS+)" framework that posits a complementary role for online and stored information and specifies the neurocognitive substrates of task-relevant action selection. This framework, unlike the reasoning based approach, has the potential to integrate the existing psychological and functional neuroanatomic data in the tool use domain. (PsycINFO Database Record

The neuro-cognitive representations of symbols: the case of concrete words

We live our lives surrounded by symbols (e.g., road signs, logos, but especially words and numbers), and throughout our life we use them to evoke, communicate and reflect upon ideas and things that are not currently present to our senses. Symbols are represented in our brains at different levels of complexity: at the first and most simple level, as physical entities, in the corresponding primary and secondary sensory cortices. The crucial property of symbols, however, is that, despite the simplicity of their surface forms, they have the power of evoking higher order multifaceted representations that are implemented in distributed neural networks spanning a large portion of the cortex. The rich internal states that reflect our knowledge of the meaning of symbols are what we call semantic representations. In this review paper, we summarize our current knowledge of both the cognitive and neural substrates of semantic representations, focusing on concrete words (i.e., nouns or verbs referring to concrete objects and actions), which, together with numbers, are the most-studied and well defined classes of symbols. Following a systematic descriptive approach, we will organize this literature review around two key questions: what is the content of semantic representations? And, how are semantic representations implemented in the brain, in terms of localization and dynamics? While highlighting the main current opposing perspectives on these topics, we propose that a fruitful way to make substantial progress in this domain would be to adopt a geometrical view of semantic representations as points in high dimensional space, and to operationally partition the space of concrete word meaning into motor-perceptual and conceptual dimensions. By giving concrete examples of the kinds of research that can be done within this perspective, we illustrate how we believe this framework will foster theoretical speculations as well as empirical research.

Effects of prefrontal cortex damage on emotion understanding: EEG and behavioural evidence

Humans are highly social beings that interact with each other on a daily basis. In these complex interactions, we get along by being able to identify others' actions and infer their intentions, thoughts and feelings. One of the major theories accounting for this critical ability assumes that the understanding of social signals is based on a primordial tendency to simulate observed actions by activating a mirror neuron system. If mirror neuron regions are important for action and emotion recognition, damage to regions in this network should lead to deficits in these domains. In the current behavioural and EEG study, we focused on the lateral prefrontal cortex including dorsal and ventral prefrontal cortex and utilized a series of task paradigms, each measuring a different aspect of recognizing others' actions or emotions from body cues. We examined 17 patients with lesions including (n = 8) or not including (n = 9) the inferior frontal gyrus, a core mirror neuron system region, and compared their performance to matched healthy control subjects (n = 18), in behavioural tasks and in an EEG observation-execution task measuring mu suppression. Our results provide support for the role of the lateral prefrontal cortex in understanding others' emotions, by showing that even unilateral lesions result in deficits in both accuracy and reaction time in tasks involving the recognition of others' emotions. In tasks involving the recognition of actions, patients showed a general increase in reaction time, but not a reduction in accuracy. Deficits in emotion recognition can be seen by either direct damage to the inferior frontal gyrus, or via damage to dorsal lateral prefrontal cortex regions, resulting in deteriorated performance and less EEG mu suppression over sensorimotor cortex.

Divergent Human Cortical Regions for Processing Distinct Acoustic-Semantic Categories of Natural Sounds: Animal Action Sounds vs. Vocalizations

A major gap in our understanding of natural sound processing is knowledge of where or how in a cortical hierarchy differential processing leads to categorical perception at a semantic level. Here, using functional magnetic resonance imaging (fMRI) we sought to determine if and where cortical pathways in humans might diverge for processing action sounds vs. vocalizations as distinct acoustic-semantic categories of real-world sound when matched for duration and intensity. This was tested by using relatively less semantically complex natural sounds produced by non-conspecific animals rather than humans. Our results revealed a striking double-dissociation of activated networks bilaterally. This included a previously well described pathway preferential for processing vocalization signals directed laterally from functionally defined primary auditory cortices to the anterior superior temporal gyri, and a less well-described pathway preferential for processing animal action sounds directed medially to the posterior insulae. We additionally found that some of these regions and associated cortical networks showed parametric sensitivity to high-order quantifiable acoustic signal attributes and/or to perceptual features of the natural stimuli, such as the degree of perceived recognition or intentional understanding. Overall, these results supported a neurobiological theoretical framework for how the mammalian brain may be fundamentally organized to process acoustically and acoustic-semantically distinct categories of ethologically valid, real-world sounds.

The mirror mechanism: a basic principle of brain function

The mirror mechanism is a basic brain mechanism that transforms sensory representations of others' behaviour into one's own motor or visceromotor representations concerning that behaviour. According to its location in the brain, it may fulfil a range of cognitive functions, including action and emotion understanding. In each case, it may enable a route to knowledge of others' behaviour, which mainly depends on one's own motor or visceromotor representations.

Primary Progressive Orofacial Apraxia: A Ten-Year Long Follow-Up Case Report

Orofacial apraxia (OA) as the main symptom in neurodegenerative disorders has not been yet reported. We present the case of a woman with a 22-month long history of isolated OA, studied with cerebrospinal fluid biomarkers and repeated clinical, neuropsychological, and morpho-functional evaluations. Baseline morpho-functional neuroimages revealed a left frontal operculum hypoperfusion with a widespread fronto-temporal involvement at follow-up. Cerebrospinal fluid concentrations of tau and amyloid-β were normal. The ten-year long clinical observation disclosed progressive OA worsening and the late onset of frontal functions impairment and extrapyramidal signs. The early and late stages of a neurodegenerative syndrome with OA as the main clinical feature were characterized.

The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People

The efficient control of our body and successful interaction with the environment are possible through the integration of multisensory information. Brain-computer interface (BCI) may allow people with sensorimotor disorders to actively interact in the world. In this study, visual information was paired with auditory feedback to improve the BCI control of a humanoid surrogate. Healthy and spinal cord injured (SCI) people were asked to embody a humanoid robot and complete a pick-and-place task by means of a visual evoked potentials BCI system. Participants observed the remote environment from the robot's perspective through a head mounted display. Human-footsteps and computer-beep sounds were used as synchronous/asynchronous auditory feedback. Healthy participants achieved better placing accuracy when listening to human footstep sounds relative to a computer-generated sound. SCI people demonstrated more difficulty in steering the robot during asynchronous auditory feedback conditions. Importantly, subjective reports highlighted that the BCI mask overlaying the display did not limit the observation of the scenario and the feeling of being in control of the robot. Overall, the data seem to suggest that sensorimotor-related information may improve the control of external devices. Further studies are required to understand how the contribution of residual sensory channels could improve the reliability of BCI systems.

Arguments about the nature of concepts: Symbols, embodiment, and beyond

How are the meanings of words, events, and objects represented and organized in the brain? This question, perhaps more than any other in the field, probes some of the deepest and most foundational puzzles regarding the structure of the mind and brain. Accordingly, it has spawned a field of inquiry that is diverse and multidisciplinary, has led to the discovery of numerous empirical phenomena, and has spurred the development of a wide range of theoretical positions. This special issue brings together the most recent theoretical developments from the leaders in the field, representing a range of viewpoints on issues of fundamental significance to a theory of meaning representation. Here we introduce the special issue by way of pulling out some key themes that cut across the contributions that form this issue and situating those themes in the broader literature. The core issues around which research on conceptual representation can be organized are representational format, representational content, the organization of concepts in the brain, and the processing dynamics that govern interactions between the conceptual system and sensorimotor representations. We highlight areas in which consensus has formed; for those areas in which opinion is divided, we seek to clarify the relation of theory and evidence and to set in relief the bridging assumptions that undergird current discussions.

Persistent sparing of action conceptual processing in spite of increasing disorders of action production: A case against motor embodiment of action concepts

In this study, we addressed the issue of whether the brain sensorimotor circuitry that controls action production is causally involved in representing and processing action-related concepts. We examined the three-year pattern of evolution of brain atrophy, action production disorders, and action-related concept processing in a patient (J.R.) diagnosed with corticobasal degeneration. During the period of investigation, J.R. presented with increasing action production disorders resulting from increasing bilateral atrophy in cortical and subcortical regions involved in the sensorimotor control of actions (notably, the superior parietal cortex, the primary motor and premotor cortex, the inferior frontal gyrus, and the basal ganglia). In contrast, the patient's performance in processing action-related concepts remained intact during the same period. This finding indicated that action concept processing hinges on cognitive and neural resources that are mostly distinct from those underlying the sensorimotor control of actions.

Rapid learning of associations between sound and action through observed movement. A TMS study

Research has established that there is a cognitive link between perception and production of the same movement. However, there has been relatively little research into the relevance of this for non-expert perceivers, such as music listeners who do not play instruments themselves. In two experiments we tested whether participants can quickly learn new associations between sounds and observed movement without performing those movements themselves. We measured motor evoked potentials (MEPs) in the first dorsal interosseous muscle of participants' right hands while test tones were heard and single transcranial magnetic stimulation (TMS) pulses were used to trigger motor activity. In Experiment 1 participants in a 'human' condition (n=4) learnt to associate the test tone with finger movement of the experimenter, while participants in a 'computer' condition (n=4) learnt that the test tone was triggered by a computer. Participants in the human condition showed a larger increase in MEPs compared with those in the computer condition. In a second experiment pairing between sounds and movement occurred without participants repeatedly observing the movement and we found no such difference between the human (n=4) and computer (n=4) conditions. These results suggest that observers can quickly learn to associate sound with movement, so it should not be necessary to have played an instrument to experience some motor resonance when hearing that instrument.

The Representation of Objects in Apraxia: From Action Execution to Error Awareness

Apraxia is a well-known syndrome characterized by the sufferer's inability to perform routine gestures. In an attempt to understand the syndrome better, various different theories have been developed and a number of classifications of different subtypes have been proposed. In this article review, we will address these theories with a specific focus on how the use of objects helps us to better understand upper limb apraxia. With this aim, we will consider transitive vs. intransitive action dissociation as well as less frequent types of apraxia involving objects, i.e., constructive apraxia and magnetic apraxia. Pantomime and the imitation of objects in use are also considered with a view to dissociating the various different components involved in upper limb apraxia. Finally, we discuss the evidence relating to action recognition and awareness of errors in the execution of actions. Various different components concerning the use of objects emerge from our analysis and the results show that knowledge of an object and sensory-motor representations are supported by other functions such as spatial and body representations, executive functions and monitoring systems.

Priming Gestures with Sounds

We report a series of experiments about a little-studied type of compatibility effect between a stimulus and a response: the priming of manual gestures via sounds associated with these gestures. The goal was to investigate the plasticity of the gesture-sound associations mediating this type of priming. Five experiments used a primed choice-reaction task. Participants were cued by a stimulus to perform response gestures that produced response sounds; those sounds were also used as primes before the response cues. We compared arbitrary associations between gestures and sounds (key lifts and pure tones) created during the experiment (i.e. no pre-existing knowledge) with ecological associations corresponding to the structure of the world (tapping gestures and sounds, scraping gestures and sounds) learned through the entire life of the participant (thus existing prior to the experiment). Two results were found. First, the priming effect exists for ecological as well as arbitrary associations between gestures and sounds. Second, the priming effect is greatly reduced for ecologically existing associations and is eliminated for arbitrary associations when the response gesture stops producing the associated sounds. These results provide evidence that auditory-motor priming is mainly created by rapid learning of the association between sounds and the gestures that produce them. Auditory-motor priming is therefore mediated by short-term associations between gestures and sounds that can be readily reconfigured regardless of prior knowledge.

Translating novel findings of perceptual-motor codes into the neuro-rehabilitation of movement disorders

The bidirectional flow of perceptual and motor information has recently proven useful as rehabilitative tool for re-building motor memories. We analyzed how the visual-motor approach has been successfully applied in neurorehabilitation, leading to surprisingly rapid and effective improvements in action execution. We proposed that the contribution of multiple sensory channels during treatment enables individuals to predict and optimize motor behavior, having a greater effect than visual input alone. We explored how the state-of-the-art neuroscience techniques show direct evidence that employment of visual-motor approach leads to increased motor cortex excitability and synaptic and cortical map plasticity. This super-additive response to multimodal stimulation may maximize neural plasticity, potentiating the effect of conventional treatment, and will be a valuable approach when it comes to advances in innovative methodologies.

Inferior frontal oscillations reveal visuo-motor matching for actions and speech: evidence from human intracranial recordings

The neural correspondence between the systems responsible for the execution and recognition of actions has been suggested both in humans and non-human primates. Apart from being a key region of this visuo-motor observation-execution matching (OEM) system, the human inferior frontal gyrus (IFG) is also important for speech production. The functional overlap of visuo-motor OEM and speech, together with the phylogenetic history of the IFG as a motor area, has led to the idea that speech function has evolved from pre-existing motor systems and to the hypothesis that an OEM system may exist also for speech. However, visuo-motor OEM and speech OEM have never been compared directly. We used electrocorticography to analyze oscillations recorded from intracranial electrodes in human fronto-parieto-temporal cortex during visuo-motor (executing or visually observing an action) and speech OEM tasks (verbally describing an action using the first or third person pronoun). The results show that neural activity related to visuo-motor OEM is widespread in the frontal, parietal, and temporal regions. Speech OEM also elicited widespread responses partly overlapping with visuo-motor OEM sites (bilaterally), including frontal, parietal, and temporal regions. Interestingly a more focal region, the inferior frontal gyrus (bilaterally), showed both visuo-motor OEM and speech OEM properties independent of orolingual speech-unrelated movements. Building on the methodological advantages in human invasive electrocorticography, the present findings provide highly precise spatial and temporal information to support the existence of a modality-independent action representation system in the human brain that is shared between systems for performing, interpreting and describing actions.

Routes to embodiment

Research on embodiment is rich in impressive demonstrations but somewhat poor in comprehensive explanations. Although some moderators and driving mechanisms have been identified, a comprehensive conceptual account of how bodily states or dynamics influence behavior is still missing. Here, we attempt to integrate current knowledge by describing three basic psychological mechanisms: direct state induction, which influences how humans feel or process information, unmediated by any other cognitive mechanism; modal priming, which changes the accessibility of concepts associated with a bodily state; sensorimotor simulation, which affects the ease with which congruent and incongruent actions are performed. We argue that the joint impact of these mechanisms can account for most existing embodiment effects. Additionally, we summarize empirical tests for distinguishing these mechanisms and suggest a guideline for future research about the mechanisms underlying embodiment effects.

Structural asymmetry of the insula is linked to the lateralization of gesture and language

The control of gesture is one of the most left-lateralized functions, and the insular cortex is one of the most left-biased structures in the human brain. Therefore, we investigated whether structural asymmetries of the insula are linked to the organization of functional activity during gesture planning. We reconstructed and parcellated the insular cortex of 27 participants. First, we tested 15 strongly left-handed individuals because of a higher incidence of atypical organization of functions such as gesture and language in such a population. The inter-hemispheric structural asymmetries were compared with the lateralization of activity for gesture in the supramarginal gyrus (the hotspot of signal increase regardless of the gesturing hand) and Broca’s area (the hotspot of signal increase for language production). The more pronounced leftward structural asymmetries were accompanied by greater left-hemisphere dominance for both of the studied functions. Conversely, an atypical, bilateral or rightward functional shift of gesture and language was accompanied by an attenuated leftward asymmetry of the insula. These significant relationships were driven primarily by differences in surface area. Subsequently, by adding 12 right-handed individuals to these analyses we demonstrated that the observed significant associations are generalizable to the population. These results provide the first demonstration of the relationships between structural inter-hemispheric differences of the insula and the cerebral specialization for gesture. They also corroborate the link between insular asymmetries and language lateralization. As such, these outcomes are relevant to the common cerebral specialization for gesture and language.

Object visibility alters the relative contribution of ventral visual stream and mirror neuron system to goal anticipation during action observation

We used fMRI to study the effect of hiding the target of a grasping action on the cerebral activity of an observer whose task was to anticipate the size of the object being grasped. Activity in the putative mirror neuron system (pMNS) was higher when the target was concealed from the view of the observer and anticipating the size of the object being grasped requested paying attention to the hand kinematics. In contrast, activity in ventral visual areas outside the pMNS increased when the target was fully visible, and the performance improved in this condition. A repetition suppression analysis demonstrated that in full view, the size of the object being grasped by the actor was encoded in the ventral visual stream. Dynamic causal modeling showed that monitoring a grasping action increased the coupling between the parietal and ventral premotor nodes of the pMNS. The modulation of the functional connectivity between these nodes was correlated with the subject's capability to detect the size of hidden objects. In full view, synaptic activity increased within the ventral visual stream, and the connectivity with the pMNS was diminished. The re-enactment of observed actions in the pMNS is crucial when interpreting others' actions requires paying attention to the body kinematics. However, when the context permits, visual-spatial information processing may complement pMNS computations for improved action anticipation accuracy.

Loss of agency in apraxia

The feeling of acting voluntarily is a fundamental component of human behavior and social life and is usually accompanied by a sense of agency. However, this ability can be impaired in a number of diseases and disorders. An important example is apraxia, a disturbance traditionally defined as a disorder of voluntary skillful movements that often results from frontal-parietal brain damage. The first part of this article focuses on direct evidence of some core symptoms of apraxia, emphasizing those with connections to agency and free will. The loss of agency in apraxia is reflected in the monitoring of internally driven action, in the perception of specifically self-intended movements and in the neural intention to act. The second part presents an outline of the evidences supporting the functional and anatomical link between apraxia and agency. The available structural and functional results converge to reveal that the frontal-parietal network contributes to the sense of agency and its impairment in disorders such as apraxia. The current knowledge on the generation of motor intentions and action monitoring could potentially be applied to develop therapeutic strategies for the clinical rehabilitation of voluntary action.

Automatic domain-general processing of sound source identity in the left posterior middle frontal gyrus

Identifying sound sources is fundamental to developing a stable representation of the environment in the face of variable auditory information. The cortical processes underlying this ability have received little attention. In two fMRI experiments, we investigated passive adaptation to (Exp. 1) and explicit discrimination of (Exp. 2) source identities for different categories of auditory objects (voices, musical instruments, environmental sounds). All cortical effects of source identity were independent of high-level category information, and were accounted for by sound-to-sound differences in low-level structure (e.g., loudness). A conjunction analysis revealed that the left posterior middle frontal gyrus (pMFG) adapted to identity repetitions during both passive listening and active discrimination tasks. These results indicate that the comparison of sound source identities in a stream of auditory stimulation recruits the pMFG in a domain-general way, i.e., independent of the sound category, based on information contained in the low-level acoustical structure. pMFG recruitment during both passive listening and explicit identity comparison tasks also suggests its automatic engagement in sound source identity processing.