Observation of an action with a congruent contextual background facilitates corticospinal excitability: A combined TMS and eye-tracking experiment

Motor imagery drives the effects of combined action observation and motor imagery on corticospinal excitability for coordinative lower-limb actions

Combined action observation and motor imagery (AOMI) facilitates corticospinal excitability (CSE) and may potentially induce plastic-like changes in the brain in a similar manner to physical practice. This study used transcranial magnetic stimulation (TMS) to explore changes in CSE for AOMI of coordinative lower-limb actions. Twenty-four healthy adults completed two baseline (BLH, BLNH) and three AOMI conditions, where they observed a knee extension while simultaneously imagining the same action (AOMICONG), plantarflexion (AOMICOOR-FUNC), or dorsiflexion (AOMICOOR-MOVE). Motor evoked potential (MEP) amplitudes were recorded as a marker of CSE for all conditions from two knee extensor, one dorsi flexor, and two plantar flexor muscles following TMS to the right leg representation of the left primary motor cortex. A main effect for experimental condition was reported for all three muscle groups. MEP amplitudes were significantly greater in the AOMICONG condition compared to the BLNH condition (p = .04) for the knee extensors, AOMICOOR-FUNC condition compared to the BLH condition (p = .03) for the plantar flexors, and AOMICOOR-MOVE condition compared to the two baseline conditions for the dorsi flexors (ps ≤ .01). The study findings support the notion that changes in CSE are driven by the imagined actions during coordinative AOMI.

What we imagine learning from watching others: how motor imagery modulates competency perceptions resulting from the repeated observation of a juggling action

Although motor learning can occur from observing others perform a motor skill (action observation; AO), observers' confidence in their own ability to perform the skill can be falsely increased compared to their actual ability. This illusion of motor competence (i.e., 'over-confidence') may arise because the learner does not gain access to sensory feedback about their own performance-a source of information that can help individuals understand their veridical motor capabilities. Unlike AO, motor imagery (MI; the mental rehearsal of a motor skill) is thought to be linked to an understanding of movement consequences and kinaesthetic information. MI may thus provide the learner with movement-related diagnostic information, leading to greater accuracy in assessing ability. The present study was designed to evaluate the effects of MI when paired with AO in assessments of one's own motor capabilities in an online observation task. Two groups rated their confidence in performing a juggling task following repeated observations of the action without MI (OBS group; n = 45) or with MI following observation (OBS+MI; n = 39). As predicted, confidence increased with repeated observation for both groups, yet increased to a greater extent in the OBS relative to the OBS+MI group. The addition of MI appeared to reduce confidence that resulted from repeated AO alone. Data support the hypothesis that AO and MI are separable and that MI allows better access to sensory information than AO. However, further research is required to assess changes in confidence that result from MI alone and motor execution.

The social relevance and the temporal constraints of motor resonance in humans

In humans, motor resonance effects can be tracked by measuring the enhancement of corticospinal excitability by action observation. Uncovering factors driving motor resonance is crucial for optimizing action observation paradigms in experimental and clinical settings. In the present study, we deepen motor resonance properties for grasping movements. Thirty-five healthy subjects underwent an action observation task presenting right-hand grasping movements differing from their action goal. Single-pulse transcranial magnetic stimulation was applied over the left primary motor cortex at 100, 200, or 300 ms from the onset of the visual stimulus depicting the action. Motor-evoked potentials were recorded from four muscles of the right hand and forearm. Results show a muscle-specific motor resonance effect at 200 ms after movement but selectively for observing a socially relevant grasp towards another human being. This effect correlates with observers' emotional empathy scores, and it was followed by inhibition of motor resonance at 300 ms post-stimulus onset. No motor resonance facilitation emerged while observing intransitive hand movement or object grasping. This evidence highlights the social side of motor resonance and its dependency on temporal factors.

“Left and right prefrontal routes to action comprehension”

Successful action comprehension requires the integration of motor information and semantic cues about objects in context. Previous evidence suggests that while motor features are dorsally encoded in the fronto-parietal action observation network (AON); semantic features are ventrally processed in temporal structures. Importantly, these dorsal and ventral routes seem to be preferentially tuned to low (LSF) and high (HSF) spatial frequencies, respectively. Recently, we proposed a model of action comprehension where we hypothesized an additional route to action understanding whereby coarse LSF information about objects in context is projected to the dorsal AON via the prefrontal cortex (PFC), providing a prediction signal of the most likely intention afforded by them. Yet, this model awaits for experimental testing. To this end, we used a perturb-and-measure continuous theta burst stimulation (cTBS) approach, selectively disrupting neural activity in the left and right PFC and then evaluating the participant's ability to recognize filtered action stimuli containing only HSF or LSF. We find that stimulation over PFC triggered different spatial-frequency modulations depending on lateralization: left-cTBS and right-cTBS led to poorer performance on HSF and LSF action stimuli, respectively. Our findings suggest that left and right PFC exploit distinct spatial frequencies to support action comprehension, providing evidence for multiple routes to social perception in humans.

An action-observation/motor-imagery based approach to differentiate disorders of consciousness: what is beneath the tip of the iceberg?

BACKGROUND

The evaluation of motor imagery in persons with prolonged Disorders of Consciousness (pDOC) is a practical approach to differentiate between patients with Minimally Conscious State (MCS) and Unresponsive Wakefulness Syndrome (UWS) and to identify residual awareness even in individuals with UWS. Investigating the influence of motor observation on motor imagery could be helpful in this regard.

OBJECTIVE

In order to corroborate the clinical diagnosis and identify misdiagnosed individuals, we used EEG recordings, to assess the influence of the low-level perceptual and motoric mechanisms on motor observation on motor imagery, taking into account the role of the high-level cognitive mechanisms in patients with pDOC.

METHODS

We assessed the influence of motor observation of walking in first-person or third-person view (by a video provision) on motor imagery of walking in the first-person view on the visual N190 (expression of motor observation processing), the readiness potential (RP) (expressing motor preparation), and the P3 component (high-level cognitive processes) in a sample of 10 persons with MCS, 10 with UWS, and 10 healthy controls (CG). Specifically, the video showed a first-view or third-view walk down the street while the participants were asked to imagine a first-view walking down the street.

RESULTS

CG showed greater N190 response (low-level sensorimotor processing) in the non-matching than in the matching condition. Conversely, the P3 and RP responses (high-level sensorimotor processing) were greater in the matching than in the non-matching condition. Remarkably, 6 out of 10 patients with MCS showed the preservation of both high- and low-level sensorimotor processing. One UWS patient showed responses similar to those six patients, suggesting a preservation of cognitively-mediated sensorimotor processing despite a detrimental motor preparation process. The remaining patients with MCS did not show diversified EEG responses, suggesting limited cognitive functioning.

CONCLUSIONS

Our study suggests that identifying the low-level visual and high-level motor preparation processes in response to a simple influence of motor observation of motor imagery tasks potentially supports the clinical differential diagnosis of with MCS and UWS. This might help identify UWS patients which were misdiagnosed and who deserve more sophisticated diagnoses.

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

Comparison of the on-line effects of different motor simulation conditions on corticospinal excitability in healthy participants

In healthy participants, corticospinal excitability is known to increase during motor simulations such as motor imagery (MI), action observation (AO) and mirror therapy (MT), suggesting their interest to promote plasticity in neurorehabilitation. Further comparing these methods and investigating their combination may potentially provide clues to optimize their use in patients. To this end, we compared in 18 healthy participants abductor pollicis brevis (APB) corticospinal excitability during MI, AO or MT, as well as MI combined with either AO or MT. In each condition, 15 motor-evoked potentials (MEPs) and three maximal M-wave were elicited in the right APB. Compared to the control condition, mean normalized MEP amplitude (i.e. MEP/M) increased during MI (P = .003), MT (P < .001) and MT + MI (P < .001), without any difference between the three conditions. No MEP modulation was evidenced during AO or AO + MI. Because MI provided no additional influence when combined with AO or MT, our results may suggest that, in healthy subjects, visual feedback and unilateral movement with a mirror may provide the greatest effects among all the tested motor simulations.

Sonification of combined action observation and motor imagery: Effects on corticospinal excitability

Action observation and motor imagery are valuable strategies for motor learning. Their simultaneous use (AOMI) increases neural activity, with related benefits for motor learning, compared to the two strategies alone. In this study, we explored how sonification influences AOMI. Twenty-five participants completed a practice block based on AOMI, motor imagery and physical execution of the same action. Participants were divided into two groups: An experimental group that practiced with sonification during AOMI (sAOMI), and a control group, which did not receive any extrinsic feedback. Corticospinal excitability at rest and during action observation and AOMI was assessed before and after practice, with and without sonification sound, to test the development of an audiomotor association. The practice block increased corticospinal excitability in all testing conditions, but sonification did not affect this. In addition, we found no differences in action observation and AOMI, irrespective of sonification. These results suggest that, at least for simple tasks, sonification of AOMI does not influence corticospinal excitability; In these conditions, sonification may have acted as a distractor. Future studies should further explore the relationship between task complexity, value of auditory information and action, to establish whether sAOMI is a valuable for motor learning.

Superior Facilitation of an Action Observation Network by Congruent Character Movements in Brain-Computer Interface Action-Observation Games

Action observation (AO) is a promising strategy for promoting motor function in neural rehabilitation. Recently, brain-computer interface (BCI)-AO game rehabilitation, which combines AO therapy with BCI technology, has been introduced to improve the effectiveness of rehabilitation. This approach can improve motor learning by providing feedback, which can be interactive in an observation task, and the game contents of the BCI-AO game paradigm can affect rehabilitation. In this study, the effects of congruent rather than incongruent feedback in a BCI-AO game on mirror neurons were investigated. Specifically, the mu suppression with congruent and incongruent BCI-AO games was measured in 17 healthy adults. The mu suppression in the central motor cortex was significantly higher with the congruent BCI-AO game than with the incongruent one. In addition, the satisfaction evaluation results were excellent for the congruent case. These results support the fact that providing feedback congruent with the motion of an action video facilitates mirror neuron activity and can offer useful guidelines for the design of BCI-AO games for rehabilitation.

What first drives visual attention during the recognition of object-directed actions? The role of kinematics and goal information

The recognition of others' object-directed actions is known to involve the decoding of both the visual kinematics of the action and the action goal. Yet whether action recognition is first guided by the processing of visual kinematics or by a prediction about the goal of the actor remains debated. In order to provide experimental evidence to this issue, the present study aimed at investigating whether visual attention would be preferentially captured by visual kinematics or by action goal information when processing others' actions. In a visual search task, participants were asked to find correct actions (e.g., drinking from glass) among distractor actions. Distractors actions contained grip and/or goal violations and could therefore share the correct goal and/or the correct grip with the target. The time course of fixation proportion on each distractor action has been taken as an indicator of visual attention allocation. Results show that visual attention is first captured by the distractor action with similar goal. Then the withdrawal of visual attention from the action distractor with similar goal suggests a later attentional capture by the action distractor with similar grip. Overall, results are in line with predictive approaches of action understanding, which assume that observers first make a prediction about the actor's goal before verifying this prediction using the visual kinematics of the action.

Using Action-congruent Language Facilitates the Motor Response during Action Observation: A Combined Transcranial Magnetic Stimulation and Eye-tracking Study

There is evidence that action observation (AO) and the processing of action-related words are associated with increased activity in cortical motor regions. Research has examined the effects of AO and action verb processing on activity in the motor system independently. The aim of this experiment was to investigate, for the first time, the modulation of corticospinal excitability and visual attention during the concurrent processing of action verbs and AO stimuli. Twenty participants took part in an integrated transcranial magnetic stimulation and eye-tracking protocol. Single-pulse transcranial magnetic stimulation was delivered to the hand representation of the left motor cortex during (i) observation of a static hand, (ii) AO of a hand squeezing a sponge, (iii) AO of the same action with an audio recording of the word "squeeze," and (iv) AO of the same action with an audio recording of the word "green". Motor evoked potentials were recorded from the abductor pollicis brevis and abductor digiti minimi muscles of the right hand. Eye gaze was recorded throughout the four conditions as a proxy for visual attention. Interviews were conducted to discuss participants' preferences and imagery use for each condition. The AO and action verb condition resulted in significantly increased motor evoked potential amplitudes in the abductor pollicis brevis muscle; participants also made significantly more fixations on the sponge and reported wanting to move their hand more in the action verb condition. The inclusion of auditory action verbs, alongside AO stimuli, in movement simulation interventions could have implications for the delivery of AO interventions for motor (re)learning.

Low or High-Level Motor Coding? The Role of Stimulus Complexity

Transcranial magnetic stimulation (TMS) studies have shown that observing an action induces activity in the onlooker's motor system. In light of the muscle specificity and time-locked mirroring nature of the effect, this motor resonance has been traditionally viewed as an inner automatic replica of the observed movement. Notably, studies highlighting this aspect have classically considered movement in isolation (i.e., using non-realistic stimuli such as snapshots of hands detached from background). However, a few recent studies accounting for the role of contextual cues, motivational states, and social factors, have challenged this view by showing that motor resonance is not completely impervious to top-down modulations. A debate is still present. We reasoned that motor resonance reflects the inner replica of the observed movement only when its modulation is assessed during the observation of movements in isolation. Conversely, the presence of top-down modulations of motor resonance emerges when other high-level factors (i.e., contextual cues, past experience, social, and motivational states) are taken into account. Here, we attempt to lay out current TMS studies assessing this issue and discuss the results in terms of their potential to favor the inner replica or the top-down modulation hypothesis. In doing so, we seek to shed light on this actual debate and suggest specific avenues for future research, highlighting the need for a more ecological approach when studying motor resonance phenomenon.

Uncertainty in contextual and kinematic cues jointly modulates motor resonance in primary motor cortex

Contextual information accompanying others' actions modulates "motor resonance", i.e., neural activity within motor areas that is elicited by movement observation. One possibility is that we weigh and combine such information in a Bayesian manner according to their relative uncertainty. Therefore, contextual information becomes particularly useful when others' actions are difficult to discriminate. It is unclear, however, whether this uncertainty modulates the neural activity in primary motor cortex (M1) during movement observation. Here, we applied single-pulse transcranial magnetic stimulation (TMS) while subjects watched different grasping actions. We operationalized motor resonance as grip-specific modulation of corticomotor excitability measured in the index (FDI) versus the little finger abductor (ADM). We experimentally modulated either the availability of kinematic information ( experiment 1) or the reliability of contextual cues ( experiment 2). Our results indicate that even in the absence of movement kinematics, reliable contextual information is enough to trigger significant muscle-specific corticomotor excitability changes in M1, which are strongest when both kinematics and contextual information are available. These findings suggest that bottom-up mechanisms that activate motor representations as a function of the observed kinematics and top-down mechanisms that activate motor representations associated with arbitrary cues converge in M1. NEW & NOTEWORTHY Our study reveals new neurophysiological insights in support of the Bayesian account of action observation by showing that "motor resonance", i.e., neural activity evoked by observing others' actions, incorporates the uncertainty related to both contextual (prior beliefs) and kinematic (sensory evidence) cues. Notably, we show that muscle-specific modulation of M1 is strongest when context and movement kinematics are available, and it can be elicited even in the absence of movement kinematics.