Automatic imitation in rhythmical actions: kinematic fidelity and the effects of compatibility, delay, and visual monitoring

Enhancing motor imagery practice using synchronous action observation

In this paper, we discuss a variety of ways in which practising motor actions by means of motor imagery (MI) can be enhanced via synchronous action observation (AO), that is, by AO + MI. We review the available research on the (mostly facilitatory) behavioural effects of AO + MI practice in the early stages of skill acquisition, discuss possible theoretical explanations, and consider several issues related to the choice and presentation schedules of suitable models. We then discuss considerations related to AO + MI practice at advanced skill levels, including expertise effects, practical recommendations such as focussing attention on specific aspects of the observed action, using just-ahead models, and possible effects of the perspective in which the observed action is presented. In section "Coordinative AO + MI", we consider scenarios where the observer imagines performing an action that complements or responds to the observed action, as a promising and yet under-researched application of AO + MI training. In section "The dual action simulation hypothesis of AO + MI", we review the neurocognitive hypothesis that AO + MI practice involves two parallel action simulations, and we consider opportunities for future research based on recent neuroimaging work on parallel motor representations. In section "AO + MI training in motor rehabilitation", we review applications of AO, MI, and AO + MI training in the field of neurorehabilitation. Taken together, this evidence-based, exploratory review opens a variety of avenues for future research and applications of AO + MI practice, highlighting several clear advantages over the approaches of purely AO- or MI-based practice.

Guidelines for reporting action simulation studies (GRASS): Proposals to improve reporting of research in motor imagery and action observation

Researchers from multiple disciplines have studied the simulation of actions through motor imagery, action observation, or their combination. Procedures used in these studies vary considerably between research groups, and no standardized approach to reporting experimental protocols has been proposed. This has led to under-reporting of critical details, impairing the assessment, replication, synthesis, and potential clinical translation of effects. We provide an overview of issues related to the reporting of information in action simulation studies, and discuss the benefits of standardized reporting. We propose a series of checklists that identify key details of research protocols to include when reporting action simulation studies. Each checklist comprises A) essential methodological details, B) essential details that are relevant to a specific mode of action simulation, and C) further points that may be useful on a case-by-case basis. We anticipate that the use of these guidelines will improve the understanding, reproduction, and synthesis of studies using action simulation, and enhance the translation of research using motor imagery and action observation to applied and clinical settings.

A neural signature for combined action observation and motor imagery? An fNIRS study into prefrontal activation, automatic imitation, and self-other perceptions

INTRODUCTION

Research indicates that both observed and imagined actions can be represented in the brain as two parallel sensorimotor representations. One proposal is that higher order cognitive processes would align these two hypothetical action simulations.

METHODS

We investigated this hypothesis using an automatic imitation paradigm, with functional near-infrared spectroscopy recordings over the prefrontal cortex during different motor simulation states. On each trial, participants (n = 14) observed a picture of a rhythmical action (instructed action) followed by a distractor movie showing the same or different action. Participants then executed the instructed action. Distractor actions were manipulated to be fast or slow, and instructions were manipulated during distractor presentation: action observation (AO), combined action observation and motor imagery (AO+MI) and observe to imitate (intentional imitation). A pure motor imagery (MI) condition was also included.

RESULTS

Kinematic analyses showed that although distractor speed effects were significant under all instructions (shorter mean cycle times in execution for fast compared to slow trials), this imitation bias was significantly stronger for combined AO+MI than both AO and MI, and stronger for intentional imitation than the other three automatic imitation conditions. In the left prefrontal cortex, cerebral oxygenation was significantly greater for combined AO+MI than all other instructions. Participants reported that their representation of the self overlapped with the observed model significantly more during AO+MI than AO.

CONCLUSION

Left prefrontal activation may therefore be a neural signature of AO+MI, supporting attentional switching between concurrent representations of self (MI, top-down) and other (AO, bottom-up) to increase imitation and perceived closeness.

An action-observation/motor-imagery based approach to differentiate disorders of consciousness: what is beneath the tip of the iceberg?

BACKGROUND

The evaluation of motor imagery in persons with prolonged Disorders of Consciousness (pDOC) is a practical approach to differentiate between patients with Minimally Conscious State (MCS) and Unresponsive Wakefulness Syndrome (UWS) and to identify residual awareness even in individuals with UWS. Investigating the influence of motor observation on motor imagery could be helpful in this regard.

OBJECTIVE

In order to corroborate the clinical diagnosis and identify misdiagnosed individuals, we used EEG recordings, to assess the influence of the low-level perceptual and motoric mechanisms on motor observation on motor imagery, taking into account the role of the high-level cognitive mechanisms in patients with pDOC.

METHODS

We assessed the influence of motor observation of walking in first-person or third-person view (by a video provision) on motor imagery of walking in the first-person view on the visual N190 (expression of motor observation processing), the readiness potential (RP) (expressing motor preparation), and the P3 component (high-level cognitive processes) in a sample of 10 persons with MCS, 10 with UWS, and 10 healthy controls (CG). Specifically, the video showed a first-view or third-view walk down the street while the participants were asked to imagine a first-view walking down the street.

RESULTS

CG showed greater N190 response (low-level sensorimotor processing) in the non-matching than in the matching condition. Conversely, the P3 and RP responses (high-level sensorimotor processing) were greater in the matching than in the non-matching condition. Remarkably, 6 out of 10 patients with MCS showed the preservation of both high- and low-level sensorimotor processing. One UWS patient showed responses similar to those six patients, suggesting a preservation of cognitively-mediated sensorimotor processing despite a detrimental motor preparation process. The remaining patients with MCS did not show diversified EEG responses, suggesting limited cognitive functioning.

CONCLUSIONS

Our study suggests that identifying the low-level visual and high-level motor preparation processes in response to a simple influence of motor observation of motor imagery tasks potentially supports the clinical differential diagnosis of with MCS and UWS. This might help identify UWS patients which were misdiagnosed and who deserve more sophisticated diagnoses.

The Effects of Instruction Manipulation on Motor Performance Following Action Observation

The effects of action observation (AO) on motor performance can be modulated by instruction. The effects of two top-down aspects of the instruction on motor performance have not been fully resolved: those related to attention to the observed task and the incorporation of motor imagery (MI) during AO. In addition, the immediate vs. 24-h retention test effects of those instruction’s aspects are yet to be elucidated. Forty-eight healthy subjects were randomly instructed to: (1) observe reaching movement (RM) sequences toward five lighted units with the intention of reproducing the same sequence as fast and as accurate as possible (Intentional + Attentional group; AO+At); (2) observe the RMs sequence with the intention of reproducing the same sequence as fast and as accurate as possible and simultaneously to the observation to imagine performing the RMs (Intentional + attentional + MI group; AO+At+MI); and (3) observe the RMs sequence (Passive AO group). Subjects’ performance was tested before and immediately after the AO and retested after 24 h. During each of the pretest, posttest, and retest, the subject performed RMs toward the units that were activated in the same order as the observed sequence. Occasionally, the sequence order was changed by beginning the sequence with a different activated unit. The outcome measures were: averaged response time of the RMs during the sequences, difference between the response time of the unexpected and expected RMs and percent of failures to reach the target within 1 s. The averaged response time and the difference between the response time of the unexpected and expected RMs were improved in all groups at posttest compared to pretest, regardless of instruction. Averaged response time was improved in the retest compared to the posttest only in the Passive AO group. The percent of failures across groups was higher in pretest compared to retest. Our findings suggest that manipulating top-down aspects of instruction by adding attention and MI to AO in an RM sequence task does not improve subsequent performance more than passive observation. Off-line learning of the sequence in the retention test was improved in comparison to posttest following passive observation only.

Differences between the Influence of Observing One's Own Movements and Those of Others in Patients with Stroke

We aimed to investigate differences between the influence of observing one's own actions and those of others in patients with stroke with hemiplegia. Thirty-four patients with stroke who had experienced a right or left hemispheric lesion (RHL: n = 17; LHL: n = 17) participated in this study. Participants viewed video clips (0.5× speed) of their own stepping movements (SO) as well as those of others (OO). After viewing the video clips, participants were asked to evaluate the vividness of the mental image of the observed stepping movement using a five-point scale, in accordance with that utilized in the Kinesthetic and Visual Imagery Questionnaire (KVIQ). We also examined changes in imagery and execution times following action observation. When all patients were considered, there were no significant differences between SO and OO conditions. However, in the RHL subgroup, KVIQ kinesthetic subscore and changes in imagery and execution times were greater in the OO condition than in the SO condition. In the LHL subgroup, changes in imagery times were greater in the SO condition than in the OO condition. These findings indicated that viewing the movements of others led to more vivid imagery and alteration in performance in patients with right-sided stroke, when compared to viewing one's own movements. Therefore, the present study suggests that clinicians should consider the side of the damaged hemisphere when implementing action observation therapy for patients with stroke.

Combined action observation and motor imagery therapy: a novel method for post-stroke motor rehabilitation

Cerebral vascular accidents (strokes) are a leading cause of motor deficiency in millions of people worldwide. While a complex range of biological systems is affected following a stroke, in this paper we focus primarily on impairments of the motor system and the recovery of motor skills. We briefly review research that has assessed two types of mental practice, which are currently recommended in stroke rehabilitation. Namely, action observation (AO) therapy and motor imagery (MI) training. We highlight the strengths and limitations in both techniques, before making the case for combined action observation and motor imagery (AO + MI) therapy as a potentially more effective method. This is based on a growing body of multimodal brain imaging research showing advantages for combined AO + MI instructions over the two separate methods of AO and MI. Finally, we offer a series of suggestions and considerations for how combined AO + MI therapy could be employed in neurorehabilitation.

Using mimicry of body movements by a virtual agent to increase synchronization behavior and rapport in individuals with schizophrenia

Synchronization of behavior such as gestures or postures is assumed to serve crucial functions in social interaction but has been poorly studied to date in schizophrenia. Using a virtual collaborative environment (VCS), we tested 1) whether synchronization of behavior, i.e., the spontaneous initiation of gestures that are congruent with those of an interaction partner, was impaired in individuals with schizophrenia compared with healthy participants; 2) whether mimicry of the patients' body movements by the virtual interaction partner was associated with increased behavioral synchronization and rapport. 19 patients and 19 matched controls interacted with a virtual agent who either mimicked their head and torso movements with a delay varying randomly between 0.5 s and 4 s or did not mimic, and rated feelings of rapport toward the virtual agent after each condition. Both groups exhibited a higher and similar synchronization behavior of the virtual agent forearm movements when they were in the Mimicry condition rather than in the No-mimicry condition. In addition, both groups felt more comfortable with a mimicking virtual agent rather than a virtual agent not mimicking them suggesting that mimicry is able to increase rapport in individuals with schizophrenia. Our results suggest that schizophrenia cannot be considered anymore as a disorder of imitation, particularly as regards behavioral synchronization processes in social interaction contexts.

Motor Imagery during Action Observation: A Brief Review of Evidence, Theory and Future Research Opportunities

Motor imagery (MI) and action observation (AO) have traditionally been viewed as two separate techniques, which can both be used alongside physical practice to enhance motor learning and rehabilitation. Their independent use has largely been shown to be effective, and there is clear evidence that the two processes can elicit similar activity in the motor system. Building on these well-established findings, research has now turned to investigate the effects of their combined use. In this article, we first review the available neurophysiological and behavioral evidence for the effects of combined action observation and motor imagery (AO+MI) on motor processes. We next describe a conceptual framework for their combined use, and then discuss several areas for future research into AO+MI processes. In this review, we advocate a more integrated approach to AO+MI techniques than has previously been adopted by movement scientists and practitioners alike. We hope that this early review of an emergent body of research, along with a related set of research questions, can inspire new work in this area. We are optimistic that future research will further confirm if, how, and when this combined approach to AO+MI can be more effective in motor learning and rehabilitation settings, relative to the more traditional application of MI or AO independently.

Status and Power Do Not Modulate Automatic Imitation of Intransitive Hand Movements

The tendency to mimic the behaviour of others is affected by a variety of social factors, and it has been argued that such “mirroring” is often unconsciously deployed as a means of increasing affiliation during interpersonal interactions. However, the relationship between automatic motor imitation and status/power is currently unclear. This paper reports five experiments that investigated whether social status (Experiments 1, 2, and 3) or power (Experiments 4 and 5) had a moderating effect on automatic imitation (AI) in finger-movement tasks, using a series of different manipulations. Experiments 1 and 2 manipulated the social status of the observed person using an associative learning task. Experiment 3 manipulated social status via perceived competence at a simple computer game. Experiment 4 manipulated participants’ power (relative to the actors) in a card-choosing task. Finally, Experiment 5 primed participants using a writing task, to induce the sense of being powerful or powerless. No significant interactions were found between congruency and social status/power in any of the studies. Additionally, Bayesian hypothesis testing indicated that the null hypothesis should be favoured over the experimental hypothesis in all five studies. These findings are discussed in terms of their implications for AI tasks, social effects on mimicry, and the hypothesis of mimicry as a strategic mechanism to promote affiliation.

Exercise Performance and Corticospinal Excitability during Action Observation

Purpose: Observation of a model performing fast exercise improves simultaneous exercise performance; however, the precise mechanism underpinning this effect is unknown. The aim of the present study was to investigate whether the speed of the observed exercise influenced both upper body exercise performance and the activation of a cortical action observation network (AON).

Method: In Experiment 1, 10 participants completed a 5 km time trial on an arm-crank ergometer whilst observing a blank screen (no-video) and a model performing exercise at both a typical (i.e., individual mean cadence during baseline time trial) and 15% faster than typical speed. In Experiment 2, 11 participants performed arm crank exercise whilst observing exercise at typical speed, 15% slower and 15% faster than typical speed. In Experiment 3, 11 participants observed the typical, slow and fast exercise, and a no-video, whilst corticospinal excitability was assessed using transcranial magnetic stimulation.

Results: In Experiment 1, performance time decreased and mean power increased, during observation of the fast exercise compared to the no-video condition. In Experiment 2, cadence and power increased during observation of the fast exercise compared to the typical speed exercise but there was no effect of observation of slow exercise on exercise behavior. In Experiment 3, observation of exercise increased corticospinal excitability; however, there was no difference between the exercise speeds.

Conclusion: Observation of fast exercise improves simultaneous upper-body exercise performance. However, because there was no effect of exercise speed on corticospinal excitability, these results suggest that these improvements are not solely due to changes in the activity of the AON.

Enhancing voluntary imitation through attention and motor imagery

Action observation activates brain areas involved in performing the same action and has been shown to increase motor learning, with potential implications for neurorehabilitation. Recent work indicates that the effects of action observation on movement can be increased by motor imagery or by directing attention to observed actions. In voluntary imitation, activation of the motor system during action observation is already increased. We therefore explored whether imitation could be further enhanced by imagery or attention. Healthy participants observed and then immediately imitated videos of human hand movement sequences, while movement kinematics were recorded. Two blocks of trials were completed, and after the first block participants were instructed to imagine performing the observed movement (Imagery group, N = 18) or attend closely to the characteristics of the movement (Attention group, N = 15), or received no further instructions (Control group, N = 17). Kinematics of the imitated movements were modulated by instructions, with both Imagery and Attention groups being closer in duration, peak velocity and amplitude to the observed model compared with controls. These findings show that both attention and motor imagery can increase the accuracy of imitation and have implications for motor learning and rehabilitation. Future work is required to understand the mechanisms by which these two strategies influence imitation accuracy.

When mirroring is both simple and "smart": how mimicry can be embodied, adaptive, and non-representational

The concept of mirroring has become rather ubiquitous. One of the most fundamental empirical and theoretical debates within research on mirroring concerns the role of mental representations: while some models argue that higher-order representational mechanisms underpin most cases of mirroring, other models argue that they only moderate a primarily non-representational process. As such, even though research on mirroring—along with its neural substrates, including the putative mirror neuron system—has grown tremendously, so too has confusion about what it actually means to “mirror”. Using recent research on spontaneous imitation, we argue that flexible mirroring effects can be fully embodied and dynamic—even in the absence of higher-order mental representations. We propose that mirroring can simply reflect an adaptive integration and utilization of cues obtained from the brain, body, and environment, which is especially evident within the social context. Such a view offers reconciliation among both representational and non-representational frameworks in cognitive neuroscience, which will facilitate revised interpretations of modern (and seemingly divergent) findings on when and how these embodied mirroring responses are employed.

Motor imagery during action observation modulates automatic imitation effects in rhythmical actions

We have previously shown that passively observing a task-irrelevant rhythmical action can bias the cycle time of a subsequently executed rhythmical action. Here we use the same paradigm to investigate the impact of different forms of motor imagery (MI) during action observation (AO) on this automatic imitation (AI) effect. Participants saw a picture of the instructed action followed by a rhythmical distractor movie, wherein cycle time was subtly manipulated across trials. They then executed the instructed rhythmical action. When participants imagined performing the instructed action in synchrony with the distractor action (AO + MI), a strong imitation bias was found that was significantly greater than in our previous study. The bias was pronounced equally for compatible and incompatible trials, wherein observed and imagined actions were different in type (e.g., face washing vs. painting) or plane of movement, or both. In contrast, no imitation bias was observed when MI conflicted with AO. In Experiment 2, motor execution synchronized with AO produced a stronger imitation bias compared to AO + MI, showing an advantage in synchronization for overt execution over MI. Furthermore, the bias was stronger when participants synchronized the instructed action with the distractor movie, compared to when they synchronized the distractor action with the distractor movie. Although we still observed a significant bias in the latter condition, this finding indicates a degree of specificity in AI effects for the identity of the synchronized action. Overall, our data show that MI can substantially modulate the effects of AO on subsequent execution, wherein: (1) combined AO + MI can enhance AI effects relative to passive AO; (2) observed and imagined actions can be flexibly coordinated across different action types and planes; and (3) conflicting AO + MI can abolish AI effects. Therefore, combined AO + MI instructions should be considered in motor training and rehabilitation.

Multiple roles of motor imagery during action observation

Over the last 20 years, the topics of action observation (AO) and motor imagery (MI) have been largely studied in isolation from each other, despite the early integrative account by Jeannerod (1994, 2001). Recent neuroimaging studies demonstrate enhanced cortical activity when AO and MI are performed concurrently ("AO+MI"), compared to either AO or MI performed in isolation. These results indicate the potentially beneficial effects of AO+MI, and they also demonstrate that the underlying neurocognitive processes are partly shared. We separately review the evidence for MI and AO as forms of motor simulation, and present two quantitative literature analyses that indeed indicate rather little overlap between the two bodies of research. We then propose a spectrum of concurrent AO+MI states, from congruent AO+MI where the contents of AO and MI widely overlap, over coordinative AO+MI, where observed and imagined action are different but can be coordinated with each other, to cases of conflicting AO+MI. We believe that an integrative account of AO and MI is theoretically attractive, that it should generate novel experimental approaches, and that it can also stimulate a wide range of applications in sport, occupational therapy, and neurorehabilitation.