Observation and physical practice: coding of simple motor sequences

C-SMB 2.0: Integrating over 25 years of motor sequencing research with the Discrete Sequence Production task

An exhaustive review is reported of over 25 years of research with the Discrete Sequence Production (DSP) task as reported in well over 100 articles. In line with the increasing call for theory development, this culminates into proposing the second version of the Cognitive framework of Sequential Motor Behavior (C-SMB 2.0), which brings together known models from cognitive psychology, cognitive neuroscience, and motor learning. This processing framework accounts for the many different behavioral results obtained with the DSP task and unveils important properties of the cognitive system. C-SMB 2.0 assumes that a versatile central processor (CP) develops multimodal, central-symbolic representations of short motor segments by repeatedly storing the elements of these segments in short-term memory (STM). Independently, the repeated processing by modality-specific perceptual and motor processors (PPs and MPs) and by the CP when executing sequences gradually associates successively used representations at each processing level. The high dependency of these representations on active context information allows for the rapid serial activation of the sequence elements as well as for the executive control of tasks as a whole. Speculations are eventually offered as to how the various cognitive processes could plausibly find their neural underpinnings within the intricate networks of the brain.

Imagine to automatize: automatization of stimulus-response coupling after action imagery practice in implicit sequence learning

Action imagery practice (AIP) describes the repetitive imagination of an action to improve subsequent action execution. Because AIP and action execution practice (AEP) draw on partly similar motor mechanisms, it was assumed that AIP may lead to motor automatization, which is observable in a reduction of dual-task costs after AEP. To investigate automatization in AIP, we compared dual-task and single-task performance in practice and random sequences in pretests and posttests. All participants practiced serial reactions to visual stimuli in ten single-task practice sessions. An AIP group imagined the reactions. An AEP group and a control practice group executed the reactions. Practice followed a sequential sequence in AIP and AEP but was random in control practice. In dual-task test conditions, tones were counted that appeared in addition to the visual stimuli. RTs decreased from pretest to posttest in both practice and random sequences in all groups indicating general sequence-unspecific learning. Further, RTs decreased to a greater extent in the practice sequence than in the random sequence after AIP and AEP, indicating sequence-specific learning. Dual-task costs-the difference between RTs after tone and no tone events-were reduced independent from the performed sequence in all groups indicating sequence-unspecific automatization. It is concluded that the stimulus-response coupling can be automatized by both, AEP and AIP.

Sleep-related motor skill consolidation and generalizability after physical practice, motor imagery, and action observation

Sleep benefits the consolidation of motor skills learned by physical practice, mainly through periodic thalamocortical sleep spindle activity. However, motor skills can be learned without overt movement through motor imagery or action observation. Here, we investigated whether sleep spindle activity also supports the consolidation of non-physically learned movements. Forty-five electroencephalographic sleep recordings were collected during a daytime nap after motor sequence learning by physical practice, motor imagery, or action observation. Our findings reveal that a temporal cluster-based organization of sleep spindles underlies motor memory consolidation in all groups, albeit with distinct behavioral outcomes. A daytime nap offers an early sleep window promoting the retention of motor skills learned by physical practice and motor imagery, and its generalizability toward the inter-manual transfer of skill after action observation. Findings may further have practical impacts with the development of non-physical rehabilitation interventions for patients having to remaster skills following peripherical or brain injury.

Sequence representations after action-imagery practice of one-finger movements are effector-independent

Action-imagery practice (AIP) is often less effective than action-execution practice (AEP). We investigated whether this is due to a different time course of learning of different types of sequence representations in AIP and AEP. Participants learned to sequentially move with one finger to ten targets, which were visible the whole time. All six sessions started with a test. In the first four sessions, participants performed AIP, AEP, or control-practice (CP). Tests involved the practice sequence, a mirror sequence, and a different sequence, which were performed both with the practice hand and the other (transfer) hand. In AIP and AEP, movement times (MTs) in both hands were significantly shorter in the practice sequence than in the other sequences, indicating sequence-specific learning. In the transfer hand, this indicates effector-independent visual-spatial representations. The time course of the acquisition of effector-independent visual-spatial representations did not significantly differ between AEP and AIP. In AEP (but not in AIP), MTs in the practice sequence were significantly shorter in the practice hand than in the transfer hand, indicating effector-dependent representations. In conclusion, effector-dependent representations were not acquired after extensive AIP, which may be due to the lack of actual feedback. Therefore, AIP may replace AEP to acquire effector-independent visual-spatial representations, but not to acquire effector-dependent representations.

Dyad training protocols and the development of a motor sequence representation

The purpose of the experiment was to determine the extent to which observation and the inter-trial dialogue in a dyad training protocol enhance the development of a movement sequence representation. The task was to reproduce a 1300ms spatial-temporal pattern of elbow extension/flexion movements. An inter-manual transfer design with a retention test and two effector transfer tests was used. The mirror transfer test required the same motor pattern of homologous muscle activation and a sequence of joint angles as experienced during the acquisition phase, and the non-mirror transfer test required the same visual-spatial pattern as practiced during acquisition. Participants (N=40) were randomly assigned to one of four groups (50 practice acquisition trials): a dyad training group where two participants alternated between physical and observational practice and permitting an inter-trial dialogue, a dyad training group where two participants alternated between physical practice and permitting a dialogue without observation, a dyad training group where two participants alternated between physical and observational practice without a dialogue, and an individual practice control group where one participant learned the movement sequence. The practice duration was for all participants identical. The results indicated that participants involved in the dyad training protocols with either observation and/or the inter-trial dialogue developed a motor representation of the movement sequence.

Interlimb transfer and generalisation of learning in the context of persistent failure to accomplish a visuomotor task

Transfer, in which capability acquired in one situation influences performance in another is considered, along with retention, as demonstrative of effectual learning. In this regard, interlimb transfer of functional capacity has commanded particular attention as a means of gauging the generalisation of acquired capability. Both theoretical treatments and prior empirical studies suggest that the successful accomplishment of a physical training regime is required to bring about generalised changes that extend to the untrained limb. In the present study, we pose the following question: Does interlimb transfer occur if and only if the training movements are executed? We report findings from JG-an individual recruited to a larger scale trial, who presented with (unilateral) deficits of motor control. We examined whether changes in the performance of the untrained right limb arose following practice undertaken by the impaired left limb, wherein the majority of JG's attempts to execute the training task were unsuccessful. Comparison was made with a group of "control" participants drawn from the main trial, who did not practice the task. For JG, substantial gains in the performance of the untrained limb (registered 3 days, 10 days and 1 year following training) indicated that effective learning had occurred. Learning was, however, expressed principally when the unimpaired (i.e. untrained) limb was utilised to perform the task. When the impaired limb was used, marked deficiencies in movement execution remained prominent throughout.

Effects of Physical and Observational Practice on Intermanual Transfer

Some studies have shown that different coordinate systems in the coding of movement sequences develop during observational and physical practice. According to Newell's (Newell, 1986) constraintsled approach, such contradictions could possibly depend on task characteristics. Accordingly, in the present study, two experiments were designed using a five-segment sequence timing task, in which the instructions on how to perform the sequence were different. The task in the first experiment comprised an alternating shift of fast and slow segments, whereas the second experiment involved an incremental procedure from slow to fast. In these experiments, the intermanual transfer of absolute and relative timing through observational and physical practice was examined. Transfer conditions were such that they required the same motor commands (mirror transfer) or the same visual-spatial coordinates (non-mirror transfer) as those in the practice conditions. The first experiment showed that the transfer to the non-mirror condition for relative timing in the physical group was better than that to the mirror condition, while the transfer was similar for both conditions in the observational group, indicating a different pattern of transfer for relative timing. The relative timing transfer pattern in the second experiment was the same for both experimental groups, such that the physical and observational practice resulted in a similar transfer to both mirror and non-mirror conditions. In both experiments, observational and physical practice participants exhibited similar intramanual transfer of absolute timing under both transfer conditions. Thus, the task itself as a constraint was revealed to be an effective factor influencing the behavioral results derived from physical and observational practice.

The influence of eye-movements on the development of a movement sequence representation during observational and physical practice

An experiment was conducted to examine the development of a movement sequence representation and the role of eye-movements during observational and physical practice. The task was to reproduce a 1300ms spatial-temporal pattern of a sequence of elbow flexions and extensions. An inter-manual transfer design with a retention and two effector transfer tests (contralateral limb) was used. The mirror transfer test required the same pattern of homologous muscle activation and a sequence of joint angles as experienced during the acquisition phase, and the non-mirror transfer test required the same visual-spatial pattern as performed or observed during acquisition. Participants were randomly assigned to one of four groups differing in eye-movements (free to use their eyes vs. instruction to fixate) and the practice type (observational practice vs. physical practice). The results indicated that permitting to use eye-movements facilitates sequence learning. This advantage was found on both practice types. The results of the transfer tests indicated that participants of the physical practice group who were permitted to use their eyes demonstrated superior transfer performance in the mirror transfer test, while participants in the observational practice group demonstrated better performance on the non-mirror transfer test. These findings indicated that eye-movements enhanced the development of a visual-spatial representation during observational practice as well as a motor representation during physical practice.

Motion video-based quantitative analysis of the 'lifting-thrusting' method: a comparison between teachers and students of acupuncture

OBJECTIVE

To compare objective measures of needle manipulation between students and teachers of acupuncture using motion video analysis technology, to help support instructional acupuncture education.

METHODS

A total of 30 teachers and 60 students participated in this study. Acupuncture needles were inserted at LI11 and motion videos were recorded for three subtypes of 'lifting-thrusting' manipulation: (1) 'mild reinforcing-attenuating'; (2) 'reinforcing'; and (3) 'attenuating'. The videos were analysed using Simi Motion 3D software to acquire the movement parameters of four trace marks: 'thumb tip'; 'forefinger tip'; 'forefinger middle joint'; and 'forefinger base joint'. Differences between the two groups were compared using t-tests, X² tests and/or rank-sum tests.

RESULTS

Changes in the near-end interphalangeal joint were positively associated with a range of movement along the X axis. Motion parameters for the thumb tip, the proximal interphalangeal (PIP) joint of the forefinger and the X axis shaft swing near the end of the forefinger in the teacher group were higher than those in the student group. The teacher group featured smaller trough dispersion and smaller crest dispersion during 'reinforcing' and 'attenuating' manipulations, respectively.

CONCLUSIONS

The 'lifting-thrusting' manipulation could be simplified as a fixed-axis rotation using metacarpophalangeal joints in the thumb and forefinger as the shaft centre. Teachers opened at a larger angular variation for the PIP during the lifting and thrusting processes with better spatial control. Temporal control was similar between groups and therefore appears easier to grasp. Repetitive training might be helpful for improving athletic and spatial stability during needle manipulation.

Serial practice impairs motor skill consolidation

Recent reports have revealed that motor skill learning is impaired if two skills are practiced one after the other, that is before the first skill has had the time to become consolidated. This suggests that motor skills should be practiced in isolation from one another to minimize interference. At the moment, little is known about the effect of practice schedules high in contextual interference on motor skill consolidation. In Experiment 1, we investigated whether a serial practice schedule impairs motor skill consolidation. Participants had to learn two distinct sequences of finger movements (A and B) under either a blocked practice schedule or a serial practice schedule before being retested the following day. A control group also practiced Sequence A only. Our results revealed that a blocked practice schedule led to no interference between the sequences, whereas a serial practice schedule impaired the consolidation of Sequence B. In Experiment 2, we investigated the origin of the interference caused by a serial practice schedule by replacing the physical practice of Sequence A with either the observation of a model performing Sequence A or by asking participants to produce random finger movements. Our results revealed that both tasks interfered with the consolidation of Sequence B. Thus, we suggest that a serial practice schedule impairs motor skill consolidation through a conflict in the brain networks involved in the acquisition of the cognitive representation of the sequence and its execution.

Have I grooved to this before? Discriminating practised and observed actions in a novel context

Learning a new motor skill typically requires converting actions observed from a third-person perspective into fluid motor commands executed from a first-person perspective. In the present study, we test the hypothesis that during motor learning, the ability to discriminate between actions that have been observed and actions that have been executed is associated with learning aptitude, as assessed by a general measure of physical performance. Using a multi-day dance-training paradigm with a group of dance-naïve participants, we investigated whether actions that had been regularly observed could be discriminated from similar actions that had been physically practised over the course of three days, or a further set of similar actions that remained untrained. Training gains and performance scores at test were correlated with participants' ability to discriminate between observed and practised actions, suggesting that an individual's ability to differentiate between visual versus visuomotor action encoding is associated with general motor learning.

A test of motor skill-specific action embodiment in ice-hockey players

To further our understanding of the role of the motor system in comprehending action-related sentences, we compared action experts (athletes) to visual experts (fans) and novices when responding with an action-specific effector (either hand or foot). These conditions allowed inferences about the degree and specificity of embodiment in language comprehension. Ice hockey players, fans and novices made speeded judgments regarding the congruence between an auditorily presented sentence and a subsequently presented picture. Picture stimuli consisted of either hockey or everyday items. Half of these pictures 'matched' the action implied in the preceding sentence. Further, the action in these images involved either primarily the hand or the foot. For everyday items, action-matched items were responded to faster than action-mismatched items. However, only the players and fans showed the action-match effect for hockey items. There were no consistent effector-stimuli compatibility effects, nor skill-based interactions with compatibility, suggesting that the action-match effect was not based on motor ability per se, but rather a construction of the action based on knowledge or visual experience with the hockey related sentences.

Effector-independent motor sequence representations exist in extrinsic and intrinsic reference frames

Many daily activities rely on the ability to produce meaningful sequences of movements. Motor sequences can be learned in an effector-specific fashion (such that benefits of training are restricted to the trained hand) or an effector-independent manner (meaning that learning also facilitates performance with the untrained hand). Effector-independent knowledge can be represented in extrinsic/world-centered or in intrinsic/body-centered coordinates. Here, we used functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis to determine the distribution of intrinsic and extrinsic finger sequence representations across the human neocortex. Participants practiced four sequences with one hand for 4 d, and then performed these sequences during fMRI with both left and right hand. Between hands, these sequences were equivalent in extrinsic or intrinsic space, or were unrelated. In dorsal premotor cortex (PMd), we found that sequence-specific activity patterns correlated higher for extrinsic than for unrelated pairs, providing evidence for an extrinsic sequence representation. In contrast, primary sensory and motor cortices showed effector-independent representations in intrinsic space, with considerable overlap of the two reference frames in caudal PMd. These results suggest that effector-independent representations exist not only in world-centered, but also in body-centered coordinates, and that PMd may be involved in transforming sequential knowledge between the two. Moreover, although effector-independent sequence representations were found bilaterally, they were stronger in the hemisphere contralateral to the trained hand. This indicates that intermanual transfer relies on motor memories that are laid down during training in both hemispheres, but preferentially draws upon sequential knowledge represented in the trained hemisphere.

Visual online control processes are acquired during observational practice

This experiment examined whether visual online control processes are coded during observational practice. Participants physically practised an aiming sequence while yoked participants either observed (observational practice) or did nothing (control). Two target sizes were used to vary the importance of visual online control processes. Constant error and variable error indicated that participants acquired the timing constraints through physical practice and observational practice. Kinematic data confirmed that the physical practice and observational practice groups executed similar movement control. Physical practice did result in a performance advantage, but only under large target conditions. These findings indicate that visual online control processes can be effectively acquired through observational practice.

Control of automated behavior: insights from the discrete sequence production task

Work with the discrete sequence production (DSP) task has provided a substantial literature on discrete sequencing skill over the last decades. The purpose of the current article is to provide a comprehensive overview of this literature and of the theoretical progress that it has prompted. We start with a description of the DSP task and the phenomena that are typically observed with it. Then we propose a cognitive model, the dual processor model (DPM), which explains performance of (skilled) discrete key-press sequences. Key features of this model are the distinction between a cognitive processor and a motor system (i.e., motor buffer and motor processor), the interplay between these two processing systems, and the possibility to execute familiar sequences in two different execution modes. We further discuss how this model relates to several related sequence skill research paradigms and models, and we outline outstanding questions for future research throughout the paper. We conclude by sketching a tentative neural implementation of the DPM.

Ipsilateral corticospinal responses to ballistic training are similar for various intensities and timings of TMS

AIM

In previous studies, unilateral ballistic training either increased or decreased corticospinal excitability for the untrained opposite limb. The objective here was to investigate whether these discrepancies can be explained by methodological differences such as the intensity of stimulation assessing excitability or the timing of excitability testing after training.

METHODS

Motor evoked potentials (MEP) were elicited by stimulating the ipsilateral cortex at high intensity (70% MEPmax) and low intensity (20% MEPmax) at specific time-points after performance of 300 ballistic movements of the index finger.

RESULTS

Ballistic practice significantly facilitated MEP size for high-intensity stimuli, whereas responses to low-intensity stimulation were variable. MEP sizes at individual time-points were not significantly facilitated until 4 min after training, although there was no difference between early and late responses when grouped over multiple time-points.

CONCLUSIONS

The data indicate that previous discrepancies in ipsilateral responses to ballistic training cannot be attributed to specific procedures used to assess corticospinal excitability as there was no tendency towards depression of MEP amplitude at any point post-exercise for both testing intensities. This suggests that other experimental factors such as locus of attention or availability of visual feedback are more likely to account for the discrepancies.

Watch and learn: seeing is better than doing when acquiring consecutive motor tasks

During motor adaptation learning, consecutive physical practice of two different tasks compromises the retention of the first. However, there is evidence that observational practice, while still effectively aiding acquisition, will not lead to interference and hence prove to be a better practice method. Observers and Actors practised in a clockwise (Task A) followed by a counterclockwise (Task B) visually rotated environment, and retention was immediately assessed. An Observe-all and Act-all group were compared to two groups who both physically practised Task A, but then only observed (ObsB) or did not see or practice Task B (NoB). The two observer groups and the NoB control group better retained Task A than Actors, although importantly only the observer groups learnt Task B. RT data and explicit awareness of the rotation suggested that the observers had acquired their respective tasks in a more strategic manner than Actor and Control groups. We conclude that observational practice benefits learning of multiple tasks more than physical practice due to the lack of updating of implicit, internal models for aiming in the former.

The role of prediction in social neuroscience

Research has shown that the brain is constantly making predictions about future events. Theories of prediction in perception, action and learning suggest that the brain serves to reduce the discrepancies between expectation and actual experience, i.e., by reducing the prediction error. Forward models of action and perception propose the generation of a predictive internal representation of the expected sensory outcome, which is matched to the actual sensory feedback. Shared neural representations have been found when experiencing one's own and observing other's actions, rewards, errors, and emotions such as fear and pain. These general principles of the “predictive brain” are well established and have already begun to be applied to social aspects of cognition. The application and relevance of these predictive principles to social cognition are discussed in this article. Evidence is presented to argue that simple non-social cognitive processes can be extended to explain complex cognitive processes required for social interaction, with common neural activity seen for both social and non-social cognitions. A number of studies are included which demonstrate that bottom-up sensory input and top-down expectancies can be modulated by social information. The concept of competing social forward models and a partially distinct category of social prediction errors are introduced. The evolutionary implications of a “social predictive brain” are also mentioned, along with the implications on psychopathology. The review presents a number of testable hypotheses and novel comparisons that aim to stimulate further discussion and integration between currently disparate fields of research, with regard to computational models, behavioral and neurophysiological data. This promotes a relatively new platform for inquiry in social neuroscience with implications in social learning, theory of mind, empathy, the evolution of the social brain, and potential strategies for treating social cognitive deficits.

Scheduling observational and physical practice: influence on the coding of simple motor sequences

The main purpose of the present experiment was to determine the coordinate system used in the development of movement codes when observational and physical practice are scheduled across practice sessions. The task was to reproduce a 1,300-ms spatial-temporal pattern of elbow flexions and extensions. An intermanual transfer paradigm with a retention test and two effector (contralateral limb) transfer tests was used. The mirror effector transfer test required the same pattern of homologous muscle activation and sequence of limb joint angles as that performed or observed during practice, and the non-mirror effector transfer test required the same spatial pattern movements as that performed or observed. The test results following the first acquisition session replicated the findings of Gruetzmacher, Panzer, Blandin, and Shea (2011) . The results following the second acquisition session indicated a strong advantage for participants who received physical practice in both practice sessions or received observational practice followed by physical practice. This advantage was found on both the retention and the mirror transfer tests compared to the non-mirror transfer test. These results demonstrate that codes based in motor coordinates can be developed relatively quickly and effectively for a simple spatial-temporal movement sequence when participants are provided with physical practice or observation followed by physical practice, but physical practice followed by observational practice or observational practice alone limits the development of codes based in motor coordinates.

In the absence of physical practice, observation and imagery do not result in updating of internal models for aiming

The presence of after-effects in adaptation tasks implies that an existing internal model has been updated. Previously, we showed that although observers adapted to a visuomotor perturbation, they did not show after-effects. In this experiment, we tested 2 further observer groups and an actor group. Observers were now actively engaged in watching (encouraged through imagery and movement estimation), with one group physically practising for 25% of the trials (mixed). Participants estimated the hand movements that produced various cursor trajectories and/or their own hand movement from a preceding trial. These trials also allowed us to assess the development of explicit knowledge as a function of the three practice conditions. The pure observation group did not show after-effects, whereas the actor and mixed groups did. The pure observation group improved their ability to estimate hand movement of the video model. Although the actor and mixed groups improved in actual reaching accuracy, they did not improve in explicit estimation. The mixed group was more accurate in reaching during adaptation and showed larger after-effects than the actors. We suggest that observation encourages an explicit mode of learning, enabling performance benefits without corresponding changes to an internal model of the mapping between output and sensory input. However, some physical practice interspersed with observation can change the manner with which learning is achieved, encouraging implicit learning and the updating of an existing internal model.

The coding and inter-manual transfer of movement sequences

The manuscript reviews recent experiments that use inter-manual transfer and inter-manual practice paradigms to determine the coordinate system (visual-spatial or motor) used in the coding of movement sequences during physical and observational practice. The results indicated that multi-element movement sequences are more effectively coded in visual-spatial coordinates even following extended practice, while very early in practice movement sequences with only a few movement elements and relatively short durations are coded in motor coordinates. Likewise, inter-manual practice of relatively simple movement sequences show benefits of right and left limb practice that involves the same motor coordinates while the opposite is true for more complex sequences. The results suggest that the coordinate system used to code the sequence information is linked to both the task characteristics and the control processes used to produce the sequence. These findings have the potential to greatly enhance our understanding of why in some conditions participants following practice with one limb or observation of one limb practice can effectively perform the task with the contralateral limb while in other (often similar) conditions cannot.