The time course of off-line motor sequence learning

Offline consolidation of procedural skill learning is enhanced by negative emotional content

It is now well established that both procedural skills and episodic memories consolidate across periods of offline retention, and most particularly across periods of sleep. Such consolidation has been demonstrated to be more marked for emotional than for neutral episodes, but the interaction between emotionality and the offline consolidation of procedural skills has yet to be investigated. Here, we address this issue by examining the impact of an emotional background context at encoding upon the subsequent consolidation of mirror tracing, a well-studied procedural skill. We also consider the importance of sleep for such consolidation by manipulating the retention interval (over a day, overnight, or over 24 h containing normal sleep). Our data show significantly greater offline improvements in the accuracy of mirror tracing when negative emotional content is present during the training phase when compared to when neutral or positive content is present. Furthermore, consolidation across a night of sleep is associated with faster and more accurate performance than consolidation across a day of wakefulness. These novel findings show that the emotional context in which a procedural skill is learned can impact upon subsequent offline consolidation.

Contribution of sleep to memory consolidation

The contribution of sleep to memory processing is being characterized at increasingly detailed levels. At a behavioral level, better performance at retrieval is usually observed after sleep, relative to a period of wakefulness. At a brainsystems level, functional neuroimaging techniques have demonstrated that the distribution of regional brain activity is influenced by previous waking experience. At present, the selective effects of sleep components, such as slow waves or spindles are being characterized. These effects are framed in terms of neural firing patterns and also in terms of the molecular mechanisms underpinning the effects of sleep on brain plasticity. Collectively, the available data indicate a positive influence of sleep on memory consolidation.

Response-dependent contributions of human primary motor cortex and angular gyrus to manual and perceptual sequence learning

Motor sequence learning on the serial reaction time task involves the integration of response-, stimulus-, and effector-based information. Human primary motor cortex (M1) and the inferior parietal lobule (IPL) have been identified with supporting the learning of effector-dependent and -independent information, respectively. Current neurocognitive data are, however, exclusively based on learning complex sequence information via perceptual-motor responses. Here, we investigated the effects of continuous theta-burst transcranial magnetic stimulation (cTBS)-induced disruption of M1 and the angular gyrus (AG) of the IPL on learning a probabilistic sequence via sequential perceptual-motor responses (experiment 1) or covert orienting of visuospatial attention (experiment 2). Functional effects on manual sequence learning were evident during 75% of training trials in the cTBS M1 condition, whereas cTBS over the AG resulted in interference confined to a midpoint during the training phase. Posttraining direct (declarative) tests of sequence knowledge revealed that cTBS over M1 modulated the availability of newly acquired sequence knowledge, whereby sequence knowledge was implicit in the cTBS M1 condition but was available to conscious awareness in the cTBS AG and control conditions. In contrast, perceptual sequence learning was abolished in the perceptual cTBS AG condition, whereas learning was intact and available to conscious awareness in the cTBS M1 and control conditions. These results show that the right AG had a critical role in perceptual sequence learning, whereas M1 had a causal role in developing experience-dependent functional attributes relevant to conscious knowledge on manual but not perceptual sequence learning.

Differential rates of consolidation of conceptual and stimulus learning following training on an auditory skill

Training-induced improvements on perceptual skills can be attributed to at least two learning types: learning of general aspects of the trained condition (conceptual learning) and learning of specific feature values of the stimulus used in training (stimulus learning). Here we asked whether conceptual and stimulus learning on interaural time difference (ITD) discrimination emerge along different time courses. Conceptual learning was clearly evident 10 h after training, when performance on a target ITD condition was equivalent following training on that condition or on a non-target condition differing only in the stimulus, and was better in both cases than immediately after training. In contrast, stimulus learning emerged 24 h after training. At that time, performance on the target ITD condition was better following target- than non-target training, due to a worsening in performance between 10 and 24 h after non-target training rather than from additional improvements over this time period after target training. Training amount influenced performance immediately, but not 10 or 24 h, after training. Thus, conceptual learning emerged before stimulus learning, and each manifested through different improvement trajectories many hours after training. These results suggest that on ITD discrimination, conceptual learning is consolidated earlier, and with different behavioral consequences, than stimulus learning.

Contribution of night and day sleep vs. simple passage of time to the consolidation of motor sequence and visuomotor adaptation learning

There is increasing evidence supporting the notion that the contribution of sleep to consolidation of motor skills depends on the nature of the task used in practice. We compared the role of three post-training conditions in the expression of delayed gains on two different motor skill learning tasks: finger tapping sequence learning (FTSL) and visuomotor adaptation (VMA). Subjects in the DaySleep and ImmDaySleep conditions were trained in the morning and at noon, respectively, afforded a 90-min nap early in the afternoon and were re-tested 12 h post-training. In the NightSleep condition, subjects were trained in the evening on either of the two learning paradigms and re-tested 12 h later following sleep, while subjects in the NoSleep condition underwent their training session in the morning and were re-tested 12 h later without any intervening sleep. The results of the FTSL task revealed that post-training sleep (day-time nap or night-time sleep) significantly promoted the expression of delayed gains at 12 h post-training, especially if sleep was afforded immediately after training. In the VMA task, however, there were no significant differences in the gains expressed at 12 h post-training in the three conditions. These findings suggest that "off-line" performance gains reflecting consolidation processes in the FTSL task benefit from sleep, even a short nap, while the simple passage of time is as effective as time in sleep for consolidation of VMA to occur. They also imply that procedural memory consolidation processes differ depending on the nature of task demands.

Contributions of the basal ganglia and functionally related brain structures to motor learning

This review discusses the cerebral plasticity, and the role of the cortico-striatal system in particular, observed as one is learning or planning to execute a newly learned motor behavior up to when the skill is consolidated or has become highly automatized. A special emphasis is given to imaging work describing the neural substrate mediating motor sequence learning and motor adaptation paradigms. These results are then put into a plausible neurobiological model of motor skill learning, which proposes an integrated view of the brain plasticity mediating this form of memory at different stages of the acquisition process.

Robust perceptual learning of faces in the absence of sleep

This study examines the effects of sleep on learning in a face identification task. Five groups of subjects performed a 1-of-10 face identification task in two sessions separated by 3, 12, and 24h. Session 1 consisted of four blocks of 105 trials each; Session 2 consisted of eight blocks of trials. All groups exhibited significant improvement in response accuracy within each session. Furthermore, between-session learning - defined as the difference in proportion correct between sessions 1 and 2 - was significant for all groups. Between-session learning was greater in groups that slept between sessions, but the effect was small and affected performance only in the first block of trials in Session 2. Overall, we find that sleep's contribution is a small proportion of the total amount learned in face identification, with improvements continuing to accrue in its absence.

Consciousness and the consolidation of motor learning

It is no secret that motor learning benefits from repetition. For example, pianists devote countless hours to performing complicated sequences of key presses, and golfers practice their swings thousands of times to reach a level of proficiency. Interestingly, the subsequent waking and sleeping hours after practice also play important roles in motor learning. During this time, a motor skill can consolidate into a more stable form that can lead to improved future performance without intervening practice. Though it is widely believed that sleep is crucial for this consolidation of motor learning, this is not generally true. In many instances only day-time consolidates motor learning, while in other instances neither day-time nor sleep consolidates learning. Recent studies have suggested that conscious awareness during motor training can determine whether sleep or day-time plays a role in consolidation. However, ongoing studies suggest that this explanation is also incomplete. In addition to conscious awareness, attention is an important factor to consider. This review discusses how attention and conscious awareness interact with day and night processes to consolidate a motor memory.

Motor sequence learning and movement disorders

PURPOSE OF REVIEW

New insights into the psychophysiological determinants of performance changes and brain plasticity associated with motor sequence learning have recently been gained through behavioral and imaging studies in healthy individuals. In addition, using a variety of motor sequential paradigms in groups of patients affected by a movement disorder, major advances have been achieved in our understanding of the pathophysiological mechanisms underlying Parkinson's and Huntington's diseases, as well as primary forms of dystonia.

RECENT FINDINGS

This review begins by describing the latest findings in normal participants with regards to the dynamic alterations in neural networks observed across the different phases of motor sequence learning. It then focuses on the hotly debated issue of motor memory consolidation, highlighting the results of novel studies that investigated the role of both day and night sleep, the neural substrates and the developmental evolution mediating this process. Finally, this paper addresses current work looking at motor sequence learning in movement disorders that helps to better comprehend the functional contribution of basal ganglia structures to this type of memory, to assess the impact of such diseases on related patterns of brain activation, as well as to identify the neuronal compensatory mechanisms educed by these basal ganglia disorders.

SUMMARY

Such advances have major implications, not only for optimizing ways to learn new skilled behaviors in real-life situations, but also for guiding therapeutic approaches in patients with movement disorders.

Sleep does not benefit probabilistic motor sequence learning

It has become widely accepted that sleep-dependent consolidation occurs for motor sequence learning based on studies using finger-tapping tasks. Studies using another motor sequence learning task [the serial response time task (SRTT)] have portrayed a more nuanced picture of off-line consolidation, involving both sleep-dependent and daytime consolidation, as well as modifying influences of explicit awareness. The present study used a variant of the SRTT featuring probabilistic sequences to investigate off-line consolidation. Probabilistic sequences confer two advantages: first, spontaneous explicit awareness does not occur, and second, sequence learning measures are continuous, making it easier to separate general skill from sequence-specific learning. We found that sleep did not enhance general skill or sequence-specific learning. In contrast, daytime enhancement occurred for general skill but not for sequence-specific learning. Overall, these results suggest that motor learning does not always undergo consolidation with sleep.

Off-line processing: reciprocal interactions between declarative and procedural memories

The acquisition of declarative (i.e., facts) and procedural (i.e., skills) memories may be supported by independent systems. This same organization may exist, after memory acquisition, when memories are processed off-line during consolidation. Alternatively, memory consolidation may be supported by interactive systems. This latter interactive organization predicts interference between declarative and procedural memories. Here, we show that procedural consolidation, expressed as an off-line motor skill improvement, can be blocked by declarative learning over wake, but not over a night of sleep. The extent of the blockade on procedural consolidation was correlated to participants' declarative word recall. Similarly, in another experiment, the reciprocal relationship was found: declarative consolidation was blocked by procedural learning over wake, but not over a night of sleep. The decrease in declarative recall was correlated to participants' procedural learning. These results challenge the concept of fixed independent memory systems; instead, they suggest a dynamic relationship, modulated by when consolidation takes place, allowing at times for a reciprocal interaction between memory systems.

Time of day accounts for overnight improvement in sequence learning

The theory that certain skills improve with a night of sleep has received considerable interest in recent years. However, because sleep typically occurs at the same time of day in humans, it is difficult to separate the effects of sleep from those of time of day. By using a version of the Serial Response Time Task, we assessed the role of sleep in implicit sequence learning while controlling for possible time-of-day effects. We replicated the apparent benefit of sleep on human participants. However, our data show that sleep does not affect implicit sequence learning; rather, time of day affects the ability of participants to express what they have learned.

Neural representations during sleep: From sensory processing to memory traces

In the course of a day, the brain undergoes large-scale changes in functional modes, from attentive wakefulness to the deepest stage of sleep. The present paper evaluates how these state changes affect the neural bases of sensory and cognitive representations. Are organized neural representations still maintained during sleep? In other words, despite the absence of conscious awareness, do neuronal signals emitted during sleep contain information and have a functional relevance? Through a critical evaluation of the animal and human literature, neural representations at different levels of integration (from the most elementary sensory level to the most cognitive one) are reviewed. Recordings of neuronal activity in animals at presentation of neutral or significant stimuli show that some analysis of the external word remains possible during sleep, allowing recognition of behaviorally relevant stimuli. Event-related brain potentials in humans confirm the preservation of some sensory integration and discriminative capacity. Behavioral and neuroimaging studies in humans substantiate the notion that memory representations are reactivated and are reorganized during post-learning sleep; these reorganisations may account for the beneficial effects of sleep on behavioral performance. Electrophysiological results showing replay of neuronal sequences in animals are presented, and their relevance as neuronal correlates of memory reactivation is discussed. The reviewed literature provides converging evidence that structured neural representations can be activated during sleep. Which reorganizations unique to sleep benefit memory representations, and to what extent the operations still efficient in processing environmental information during sleep are similar to those underlying the non-conscious, automatic processing continually at work in wakefulness, are challenging questions open to investigation.

Motor sequence consolidation: constrained by critical time windows or competing components

Skill improvements may develop between practice sessions during memory consolidation. Skill enhancement within an egocentric coordinate frame develops over wake, whereas skill enhancement in an allocentric coordinate frame develops over a night of sleep. We tested whether both types of improvement could develop over two different 24-h intervals: 8 am to 8 am or from 8 pm to 8 pm. We found that for each 24 h interval, only one type of skill improvement was seen. Despite passing through wake and a night of sleep participants only showed skill improvements commensurate with either a night of sleep or a day awake. The nature of the off-line skill enhancement was determined by when consolidation occurred within the normal sleep-wake cycle. We conclude that motor sequence consolidation is constrained either by having critical time windows or by a competitive interaction in which improvements within one co-ordinate frame actively block improvements from developing in the alternative co-ordinate frame.

Early boost and slow consolidation in motor skill learning

Motorskill learning is a dynamic process that continues covertly after training has ended and eventually leads to delayed increments in performance. Current theories suggest that this off-line improvement takes time and appears only after several hours. Here we show an early transient and short-lived boost in performance, emerging as early as 5-30 min after training but no longer observed 4 h later. This early boost is predictive of the performance achieved 48 h later, suggesting its functional relevance for memory processes.

Implicit oculomotor sequence learning in humans: Time course of offline processing

Studies of manual and digital sequence learning indicate that motor memories continue to be processed after training has ended, following a succession of identifiable steps. However, it is not known whether this offline memory processing constitutes a basic feature of motor learning and generalizes to the implicit learning of a sequence of eye movements. To assess this hypothesis, we have created the serial oculomotor reaction time task (SORT). Participants were trained to the SORT then tested after either 30 min, 5 h or 24 h. During training, ocular reaction times decreased monotonically over practice of a repeated sequence, then increased when a different sequence was displayed, demonstrating oculomotor learning of the trained sequence. When tested 30 min after training, a significant gain in oculomotor performance was observed irrespective of the sequence learning. This gain was no longer present after 5 h. Remarkably, a gain in performance specific to the learned sequence emerged only 24 h after training. After testing, a generation task confirmed that most subjects learned implicitly the regularities of the sequence. Our results show that, as for manual or digital sequences, oculomotor sequences can be implicitly learned. The offline processing of oculomotor memories follows distinct stages in a way similar to those observed after manual or digital sequence learning.

Off-line learning and the primary motor cortex

We are all familiar with acquiring skills during practice, but skill can also continue to develop between practice sessions. These "off-line" improvements are frequently supported by sleep, but they can be time dependent when a skill is acquired unintentionally. The magnitude of these over-day and overnight improvements is similar, suggesting that a similar mechanism may support both types of off-line improvements. However, here we show that disruption of the primary motor cortex with repetitive transcranial magnetic stimulation blocks off-line improvements over the day but not overnight. This suggests that a memory may be rescued overnight and subsequently enhanced or that different aspects of a skill, with differential dependencies on the primary motor cortex, are enhanced over day and overnight. Off-line improvements of similar magnitude are not supported by similar mechanisms; instead, the mechanisms engaged may depend on brain state.