Covert reorganization of implicit task representations by slow wave sleep

Sleep’s Role in Schema Learning and Creative Insights

Purpose of Review

A recent resurgence of interest in schema theory has influenced research on sleep-dependent memory consolidation and led to a new understanding of how schemata might be activated during sleep and play a role in the reorganisation of memories. This review is aimed at synthesising recent findings into a coherent narrative and draw overall conclusions.

Recent Findings

Rapid consolidation of schematic memories has been shown to benefit from an interval containing sleep. These memories have shown reduced reliance on the hippocampus following consolidation in both humans and rodents. Using a variety of methodologies, notably including the DRM paradigm, it has been shown that activation of a schema can increase the rate of false memory as a result of activation of semantic associates during slow wave sleep (SWS). Memories making use of a schema have shown increased activity in the medial prefrontal cortex, which may reflect both the schematic activation itself and a cognitive control component selecting an appropriate schema to use. SWS seems to be involved in assimilation of new memories within existing semantic frameworks and in making memories more explicit, while REM sleep may be more associated with creating entirely novel associations while keeping memories implicit.

Summary

Sleep plays an important role in schematic memory consolidation, with more rapid consolidation, reduced hippocampal involvement, and increased prefrontal involvement as the key characteristics. Both SWS and REM sleep may have a role to play.

Sleep and the extraction of hidden regularities: A systematic review and the importance of temporal rules

As part of its role in memory consolidation, sleep has been repeatedly identified as critical for the extraction of regularities from wake experiences. However, many null results have been published as well, with no clear consensus emerging regarding the conditions that yield this sleep effect. Here, we systematically review the role of sleep in the extraction of hidden regularities, specifically those involving associative relations embedded in newly learned information. We found that the specific behavioral task used in a study had far more impact on whether a sleep effect was discovered than either the category of the cognitive processes targeted, or the particular experimental design employed. One emerging pattern, however, was that the explicit detection of hidden rules is more likely to happen when the rules are of a temporal nature (i.e., event A at time t predicts a later event B) than when they are non-temporal. We discuss this temporal rule sensitivity in reference to the compressed memory replay occurring in the hippocampus during slow-wave-sleep, and compare this effect to what happens when the extraction of regularities depends on prior knowledge and relies on structures other than the hippocampus.

Rest on it: Awake quiescence facilitates insight

Many scientific discoveries have been explained by a sudden gaining of insight with regards to an ongoing problem. Insight is characterised by a mental restructuring of acquired information, from which new explicit knowledge can be drawn, leading to qualitative changes in behaviour. Extended sleep facilitates the gaining of insight, possibly because it is conducive to the stabilisation and restructuring of new memory representations via consolidation. Research shows that a brief period of awake quiescence (quiet resting), too, can support consolidation: people remember more new memories if they quietly rest for several minutes after encoding than if they engage in a task involving ongoing sensory input after encoding. However, it remains unknown whether awake quiescence inspires insight. Using a number-based problem-solving task (the Number Reduction Task - 'NRT'), we reveal that, like sleep, awake quiescence facilitates the rapid gaining of insight: young adults were more than twice as likely to demonstrate new explicit knowledge of a hidden solution to the NRT if initial exposure to this task was followed by 10 min of awake quiescence than an unrelated perceptual task. These findings indicate that, at least for the NRT, the development of insight is not restricted to sleep but can be achieved via a brief period of awake quiescence. Thus, contrary to conventional wisdom and theories, when faced with a novel problem we may not always need to 'sleep on it' to find a novel solution, simply 'resting on it' may be enough.

Sleep Spindles in the Right Hemisphere Support Awareness of Regularities and Reflect Pre-Sleep Activations

Study Objectives

The present study explored the sleep mechanisms which may support awareness of hidden regularities.

Methods

Before sleep, 53 participants learned implicitly a lateralized variant of the serial response-time task in order to localize sensorimotor encoding either in the left or right hemisphere and induce implicit regularity representations. Electroencephalographic (EEG) activity was recorded at multiple electrodes during both task performance and sleep, searching for lateralized traces of the preceding activity during learning. Sleep EEG analysis focused on region-specific slow (9-12 Hz) and fast (13-16 Hz) sleep spindles during nonrapid eye movement sleep.

Results

Fast spindle activity at those motor regions that were activated during learning increased with the amount of postsleep awareness. Independently of side of learning, spindle activity at right frontal and fronto-central regions was involved: there, fast spindles increased with the transformation of sequence knowledge from implicit before sleep to explicit after sleep, and slow spindles correlated with individual abilities of gaining awareness. These local modulations of sleep spindles corresponded to regions with greater presleep activation in participants with postsleep explicit knowledge.

Conclusions

Sleep spindle mechanisms are related to explicit awareness (1) by tracing the activation of motor cortical and right-hemisphere regions which had stronger involvement already during learning and (2) by recruitment of individually consolidated processing modules in the right hemisphere. The integration of different sleep spindle mechanisms with functional states during wake collectively supports the gain of awareness of previously experienced regularities, with a special role for the right hemisphere.

Increased Performance Variability as a Marker of Implicit/Explicit Interactions in Knowledge Awareness

Only some, but not all, individuals who practice tasks with dual structure, overt and covert, are able to comprehend consciously a hidden regularity. The formation of implicit representations of regularity has been proposed to be critical for subsequent awareness. However, explicit knowledge also has been predicted by the activation of executive control systems during task encoding. The present study analyzed performance patterns in participants who could comprehend task regularity and those who could not at delayed recall. Specifically, the role of practice-based knowledge of sequence for individual awareness was focused on. A lateralized variant of the visual serial response time task (SRTT) comprising structured and random blocks was practiced in implicit conditions by 109 participants before and after 10-h retention, with explicit knowledge about covert sequence tested thereafter. Sequence learning was quantified using the normalized difference between response speed in regular and subsequent random blocks. Patterns of performance dynamics were evaluated using response speed, response variability, and error rate. Major results demonstrate that (1) All participants who became aware of the sequence (solvers), gained practice-based sequence knowledge at learning or after retention, (2) Such knowledge also was accumulated during learning by participants who remained fully unaware about covert task structure, (3) Only in explicit solvers, however, was sequence-specific learning accompanied by a prominent increase in performance variability. (4) Specific features and dynamics of performance patterns distinguished different cognitive modes of SRTT processing, each of which supported subsequent knowledge awareness. It is concluded that a behavioral precursor of sequence awareness is the combination of speeded sequence processing and increased performance variability, pointing to an interaction between implicit and explicit processing systems. These results may contribute to refine the evaluation of online and offline learning of tasks with dual structure, and to extend understanding of increased behavioral variability in both normal and pathological conditions.

Labile sleep promotes awareness of abstract knowledge in a serial reaction time task

Sleep has been identified as a critical brain state enhancing the probability of gaining insight into covert task regularities. Both non-rapid eye movement (NREM) and rapid eye movement (REM) sleep have been implicated with offline re-activation and reorganization of memories supporting explicit knowledge generation. According to two-stage models of sleep function, offline processing of information during sleep is sequential requiring multiple cycles of NREM and REM sleep stages. However, the role of overnight dynamic sleep macrostructure for insightfulness has not been studied so far. In the present study, we test the hypothesis that the frequency of interactions between NREM and REM sleep stages might be critical for awareness after sleep. For that aim, the rate of sleep stage transitions was evaluated in 53 participants who learned implicitly a serial reaction time task (SRTT) in which a determined sequence was inserted. The amount of explicit knowledge about the sequence was established by verbal recall after a night of sleep following SRTT learning. Polysomnography was recorded in this night and in a control night before and was analyzed to compare the rate of sleep-stage transitions between participants who did or did not gain awareness of task regularity after sleep. Indeed, individual ability of explicit knowledge generation was strongly associated with increased rate of transitions between NREM and REM sleep stages and between light sleep stages and slow wave sleep. However, the rate of NREM-REM transitions specifically predicted the amount of explicit knowledge after sleep in a trait-dependent way. These results demonstrate that enhanced lability of sleep goes along with individual ability of knowledge awareness. Observations suggest that facilitated dynamic interactions between sleep stages, particularly between NREM and REM sleep stages play a role for offline processing which promotes rule extraction and awareness.

Time rather than sleep appears to enhance off-line learning and transfer of learning of an implicit continuous task

There is increasing evidence that sleep promotes off-line enhancement of a variety of explicitly learned motor tasks in young adults. However, whether sleep promotes off-line consolidation of implicitly learned motor tasks is still under question. Furthermore, the role of sleep in promoting transfer of learning remains unknown. This study examined the role of sleep in learning and transfer of learning of an implicit continuous motor task. Twenty-three neurologically intact individuals (mean age 26.4 years) were randomly assigned to either a sleep group or a no-sleep group. The sleep group practiced a continuous tracking task in the evening and underwent retention and transfer testing the following morning, while the no-sleep group practiced the tracking task in the morning and underwent retention and transfer testing in the evening. The results show that in both the sleep and no-sleep groups, performance improved off-line without further practice for both the general skill and the sequence-specific skill. The results also indicate that sleep and time promote transfer of learning of both sequence-specific and general skill learning to a spatial and temporal variation of the motor task. These findings demonstrate that sleep does not play a critical role in promoting off-line learning and transfer of learning of an implicit continuous motor task.

Insights into sleep's role for insight: Studies with the number reduction task

In recent years, vibrant research has developed on “consolidation” during sleep: To what extent are newly experienced impressions reprocessed or even restructured during sleep? We used the number reduction task (NRT) to study if and how sleep does not only reiterate new experiences but may even lead to new insights. In the NRT, covert regularities may speed responses. This implicit acquisition of regularities may become explicitly conscious at some point, leading to a qualitative change in behavior which reflects this insight. By applying the NRT at two consecutive sessions separated by an interval, we investigated the role of sleep in this interval for attaining insight at the second session. In the first study, a night of sleep was shown to triple the number of participants attaining insight above the base rate of about 20%. In the second study, this hard core of 20% discoverers differed from other participants in their task-related EEG potentials from the very beginning already. In the third study, the additional role of sleep was specified as an effect of the deep-sleep phase of slow-wave sleep on participants who had implicitly acquired the covert regularity before sleep. It was in these participants that a specific increase of EEG during slow-wave sleep in the 10-12 Hz band was obtained. These results support the view that neuronal memory reprocessing during slow-wave sleep restructures task-related representations in the brain, and that such restructuring promotes the gain of explicit knowledge.

About sleep's role in memory

Over more than a century of research has established the fact that sleep benefits the retention of memory. In this review we aim to comprehensively cover the field of "sleep and memory" research by providing a historical perspective on concepts and a discussion of more recent key findings. Whereas initial theories posed a passive role for sleep enhancing memories by protecting them from interfering stimuli, current theories highlight an active role for sleep in which memories undergo a process of system consolidation during sleep. Whereas older research concentrated on the role of rapid-eye-movement (REM) sleep, recent work has revealed the importance of slow-wave sleep (SWS) for memory consolidation and also enlightened some of the underlying electrophysiological, neurochemical, and genetic mechanisms, as well as developmental aspects in these processes. Specifically, newer findings characterize sleep as a brain state optimizing memory consolidation, in opposition to the waking brain being optimized for encoding of memories. Consolidation originates from reactivation of recently encoded neuronal memory representations, which occur during SWS and transform respective representations for integration into long-term memory. Ensuing REM sleep may stabilize transformed memories. While elaborated with respect to hippocampus-dependent memories, the concept of an active redistribution of memory representations from networks serving as temporary store into long-term stores might hold also for non-hippocampus-dependent memory, and even for nonneuronal, i.e., immunological memories, giving rise to the idea that the offline consolidation of memory during sleep represents a principle of long-term memory formation established in quite different physiological systems.

Increased Alpha (8–12 Hz) Activity during Slow Wave Sleep as a Marker for the Transition from Implicit Knowledge to Explicit Insight

The number reduction task (NRT) allows us to study the transition from implicit knowledge of hidden task regularities to explicit insight into these regularities. To identify sleep-associated neurophysiological indicators of this restructuring of knowledge representations, we measured frequency-specific power of EEG while participants slept during the night between two sessions of the NRT. Alpha (8–12 Hz) EEG power during slow wave sleep (SWS) emerged as a specific marker of the transformation of presleep implicit knowledge to postsleep explicit knowledge (ExK). Beta power during SWS was increased whenever ExK was attained after sleep, irrespective of presleep knowledge. No such EEG predictors of insight were found during Sleep Stage 2 and rapid eye movement sleep. These results support the view that it is neuronal memory reprocessing during sleep, in particular during SWS, that lays the foundations for restructuring those task-related representations in the brain that are necessary for promoting the gain of ExK.

Sleep restores daytime deficits in procedural memory in children with attention-deficit/hyperactivity disorder

Sleep supports the consolidation of declarative and procedural memory. While prefrontal cortex (PFC) activity supports the consolidation of declarative memory during sleep, opposite effects of PFC activity are reported with respect to the consolidation of procedural memory during sleep. Patients with attention-deficit/hyperactivity disorder (ADHD) are characterised by a prefrontal hypoactivity. Therefore, we hypothesised that children with ADHD benefit from sleep with respect to procedural memory more than healthy children. Sixteen children with ADHD and 16 healthy controls (aged 9-12) participated in this study. A modification of the serial-reaction-time task was conducted. In the sleep condition, learning took place in the evening and retrieval after a night of sleep, whereas in the wake condition learning took place in the morning and retrieval in the evening without sleep. Children with ADHD showed an improvement in motor skills after sleep compared to the wake condition. Sleep-associated gain in reaction times was positively correlated with the amount of sleep stage 4 and REM-density in ADHD. As expected, sleep did not benefit motor performance in the group of healthy children. These data suggest that sleep in ADHD normalizes deficits in procedural memory observed during daytime. It is discussed whether in patients with ADHD attenuated prefrontal control enables sleep-dependent gains in motor skills by reducing the competitive interference between explicit and implicit components within a motor task.

The construction of semantic memory: grammar-based representations learned from relational episodic information

After acquisition, memories underlie a process of consolidation, making them more resistant to interference and brain injury. Memory consolidation involves systems-level interactions, most importantly between the hippocampus and associated structures, which takes part in the initial encoding of memory, and the neocortex, which supports long-term storage. This dichotomy parallels the contrast between episodic memory (tied to the hippocampal formation), collecting an autobiographical stream of experiences, and semantic memory, a repertoire of facts and statistical regularities about the world, involving the neocortex at large. Experimental evidence points to a gradual transformation of memories, following encoding, from an episodic to a semantic character. This may require an exchange of information between different memory modules during inactive periods. We propose a theory for such interactions and for the formation of semantic memory, in which episodic memory is encoded as relational data. Semantic memory is modeled as a modified stochastic grammar, which learns to parse episodic configurations expressed as an association matrix. The grammar produces tree-like representations of episodes, describing the relationships between its main constituents at multiple levels of categorization, based on its current knowledge of world regularities. These regularities are learned by the grammar from episodic memory information, through an expectation-maximization procedure, analogous to the inside-outside algorithm for stochastic context-free grammars. We propose that a Monte-Carlo sampling version of this algorithm can be mapped on the dynamics of "sleep replay" of previously acquired information in the hippocampus and neocortex. We propose that the model can reproduce several properties of semantic memory such as decontextualization, top-down processing, and creation of schemata.

Neural Precursors of Delayed Insight

The solution of a problem left unresolved in the evening can sometimes pop into mind as a sudden insight after a night of sleep in the following morning. Although favorable effects of sleep on insightful behavior have been experimentally confirmed, the neural mechanisms determining this delayed insight remain unknown. Here, using fMRI, we characterize the neural precursors of delayed insight in the number reduction task (NRT), in which a hidden task structure can be learned implicitly, but can also be recognized explicitly in an insightful process, allowing immediate qualitative improvement in task performance. Normal volunteers practiced the NRT during two fMRI sessions (training and retest), taking place 12 hours apart after a night of sleep. After this delay, half of the subjects gained insight into the hidden task structure (“solvers,” S), whereas the other half did not (“nonsolvers,” NS). Already at training, solvers and nonsolvers differed in their cerebral responses associated with implicit learning. In future solvers, responses were observed in the superior frontal sulcus, posterior parietal cortex, and the insula, three areas mediating controlled processes and supporting early learning and novice performance. In contrast, implicit learning was related to significant responses in the hippocampus in nonsolvers. Moreover, the hippocampus was functionally coupled with the basal ganglia in nonsolvers and with the superior frontal sulcus in solvers, thus potentially biasing participants' strategy towards implicit or controlled processes of memory encoding, respectively. Furthermore, in solvers but not in nonsolvers, response patterns were further transformed overnight, with enhanced responses in ventral medial prefrontal cortex, an area previously implicated in the consolidation of declarative memory. During retest in solvers, before they gain insight into the hidden rule, significant responses were observed in the same medial prefrontal area. After insight, a distributed set of parietal and frontal areas is recruited among which information concerning the hidden rule can be shared in a so-called global workspace.

Sleep promotes offline enhancement of an explicitly learned discrete but not an explicitly learned continuous task

BACKGROUND

Healthy young individuals benefit from sleep to promote offline enhancement of a variety of explicitly learned discrete motor tasks. It remains unknown if sleep will promote learning of other types of explicit tasks. The purpose of this study is to verify the role of sleep in learning an explicitly instructed discrete motor task and to determine if participants who practice an explicitly instructed continuous tracking task demonstrate sleep-dependent offline learning of this task.

METHODS

In experiment 1, 28 healthy young adults (mean age 25.6 ± 3.8 years) practiced a serial reaction time (SRT) task at either 8 am (SRT no-sleep group) or 8 pm (SRT sleep group) and underwent retention testing 12 ± 1 hours later. In experiment 2, 20 healthy young individuals (mean age 25.6 ± 3.3 years) practiced a continuous tracking task and were similarly divided into a no-sleep (continuous tracking no-sleep group) or sleep group (continuous tracking sleep group). Individuals in both experiments were provided with explicit instruction on the presence of a sequence in their respective task prior to practice.

RESULTS

Individuals in the SRT sleep group demonstrated a significant offline reduction in reaction time whereas the SRT no-sleep group did not. Results for experiment 1 provide concurrent evidence that explicitly learned discrete tasks undergo sleep-dependent offline enhancement. Individuals in the continuous tracking sleep group failed to demonstrate a significant offline reduction in tracking error. However, the continuous tracking no-sleep group did demonstrate a significant offline improvement in performance. Results for experiment 2 indicate that sleep is not critical for offline enhancement of an explicit learned continuous task.

CONCLUSION

The findings that individuals who practiced an explicitly instructed discrete task experienced sleep-dependent offline learning while those individuals who practiced an explicitly instructed continuous task did not may be due to the difference in motor control or level of complexity between discrete and continuous tasks.

Differential associations of early- and late-night sleep with functional brain states promoting insight to abstract task regularity

Background

Solving a task with insight has been associated with occipital and right-hemisphere activations. The present study tested the hypothesis if sleep-related alterations in functional activation states modulate the probability of insight into a hidden abstract regularity of a task.

Methodology

State-dependent functional activation was measured by beta and alpha electroencephalographic (EEG) activity and spatial synchronization. Task-dependent functional activation was assessed by slow cortical potentials (SPs). EEG parameters during the performance of the Number Reduction Task (NRT) were compared between before sleep and after sleep sessions. In two different groups, the relevant sleep occurred either in the first or in the second half of the night, dominated by slow wave sleep (SWS) or by rapid eye movement (REM) sleep.

Principal Findings

Changes in EEG parameters only occurred in the early-night group, not in the late-night group and indicated occipital and right-hemisphere functional alterations. These changes were associated with off-line consolidation of implicit task representations and with the amount of SWS but they did not predict subsequent insight. The gain of insight was, however, independently associated with changes of spectral beta and alpha measures only in those subjects from the two sleep groups who would subsequently comprehend the hidden regularity of the task. Insight-related enhancement of right frontal asymmetry after sleep did not depend on sleep stages.

Significance

It is concluded that off-line restructuring of implicit information during sleep is accompanied by alterations of functional activation states after sleep. This mechanism is promoted by SWS but not by REM sleep and may contribute to attaining insight after sleep. Original neurophysiologic evidence is provided for alterations of the functional activation brain states after sleep. These alterations are associated with a decrease in controlled processing within the visual system and with an increase in the functional connectivity of the right hemisphere, and are supported by SWS in the first half of the night.

Patterns of Implicit Learning Below the Level of Conscious Knowledge

The objective of the present study was to evaluate patterns of implicit processing in a task where the acquisition of explicit and implicit knowledge occurs simultaneously. The number reduction task (NRT) was used as having two levels of organization, overt and covert, where the covert level of processing is associated with implicit associative and implicit procedural learning. One aim was to compare these two types of implicit processes in the NRT when sleep was or was not introduced between initial formation of task representations and subsequent NRT processing. To assess the effects of different sleep stages, two sleep groups (early- and late-night groups) were used where initial training of the task was separated from subsequent retest by 3 h full of predominantly slow wave sleep (SWS) or rapid eye movement (REM) sleep. In two no-sleep groups, no interval was introduced between initial and subsequent NRT performance. A second aim was to evaluate the interaction between procedural and associative implicit learning in the NRT. Implicit associative learning was measured by the difference between the speed of responses that could or could not be predicted by the covert abstract regularity of the task. Implicit procedural on-line learning was measured by the practice-based increased speed of performance with time on task. Major results indicated that late-night sleep produced a substantial facilitation of implicit associations without modifying individual ability for explicit knowledge generation or for procedural on-line learning. This was evidenced by the higher rate of subjects who gained implicit knowledge of abstract task structure in the late-night group relative to the early-night and no-sleep groups. Independently of sleep, gain of implicit associative knowledge was accompanied by a relative slowing of responses to unpredictable items suggesting reciprocal interactions between associative and motor procedural processes within the implicit system. These observations provide evidence for the separability and interactions of different patterns of processing within implicit memory.

Awareness of knowledge or awareness of processing? Implications for sleep-related memory consolidation

The present study assessed the effects of awareness at encoding on off-line learning during sleep. A new framework is suggested according to which two aspects of awareness are distinguished: awareness of task information, and awareness of task processing. The number reduction task (NRT) was employed because it has two levels of organization, an overt one based on explicit knowledge of task instructions, and a covert one based on hidden abstract regularities of task structure (implicit knowledge). Each level can be processed consciously (explicitly) or non-consciously (implicitly). Different performance parameters were defined to evaluate changes between two sessions for each of the four conditions of awareness arising from whether explicit or implicit task information was processed explicitly or implicitly. In two groups of subjects, the interval between the pre-sleep and post-sleep sessions was filled either with early-night sleep, rich in slow wave sleep (SWS), or late-night sleep, rich in rapid eye movement (REM) sleep. Results show that implicit processing of explicit information was improved in the post-sleep relative to the pre-sleep session only in the early-night group. Independently of sleep stage, changes between sessions occurred for explicit processing of implicit information only in those subjects who gained insight into the task regularity after sleep. It is concluded that SWS but not REM sleep specifically supports gains in computational skills for the processing of information that was accessible by consciousness before sleep.