Cross-modal transfer of statistical information benefits from sleep

Taking time: Auditory statistical learning benefits from distributed exposure

In an auditory statistical learning paradigm, listeners learn to partition a continuous stream of syllables by discovering the repeating syllable patterns that constitute the speech stream. Here, we ask whether auditory statistical learning benefits from spaced exposure compared with massed exposure. In a longitudinal online study on Prolific, we exposed 100 participants to the regularities in a spaced way (i.e., with exposure blocks spread out over 3 days) and another 100 in a massed way (i.e., with all exposure blocks lumped together on a single day). In the exposure phase, participants listened to streams composed of pairs while responding to a target syllable. The spaced and massed groups exhibited equal learning during exposure, as indicated by a comparable response-time advantage for predictable target syllables. However, in terms of resulting long-term knowledge, we observed a benefit from spaced exposure. Following a 2-week delay period, we tested participants' knowledge of the pairs in a forced-choice test. While both groups performed above chance, the spaced group had higher accuracy. Our findings speak to the importance of the timing of exposure to structured input and also for statistical learning outside of the laboratory (e.g., in language development), and imply that current investigations of auditory statistical learning likely underestimate human statistical learning abilities.

Rule Abstraction Is Facilitated by Auditory Cuing in REM Sleep

Sleep facilitates abstraction, but the exact mechanisms underpinning this are unknown. Here, we aimed to determine whether triggering reactivation in sleep could facilitate this process. We paired abstraction problems with sounds, then replayed these during either slow-wave sleep (SWS) or rapid eye movement (REM) sleep to trigger memory reactivation in 27 human participants (19 female). This revealed performance improvements on abstraction problems that were cued in REM, but not problems cued in SWS. Interestingly, the cue-related improvement was not significant until a follow-up retest 1 week after the manipulation, suggesting that REM may initiate a sequence of plasticity events that requires more time to be implemented. Furthermore, memory-linked trigger sounds evoked distinct neural responses in REM, but not SWS. Overall, our findings suggest that targeted memory reactivation in REM can facilitate visual rule abstraction, although this effect takes time to unfold.SIGNIFICANCE STATEMENT The ability to abstract rules from a corpus of experiences is a building block of human reasoning. Sleep is known to facilitate rule abstraction, but it remains unclear whether we can manipulate this process actively and which stage of sleep is most important. Targeted memory reactivation (TMR) is a technique that uses re-exposure to learning-related sensory cues during sleep to enhance memory consolidation. Here, we show that TMR, when applied during REM sleep, can facilitate the complex recombining of information needed for rule abstraction. Furthermore, we show that this qualitative REM-related benefit emerges over the course of a week after learning, suggesting that memory integration may require a slower form of plasticity.

Advantage conferred by overnight sleep on schema-related memory may last only a day

Study Objectives

Sleep contributes to declarative memory consolidation. Independently, schemas benefit memory. Here we investigated how sleep compared with active wake benefits schema consolidation 12 and 24 hours after initial learning.

Methods

Fifty-three adolescents (age: 15-19 years) randomly assigned into sleep and active wake groups participated in a schema-learning protocol based on transitive inference (i.e. If B > C and C > D then B > D). Participants were tested immediately after learning and following 12-, and 24-hour intervals of wake or sleep for both the adjacent (e.g. B-C, C-D; relational memory) and inference pairs: (e.g.: B-D, B-E, and C-E). Memory performance following the respective 12- and 24-hour intervals were analyzed using a mixed ANOVA with schema (schema, no-schema) as the within-participant factor, and condition (sleep, wake) as the between-participant factor.

Results

Twelve hours after learning, there were significant main effects of condition (sleep, wake) and schema, as well as a significant interaction, whereby schema-related memory was significantly better in the sleep condition compared to wake. Higher sleep spindle density was most consistently associated with greater overnight schema-related memory benefit. After 24 hours, the memory advantage of initial sleep was diminished.

Conclusions

Overnight sleep preferentially benefits schema-related memory consolidation following initial learning compared with active wake, but this advantage may be eroded after a subsequent night of sleep. This is possibly due to delayed consolidation that might occur during subsequent sleep opportunities in the wake group.

Clinical Trial Information

Name: Investigating Preferred Nap Schedules for Adolescents (NFS5) URL: https://clinicaltrials.gov/ct2/show/NCT04044885. Registration: NCT04044885.

Sleep loss disrupts the neural signature of successful learning

Sleep supports memory consolidation as well as next-day learning. The influential "Active Systems" account of offline consolidation suggests that sleep-associated memory processing paves the way for new learning, but empirical evidence in support of this idea is scarce. Using a within-subjects (n = 30), crossover design, we assessed behavioral and electrophysiological indices of episodic encoding after a night of sleep or total sleep deprivation in healthy adults (aged 18-25 years) and investigated whether behavioral performance was predicted by the overnight consolidation of episodic associations from the previous day. Sleep supported memory consolidation and next-day learning as compared to sleep deprivation. However, the magnitude of this sleep-associated consolidation benefit did not significantly predict the ability to form novel memories after sleep. Interestingly, sleep deprivation prompted a qualitative change in the neural signature of encoding: Whereas 12-20 Hz beta desynchronization-an established marker of successful encoding-was observed after sleep, sleep deprivation disrupted beta desynchrony during successful learning. Taken together, these findings suggest that effective learning depends on sleep but not necessarily on sleep-associated consolidation.

Can adults with developmental dyslexia apply statistical knowledge to a new context?

We investigated transfer of artificial grammar learning in adults with and without dyslexia in 3 experiments. In Experiment 1, participants implicitly learned an artificial grammar system and were tested on new items that included the same symbols. In Experiment 2, participants were given practice with letter strings and then tested on strings created with a different letter set. In Experiment 3, participants were given practice with shapes and then tested on strings created with different shapes. Results show that in Experiment 1, both groups demonstrated utilization of pre-trained instances in the subsequent grammaticality judgement task, while in Experiments 2 (orthographic) and 3 (nonorthographic), only typically developed participants demonstrated application of knowledge from training to test. A post hoc analysis comparing between the experiments suggests that being trained and tested on an orthographic task leads to better performance than a nonorthographic task among typically developed adults but not among adults with dyslexia. Taken together, it appears that following extensive training, individuals with dyslexia are able to form stable representations from sequential stimuli and use them in a subsequent task that utilizes strings of similar symbols. However, the manipulation of the symbols challenges this ability.

Failure to consolidate statistical learning in developmental dyslexia

Statistical learning (SL), the ability to pick up patterns in sensory input, serves as one of the building blocks of language acquisition. Although SL has been studied extensively in developmental dyslexia (DD), much less is known about the way SL evolves over time. The handful of studies examining this question were all limited to the acquisition of motor sequential knowledge or highly learned segmented linguistic units. Here we examined memory consolidation of statistical regularities in adults with DD and typically developed (TD) readers by using auditory SL requiring the segmentation of units from continuous input, which represents one of the earliest learning challenges in language acquisition. DD and TD groups were exposed to tones in a probabilistically determined sequential structure varying in difficulty and subsequently tested for recognition of novel short sequences that adhered to this statistical pattern in immediate and delayed-recall sessions separated by a night of sleep. SL performance of the DD group at the easy and hard difficulty levels was poorer than that of the TD group in the immediate-recall session. Importantly, DD participants showed a significant overnight deterioration in SL performance at the medium difficulty level compared to TD, who instead showed overnight stabilization of the learned information. These findings imply that SL difficulties in DD may arise not only from impaired initial learning but also due to a failure to consolidate statistically structured information into long-term memory. We hypothesize that these deficits disrupt the typical course of language acquisition in those with DD.

Sleep bolsters schematically incongruent memories

Our ability to recall memories is improved when sleep follows learning, suggesting that sleep facilitates memory consolidation. A number of factors are thought to influence the impact of sleep on newly learned information, such as whether or not we rehearse that information (e.g. via restudy or retrieval practice), or the extent to which the information is consistent with our pre-existing schematic knowledge. In this pre-registered, online study, we examined the effects of both rehearsal and schematic congruency on overnight consolidation. Participants learned noun-colour pairings (e.g. elephant-red) and rated each pairing as plausible or implausible before completing a baseline memory assessment. Afterwards, participants engaged in a period of restudy or retrieval practice for the pairings, and then entered a 12 h retention interval of overnight sleep or daytime wakefulness. Follow-up assessments were completed immediately after sleep or wake, and again 24 h after learning. Our data indicated that overnight consolidation was amplified for restudied relative to retested noun-colour pairings, but only when sleep occurred soon after learning. Furthermore, whereas plausible (i.e. schematically congruent) pairings were generally better remembered than implausible (i.e. schematically incongruent) pairings, the benefits of sleep were stronger for implausible relative to plausible memories. These findings challenge the notion that schema-conformant memories are preferentially strengthened during post-learning sleep.

Sleep Facilitates Extraction of Temporal Regularities With Varying Timescales

Evidence suggests that memory consolidation is facilitated by sleep, both through the strengthening of existing memories and by extracting regularities embedded in those memories. We previously observed that one sleep stage, Slow-Wave sleep (SWS), is particularly involved in the extraction of temporal regularities. We suggested that this attribute can naturally stem from the time-compressed memory replay known to occur in the hippocampus during SWS. A prediction coming out of this “temporal scaffolding” hypothesis is that sleep would be especially influential on extraction of temporal regularities when the time gap between the events constituting the regularities is shortish. In this study, we tested this prediction. Eighty-three participants performed a cognitive task in which hidden temporal regularities of varying time gaps were embedded. Detecting these regularities could significantly improve performance. Participants performed the task in two sessions with an interval filled with either wake or sleep in between. We found that sleep improved performance across all time gaps and that the longer the gap had been, the smaller was the improvement across both sleep and wake. No interaction between sleep and gap size was observed; however, unlike sleeping participants, awake participants did not exhibit any further performance improvement for the long gaps following the interval. In addition, across all participants, performance for the long gaps was associated with the development of conscious awareness to the regularities. We discuss these results in light of the temporal scaffolding hypothesis and suggest future directions to further elucidate the mechanisms involved.

Future-relevant memories are not selectively strengthened during sleep

Overnight consolidation processes are thought to operate in a selective manner, such that important (i.e. future-relevant) memories are strengthened ahead of irrelevant information. Using an online protocol, we sought to replicate the seminal finding that the memory benefits of sleep are enhanced when people expect a future test [Wilhelm et al., 2011]. Participants memorised verbal paired associates to a criterion of 60 percent (Experiment 1) or 40 percent correct (Experiment 2) before a 12-hour delay containing overnight sleep (sleep group) or daytime wakefulness (wake group). Critically, half of the participants were informed that they would be tested again the following day, whereas the other half were told that they would carry out a different set of tasks. We observed a robust memory benefit of overnight consolidation, with the sleep group outperforming the wake group in both experiments. However, knowledge of an upcoming test had no impact on sleep-associated consolidation in either experiment, suggesting that overnight memory processes were not enhanced for future-relevant information. These findings, together with other failed replication attempts, show that sleep does not provide selective support to memories that are deemed relevant for the future.

Occipital sleep spindles predict sequence learning in a visuo-motor task

STUDY OBJECTIVES

The brain appears to use internal models to successfully interact with its environment via active predictions of future events. Both internal models and the predictions derived from them are based on previous experience. However, it remains unclear how previously encoded information is maintained to support this function, especially in the visual domain. In the present study, we hypothesized that sleep consolidates newly encoded spatio-temporal regularities to improve predictions afterwards.

METHODS

We tested this hypothesis using a novel sequence-learning paradigm that aimed to dissociate perceptual from motor learning. We recorded behavioral performance and high-density electroencephalography (EEG) in male human participants during initial training and during testing two days later, following an experimental night of sleep (n = 16, including high-density EEG recordings) or wakefulness (n = 17).

RESULTS

Our results show sleep-dependent behavioral improvements correlated with sleep-spindle activity specifically over occipital cortices. Moreover, event-related potential (ERP) responses indicate a shift of attention away from predictable to unpredictable sequences after sleep, consistent with enhanced automaticity in the processing of predictable sequences.

CONCLUSIONS

These findings suggest a sleep-dependent improvement in the prediction of visual sequences, likely related to visual cortex reactivation during sleep spindles. Considering that controls in our experiments did not fully exclude oculomotor contributions, future studies will need to address the extent to which these effects depend on purely perceptual versus oculomotor sequence learning.

Artificial grammar learning is facilitated by distributed practice: Evidence from a letter reordering task

Previous studies have shown that distributed practice-a training strategy that is known to facilitate memory-is likely to result in greater learning than massed practice. This effect has been demonstrated largely in explicit tasks. The purpose of this study was to test whether statistical learning of artificial grammar is affected by the lag between learning sessions overall, and by high and low complexity stimuli (as measure by chunk strength). Two groups (spaced-short and spaced-long) learned strings of letters created according to a set of rules and were required to produce new strings using given letter sets. For the spaced-short group, the two learning sessions, each including training and a test phase, took place sequentially with a 10-min break, whereas for the spaced-long group, learning sessions were distributed across two days (1-day lag). Overall results showed improved performance following spaced-long practice compared to spaced-short practice. The results also indicated that in the low chunk strength strings (indicating high complexity), both groups demonstrated similar improvement from first to second testing, while in the high chunk strength strings (indicating low complexity), improvement in letter reordering performance was significantly higher when the learning sessions were distributed across two days. This pattern of findings suggests that stimuli complexity affects the extent to which distributed practice enhance artificial grammar learning.

Sleep strengthens integration of spatial memory systems

Spatial memory comprises different representational systems that are sensitive to different environmental cues, like proximal landmarks or local boundaries. Here we examined how sleep affects the formation of a spatial representation integrating landmark-referenced and boundary-referenced representations. To this end, participants (n = 42) were familiarized with an environment featuring both a proximal landmark and a local boundary. After nocturnal periods of sleep or wakefulness and another night of sleep, integration of the two representational systems was tested by testing the participant's flexibility to switch from landmark-based to boundary-based navigation in the environment, and vice versa. Results indicate a distinctly increased flexibility in relying on either landmarks or boundaries for navigation, when familiarization to the environment was followed by sleep rather than by wakefulness. A second control study (n = 45) did not reveal effects of sleep (vs. wakefulness) on navigation in environments featuring only landmarks or only boundaries. Thus, rather than strengthening isolated representational systems per se, sleep presumably through forming an integrative representation, enhances flexible coordination of representational subsystems.

Cross-Modal Transfer Following Auditory Task-Switching Training in Old Adults

Maintaining and coordinating multiple task-sets is difficult and leads to costs, however task-switching training can reduce these deficits. A recent study in young adults demonstrated that this training effect occurs at an amodal processing level. Old age is associated with reduced cognitive plasticity and further increases the performance costs when mixing multiple tasks. Thus, cognitive aging might be a limiting factor for inducing cross-modal training effects in a task-switching environment. We trained participants, aged 62-83 years, with an auditory task-switching paradigm over four sessions (2880 total trials), to investigate whether training-related reductions in task-switching costs would also manifest in an untrained visual modality version of the task. Two control groups trained with single tasks (active control) or not trained (passive control) allowed us to identify improvements specific to task-switching training. To make statistical evaluations of any age differences in training and cross-modal transfer, the data from the Kattner cohort were incorporated into the present analysis. Despite the tendency for older adults to respond more cautiously, task-switching training specifically led to a mixing cost reduction in both trained and untrained modalities, the magnitude of which was statistically similar regardless of age. In line with a growing body of research, we failed to observe any far transfer effects in measures of inhibition, working memory or fluid intelligence. Overall, we conclude that any apparent cognitive limitations associated with aging do not prevent cognitive control processes which support set-shifting from improving at an amodal level.

Sleep spindle activity correlates with implicit statistical learning consolidation in untreated obstructive sleep apnea patients

OBJECTIVE/BACKGROUND

The aim of this study was to examine the relationship between overnight consolidation of implicit statistical learning with spindle frequency EEG activity and slow frequency delta power during non-rapid eye movement (NREM) sleep in obstructive sleep apnea (OSA).

PATIENTS/METHODS

Forty-seven OSA participants completed the experiment. Prior to sleep, participants performed a reaction time cover task containing hidden patterns of pictures, about which participants were not informed. After the familiarisation phase, participants underwent overnight polysomnography. 24 h after the familiarisation phase, participants performed a test phase to assess their learning of the hidden patterns, expressed as a percentage of the number of correctly identified patterns. Spindle frequency activity (SFA) and delta power (0.5-4.5 Hz), were quantified from NREM electroencephalography. Associations between statistical learning and sleep EEG, and OSA severity measures were examined.

RESULTS

SFA in NREM sleep in frontal and central brain regions was positively correlated with statistical learning scores (r = 0.41 to 0.31, p = 0.006 to 0.044). In multiple regression, greater SFA and longer sleep onset latency were significant predictors of better statistical learning performance. Delta power and OSA severity were not significantly correlated with statistical learning.

CONCLUSIONS

These findings suggest spindle activity may serve as a marker of statistical learning capability in OSA. This work provides novel insight into how altered sleep physiology relates to consolidation of implicitly learnt information in patients with moderate to severe OSA.

Sleep’s Role in Schema Learning and Creative Insights

Purpose of Review

A recent resurgence of interest in schema theory has influenced research on sleep-dependent memory consolidation and led to a new understanding of how schemata might be activated during sleep and play a role in the reorganisation of memories. This review is aimed at synthesising recent findings into a coherent narrative and draw overall conclusions.

Recent Findings

Rapid consolidation of schematic memories has been shown to benefit from an interval containing sleep. These memories have shown reduced reliance on the hippocampus following consolidation in both humans and rodents. Using a variety of methodologies, notably including the DRM paradigm, it has been shown that activation of a schema can increase the rate of false memory as a result of activation of semantic associates during slow wave sleep (SWS). Memories making use of a schema have shown increased activity in the medial prefrontal cortex, which may reflect both the schematic activation itself and a cognitive control component selecting an appropriate schema to use. SWS seems to be involved in assimilation of new memories within existing semantic frameworks and in making memories more explicit, while REM sleep may be more associated with creating entirely novel associations while keeping memories implicit.

Summary

Sleep plays an important role in schematic memory consolidation, with more rapid consolidation, reduced hippocampal involvement, and increased prefrontal involvement as the key characteristics. Both SWS and REM sleep may have a role to play.

Sleep and the extraction of hidden regularities: A systematic review and the importance of temporal rules

As part of its role in memory consolidation, sleep has been repeatedly identified as critical for the extraction of regularities from wake experiences. However, many null results have been published as well, with no clear consensus emerging regarding the conditions that yield this sleep effect. Here, we systematically review the role of sleep in the extraction of hidden regularities, specifically those involving associative relations embedded in newly learned information. We found that the specific behavioral task used in a study had far more impact on whether a sleep effect was discovered than either the category of the cognitive processes targeted, or the particular experimental design employed. One emerging pattern, however, was that the explicit detection of hidden rules is more likely to happen when the rules are of a temporal nature (i.e., event A at time t predicts a later event B) than when they are non-temporal. We discuss this temporal rule sensitivity in reference to the compressed memory replay occurring in the hippocampus during slow-wave-sleep, and compare this effect to what happens when the extraction of regularities depends on prior knowledge and relies on structures other than the hippocampus.

How Memory Replay in Sleep Boosts Creative Problem-Solving

Creative thought relies on the reorganisation of existing knowledge. Sleep is known to be important for creative thinking, but there is a debate about which sleep stage is most relevant, and why. We address this issue by proposing that rapid eye movement sleep, or 'REM', and non-REM sleep facilitate creativity in different ways. Memory replay mechanisms in non-REM can abstract rules from corpuses of learned information, while replay in REM may promote novel associations. We propose that the iterative interleaving of REM and non-REM across a night boosts the formation of complex knowledge frameworks, and allows these frameworks to be restructured, thus facilitating creative thought. We outline a hypothetical computational model which will allow explicit testing of these hypotheses.

Sleep-Dependent Memory Consolidation and Incremental Sentence Comprehension: Computational Dependencies during Language Learning as Revealed by Neuronal Oscillations

We hypothesize a beneficial influence of sleep on the consolidation of the combinatorial mechanisms underlying incremental sentence comprehension. These predictions are grounded in recent work examining the effect of sleep on the consolidation of linguistic information, which demonstrate that sleep-dependent neurophysiological activity consolidates the meaning of novel words and simple grammatical rules. However, the sleep-dependent consolidation of sentence-level combinatorics has not been studied to date. Here, we propose that dissociable aspects of sleep neurophysiology consolidate two different types of combinatory mechanisms in human language: sequence-based (order-sensitive) and dependency-based (order-insensitive) combinatorics. The distinction between the two types of combinatorics is motivated both by cross-linguistic considerations and the neurobiological underpinnings of human language. Unifying this perspective with principles of sleep-dependent memory consolidation, we posit that a function of sleep is to optimize the consolidation of sequence-based knowledge (the when) and the establishment of semantic schemas of unordered items (the what) that underpin cross-linguistic variations in sentence comprehension. This hypothesis builds on the proposal that sleep is involved in the construction of predictive codes, a unified principle of brain function that supports incremental sentence comprehension. Finally, we discuss neurophysiological measures (EEG/MEG) that could be used to test these claims, such as the quantification of neuronal oscillations, which reflect basic mechanisms of information processing in the brain.

Cued Memory Reactivation During SWS Abolishes the Beneficial Effect of Sleep on Abstraction

Study Objectives

Extracting regularities from stimuli in our environment and generalizing these to new situations are fundamental processes in human cognition. Sleep has been shown to enhance these processes, possibly by facilitating reactivation-triggered memory reorganization. Here, we assessed whether cued reactivation during slow wave sleep (SWS) promotes the beneficial effect of sleep on abstraction of statistical regularities.

Methods

We used an auditory statistical learning task, in which the benefit of sleep has been firmly established. Participants were exposed to a probabilistically determined sequence of tones and subsequently tested for recognition of novel short sequences adhering to this same statistical pattern in both immediate and delayed recall sessions. In different groups, the exposure stream was replayed during SWS in the night between the recall sessions (SWS-replay group), in wake just before sleep (presleep replay group), or not at all (control group).

Results

Surprisingly, participants who received replay in sleep performed worse in the delayed recall session than the control and the presleep replay group. They also failed to show the association between SWS and task performance that has been observed in previous studies and was present in the controls. Importantly, sleep structure and sleep quality did not differ between groups, suggesting that replay during SWS did not impair sleep but rather disrupted or interfered with sleep-dependent mechanisms that underlie the extraction of the statistical pattern.

Conclusions

These findings raise important questions about the scope of cued memory reactivation and the mechanisms that underlie sleep-related generalization.