Novelty Before or After Word Learning Does Not Affect Subsequent Memory Performance

Eyes on Memory: Pupillometry in Encoding and Retrieval

This review critically examines the contributions of pupillometry to memory research, primarily focusing on its enhancement of our understanding of memory encoding and retrieval mechanisms mainly investigated with the recognition memory paradigm. The evidence supports a close link between pupil response and memory formation, notably influenced by the type of novelty detected. This proposal reconciles inconsistencies in the literature regarding pupil response patterns that may predict successful memory formation, and highlights important implications for encoding mechanisms. The review also discusses the pupil old/new effect and its significance in the context of recollection and in reflecting brain signals related to familiarity or novelty detection. Additionally, the capacity of pupil response to serve as a true memory signal and to distinguish between true and false memories is evaluated. The evidence provides insights into the nature of false memories and offers a novel understanding of the cognitive mechanisms involved in memory distortions. When integrated with rigorous experimental design, pupillometry can significantly refine theoretical models of memory encoding and retrieval. Furthermore, combining pupillometry with neuroimaging and pharmacological interventions is identified as a promising direction for future research.

Novelty-induced memory boosts in humans: The when and how

Novel information potentially signals danger or reward and behavioral and psychophysiological studies have suggested that the brain prioritizes its processing. Some effects of novelty even go beyond the stimulus itself. Studies in animals have robustly shown that exposure to novel stimulation can promote memory for information presented before or after this exposure. Research regarding effects of novelty on memory in humans is lagging, but in the last few years, several studies have emerged that suggest that memory-facilitating effects of novelty also exist in humans. Here, we provide a comprehensive overview of these studies. We identified several factors that have been shown to influence whether novelty promotes memory or not, including the timing between the novel experience and the learning events, the involvement with the novel material, and population characteristics (such as clinical diagnosis or age). Finally, we link the behavioral findings to potential neurobiological mechanisms and discuss the relevance of specific findings in light of potential clinical and educational applications that could leverage novelty to improve memory.

Novel immersive virtual reality experiences do not produce retroactive memory benefits for unrelated material

The experience of novelty can enhance memory for information that occurs close in time, even if not directly related to the experience-a phenomenon called "behavioural tagging." For example, an animal exposed to a novel spatial environment shows improved memory for other information presented previously. This has been linked to neurochemical modulations induced by novelty, which affect consolidation of memories for experiences that were encoded around the same time. Neurophysiological research in animals has shown that novelty benefits weakly encoded but not strongly encoded information. However, a benefit that is selective to weak memories seems difficult to reconcile with studies in humans that have reported that novelty improves recollection, but not familiarity. One possibility is that the novelty increases activity in hippocampus, which is also associated with processes that enable recollection. This is consistent with another prediction of behavioural tagging theory, namely that novelty only enhances consolidation of information that converges on the same neuronal population. However, no study has directly explored the relationship between encoding strength and retrieval quality (recollection versus familiarity). We examined the effects of exposure to a novel immersive virtual reality environment on memory for words presented immediately beforehand, under either deep or shallow encoding tasks, and by testing both recall memory immediately, and recognition memory with remember/know instructions the next day. However, Bayes factors showed no evidence to support the behavioural tagging predictions: that novelty would improve memory, particularly for shallowly encoded words, and this improvement would differentially affect familiarity versus recollection.

Effects of exploring a novel environment on memory across the lifespan

Exploration of a novel environment has been shown to promote memory formation in healthy adults. Studies in animals have suggested that such novelty-induced memory boosts are mediated by hippocampal dopamine. The dopaminergic system is known to develop and deteriorate over the lifespan, but so far, the effects of novelty on memory across the lifespan have not yet been investigated. In the current study, we had children, adolescents, younger, and older adults (n = 439) explore novel and previously familiarized virtual environments to pinpoint the effects of spatial novelty on declarative memory in humans across different age groups. After exploration, words were presented while participants performed a deep or shallow encoding task. Incidental memory was quantified in a surprise test. Results showed that participants in the deep encoding condition remembered more words than those in the shallow condition, while novelty did not influence this effect. Interestingly, however, children, adolescents and younger adults benefitted from exploring a novel compared to a familiar environment as evidenced by better word recall, while these effects were absent in older adults. Our findings suggest that the beneficial effects of novelty on memory follow the deterioration of neural pathways involved in novelty-related processes across the lifespan.

Novelty exposure induces stronger sensorimotor representations during a manual adaptation task

Active exploration of novel spatial environments enhances memory for subsequently presented explicit, declarative information in humans. These effects have been attributed to novelty promoting dopamine release via mesolimbic dopaminergic pathways in the brain. As procedural motor learning has been linked to dopamine as well, we predict that novelty effects extend to this domain. To test this hypothesis, the present study examined whether spatial novelty exploration benefits subsequent sensorimotor adaptation. Participants explored either two different virtual environments (i.e., novelty condition; n = 210) or two identical environments (i.e., familiar condition; n = 253). They then performed a manual adaptation task in which they had to adapt joystick movements to a visual perturbation. We assessed the rate of adaptation following the introduction of this perturbation, and the rate of deadaptation following its removal. While results showed reliable adaptation patterns and similar adaptation rates across both conditions, individuals in the novelty condition showed slower deadaptation. This suggests that exposure to spatial novelty induced stronger sensorimotor representations during adaptation, potentially through novelty-induced dopaminergic effects in mesocortical and/or nigrostriatal pathways. Novelty exposure may be employed to promote motor learning on tasks that require precision movements in altered sensory contexts, for example, in astronauts moving in microgravity or patients with impaired motor processing.

Anticipation of novel environments enhances memory for incidental information

Novelty is a potent driver of learning, but little is known about whether anticipation of novelty can enhance memory for incidental information. Here, participants incidentally encountered objects while they actively navigated toward novel or previously familiarized virtual rooms. Across immediate and delayed surprise memory tests, participants showed superior recollection for incidental objects encountered while anticipating novel as compared with familiarized rooms. Furthermore, memory for incidental objects correlated positively with between-participants average curiosity about novel rooms but negatively with within-participants trial-specific curiosity. Our findings contribute to the growing literature on how salient processes impact memory for incidental material.

Expectation-driven novelty effects in episodic memory

Novel and unexpected stimuli are often prioritised in memory, given their inherent salience. Nevertheless, not all forms of novelty show such an enhancement effect. Here, we discuss the role expectation plays in modulating the way novelty affects memory processes, circuits, and subsequent performance. We first review independent effects of expectation on memory, and then consider how different types of novelty are characterised by expectation. We argue that different types of novelty defined by expectation implicate differential neurotransmission in memory formation brain regions and may also result in the creation of different types of memory. Contextual novelty, which is unexpected by definition, is often associated with better recollection, supported by dopaminergic-hippocampal interactions. On the other hand, expected stimulus novelty is supported by engagement of medial temporal cortices, as well as the hippocampus, through cholinergic modulation. Furthermore, when expected stimulus novelty results in enhanced memory, it is predominantly driven by familiarity. The literature reviewed here highlights the complexity of novelty-sensitive memory systems, the distinction between types of novelty, and how they are differentially affected by expectancy.

A predictive account of how novelty influences declarative memory

A rich body of studies in the human and non-human literature has examined the question how novelty influences memory. For a variety of different stimuli, ranging from simple objects and words to vastly complex scenarios, the literature reports that novelty improves memory in some cases, but impairs memory in other cases. In recent attempts to reconcile these conflicting findings, novelty has been divided into different subtypes, such as relative versus absolute novelty, or stimulus versus contextual novelty. Nevertheless, a single overarching theory of novelty and memory has been difficult to attain, probably due to the complexities in the interactions among stimuli, environmental factors (e.g., spatial and temporal context) and level of prior knowledge (but see Duszkiewicz et al., 2019; Kafkas & Montaldi, 2018b; Schomaker & Meeter, 2015). Here we describe how a predictive coding framework might be able to shed new light on different types of novelty and how they affect declarative memory in humans. More precisely, we consider how prior expectations modulate the influence of novelty on encoding episodes into memory, e.g., in terms of surprise, and how novelty/surprise affect memory for surrounding information. By reviewing a range of behavioural findings and their possible underlying neurobiological mechanisms, we highlight where a predictive coding framework succeeds and where it appears to struggle.

Encoding-linked pupil response is modulated by expected and unexpected novelty: Implications for memory formation and neurotransmission

Whether a novel stimulus is expected or unexpected may have implications for the kind of ensuing encoding and the type of subsequent memory. Pupil response was used in the present study to explore the way expected and unexpected stimuli are encoded and whether encoding-linked pupil response is modulated by expectation. Participants first established a contingency relationship between a series of symbols and the type of stimulus (man-made or natural) that followed each one. At encoding, some of the target stimuli violated the previously established relationship (i.e., unexpected), while the majority conformed to this relationship (i.e., expected). Expectation at encoding had opposite effects on familiarity and recollection, the two types of memory that support recognition, and modulated differently the way pupil response predicted subsequent memory. Encoding of unexpected novel stimuli was associated with increased pupil dilation as a predictor of subsequent memory type and strength. In contrast, encoding of expected novel stimuli was associated with decreased pupil response (constriction), which was predictive of subsequent memory type and strength. The findings support the close link between pupil response and memory formation, but critically indicate that this is modulated by the type of novelty as defined by expectation. These novel findings have important implications for the encoding mechanisms involved when different types of novelty are detected and is proposed to indicate the operation of different neurotransmitters during memory formation.

Effects of active exploration on novelty-related declarative memory enhancement

Exploration of novel environments has reliably been shown to enhance learning in rodents. More recently, these effects have been replicated in humans using virtual reality: Memory is enhanced after exploration of novel compared to familiar virtual environments. However, exploration of a novel versus familiar environment differs in another aspect. Navigating familiar territory can rely more on habits, while navigating new territory requires active decision-making. This difference in choices could contribute to the positive effects of novelty exploration on memory. In this study, we aimed to investigate this possibility. Participants familiarized with a virtual environment (day 1) and were exposed to this environment again (day 2 or 3) and to a novel environment (day 2 or 3). Participants either actively explored the environments or were passively exposed to the exploration behavior of another participant in virtual reality. After exposure to the environment, participants performed a word-learning task and filled out questionnaires regarding virtual presence and the novelty seeking personality trait. Mixed models suggested that memory performance was higher after participants actively explored versus were passively exposed to a novel environment, while these effects were reversed for a familiar environment. Bayesian statistics provided further weak evidence that memory performance was influenced by the interaction between novelty and exposure type. Taken together, our findings suggest that active exploration may contribute to novelty-induced memory benefits, but future studies need to confirm this finding.

Exploration of a novel virtual environment improves memory consolidation in ADHD

Experimental evidence in rodents and humans suggests that long-term memory consolidation can be enhanced by the exploration of a novel environment presented during a vulnerable early phase of consolidation. This memory enhancing effect (behavioral tagging) is caused by dopaminergic and noradrenergic neuromodulation of hippocampal plasticity processes. In translation from animal to human research, we investigated whether behavioral tagging with novelty can be used to tackle memory problems observed in children and adolescents with attention-deficit/hyperactivity disorder (ADHD). 34 patients with ADHD and 34 typically developing participants (age 9–15 years) explored either a previously familiarized or a novel virtual environment 45 min after they had learned a list of 20 words. Participants took a free recall test both immediately after learning the word list and after 24 h. Patients who explored a familiar environment showed significantly impaired memory consolidation compared to typically developing peers. Exploration of a novel environment led to significantly better memory consolidation in children and adolescents with ADHD. However, we did not observe a beneficial effect of novel environment exploration in typically developing participants. Our data rather suggested that increased exploration of a novel environment as well as higher feelings of virtual immersion compromised memory performance in typically developing children and adolescents, which was not the case for patients with ADHD. We propose that behavioral tagging with novel virtual environments is a promising candidate to overcome ADHD related memory problems. Moreover, the discrepancy between children and adolescents with and without ADHD suggests that behavioral tagging might only be able to improve memory consolidation for weakly encoded information.

The gains of a 4-week cognitive training are not modulated by novelty

Cognitive training should not only improve performance of the trained task, but also untrained abilities. Exposure to novelty can improve subsequent memory performance, suggesting that novelty exposure might be a critical factor to promote the effects of cognitive training. Therefore, we combined a 4‐week working memory training with novelty exposure. Neuropsychological tests and MRI data were acquired before and after training to analyze behavior and changes in gray matter volume, myelination, and iron levels. In total, 83 healthy older humans participated in one of three groups: Two groups completed a 4‐week computerized cognitive training of a two‐back working memory task, either in combination with novel or with familiarized nature movies. A third group did not receive any training. As expected, both training groups showed improvements in task specific working memory performance and reaction times. However, there were no transfer or novelty effects on fluid intelligence, verbal memory, digit‐span, and executive functions. At the neural level, no significant micro‐ or macrostructural changes emerged in either group. Our findings suggest that working memory training in healthy older adults is associated with task‐specific improvements, but these gains do not transfer to other cognitive domains, and it does not lead to structural brain changes.