Exploring a novel environment improves motivation and promotes recall of words

Interactive Virtual Ankle Movement Controlled by Wrist sEMG Improves Motor Imagery: An Exploratory Study

Virtual reality (VR) techniques can significantly enhance motor imagery training by creating a strong illusion of action for central sensory stimulation. In this article, we establish a precedent by using surface electromyography (sEMG) of contralateral wrist movement to trigger virtual ankle movement through an improved data-driven approach with a continuous sEMG signal for fast and accurate intention recognition. Our developed VR interactive system can provide feedback training for stroke patients in the early stages, even if there is no active ankle movement. Our objectives are to evaluate: 1) the effects of VR immersion mode on body illusion, kinesthetic illusion, and motor imagery performance in stroke patients; 2) the effects of motivation and attention when utilizing wrist sEMG as a trigger signal for virtual ankle motion; 3) the acute effects on motor function in stroke patients. Through a series of well-designed experiments, we have found that, compared to the 2D condition, VR significantly increases the degree of kinesthetic illusion and body ownership of the patients, and improves their motor imagery performance and motor memory. When compared to conditions without feedback, using contralateral wrist sEMG signals as trigger signals for virtual ankle movement enhances patients' sustained attention and motivation during repetitive tasks. Furthermore, the combination of VR and feedback has an acute impact on motor function. Our exploratory study suggests that the sEMG-based immersive virtual interactive feedback provides an effective option for active rehabilitation training for severe hemiplegia patients in the early stages, with great potential for clinical application.

Contextual novelty detection and novelty-related memory enhancement in amnestic mild cognitive impairment

INTRODUCTION

Though novelty processing plays a critical role in memory function, little is known about how it influences learning in memory-impaired populations, such as amnestic Mild Cognitive Impairment (aMCI).

METHODS

21 aMCI patients and 22 age- and education-matched healthy older participants performed two tasks-(i) an oddball paradigm where fractals that were often repeated (60 % of the stimuli), less frequently repeated (20 %), or novel (presented once each) were shown to assess novelty preference (longer viewing time for novel than familiar stimuli), and (ii) a Von Restorff paradigm assessing novelty-related effects on memory. Participants studied 22 lists of 10 words. Among these lists, 18 contained an isolated word different from the others by its distinctive aspect, here the font size (90-point, 120-point or 150-point against 60-point for non-isolated words). The remaining four were control lists without isolated words. After studying each list, participants freely recalled the maximum words possible.

RESULTS

For the oddball task, a group-by-stimulus type ANOVA on median viewing times revealed a significant effect of stimulus type, but not of group. Both groups spent more time on novel stimuli. For the Von Restorff task, both aMCI and healthy controls recalled the isolated words (presented in 120-point or 150-point, but not 90-point) better than others (excluding primacy and recency effects). Novelty-related memory benefit-gain factor-was computed as the difference between the recall scores for isolated and other words. A group-by-font size ANOVA on gain factors revealed no group effect, nor interaction, suggesting that aMCI patients benefited from novelty, alike controls.

CONCLUSION

Novelty preference and the boosting effect of isolation-related novelty on subsequent recall seem preserved despite impaired episodic memory in aMCI patients. This is discussed in the light of contemporary divergent theories regarding the relationship between novelty and memory, as either being independent or parts of a continuum.

Altered hierarchical auditory predictive processing after lesions to the orbitofrontal cortex

Orbitofrontal cortex (OFC) is classically linked to inhibitory control, emotion regulation, and reward processing. Recent perspectives propose that the OFC also generates predictions about perceptual events, actions, and their outcomes. We tested the role of the OFC in detecting violations of prediction at two levels of abstraction (i.e., hierarchical predictive processing) by studying the event-related potentials (ERPs) of patients with focal OFC lesions (n = 12) and healthy controls (n = 14) while they detected deviant sequences of tones in a local-global paradigm. The structural regularities of the tones were controlled at two hierarchical levels by rules defined at a local (i.e., between tones within sequences) and at a global (i.e., between sequences) level. In OFC patients, ERPs elicited by standard tones were unaffected at both local and global levels compared to controls. However, patients showed an attenuated mismatch negativity (MMN) and P3a to local prediction violation, as well as a diminished MMN followed by a delayed P3a to the combined local and global level prediction violation. The subsequent P3b component to conditions involving violations of prediction at the level of global rules was preserved in the OFC group. Comparable effects were absent in patients with lesions restricted to the lateral PFC, which lends a degree of anatomical specificity to the altered predictive processing resulting from OFC lesion. Overall, the altered magnitudes and time courses of MMN/P3a responses after lesions to the OFC indicate that the neural correlates of detection of auditory regularity violation are impacted at two hierarchical levels of rule abstraction.

Reduction in the activity of VTA/SNc dopaminergic neurons underlies aging-related decline in novelty seeking

Curiosity, or novelty seeking, is a fundamental mechanism motivating animals to explore and exploit environments to improve survival, and is also positively associated with cognitive, intrapersonal and interpersonal well-being in humans. However, curiosity declines as humans age, and the decline even positively predicts the extent of cognitive decline in Alzheimer's disease patients. Therefore, determining the underlying mechanism, which is currently unknown, is an urgent task for the present aging society that is growing at an unprecedented rate. This study finds that seeking behaviors for both social and inanimate novelties are compromised in aged mice, suggesting that the aging-related decline in curiosity and novelty-seeking is a biological process. This study further identifies an aging-related reduction in the activity (manifesting as a reduction in spontaneous firing) of dopaminergic neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNc). Finally, this study establishes that this reduction in activity causally underlies the aging-related decline in novelty-seeking behaviors. This study potentially provides an interventional strategy for maintaining high curiosity in the aged population, i.e., compensating for the reduced activity of VTA/SNc dopaminergic neurons, enabling the aged population to cope more smoothly with the present growing aging society, physically, cognitively and socioeconomically.

Novelty-induced memory boosts in humans: The when and how

Novel information potentially signals danger or reward and behavioral and psychophysiological studies have suggested that the brain prioritizes its processing. Some effects of novelty even go beyond the stimulus itself. Studies in animals have robustly shown that exposure to novel stimulation can promote memory for information presented before or after this exposure. Research regarding effects of novelty on memory in humans is lagging, but in the last few years, several studies have emerged that suggest that memory-facilitating effects of novelty also exist in humans. Here, we provide a comprehensive overview of these studies. We identified several factors that have been shown to influence whether novelty promotes memory or not, including the timing between the novel experience and the learning events, the involvement with the novel material, and population characteristics (such as clinical diagnosis or age). Finally, we link the behavioral findings to potential neurobiological mechanisms and discuss the relevance of specific findings in light of potential clinical and educational applications that could leverage novelty to improve memory.

Enhancing learning and retention with distinctive virtual reality environments and mental context reinstatement

Memory is inherently context-dependent: internal and environmental cues become bound to learnt information, and the later absence of these cues can impair recall. Here, we developed an approach to leverage context-dependence to optimise learning of challenging, interference-prone material. While navigating through desktop virtual reality (VR) contexts, participants learnt 80 foreign words in two phonetically similar languages. Those participants who learnt each language in its own unique context showed reduced interference and improved one-week retention (92%), relative to those who learnt the languages in the same context (76%)-however, this advantage was only apparent if participants subjectively experienced VR-based contexts as "real" environments. A follow-up fMRI experiment confirmed that reinstatement of brain activity patterns associated with the original encoding context during word retrieval was associated with improved recall performance. These findings establish that context-dependence can be harnessed with VR to optimise learning and showcase the important role of mental context reinstatement.

Novel immersive virtual reality experiences do not produce retroactive memory benefits for unrelated material

The experience of novelty can enhance memory for information that occurs close in time, even if not directly related to the experience-a phenomenon called "behavioural tagging." For example, an animal exposed to a novel spatial environment shows improved memory for other information presented previously. This has been linked to neurochemical modulations induced by novelty, which affect consolidation of memories for experiences that were encoded around the same time. Neurophysiological research in animals has shown that novelty benefits weakly encoded but not strongly encoded information. However, a benefit that is selective to weak memories seems difficult to reconcile with studies in humans that have reported that novelty improves recollection, but not familiarity. One possibility is that the novelty increases activity in hippocampus, which is also associated with processes that enable recollection. This is consistent with another prediction of behavioural tagging theory, namely that novelty only enhances consolidation of information that converges on the same neuronal population. However, no study has directly explored the relationship between encoding strength and retrieval quality (recollection versus familiarity). We examined the effects of exposure to a novel immersive virtual reality environment on memory for words presented immediately beforehand, under either deep or shallow encoding tasks, and by testing both recall memory immediately, and recognition memory with remember/know instructions the next day. However, Bayes factors showed no evidence to support the behavioural tagging predictions: that novelty would improve memory, particularly for shallowly encoded words, and this improvement would differentially affect familiarity versus recollection.

Comparing virtual reality, desktop-based 3D, and 2D versions of a category learning experiment

Virtual reality (VR) has seen increasing application in cognitive psychology in recent years. There is some debate about the impact of VR on both learning outcomes and on patterns of information access behaviors. In this study we compare performance on a category learning task between three groups: one presented with three-dimensional (3D) stimuli while immersed in the HTC Vive VR system (n = 26), another presented with the same 3D stimuli while using a flat-screen desktop computer (n = 26), and a third presented with a two-dimensional projection of the stimuli on a desktop computer while their eye movements were tracked (n = 8). In the VR and 3D conditions, features of the object to be categorized had to be revealed by rotating the object. In the eye tracking control condition (2D), all object features were visible, and participants' gaze was tracked as they examined each feature. Over 240 trials we measured accuracy, reaction times, attentional optimization, time spent on feedback, fixation durations, and fixation counts for each participant as they learned to correctly categorize the stimuli. In the VR condition, participants had increased fixation counts compared to the 3D and 2D conditions. Reaction times for the 2D condition were significantly faster and fixation durations were lower compared to the VR and 3D conditions. We found no significant differences in learning accuracy between the VR, 3D, and 2D conditions. We discuss implications for both researchers interested in using VR to study cognition, and VR developers hoping to use non-VR research to guide their designs and applications.

Effects of exploring a novel environment on memory across the lifespan

Exploration of a novel environment has been shown to promote memory formation in healthy adults. Studies in animals have suggested that such novelty-induced memory boosts are mediated by hippocampal dopamine. The dopaminergic system is known to develop and deteriorate over the lifespan, but so far, the effects of novelty on memory across the lifespan have not yet been investigated. In the current study, we had children, adolescents, younger, and older adults (n = 439) explore novel and previously familiarized virtual environments to pinpoint the effects of spatial novelty on declarative memory in humans across different age groups. After exploration, words were presented while participants performed a deep or shallow encoding task. Incidental memory was quantified in a surprise test. Results showed that participants in the deep encoding condition remembered more words than those in the shallow condition, while novelty did not influence this effect. Interestingly, however, children, adolescents and younger adults benefitted from exploring a novel compared to a familiar environment as evidenced by better word recall, while these effects were absent in older adults. Our findings suggest that the beneficial effects of novelty on memory follow the deterioration of neural pathways involved in novelty-related processes across the lifespan.

Tag and capture: how salient experiences target and rescue nearby events in memory

The long-term fate of a memory is not exclusively determined by the events occurring at the moment of encoding. Research at the cellular, circuit, and behavioral levels is beginning to reveal how neurochemical activations in the moments surrounding an event can retroactively and proactively rescue weak memory for seemingly mundane experiences. We review emerging evidence showing enhancement of weakly formed memories encoded minutes to hours before or after a related motivationally relevant experience. We discuss proposed neurobiological mechanisms for strengthening weak memories formed in temporal proximity to a strong event, and how this knowledge could be leveraged to improve memory for information that is prone to forgetting.

A resting-state network for novelty: Similar involvement of a global network under rest and task conditions

Neuroimaging research provides converging evidence in support of functional networks active under rest conditions. While these networks are typically locally-distributed, a globally-distributed resting-state network (gRSN) was recently identified. The gRSN component is characterized by a scalp topography similar to that of the widely-studied P3 component of the event related potential, thought to represent the brain's response to novelty. In this study, we investigate similarities between the neural generators underlying these two networks to test the hypothesis that the gRSN is a resting-state network for novelty. By using the second-order blind identification (SOBI) algorithm, which works with temporal information, we show that (1) a resting-state component resembling the topography of the P3 can be recovered in all participants; (2) this gRSN component can be modeled with a set of ECDs with high goodness of fit; (3) ECD locations of the gRSN correspond to a network of globally-distributed brain structures overlapping heavily with the networking underlying the P3; and, (4) structures underlying these two networks are similarly involved during task and resting-state conditions. We interpret this as evidence in support of a resting-state network for detection and response to novelty.

Expectation of irrelevant novel stimuli has no consistent effect on recognition memory

Novelty is defined as the part of an experience that is not yet represented by memory systems. Novelty has been claimed to exert various memory-enhancing effects. A pioneering study by Wittmann et al. (2007) has shown that memory formation may even benefit from the expectation of novelty. We aimed to replicate this assumed memory effect in four behavioral studies. However, our results do not support the idea that anticipated novel stimuli are more memorable than unexpected novelty. In our experiments, we systematically manipulated the novelty predicting cues to ensure that the expectations were correctly formed by the participants, however, the results showed that there was no memory enhancement for expected novel pictures in any of the examined indices, thus we could not replicate the main behavioral finding of Wittmann et al. (2007). These results call into question the original effect, and we argue that this fits more into current thinking on memory formation and brain function in general. Our results are more consistent with the view that unexpected stimuli are more likely to be retained by memory systems. Predictive coding theory suggests that unexpected stimuli are prioritized by the nervous system and this may also benefit memory processes. Novel stimuli may be unexpected and thus recognized better in some experimental setups, yet novelty and unexpectedness do not always coincide. We hope that our work can bring more consistency in the literature on novelty, as educational methods in general could also benefit from this clarification.

A bias toward the unknown: individual and environmental factors influencing exploratory behavior

With limited resources, exploring new opportunities is crucial for survival. Exploring novel options, however, comes at the cost of uncertainty. Therefore, there is a trade‐off between exploiting options with a known beneficial outcome and exploring novel options with a potentially higher gain. Computational models have suggested that novelty may promote exploratory behavior by inducing a so‐called novelty bonus through reward‐related processes. So far, few studies have provided behavioral evidence for such a novelty bonus. In this study, we aimed to investigate whether spatial novelty can stimulate exploratory behavior (Experiment 1), and whether age, novelty‐seeking, and reduced action radius or social interactions due to COVID‐19 restrictions influenced the exploration–exploitation trade‐off (Experiment 2). In both experiments, we employed a novel paradigm in which participants made binary decisions between food items, while on rare trials, a surprise option was presented. Results from Experiment 1 are in line with a novelty bonus, with spatial novelty promoting exploratory behavior. In Experiment 2, we found that exploratory behavior declined with age, high novelty seekers made more exploratory choices than low novelty seekers, and participants with a smaller action radius made fewer exploratory choices. These findings are consistent with previous findings in animals and predictions from computational models.

Novelty processing associated with neural beta oscillations improves recognition memory in young and older adults

Novelty anticipation activates the mesolimbic system and promotes subsequent long-term memory in younger adults. Importantly, mesolimbic structures typically degenerate with age, which might reduce positive effects of novelty anticipation. Here, we used electroencephalography in combination with an established paradigm in healthy young (19-33 years old, n = 28) and older (53-84, n = 27) humans. Colored cues predicted the subsequent presentation of either a novel or previously familiarized image (75% cue validity). On the subsequent day, recognition memory for the novel images was tested. Behaviorally, novelty anticipation improved recollection-based but not familiarity-based recognition memory in both groups, and this effect was more pronounced in older subjects. Furthermore, novelty and familiarity cues increased theta (4-8 Hz) and decreased alpha/beta power (9-20 Hz); at outcome, expected novel and familiar images both increased beta power (13-25 Hz). Finally, a subsequent memory effect for expected novel images was associated with increases in beta power independent of age. Together, novelty anticipation drives hippocampus-dependent long-term recognition memory across the life span, and this effect appears to be related to neural beta oscillations.

Novelty exposure induces stronger sensorimotor representations during a manual adaptation task

Active exploration of novel spatial environments enhances memory for subsequently presented explicit, declarative information in humans. These effects have been attributed to novelty promoting dopamine release via mesolimbic dopaminergic pathways in the brain. As procedural motor learning has been linked to dopamine as well, we predict that novelty effects extend to this domain. To test this hypothesis, the present study examined whether spatial novelty exploration benefits subsequent sensorimotor adaptation. Participants explored either two different virtual environments (i.e., novelty condition; n = 210) or two identical environments (i.e., familiar condition; n = 253). They then performed a manual adaptation task in which they had to adapt joystick movements to a visual perturbation. We assessed the rate of adaptation following the introduction of this perturbation, and the rate of deadaptation following its removal. While results showed reliable adaptation patterns and similar adaptation rates across both conditions, individuals in the novelty condition showed slower deadaptation. This suggests that exposure to spatial novelty induced stronger sensorimotor representations during adaptation, potentially through novelty-induced dopaminergic effects in mesocortical and/or nigrostriatal pathways. Novelty exposure may be employed to promote motor learning on tasks that require precision movements in altered sensory contexts, for example, in astronauts moving in microgravity or patients with impaired motor processing.

Anticipation of novel environments enhances memory for incidental information

Novelty is a potent driver of learning, but little is known about whether anticipation of novelty can enhance memory for incidental information. Here, participants incidentally encountered objects while they actively navigated toward novel or previously familiarized virtual rooms. Across immediate and delayed surprise memory tests, participants showed superior recollection for incidental objects encountered while anticipating novel as compared with familiarized rooms. Furthermore, memory for incidental objects correlated positively with between-participants average curiosity about novel rooms but negatively with within-participants trial-specific curiosity. Our findings contribute to the growing literature on how salient processes impact memory for incidental material.

A predictive account of how novelty influences declarative memory

A rich body of studies in the human and non-human literature has examined the question how novelty influences memory. For a variety of different stimuli, ranging from simple objects and words to vastly complex scenarios, the literature reports that novelty improves memory in some cases, but impairs memory in other cases. In recent attempts to reconcile these conflicting findings, novelty has been divided into different subtypes, such as relative versus absolute novelty, or stimulus versus contextual novelty. Nevertheless, a single overarching theory of novelty and memory has been difficult to attain, probably due to the complexities in the interactions among stimuli, environmental factors (e.g., spatial and temporal context) and level of prior knowledge (but see Duszkiewicz et al., 2019; Kafkas & Montaldi, 2018b; Schomaker & Meeter, 2015). Here we describe how a predictive coding framework might be able to shed new light on different types of novelty and how they affect declarative memory in humans. More precisely, we consider how prior expectations modulate the influence of novelty on encoding episodes into memory, e.g., in terms of surprise, and how novelty/surprise affect memory for surrounding information. By reviewing a range of behavioural findings and their possible underlying neurobiological mechanisms, we highlight where a predictive coding framework succeeds and where it appears to struggle.

Encoding-linked pupil response is modulated by expected and unexpected novelty: Implications for memory formation and neurotransmission

Whether a novel stimulus is expected or unexpected may have implications for the kind of ensuing encoding and the type of subsequent memory. Pupil response was used in the present study to explore the way expected and unexpected stimuli are encoded and whether encoding-linked pupil response is modulated by expectation. Participants first established a contingency relationship between a series of symbols and the type of stimulus (man-made or natural) that followed each one. At encoding, some of the target stimuli violated the previously established relationship (i.e., unexpected), while the majority conformed to this relationship (i.e., expected). Expectation at encoding had opposite effects on familiarity and recollection, the two types of memory that support recognition, and modulated differently the way pupil response predicted subsequent memory. Encoding of unexpected novel stimuli was associated with increased pupil dilation as a predictor of subsequent memory type and strength. In contrast, encoding of expected novel stimuli was associated with decreased pupil response (constriction), which was predictive of subsequent memory type and strength. The findings support the close link between pupil response and memory formation, but critically indicate that this is modulated by the type of novelty as defined by expectation. These novel findings have important implications for the encoding mechanisms involved when different types of novelty are detected and is proposed to indicate the operation of different neurotransmitters during memory formation.

Effects of active exploration on novelty-related declarative memory enhancement

Exploration of novel environments has reliably been shown to enhance learning in rodents. More recently, these effects have been replicated in humans using virtual reality: Memory is enhanced after exploration of novel compared to familiar virtual environments. However, exploration of a novel versus familiar environment differs in another aspect. Navigating familiar territory can rely more on habits, while navigating new territory requires active decision-making. This difference in choices could contribute to the positive effects of novelty exploration on memory. In this study, we aimed to investigate this possibility. Participants familiarized with a virtual environment (day 1) and were exposed to this environment again (day 2 or 3) and to a novel environment (day 2 or 3). Participants either actively explored the environments or were passively exposed to the exploration behavior of another participant in virtual reality. After exposure to the environment, participants performed a word-learning task and filled out questionnaires regarding virtual presence and the novelty seeking personality trait. Mixed models suggested that memory performance was higher after participants actively explored versus were passively exposed to a novel environment, while these effects were reversed for a familiar environment. Bayesian statistics provided further weak evidence that memory performance was influenced by the interaction between novelty and exposure type. Taken together, our findings suggest that active exploration may contribute to novelty-induced memory benefits, but future studies need to confirm this finding.

Exploration of a novel virtual environment improves memory consolidation in ADHD

Experimental evidence in rodents and humans suggests that long-term memory consolidation can be enhanced by the exploration of a novel environment presented during a vulnerable early phase of consolidation. This memory enhancing effect (behavioral tagging) is caused by dopaminergic and noradrenergic neuromodulation of hippocampal plasticity processes. In translation from animal to human research, we investigated whether behavioral tagging with novelty can be used to tackle memory problems observed in children and adolescents with attention-deficit/hyperactivity disorder (ADHD). 34 patients with ADHD and 34 typically developing participants (age 9–15 years) explored either a previously familiarized or a novel virtual environment 45 min after they had learned a list of 20 words. Participants took a free recall test both immediately after learning the word list and after 24 h. Patients who explored a familiar environment showed significantly impaired memory consolidation compared to typically developing peers. Exploration of a novel environment led to significantly better memory consolidation in children and adolescents with ADHD. However, we did not observe a beneficial effect of novel environment exploration in typically developing participants. Our data rather suggested that increased exploration of a novel environment as well as higher feelings of virtual immersion compromised memory performance in typically developing children and adolescents, which was not the case for patients with ADHD. We propose that behavioral tagging with novel virtual environments is a promising candidate to overcome ADHD related memory problems. Moreover, the discrepancy between children and adolescents with and without ADHD suggests that behavioral tagging might only be able to improve memory consolidation for weakly encoded information.

How to optimize knowledge construction in the brain

Well-structured knowledge allows us to quickly understand the world around us and make informed decisions to adequately control behavior. Knowledge structures, or schemas, are presumed to aid memory encoding and consolidation of new experiences so we cannot only remember the past, but also guide behavior in the present and predict the future. However, very strong schemas can also lead to unwanted side effects such as false memories and misconceptions. To overcome this overreliance on a schema, we should aim to create robust schemas that are on the one hand strong enough to help to remember and predict, but also malleable enough to avoid such undesirable side effects. This raises the question as to whether there are ways to deliberately influence knowledge construction processes, with the goal to reach such optimally balanced schemas. Here, we will discuss how the mnemonic processes in our brains build long-term knowledge and, more specifically, how different phases of memory formation (encoding, consolidation, retrieval, and reconsolidation) contribute to this schema build-up. We finally provide ways how to best keep a balance between generalized semantic and detailed episodic memories, which can prove very useful in, e.g., educational settings.

Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness

Novelty is central to the study of memory, but the wide range of experimental manipulations aimed to reveal its effects on learning produced inconsistent results. The novelty/encoding hypothesis suggests that novel information undergoes enhanced encoding and thus leads to benefits in memory, especially in recognition performance; however, recent studies cast doubts on this assumption. On the other hand, data from animal studies provided evidence on the robust effects of novelty manipulations on the neurophysiological correlates of memory processes. Conceptualizations and operationalizations of novelty are remarkably variable and were categorized into different subtypes, such as stimulus, context, associative or spatial novelty. Here, we summarize previous findings about the effects of novelty on memory and suggest that predictive coding theories provide a framework that could shed light on the differential influence of novelty manipulations on memory performance. In line with predictive coding theories, we emphasize the role of unexpectedness as a crucial property mediating the behavioral and neural effects of novelty manipulations.

The gains of a 4-week cognitive training are not modulated by novelty

Cognitive training should not only improve performance of the trained task, but also untrained abilities. Exposure to novelty can improve subsequent memory performance, suggesting that novelty exposure might be a critical factor to promote the effects of cognitive training. Therefore, we combined a 4‐week working memory training with novelty exposure. Neuropsychological tests and MRI data were acquired before and after training to analyze behavior and changes in gray matter volume, myelination, and iron levels. In total, 83 healthy older humans participated in one of three groups: Two groups completed a 4‐week computerized cognitive training of a two‐back working memory task, either in combination with novel or with familiarized nature movies. A third group did not receive any training. As expected, both training groups showed improvements in task specific working memory performance and reaction times. However, there were no transfer or novelty effects on fluid intelligence, verbal memory, digit‐span, and executive functions. At the neural level, no significant micro‐ or macrostructural changes emerged in either group. Our findings suggest that working memory training in healthy older adults is associated with task‐specific improvements, but these gains do not transfer to other cognitive domains, and it does not lead to structural brain changes.

Novelty Before or After Word Learning Does Not Affect Subsequent Memory Performance

In humans, exposure to novel images and exploration of novel virtual environments before the encoding of words improved subsequent memory performance. Animal studies revealed similar effects of novelty, both before and after learning, and could show that hippocampus-dependent dopaminergic neuromodulation plays an important role. Here, we further investigated the effects of novelty on long-term memory in humans using a novel paradigm employing short sequences of nature movies presented either before or at two time points after learning of unrelated words. Since novelty processing is associated with a release of dopamine into the hippocampus, we hypothesized that novelty exposure primarily affects hippocampus-dependent memory (i.e., recollection) but not hippocampus-independent memory (i.e., familiarity). We tested 182 healthy human subjects in three experiments including a word-learning task followed by a 1-day delayed recognition task. Importantly, participants were exposed to novel (NOV) or familiar movies (FAM) at three time points: (experiment 1) directly after encoding of the word list, (experiment 2) 15 min after encoding, (experiment 3) 15 min prior to encoding. As expected, novel movies were perceived as more interesting and led to better mood. During word recognition, reaction times were faster for remember as compared to familiarity responses in all three experiments, but this effect was not modulated by novelty. In contrast to our main hypothesis, there was no effect of novelty – before or after encoding – on subsequent word recognition, including recollection and familiarity scores. Therefore, an exposure to novel movies without an active task does not affect hippocampus-dependent and hippocampus-independent long-term recognition memory for words in humans.

Seeing the past: afterglow effects on familiarity judgments are category-specific

According to several computational models, novel items can create a learning mode with dynamics favorable to new learning, and not to memory retrieval. In line with that idea, a new item in a recognition test has been found to create a bias toward calling subsequent items new as well. Here, we tested whether this bias, which we termed the afterglow effect, is indeed caused by a general learning mode, or is caused by perceptual overlap between preceding and current items. In two experiments, we show that a preceding recognition judgment biases the current one, but only if the preceding and current items are of the same perceptual category. In contrast, we did not find strong bias effects from perceptually novel fractal images, as would be predicted if novel items induce a learning mode that then biases recognition judgments. We conclude that the afterglow effect is more likely to reflect perceptual phenomena than a learning mode. We suggest how this can be reconciled with what is known about familiarity at the neural level.

Unexplored territory: Beneficial effects of novelty on memory

Exploring novel environments enhances learning in animals. Due to differing traditions, research into the effects of spatial novelty on learning in humans is scarce. Recent developments of affordable and fMRI-compatible virtual reality (VR) and mobile EEG systems can help bridge the gap between the two literatures. One promising study showed that spatial novelty also promotes learning in humans. It still remains largely unknown, however, which aspect of novelty underlies the beneficial effect on memory, as novelty, expectations, and volition are often confounded in animal studies. In humans, these factors can be experimentally manipulated, but such studies are currently lacking. Future studies in humans could combine pharmacological interventions, neuroimaging and VR or use mobile EEG to help elucidate whether the plasticity enhancing mechanisms observed in animals, also exist in humans. When the aspects of exploring a novel environment underlying beneficial memory effects have been identified, effective novelty-exposure interventions could be designed to improve learning and counteract age-related memory decline.

Hippocampal representations as a function of time, subregion, and brain state

How does the hippocampus represent interrelated experiences in memory? We review prominent yet seemingly contradictory theoretical perspectives, which propose that the hippocampus distorts experiential representations to either emphasize their distinctiveness or highlight common elements. These fundamentally different kinds of memory representations may be instantiated in the brain via conjunctive separated codes and adaptively differentiated codes on the one hand, or integrated relational codes on the other. After reviewing empirical support for these different coding schemes within the hippocampus, we outline two organizing principles which may explain the conflicting findings in the literature. First focusing on where the memories are formed and stored, we argue that distinct hippocampal regions represent experiences at multiple levels of abstraction and may transmit them to distinct cortical networks. Then focusing on when memories are formed, we identify several factors that can open and maintain specialized time windows, during which the very same hippocampal network is biased toward one coding scheme over the others. Specifically, we discuss evidence for (1) excitability-mediated integration windows, maintained by persistently elevated CREB levels following encoding of a specific memory, (2) fleeting cholinergically-mediated windows favoring memory separation, and (3) sustained dopaminergically-mediated windows favoring memory integration. By presenting a broad overview of different hippocampal coding schemes across species, we hope to inspire future empirical and modeling research to consider how factors surrounding memory formation shape the representations in which they are stored.

Open-field exposure facilitates consummatory extinction

During extinction, the organism learns that a conditioned stimulus or a conditioned response is no longer associated with an unconditioned stimulus, and as a consequence, a decrement in the response is presented. The exposure to novel situations (e.g. exploration of a novel open field) has been used widely to modulate (i.e. either enhance or deteriorate) learning and memory. The aim of the present study was to test whether open-field exposure could modulate consummatory extinction. The results indicated that open-field exposure accelerated the extinction response (i.e. experimental animals provided novelty exposure had lower consummatory behavior than control animals) when applied before - but not after - the first extinction trial, or when applied before the second extinction trial. The results suggest that environmental treatments such as novelty exposure provide a valuable, nonpharmacological alternative to potentially modulate extinction processes.

Attention Cueing and Activity Equally Reduce False Alarm Rate in Visual-Auditory Associative Learning through Improving Memory

In our daily life, we continually exploit already learned multisensory associations and form new ones when facing novel situations. Improving our associative learning results in higher cognitive capabilities. We experimentally and computationally studied the learning performance of healthy subjects in a visual-auditory sensory associative learning task across active learning, attention cueing learning, and passive learning modes. According to our results, the learning mode had no significant effect on learning association of congruent pairs. In addition, subjects' performance in learning congruent samples was not correlated with their vigilance score. Nevertheless, vigilance score was significantly correlated with the learning performance of the non-congruent pairs. Moreover, in the last block of the passive learning mode, subjects significantly made more mistakes in taking non-congruent pairs as associated and consciously reported lower confidence. These results indicate that attention and activity equally enhanced visual-auditory associative learning for non-congruent pairs, while false alarm rate in the passive learning mode did not decrease after the second block. We investigated the cause of higher false alarm rate in the passive learning mode by using a computational model, composed of a reinforcement learning module and a memory-decay module. The results suggest that the higher rate of memory decay is the source of making more mistakes and reporting lower confidence in non-congruent pairs in the passive learning mode.

Behavioral tagging: A novel model for studying long-term memory

New information acquired by our brain is stored in the form of two types of memories: short term memory (STM) and long term memory (LTM). Initially, Synaptic and Capture hypothesis has been proposed to describe the synaptic changes that occur during memory formation. However, recently Behavioral Tagging hypothesis was proposed that relies on the setting of a learning tag and the synthesis of plasticity related proteins (PRPs). Behavioral Tagging has its roots in Synaptic and Capture hypothesis. It seeks to explain that how a learning tag produced as a result of weak training can be paired up with PRPs (formed as a result of novelty) and can lead to long lasting memories. We have focused on describing behavioral paradigms that have been used for establishing the model of "Behavioral Tagging" and the molecules which qualify for potential PRP candidature.

Electroencephalographic Correlates of Sensorimotor Integration and Embodiment during the Appreciation of Virtual Architectural Environments

Nowadays there is the hope that neuroscientific findings will contribute to the improvement of building design in order to create environments which satisfy man's demands. This can be achieved through the understanding of neurophysiological correlates of architectural perception. To this aim, the electroencephalographic (EEG) signals of 12 healthy subjects were recorded during the perception of three immersive virtual reality environments (VEs). Afterwards, participants were asked to describe their experience in terms of Familiarity, Novelty, Comfort, Pleasantness, Arousal, and Presence using a rating scale from 1 to 9. These perceptual dimensions are hypothesized to influence the pattern of cerebral spectral activity, while Presence is used to assess the realism of the virtual stimulation. Hence, the collected scores were used to analyze the Power Spectral Density (PSD) of the EEG for each behavioral dimension in the theta, alpha and mu bands by means of time-frequency analysis and topographic statistical maps. Analysis of Presence resulted in the activation of the frontal-midline theta, indicating the involvement of sensorimotor integration mechanisms when subjects expressed to feel more present in the VEs. Similar patterns also characterized the experience of familiar and comfortable VEs. In addition, pleasant VEs increased the theta power across visuomotor circuits and activated the alpha band in areas devoted to visuospatial exploration and processing of categorical spatial relations. Finally, the de-synchronization of the mu rhythm described the perception of pleasant and comfortable VEs, showing the involvement of left motor areas and embodied mechanisms for environment appreciation. Overall, these results show the possibility to measure EEG correlates of architectural perception involving the cerebral circuits of sensorimotor integration, spatial navigation, and embodiment. These observations can help testing architectural hypotheses in order to design environments matching the changing needs of humans.

Behavioral Tagging: A Translation of the Synaptic Tagging and Capture Hypothesis

Similar molecular machinery is activated in neurons following an electrical stimulus that induces synaptic changes and after learning sessions that trigger memory formation. Then, to achieve perdurability of these processes protein synthesis is required for the reinforcement of the changes induced in the network. The synaptic tagging and capture theory provided a strong framework to explain synaptic specificity and persistence of electrophysiological induced plastic changes. Ten years later, the behavioral tagging hypothesis (BT) made use of the same argument, applying it to learning and memory models. The hypothesis postulates that the formation of lasting memories relies on at least two processes: the setting of a learning tag and the synthesis of plasticity related proteins, which once captured at tagged sites allow memory consolidation. BT explains how weak events, only capable of inducing transient forms of memories, can result in lasting memories when occurring close in time with other behaviorally relevant experiences that provide proteins. In this review, we detail the findings supporting the existence of BT process in rodents, leading to the consolidation, persistence, and interference of a memory. We focus on the molecular machinery taking place in these processes and describe the experimental data supporting the BT in humans.