Predicting the unknown: Novelty processing depends on expectations

To update or to create? The influence of novelty and prior knowledge on memory networks

Schemas are foundational mental structures shaped by experience. They influence behaviour, guide the encoding of new memories and are shaped by associated information. The adaptability of memory schemas facilitates the integration of new information that aligns with existing knowledge structures. First, we discuss how novel information consistent with an existing schema can be swiftly assimilated when presented. This cognitive updating is facilitated by the interaction between the hippocampus and the prefrontal cortex. Second, when novel information is inconsistent with the schema, it likely engages the hippocampus to encode the information as part of an episodic memory trace. Third, novelty may enhance hippocampal dopamine through either the locus coeruleus or ventral tegmental area pathways, with the pathway involved potentially depending on the type of novelty encountered. We propose a gradient theory of schema and novelty to elucidate the neural processes by which schema updating or novel memory traces are formed. It is likely that experiences vary along a familiarity-novelty continuum, and the degree to which new experiences are increasingly novel will guide whether memory for a new experience either integrates into an existing schema or prompts the creation of a new cognitive framework. This article is part of the theme issue 'Long-term potentiation: 50 years on'.

Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials

Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

Differential effects of expectancy on memory formation in young and older adults

Novelty can promote subsequent long-term memory via the mesolimbic system, including the medial temporal lobe and midbrain structures. Importantly, these and other brain regions typically degenerate during healthy aging, which suggests a reduced impact of novelty on learning. However, evidence in favor of such a hypothesis is scarce. Thus, we used functional MRI in combination with an established paradigm in healthy young (19-32 years, n = 30) and older (51-81 years, n = 32) humans. During encoding, colored cues predicted the subsequent presentation of either a novel or previously familiarized image (75% cue validity), and approximately 24 h later, recognition memory for novel images was tested. Behaviorally, expected novel images, as compared to unexpected novel images, were better recognized in young and, to a lesser degree, older subjects. At the neural level, familiar cues activated memory related areas, especially the medial temporal lobe, whereas novelty cues activated the angular gyrus and inferior parietal lobe, which may reflect enhanced attentional processing. During outcome processing, expected novel images activated the medial temporal lobe, angular gyrus and inferior parietal lobe. Importantly, a similar activation pattern was observed for subsequently recognized novel items, which helps to explain the behavioral effect of novelty on long-term memory. Finally, age-effects were pronounced for successfully recognized novel images with relatively stronger activations in attention-related brain regions in older adults; younger adults, on the other hand, showed stronger hippocampal activation. Together, expectancy promotes memory formation for novel items via neural activity in medial temporal lobe structures and this effect appears to be reduced with age.

Cognitive control in creative discovery: The gap between ideal and reality

Creative discovery involves discovering the additional values of existing things in the environment by identifying the novel associations between seemingly unrelated things; the judgment made in this process is expected to be accurate but not entirely correct. From the perspective of cognitive processing, what is the difference between the ideal and real states of creative discovery? This is largely unknown. In this study, a daily life scenario was presented, and a great number of seemingly unrelated tools were presented for participants to discover valuable tools. Electrophysiological activity was recorded when participants identified tools, and we then retrospectively analyzed the differences between responses. Compared with usual tools, unusual tools evoked greater N2, N400 and late sustained potential (LSP) amplitudes, which was likely associated with the monitoring and resolution of cognitive conflicts. Moreover, unusual tools evoked smaller N400 and greater LSP amplitudes when correctly identified as usable than when identified as unusable; this result suggested that creative discovery in the ideal state should depend on the cognitive control involved in resolving conflicts. However, in the comparison between subjectively rated usable and unusable tools, smaller N400 and greater LSP amplitudes were observed only when unusual tools could be identified by expanding the application scope but not by releasing functional fixedness; this outcome suggested that creative discovery in the real state was not always influenced by the cognitive control involved in resolving conflicts. The difference in cognitive control that should be exerted and that was actually exerted to identify novel associations was discussed.

Cognitive control of invalid predominant ideas in insight-like problem solving

Predominant ordinary ideas are insufficient for solving insight-like problems; they interfere with subordinate original ideas and can produce a mental impasse. However, how people monitor and control invalid predominant ideas remains largely unknown. In the current study, participants were asked to solve a sequence of several similar practice problems that had the same solution to strengthen a predominant idea; the participants were then presented with an insight-like test problem that could not be solved by the predominant idea. The results showed that if the test problem was similar to the practice problems in which the predominant idea could typically be applied, it elicited greater late sustained potential (LSP) over the whole brain but no conflict-related N2 or N400 components, which suggests that the participants did not experience cognitive conflict and continued to verify the predominant but currently invalid idea. When the test problem differed from the practice problems, the items that participants reported trying to solve elicited greater N2-N400 and LSP over the whole brain, which suggests that the participants experienced cognitive conflict and exerted more reactive control over the invalid predominant idea; in contrast, the items that participants reported thinking about how to solve did not evoke greater conflict-related N2-N400 components and evoked even lower LSP, which likely indicates an ineffective state. These findings demonstrate three kinds of cognitive control toward invalid predominant ideas in situations where they are typically and not typically applied and provide empirical evidence of a mental impasse in insight-like problem-solving behaviors.

Expectation of irrelevant novel stimuli has no consistent effect on recognition memory

Novelty is defined as the part of an experience that is not yet represented by memory systems. Novelty has been claimed to exert various memory-enhancing effects. A pioneering study by Wittmann et al. (2007) has shown that memory formation may even benefit from the expectation of novelty. We aimed to replicate this assumed memory effect in four behavioral studies. However, our results do not support the idea that anticipated novel stimuli are more memorable than unexpected novelty. In our experiments, we systematically manipulated the novelty predicting cues to ensure that the expectations were correctly formed by the participants, however, the results showed that there was no memory enhancement for expected novel pictures in any of the examined indices, thus we could not replicate the main behavioral finding of Wittmann et al. (2007). These results call into question the original effect, and we argue that this fits more into current thinking on memory formation and brain function in general. Our results are more consistent with the view that unexpected stimuli are more likely to be retained by memory systems. Predictive coding theory suggests that unexpected stimuli are prioritized by the nervous system and this may also benefit memory processes. Novel stimuli may be unexpected and thus recognized better in some experimental setups, yet novelty and unexpectedness do not always coincide. We hope that our work can bring more consistency in the literature on novelty, as educational methods in general could also benefit from this clarification.

Novelty processing associated with neural beta oscillations improves recognition memory in young and older adults

Novelty anticipation activates the mesolimbic system and promotes subsequent long-term memory in younger adults. Importantly, mesolimbic structures typically degenerate with age, which might reduce positive effects of novelty anticipation. Here, we used electroencephalography in combination with an established paradigm in healthy young (19-33 years old, n = 28) and older (53-84, n = 27) humans. Colored cues predicted the subsequent presentation of either a novel or previously familiarized image (75% cue validity). On the subsequent day, recognition memory for the novel images was tested. Behaviorally, novelty anticipation improved recollection-based but not familiarity-based recognition memory in both groups, and this effect was more pronounced in older subjects. Furthermore, novelty and familiarity cues increased theta (4-8 Hz) and decreased alpha/beta power (9-20 Hz); at outcome, expected novel and familiar images both increased beta power (13-25 Hz). Finally, a subsequent memory effect for expected novel images was associated with increases in beta power independent of age. Together, novelty anticipation drives hippocampus-dependent long-term recognition memory across the life span, and this effect appears to be related to neural beta oscillations.

Reactive control in evaluating appropriately or inappropriately novel ideas: Evidence from electrophysiological measures

Novelty and appropriateness have been considered two necessary criteria to distinguish creative ideas, but little is known about what kind of reactive control people will make when they evaluate appropriately or inappropriately novel ideas. To study this issue, high-density technology was used to record electroencephalography (EEG) signals when participants were evaluating ideas in novel & appropriate, novel & inappropriate, ordinary & appropriate, and ordinary & inappropriate conditions. An analysis of event-related potentials (ERPs) revealed that greater conflict detection-related N2 and N400-like components over the anterior scalp appeared in novel conditions than in ordinary conditions, suggesting that people are able to rapidly monitor novel ideas. Afterward, the mean amplitudes of the LPC over the left anterior scalp were greater in novel & appropriate condition than ordinary & appropriate condition, but no difference was found between novel & appropriate and novel & inappropriate conditions, which likely displayed much more reactive control was recruited to handle novel ideas and no additional control was recruited when the novel ideas were inappropriate. In addition, the mean amplitudes of the LPC/LNC over the posterior scalp were greater in novel than ordinary conditions and were also greater in inappropriate than appropriate conditions, which likely reflected the processing difficulties of conceptual understanding. These findings revealed the early rise monitoring, conceptual understanding, and reactive control mechanism underlying the evaluation of novel ideas.

Expectation-driven novelty effects in episodic memory

Novel and unexpected stimuli are often prioritised in memory, given their inherent salience. Nevertheless, not all forms of novelty show such an enhancement effect. Here, we discuss the role expectation plays in modulating the way novelty affects memory processes, circuits, and subsequent performance. We first review independent effects of expectation on memory, and then consider how different types of novelty are characterised by expectation. We argue that different types of novelty defined by expectation implicate differential neurotransmission in memory formation brain regions and may also result in the creation of different types of memory. Contextual novelty, which is unexpected by definition, is often associated with better recollection, supported by dopaminergic-hippocampal interactions. On the other hand, expected stimulus novelty is supported by engagement of medial temporal cortices, as well as the hippocampus, through cholinergic modulation. Furthermore, when expected stimulus novelty results in enhanced memory, it is predominantly driven by familiarity. The literature reviewed here highlights the complexity of novelty-sensitive memory systems, the distinction between types of novelty, and how they are differentially affected by expectancy.

Novelty processing depends on medial temporal lobe structures

OBJECTIVES

The goal of the present study was to identify the role of the medial temporal lobe (MTL) in the detection and later processing of novelty.

METHODS

Twenty-one epilepsy patients with unilateral MTL resection (10 left-sided; 11 right-sided) and 26 matched healthy controls performed an adapted visual novelty oddball task. In this task two streams of stimuli were presented on the left and right of fixation while the patients' electroencephalogram was measured. The participants had to respond to infrequent target stimuli, while ignoring frequent standard, and infrequent novel stimuli that were presented to the left or right, appearing either contra- or ipsilateral to the patients' resections.

RESULTS

Novelty detection, as indexed by the N2 ERP component elicited by novels, was reduced by the MTL resections, as evidenced by a smaller N2 for patients than healthy controls. Later processing of novels, as indexed by the novelty P3 ERP component, was reduced for novels presented contra- versus ipsilateral to the resected side. Moreover, at a frontal electrode site, the N2-P3 complex showed reduced novelty processing in patients with MTL resections compared to healthy controls. The ERP differences were specific for the novel stimuli, as target processing, as indexed by the P3b, was unaffected in the patients: No P3b differences were found between targets presented ipsi- or contralaterally to the resected side, nor between patients and healthy controls.

CONCLUSIONS

The current results suggest that MTL structures play a role in novelty processing. In contrast, target processing was unaffected by MTL resections.

Midbrain circuits of novelty processing

Novelty triggers an increase in orienting behavior that is critical to evaluate the potential salience of unknown events. As novelty becomes familiar upon repeated encounters, this increase in response rapidly habituates as a form of behavioral adaptation underlying goal-directed behaviors. Many neurodevelopmental, psychiatric and neurodegenerative disorders are associated with abnormal responses to novelty and/or familiarity, although the neuronal circuits and cellular/molecular mechanisms underlying these natural behaviors in the healthy brain are largely unknown, as is the maladaptive processes that occur to induce impairment of novelty signaling in diseased brains. In rodents, the development of cutting-edge tools that allow for measurements of real time activity dynamics in selectively identified neuronal ensembles by gene expression signatures is beginning to provide advances in understanding the neural bases of the novelty response. Accumulating evidence indicate that midbrain circuits, the majority of which linked to dopamine transmission, promote exploratory assessments and guide approach/avoidance behaviors to different types of novelty via specific projection sites. The present review article focuses on midbrain circuit analysis relevant to novelty processing and habituation with familiarity.

Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness

Novelty is central to the study of memory, but the wide range of experimental manipulations aimed to reveal its effects on learning produced inconsistent results. The novelty/encoding hypothesis suggests that novel information undergoes enhanced encoding and thus leads to benefits in memory, especially in recognition performance; however, recent studies cast doubts on this assumption. On the other hand, data from animal studies provided evidence on the robust effects of novelty manipulations on the neurophysiological correlates of memory processes. Conceptualizations and operationalizations of novelty are remarkably variable and were categorized into different subtypes, such as stimulus, context, associative or spatial novelty. Here, we summarize previous findings about the effects of novelty on memory and suggest that predictive coding theories provide a framework that could shed light on the differential influence of novelty manipulations on memory performance. In line with predictive coding theories, we emphasize the role of unexpectedness as a crucial property mediating the behavioral and neural effects of novelty manipulations.

Unexplored territory: Beneficial effects of novelty on memory

Exploring novel environments enhances learning in animals. Due to differing traditions, research into the effects of spatial novelty on learning in humans is scarce. Recent developments of affordable and fMRI-compatible virtual reality (VR) and mobile EEG systems can help bridge the gap between the two literatures. One promising study showed that spatial novelty also promotes learning in humans. It still remains largely unknown, however, which aspect of novelty underlies the beneficial effect on memory, as novelty, expectations, and volition are often confounded in animal studies. In humans, these factors can be experimentally manipulated, but such studies are currently lacking. Future studies in humans could combine pharmacological interventions, neuroimaging and VR or use mobile EEG to help elucidate whether the plasticity enhancing mechanisms observed in animals, also exist in humans. When the aspects of exploring a novel environment underlying beneficial memory effects have been identified, effective novelty-exposure interventions could be designed to improve learning and counteract age-related memory decline.