Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach

Event Segmentation Promotes the Reorganization of Emotional Memory

Event boundaries help structure the content of episodic memories by segmenting continuous experiences into discrete events. Event boundaries may also serve to preserve meaningful information within an event, thereby actively separating important memories from interfering representations imposed by past and future events. Here, we tested the hypothesis that event boundaries organize emotional memory based on changing dynamics as events unfold. We developed a novel threat-reversal learning task whereby participants encoded trial-unique exemplars from two semantic categories across three phases: preconditioning, fear acquisition, and reversal. Shock contingencies were established for one category during acquisition (CS+) and then switched to the other during reversal (CS-). Importantly, reversal was either separated by a perceptible event boundary (Experiment 1) or occurred immediately after acquisition, with no perceptible context shift (Experiment 2). In a surprise recognition memory test the next day, memory performance tracked the learning contingencies from encoding in Experiment 1, such that participants selectively recognized more threat-associated CS+ exemplars from before (retroactive) and during acquisition, but this pattern reversed toward CS- exemplars encoded during reversal. By contrast, participants with continuous encoding-without a boundary between conditioning and reversal-exhibited undifferentiated memory for exemplars from both categories encoded before acquisition and after reversal. Further analyses highlight nuanced effects of event boundaries on reversing conditioned fear, updating mnemonic generalization, and emotional biasing of temporal source memory. These findings suggest that event boundaries provide anchor points to organize memory for distinctly meaningful information, thereby adaptively structuring memory based on the content of our experiences.

A systematic and meta-analytic review of the impact of sleep restriction on memory formation

Modern life causes a quarter of adults and half of teenagers to sleep for less than is recommended (Kocevska et al., 2021). Given well-documented benefits of sleep on memory, we must understand the cognitive costs of short sleep. We analysed 125 sleep restriction effect sizes from 39 reports involving 1234 participants. Restricting sleep (3-6.5 hours) compared to normal sleep (7-11 hours) negatively affects memory formation with a small effect size (Hedges' g = 0.29, 95 % CI = [0.13, 0.44]). We detected no evidence for publication bias. When sleep restriction effect sizes were compared with 185 sleep deprivation effect sizes (Newbury et al., 2021) no statistically significant difference was found, suggesting that missing some sleep has similar consequences for memory as not sleeping at all. When the analysis was restricted to post-encoding, rather than pre-encoding, sleep loss, sleep deprivation was associated with larger memory impairment than restriction. Our findings are best accounted for by the sequential hypothesis which emphasises complementary roles of slow-wave sleep and REM sleep for memory.

Motor-related oscillations reveal the involvement of sensorimotor processes during recognition memory

Certain object properties may render an item as more memorable than others. One such property is manipulability, or the extent to which an object can be interacted with using our hands. This study sought to determine if the manipulability of an item modulates memory task performance on both a behavioural and neural level. We recorded electroencephalography (EEG) from a large sample of right-handed individuals (N = 53) during a visual item recognition memory task. The task contained stimuli of both high and low manipulability. Analysis focused on activity in the theta rhythm (3.5-7 Hz), which has been implicated in sensorimotor integration, and the mu rhythm (8-14 Hz), the primary oscillation associated with sensorimotor related behaviours. At both encoding and retrieval, theta oscillations were greater over the left motor region for high manipulability stimuli, suggesting that an item's sensorimotor properties are assessed immediately upon presentation. Manipulability did not affect activity in the mu rhythm. However, mu oscillations over the left motor region were lower during the retrieval of old versus new items and response time was faster for old items, aligning with the cortical reinstatement hypothesis. These results collectively reveal an association between motor oscillations and memory processes, highlight the involvement of sensorimotor processing at both encoding and retrieval.

Neuroplastic Responses to Chiropractic Care: Broad Impacts on Pain, Mood, Sleep, and Quality of Life

OBJECTIVES

This study aimed to elucidate the mechanisms of chiropractic care using resting electroencephalography (EEG), somatosensory evoked potentials (SEPs), clinical health assessments (Fitbit), and Patient-reported Outcomes Measurement Information System (PROMIS-29).

METHODS

Seventy-six people with chronic low back pain (mean age ± SD: 45 ± 11 years, 33 female) were randomised into control (n = 38) and chiropractic (n = 38) groups. EEG and SEPs were collected pre and post the first intervention and post 4 weeks of intervention. PROMIS-29 was measured pre and post 4 weeks. Fitbit data were recorded continuously.

RESULTS

Spectral analysis of resting EEG showed a significant increase in Theta, Alpha and Beta, and a significant decrease in Delta power in the chiropractic group post intervention. Source localisation revealed a significant increase in Alpha activity within the Default Mode Network (DMN) post intervention and post 4 weeks. A significant decrease in N30 SEP peak amplitude post intervention and post 4 weeks was found in the chiropractic group. Source localisation demonstrated significant changes in Alpha and Beta power within the DMN post-intervention and post 4 weeks. Significant improvements in light sleep stage were observed in the chiropractic group along with enhanced overall quality of life post 4 weeks, including significant reductions in anxiety, depression, fatigue, and pain.

CONCLUSIONS

These findings indicate that many health benefits of chiropractic care are due to altered brain activity.

Long-term retention of real-world experiences in a patient with profound amnesia

The medial temporal lobe (MTL) is known to be critical for healthy memory function, but patients with MTL damage can, under certain circumstances, demonstrate successful learning of novel information encountered outside the laboratory. Here, we describe a patient, D.C., with extensive but focal bilateral MTL damage centering primarily on his hippocampus, whose memory for real-world experiences was assessed. Tests of remote memory indicated at least some capacity to retrieve specific details. To test his anterograde memory, he was taken on a tour of the NIH Clinical Center, with unique events occurring at each of ten specific locations. His memory for these events was tested after 1 h, and again after fifteen months. Initially, D.C. could not recall having participated in the tour, even when cued with photographs of specific places he had visited. However, he achieved 90% accuracy on a forced choice recognition test of old and new objects he encountered on the tour, and his recognition of these objects remained intact over a year later when he was tested once again. Subsequent recognition memory tests using novel picture stimuli in a standard laboratory-style computer task resulted in chance-level performance across multiple test formats and stimulus categories. These findings suggest a potentially privileged role for natural learning for long-term retention in a patient with severely damaged medial temporal lobes.

A short natural history of mental time travels: a journey still travelled?

Tulving's introduction of episodic memory and the metaphor of mental time travel has immensely enriched our understanding of human cognition. However, his focus on human psychology, with limited consideration of evolutionary perspectives, led to the entrenched notion that mental time travel is uniquely human. We contend that adopting a phylogenetic perspective offers a deeper insight into cognition, revealing it as a continuous evolutionary process. Adherence to the uniqueness of pre-defined psychological concepts obstructs a more complete understanding. We offer a concise natural history to elucidate how events that occurred hundreds of millions of years ago have been pivotal for our ability to mentally time travel. We discuss how the human brain, utilizing parts with ancient origins in a networked manner, enables mental time travel. This underscores that episodic memories and mental time travel are not isolated mental constructs but integral to our perception and representation of the world. We conclude by examining recent evidence of neuroanatomical correlates found only in great apes, which show great variability, indicating the ongoing evolution of mental time travel in humans.This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Synthesizing the temporal self: robotic models of episodic and autobiographical memory

Episodic memories are experienced as belonging to a self that persists in time. We review evidence concerning the nature of human episodic memory and of the sense of self and how these emerge during development, proposing that the younger child experiences a persistent self that supports a subjective experience of remembering. We then explore recent research in cognitive architectures for robotics that has investigated the possibility of forms of synthetic episodic and autobiographical memory. We show that recent advances in generative modeling can support an understanding of the emergence of self and of episodic memory, and that cognitive architectures which include a language capacity are showing progress towards the construction of a narrative self with autobiographical memory capabilities for robots. We conclude by considering the prospects for a more complete model of mental time travel in robotics and the implications of this modeling work for understanding human episodic memory and the self in time. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

How Psychedelics Modulate Multiple Memory Mechanisms in Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is a psychiatric disorder with defining abnormalities in memory, and psychedelics may be promising candidates for the treatment of PTSD given their effects on multiple memory systems. Most PTSD and psychedelic research has investigated memory with fear conditioning and extinction. While fruitful, conditioning and extinction provide a limited model of the complexity of PTSD and phenomenology of psychedelics, thereby limiting the refinement of therapies. In this review, we discuss abnormalities in fear conditioning and extinction in PTSD and review 25 studies testing psychedelics on these forms of memory. Perhaps the most reliable effect is that the acute effects of psychedelics can enhance extinction learning, which is impaired in PTSD. However, the post-acute effects may also enhance extinction learning, and the acute effects can also enhance fear conditioning. We then discuss abnormalities in episodic and semantic memory in PTSD and review current knowledge on how psychedelics impact these memory systems. Although PTSD and psychedelics acutely impair the formation of hippocampal-dependent episodic memories, psychedelics may acutely enhance cortical-dependent learning of semantic memories that could facilitate the integration of trauma memories and disrupt maladaptive beliefs. More research is needed on the acute effects of psychedelics on episodic memory consolidation, retrieval, and reconsolidation and post-acute effects of psychedelics on all phases of episodic memory. We conclude by discussing how targeting multiple memory mechanisms could improve upon the current psychedelic therapy paradigm for PTSD, thereby necessitating a greater emphasis on assessing diverse measures of memory in translational PTSD and psychedelic research.

Hippocampal storage and recall of neocortical "What"-"Where" representations

A key question for understanding the function of the hippocampus in memory is how information is recalled from the hippocampus to the neocortex. This was investigated in a neuronal network model of the hippocampal system in which "What" and "Where" neuronal firing rate vectors were applied to separate neocortical modules, which then activated entorhinal cortex "What" and "Where" modules, then the dentate gyrus, then CA3, then CA1, then the entorhinal cortex, and then the backprojections to the neocortex. A rate model showed that the whole system could be trained to recall "Where" in the neocortex from "What" applied as a retrieval cue to the neocortex, and could in principle be trained up towards the theoretical capacity determined largely by the number of synapses onto any one neuron divided by the sparseness of the representation. The trained synaptic weights were then imported into an integrate-and-fire simulation of the same architecture, which showed that the time from presenting a retrieval cue to a neocortex module to recall the whole memory in the neocortex is approximately 100 ms. This is sufficiently fast for the backprojection synapses to be trained onto the still active neocortical neurons during storage of the episodic memory, and this is needed for recall to operate correctly to the neocortex. These simulations also showed that the long loop neocortex-hippocampus-neocortex that operates continuously in time may contribute to complete recall in the neocortex; but that this positive feedback long loop makes the whole dynamical system inherently liable to a pathological increase in neuronal activity. Important factors that contributed to stability included increased inhibition in CA3 and CA1 to keep the firing rates low; and temporal adaptation of the neuronal firing and of active synapses, which are proposed to make an important contribution to stabilizing runaway excitation in cortical circuits in the brain.

Cross-cultural comparison of the neural correlates of true and false memory retrieval

Prior work has shown Americans have higher levels of memory specificity than East Asians. Neuroimaging studies have not investigated mechanisms that account for cultural differences at retrieval. In this study, we use fMRI to assess whether mnemonic discrimination, distinguishing novel from previously encountered stimuli, accounts for cultural differences in memory. Fifty-five American and 55 Taiwanese young adults completed an object recognition paradigm testing discrimination of old targets, similar lures and novel foils. Mnemonic discrimination was tested by comparing discrimination of similar lures from studied targets, and results showed the relationship between activity in right fusiform gyrus and behavioural discrimination between target and lure objects differed across cultural groups. Parametric modulation analyses of activity during lure correct rejections also indicated that groups differed in left superior parietal cortex response to variations in lure similarity. Additional analyses of old vs. new activity indicated that Americans and Taiwanese differ in the neural activity supporting general object recognition in the hippocampus, left inferior frontal gyrus and middle frontal gyrus. Results are juxtaposed against comparisons of the regions activated in common across the two cultures. Overall, Americans and Taiwanese differ in the extent to which they recruit visual processing and attention modulating brain regions.

A daytime nap with REM sleep is linked to enhanced generalization of emotional stimuli

How memory representations are shaped during and after their encoding is a central question in the study of human memory. Recognition responses to stimuli that are similar to those observed previously can hint at the fidelity of the memories or point to processes of generalization at the expense of precise memory representations. Experimental studies utilizing this approach showed that emotions and sleep both influence these responses. Sleep, and more specifically rapid eye movement sleep, is assumed to facilitate the generalization of emotional memories. We studied mnemonic discrimination by the emotional variant of the Mnemonic Separation Task in participants (N = 113) who spent a daytime nap between learning and testing compared with another group that spent an equivalent time awake between the two sessions. Our findings indicate that the discrimination of similar but previously not seen items from previously seen ones is enhanced in case of negative compared with neutral and positive stimuli. Moreover, whereas the sleep and the wake groups did not differ in memory performance, participants entering rapid eye movement sleep exhibited increased generalization of emotional memories. Our findings indicate that entering into rapid eye movement sleep during a daytime nap shapes emotional memories in a way that enhances recognition at the expense of detailed memory representations.

Estimating statistical power for structural equation models in developmental cognitive science: A tutorial in R : Power simulation for SEMs

Determining the compositional structure and dimensionality of psychological constructs lies at the heart of many research questions in developmental science. Structural equation modeling (SEM) provides a versatile framework for formalizing and estimating the relationships among multiple latent constructs. While the flexibility of SEM can accommodate many complex assumptions on the underlying structure of psychological constructs, it makes a priori estimation of statistical power and required sample size challenging. This difficulty is magnified when comparing non-nested SEMs, which prevents the use of traditional likelihood-ratio tests. Sample size estimates for SEM model fit comparisons typically rely on generic rules of thumb. Such heuristics can be misleading because statistical power in SEM depends on a variety of model properties. Here, we demonstrate a Monte Carlo simulation approach for estimating a priori statistical power for model selection when comparing non-nested models in an SEM framework. We provide a step-by-step guide to this approach based on an example from our memory development research in children.

A neural network model of differentiation and integration of competing memories

What determines when neural representations of memories move together (integrate) or apart (differentiate)? Classic supervised learning models posit that, when two stimuli predict similar outcomes, their representations should integrate. However, these models have recently been challenged by studies showing that pairing two stimuli with a shared associate can sometimes cause differentiation, depending on the parameters of the study and the brain region being examined. Here, we provide a purely unsupervised neural network model that can explain these and other related findings. The model can exhibit integration or differentiation depending on the amount of activity allowed to spread to competitors - inactive memories are not modified, connections to moderately active competitors are weakened (leading to differentiation), and connections to highly active competitors are strengthened (leading to integration). The model also makes several novel predictions - most importantly, that when differentiation occurs as a result of this unsupervised learning mechanism, it will be rapid and asymmetric, and it will give rise to anticorrelated representations in the region of the brain that is the source of the differentiation. Overall, these modeling results provide a computational explanation for a diverse set of seemingly contradictory empirical findings in the memory literature, as well as new insights into the dynamics at play during learning.

How schema knowledge influences memory in older adults: Filling in the gaps, or leading memory astray?

Age-related declines in episodic memory do not affect all types of mnemonic information equally: when to-be-remembered information is in line with one's prior knowledge, or schema-congruent, older adults often show no impairments. There are two major accounts of this effect: One proposes that schemas compensate for memory failures in aging, and the other proposes that schemas instead actively impair older adults' otherwise intact memory for incongruent information. However, the evidence thus far is inconclusive, likely due to methodological constraints in teasing apart these complex underlying dynamics. We developed a paradigm that separately examines the contributions of underlying memory and schema knowledge to a final memory decision, allowing these dynamics to be examined directly. In the present study, healthy older and younger adults first searched for target objects in congruent or incongruent locations within scenes. In a subsequent test, participants indicated where in each scene the target had been located previously, and provided confidence-based recognition memory judgments that indexed underlying memory, in terms of recollection and familiarity, for the background scenes. We found that age-related increases in schema effects on target location spatial recall were predicted and statistically mediated by age-related increases in underlying memory failures, specifically within recollection. We also found that, relative to younger adults, older adults had poorer spatial memory precision within recollected scenes but slightly better precision within familiar scenes-and age increases in schema bias were primarily exhibited within recollected scenes. Interestingly, however, there were also slight age-related increases in schema effects that could not be explained by memory deficits alone, outlining a role for active schema influences as well. Together, these findings support the account that age-related schema effects on memory are compensatory in that they are driven primarily by underlying memory failures, and further suggest that age-related deficits in memory precision may also drive schema effects.

Event-related potentials during encoding coincide with subsequent forced-choice mnemonic discrimination

Computational models and eye-tracking research suggest that encoding variability accounts for the reduced recognition of targets (A) when paired with non-corresponding lures (B') relative to corresponding lures (A'). The current study examined whether neural activity during learning coincided with subsequent performance on the forced-choice Mnemonic Similarity Task (MST). Event-related potential responses were collected during encoding while young adults completed A-B' and A-A' trials of the forced-choice MST. Consistent with previous research, performance was lower on A-B' trials than A-A' trials. The subsequent memory effect was not significant for the A-A' test format. However, for A-B' trials, we observed a significant Accuracy × Stimulus interaction 1000-1200 ms poststimulus onset across frontal and fronto-central electrodes. As hypothesized, subsequently correct A-B' trials were associated with a larger amplitude response at encoding to the target (A) than the original version of the non-corresponding lure (B). However, subsequently incorrect trials were associated with a larger amplitude response to the non-corresponding lure (B) than the target stimulus (A). These findings provide additional support for the effect of encoding variability on mnemonic discrimination.

Contribution of the lateral occipital and parahippocampal cortices to pattern separation of objects and contexts

Contextual features are integral to episodic memories; yet, we know little about context effects on pattern separation, a hippocampal function promoting orthogonalization of overlapping memory representations. Recent studies suggested that various extrahippocampal brain regions support pattern separation; however, the specific role of the parahippocampal cortex-a region involved in context representation-in pattern separation has not yet been studied. Here, we investigated the contribution of the parahippocampal cortex (specifically, the parahippocampal place area) to context reinstatement effects on mnemonic discrimination, using functional magnetic resonance imaging. During scanning, participants saw object images on unique context scenes, followed by a recognition task involving the repetitions of encoded objects or visually similar lures on either their original context or a lure context. Context reinstatement at retrieval improved item recognition but hindered mnemonic discrimination. Crucially, our region of interest analyses of the parahippocampal place area and an object-selective visual area, the lateral occipital cortex indicated that while during successful mnemonic decisions parahippocampal place area activity decreased for old contexts compared to lure contexts irrespective of object novelty, lateral occipital cortex activity differentiated between old and lure objects exclusively. These results imply that pattern separation of contextual and item-specific memory features may be differentially aided by scene and object-selective cortical areas.

A conceptual-perceptual distinctiveness processing account of the superior recognition memory of pictures over environmental sounds

Researchers have proposed a coarser or gist-based representation for sounds, whereas a more verbatim-based representation is retrieved from long-term memory to account for higher recognition performance for pictures. This study examined the mechanism for the recognition advantage for pictures. In Experiment 1A, pictures and sounds were presented in separate trials in a mixed list during the study phase and participants showed in a yes-no test, a higher proportion of correct responses for targets, exemplar foils categorically related to the target, and novel foils for pictures compared with sounds. In Experiment 1B, the picture recognition advantage was replicated in a two-alternative forced-choice test for the novel and exemplar foil conditions. For Experiment 2A, even when verbal labels (i.e., written labels) were presented for sounds during the study phase, a recognition advantage for pictures was shown for both targets and exemplar foils. Experiment 2B showed that the presence of written labels for sounds, during both the study and test phases did not eliminate the advantage of recognition of pictures in terms of correct rejection of exemplar foils. Finally, in two additional experiments, we examined whether the degree of similarity within pictures and sounds could account for the recognition advantage of pictures. The mean similarity rating for pictures was higher than the mean similarity rating for sounds in the exemplar test condition, whereas mean similarity rating for sounds was higher than pictures in the novel test condition. These results pose a challenge for some versions of distinctiveness accounts of the picture superiority effect. We propose a conceptual-perceptual distinctiveness processing account of recognition memory for pictures and sounds.

A lightweight data-driven spiking neuronal network model of Drosophila olfactory nervous system with dedicated hardware support

Data-driven spiking neuronal network (SNN) models enable in-silico analysis of the nervous system at the cellular and synaptic level. Therefore, they are a key tool for elucidating the information processing principles of the brain. While extensive research has focused on developing data-driven SNN models for mammalian brains, their complexity poses challenges in achieving precision. Network topology often relies on statistical inference, and the functions of specific brain regions and supporting neuronal activities remain unclear. Additionally, these models demand huge computing facilities and their simulation speed is considerably slower than real-time. Here, we propose a lightweight data-driven SNN model that strikes a balance between simplicity and reproducibility. The model is built using a qualitative modeling approach that can reproduce key dynamics of neuronal activity. We target the Drosophila olfactory nervous system, extracting its network topology from connectome data. The model was successfully implemented on a small entry-level field-programmable gate array and simulated the activity of a network in real-time. In addition, the model reproduced olfactory associative learning, the primary function of the olfactory system, and characteristic spiking activities of different neuron types. In sum, this paper propose a method for building data-driven SNN models from biological data. Our approach reproduces the function and neuronal activities of the nervous system and is lightweight, acceleratable with dedicated hardware, making it scalable to large-scale networks. Therefore, our approach is expected to play an important role in elucidating the brain's information processing at the cellular and synaptic level through an analysis-by-construction approach. In addition, it may be applicable to edge artificial intelligence systems in the future.

Differentiation and Integration of Competing Memories: A Neural Network Model

What determines when neural representations of memories move together (integrate) or apart (differentiate)? Classic supervised learning models posit that, when two stimuli predict similar outcomes, their representations should integrate. However, these models have recently been challenged by studies showing that pairing two stimuli with a shared associate can sometimes cause differentiation, depending on the parameters of the study and the brain region being examined. Here, we provide a purely unsupervised neural network model that can explain these and other related findings. The model can exhibit integration or differentiation depending on the amount of activity allowed to spread to competitors - inactive memories are not modified, connections to moderately active competitors are weakened (leading to differentiation), and connections to highly active competitors are strengthened (leading to integration). The model also makes several novel predictions - most importantly, that when differentiation occurs as a result of this unsupervised learning mechanism, it will be rapid and asymmetric, and it will give rise to anticorrelated representations in the region of the brain that is the source of the differentiation. Overall, these modeling results provide a computational explanation for a diverse set of seemingly contradictory empirical findings in the memory literature, as well as new insights into the dynamics at play during learning.

Brain regions supporting retrieval of words drawn at encoding: fMRI evidence for multimodal reactivation

Memory for words that are drawn or sketched by the participant, rather than written, during encoding is typically superior. While this drawing benefit has been reliably demonstrated in recent years, there has yet to be an investigation of its neural basis. Here, we asked participants to either create drawings, repeatedly write, or list physical characteristics depicting each target word during encoding. Participants then completed a recognition memory test for target words while undergoing functional magnetic resonance imaging (fMRI). Behavioural results showed memory was significantly higher for words drawn than written, replicating the typical drawing effect. Memory for words whose physical characteristics were listed at encoding was also higher than for those written repeatedly, but lower than for those drawn. Voxel-wise analyses of fMRI data revealed two distributed sets of brain regions more active for items drawn relative to written, the left angular gyrus (BA 39) and bilateral frontal (BA 10) regions, suggesting integration and self-referential processing during retrieval of drawn words. Brain-behaviour correlation analyses showed that the size of one's memory benefit for words drawn relative to written at encoding was positively correlated with activation in brain regions linked to visual representation and imagery (BA 17 and cuneus) and motor planning (premotor and supplementary motor areas; BA 6). This study suggests that drawing benefits memory by coactivating multiple sensory traces. Target words drawn during encoding are subsequently remembered by re-engaging visual, motoric, and semantic representations.

Hippocampus-to-amygdala pathway drives the separation of remote memories of related events

The mammalian brain can store and retrieve memories of related events as distinct memories and remember common features of those experiences. How it computes this function remains elusive. Here, we show in rats that recent memories of two closely timed auditory fear events share overlapping neuronal ensembles in the basolateral amygdala (BLA) and are functionally linked. However, remote memories have reduced neuronal overlap and are functionally independent. The activity of parvalbumin (PV)-expressing neurons in the BLA plays a crucial role in forming separate remote memories. Chemogenetic blockade of PV preserves individual remote memories but prevents their segregation, resulting in reciprocal associations. The hippocampus drives this process through specific excitatory connections with BLA GABAergic interneurons. These findings provide insights into the neuronal mechanisms that minimize the overlap between distinct remote memories and enable the retrieval of related memories separately.

Identification of Early Hippocampal Dynamics during Recognition Memory with Independent Component Analysis

The hippocampus is generally considered to have relatively late involvement in recognition memory, its main electrophysiological signature being between 400 and 800 ms after stimulus onset. However, most electrophysiological studies have analyzed the hippocampus as a single responsive area, selecting only a single-site signal exhibiting the strongest effect in terms of amplitude. These classical approaches may not capture all the dynamics of this structure, hindering the contribution of other hippocampal sources that are not located in the vicinity of the selected site. We combined intracerebral electroencephalogram recordings from epileptic patients with independent component analysis during a recognition memory task involving the recognition of old and new images. We identified two sources with different responses emerging from the hippocampus: a fast one (maximal amplitude at ∼250 ms) that could not be directly identified from raw recordings and a latter one, peaking at ∼400 ms. The former component presented different amplitudes between old and new items in 6 out of 10 patients. The latter component had different delays for each condition, with a faster activation (∼290 ms after stimulus onset) for recognized items. We hypothesize that both sources represent two steps of hippocampal recognition memory, the faster reflecting the input from other structures and the latter the hippocampal internal processing. Recognized images evoking early activations would facilitate neural computation in the hippocampus, accelerating memory retrieval of complementary information. Overall, our results suggest that the hippocampal activity is composed of several sources with an early activation related to recognition memory.

Event Integration and Temporal Differentiation: How Hierarchical Knowledge Emerges in Hippocampal Subfields through Learning

Everyday life is composed of events organized by changes in contexts, with each event containing an unfolding sequence of occurrences. A major challenge facing our memory systems is how to integrate sequential occurrences within events while also maintaining their details and avoiding over-integration across different contexts. We asked if and how distinct hippocampal subfields come to hierarchically and, in parallel, represent both event context and subevent occurrences with learning. Female and male human participants viewed sequential events defined as sequences of objects superimposed on shared color frames while undergoing high-resolution fMRI. Importantly, these events were repeated to induce learning. Event segmentation, as indexed by increased reaction times at event boundaries, was observed in all repetitions. Temporal memory decisions were quicker for items from the same event compared to across different events, indicating that events shaped memory. With learning, hippocampal CA3 multivoxel activation patterns clustered to reflect the event context, with more clustering correlated with behavioral facilitation during event transitions. In contrast, in the dentate gyrus (DG), temporally proximal items that belonged to the same event became associated with more differentiated neural patterns. A computational model explained these results by dynamic inhibition in the DG. Additional similarity measures support the notion that CA3 clustered representations reflect shared voxel populations, while DG's distinct item representations reflect different voxel populations. These findings suggest an interplay between temporal differentiation in the DG and attractor dynamics in CA3. They advance our understanding of how knowledge is structured through integration and separation across time and context.

Can the prosocial benefits of episodic simulation transfer to different people and situational contexts?

Previous research has found that episodic simulation of events of helping others can effectively enhance intentions to help the same person involved and the identical situational context as the imagined scenarios. This 'prosocial simulation effect' is argued to reflect, at least in part, associative memory mechanisms whereby the simulation is reactivated when in the same situation as that imagined. However, to date, no study has examined systematically whether this 'prosocial simulation effect' can be transferred to response scenarios involving different people and/or situational contexts to the imagined scenarios, and if so, whether the degree of overlap with the imagined helping episode modulated the transfer effect. Across two experiments, we systematically varied the overlap of the simulated and response scenarios, both in terms of the persons in need and/or the situational contexts, and whether would influence the magnitude of prosocial simulation effect. Results from both experiments showed that the prosocial simulation effect can be transferred to response scenarios involving different people and situational contexts to the simulated scenarios. However, this finding was primarily driven by response scenarios that had a high degree of overlap to the simulated scenarios. The application of our findings to the practical implementation of simulation to promote prosociality in the real world is discussed.

Sleep shapes the associative structure underlying pattern completion in multielement event memory

Sleep supports the consolidation of episodic memory. It is, however, a matter of ongoing debate how this effect is established, because, so far, it has been demonstrated almost exclusively for simple associations, which lack the complex associative structure of real-life events, typically comprising multiple elements with different association strengths. Because of this associative structure interlinking the individual elements, a partial cue (e.g., a single element) can recover an entire multielement event. This process, referred to as pattern completion, is a fundamental property of episodic memory. Yet, it is currently unknown how sleep affects the associative structure within multielement events and subsequent processes of pattern completion. Here, we investigated the effects of post-encoding sleep, compared with a period of nocturnal wakefulness (followed by a recovery night), on multielement associative structures in healthy humans using a verbal associative learning task including strongly, weakly, and not directly encoded associations. We demonstrate that sleep selectively benefits memory for weakly associated elements as well as for associations that were not directly encoded but not for strongly associated elements within a multielement event structure. Crucially, these effects were accompanied by a beneficial effect of sleep on the ability to recall multiple elements of an event based on a single common cue. In addition, retrieval performance was predicted by sleep spindle activity during post-encoding sleep. Together, these results indicate that sleep plays a fundamental role in shaping associative structures, thereby supporting pattern completion in complex multielement events.

Schema-congruency supports the formation of unitized representations: Evidence from event-related potentials

The main goal of the present study was to investigate whether schema-based encoding of novel word pairs (i.e., novel compound words) supports the formation of unitized representations and thus, associative familiarity-based recognition. We report two experiments that both comprise an incidental learning task, in which novel noun-noun compound words were presented in semantically congruent contexts, enabling schema-supported processing of both constituents, contrasted with a schema-neutral condition. In Experiment 1, the effects of schema congruency on memory performance were larger for associative memory performance than for item memory performance in a memory test in which intact, recombined, and new compound words had to be discriminated. This supports the view that schema congruency boosts associative memory by promoting unitization. When contrasting event-related potentials (ERPs) for hits with correct rejections or associative misses, an N400 attenuation effect (520-676 ms) indicating absolute familiarity was present in the congruent condition, but not in the neutral condition. In line with this, a direct comparison of ERPs on hits across conditions revealed more positive waveforms in the congruent than in the neutral condition. This suggests that absolute familiarity contributes to associative recognition memory when schema-supported processing is established. In Experiment 2, we tested whether schema congruency enables the formation of semantically overlapping representations. Therefore, we included semantically similar lure compound words in the test phase and compared false alarm rates to these lures across conditions. In line with our hypothesis, we found higher false alarm rates in the congruent as compared to the neutral condition. In conclusion, we provide converging evidence for the view that schema congruency enables the formation of unitized representations and supports familiarity-based memory retrieval.

Distinct hippocampal mechanisms support concept formation and updating

Learning systems must constantly decide whether to create new representations or update existing ones. For example, a child learning that a bat is a mammal and not a bird would be best served by creating a new representation, whereas updating may be best when encountering a second similar bat. Characterizing the neural dynamics that underlie these complementary memory operations requires identifying the exact moments when each operation occurs. We address this challenge by interrogating fMRI brain activation with a computational learning model that predicts trial-by-trial when memories are created versus updated. We found distinct neural engagement in anterior hippocampus and ventral striatum for model-predicted memory create and update events during early learning. Notably, the degree of this effect in hippocampus, but not ventral striatum, significantly related to learning outcome. Hippocampus additionally showed distinct patterns of functional coactivation with ventromedial prefrontal cortex and angular gyrus during memory creation and premotor cortex during memory updating. These findings suggest that complementary memory functions, as formalized in computational learning models, underlie the rapid formation of novel conceptual knowledge, with the hippocampus and its interactions with frontoparietal circuits playing a crucial role in successful learning.

Significance statement

How do we reconcile new experiences with existing knowledge? Prominent theories suggest that novel information is either captured by creating new memories or leveraged to update existing memories, yet empirical support of how these distinct memory operations unfold during learning is limited. Here, we combine computational modeling of human learning behaviour with functional neuroimaging to identify moments of memory formation and updating and characterize their neural signatures. We find that both hippocampus and ventral striatum are distinctly engaged when memories are created versus updated; however, it is only hippocampus activation that is associated with learning outcomes. Our findings motivate a key theoretical revision that positions hippocampus is a key player in building organized memories from the earliest moments of learning.

The role of recollection, familiarity, and the hippocampus in episodic and working memory

The hippocampus plays an essential role in long-term episodic memory by supporting the recollection of contextual details, whereas surrounding regions such as the perirhinal cortex support familiarity-based recognition discriminations. Working memory - the ability to maintain information over very brief periods of time - is traditionally thought to rely heavily on frontoparietal attention networks, but recent work has shown that it can also rely on the hippocampus. However, the conditions in which the hippocampus becomes involved in working memory tasks are unclear and whether it contributes to recollection or familiarity-based responses in working memory is only beginning to be explored. In the current paper, we first review and contrast the existing amnesia literature examining recollection and familiarity in episodic and working memory. The results indicate that recollection and familiarity contribute to both episodic and working memory. However, in contrast to episodic memory, in working memory the hippocampus is particularly critical for familiarity-based rather than recollection-based discrimination. Moreover, the results indicate that the role of the hippocampus in working memory can be obscured due to 'criterion-induced process-masking' because it primarily supports intermediate-confidence recognition decisions. We then report results from a new working memory study examining the ability of amnesics to detect global and local changes in novel complex objects (i.e., fribbles), which indicates that the hippocampus plays an especially critical role in working memory when the task requires the detection of global rather than discrete changes. We conclude by considering the results in light of neurocomputational models and proposing a general framework for understanding the relationship between episodic and working memory.

The effect of hippocampal subfield damage on rapid temporal integration through statistical learning and associative inference

INTRODUCTION

The hippocampus (HPC) supports integration of information across time, often indexed by associative inference (AI) and statistical learning (SL) tasks. In AI, an indirect association between stimuli that never appeared together is inferred, whereas SL involves learning item relationships by extracting regularities across experiences. A recent model of hippocampal function (Schapiro et al., 2017) proposes that the HPC can support temporal integration in both paradigms through its two distinct pathways.

METHODS

We tested this models' predictions in four patients with varying degrees of bilateral HPC damage and matched healthy controls, with two patients with complementary damage to either the monosynaptic or trisynaptic pathway. During AI, participants studied overlapping paired associates (AB, BC) and their memory was tested for premise pairs (AB) and for inferred pairs (AC). During SL, participants passively viewed a continuous picture sequence that contained an underlying structure of triplets that later had to be recognized.

RESULTS

Binomial distributions were used to calculate above chance performance at the individual level. For AI, patients with focal HPC damage were impaired at inference but could correctly infer pairs above chance once premise pair acquisition was equated to controls; however, the patient with HPC and cortical damage showed severe impairment at recalling premise and inferred pairs, regardless of accounting for premise pair performance. For SL, none of the patients performed above chance, but notably neither did most controls.

CONCLUSIONS

Associative inference of indirect relationships can be intact with HPC damage to either hippocampal pathways or the HPC more broadly, provided premise pairs can first be formed. Inference may remain intact through residual HPC tissue supporting premise pair acquisition, and/or through extra-hippocampal structures supporting inference at retrieval. Clear conclusions about hippocampal contributions to SL are precluded by low performance in controls, which we caution is not dissimilar to previous amnesic studies using the same task. This complicates interpretations of studies claiming necessity of hippocampal contributions to SL and warrants the use of a common and reliable task before conclusions can be drawn.

Drawing improves memory in patients with hippocampal damage

The hippocampus plays a critical role in the formation of declarative memories, and hippocampal damage leads to significant impairments in new memory formation. Drawing can serve as a form of multi-modal encoding that improves declarative memory performance relative to other multimodal encoding strategies such as writing. We examined whether, and to what extent, patients with hippocampal damage could benefit from the mnemonic strategy of drawing. Three patients with focal hippocampal damage, and one patient with both hippocampal and cortical lesions, in addition to 22 age-, sex-, and education-matched controls, were shown a list of words one at a time during encoding and instructed to either draw a picture or repeatedly write each word for 40 s. Following a brief filled delay, free recall and recognition memory for words from both encoding trial types were assessed. Controls showed enhanced recall and recognition memory for words drawn versus those that were written, an effect that was even more pronounced in patients with focal hippocampal damage. By contrast, the patient with both hippocampal and cortical lesions showed no drawing-mediated boost in either recall or recognition memory. These findings demonstrate that drawing is an effective encoding strategy, likely accruing from the engagement of extra-hippocampal processes including the integration of cortical-based motor, visual, and semantic processing, enabling more elaborative encoding.

Computational models can distinguish the contribution from different mechanisms to familiarity recognition

Familiarity is the strange feeling of knowing that something has already been seen in our past. Over the past decades, several attempts have been made to model familiarity using artificial neural networks. Recently, two learning algorithms successfully reproduced the functioning of the perirhinal cortex, a key structure involved during familiarity: Hebbian and anti-Hebbian learning. However, performance of these learning rules is very different from one to another thus raising the question of their complementarity. In this work, we designed two distinct computational models that combined Deep Learning and a Hebbian learning rule to reproduce familiarity on natural images, the Hebbian model and the anti-Hebbian model, respectively. We compared the performance of both models during different simulations to highlight the inner functioning of both learning rules. We showed that the anti-Hebbian model fits human behavioral data whereas the Hebbian model fails to fit the data under large training set sizes. Besides, we observed that only our Hebbian model is highly sensitive to homogeneity between images. Taken together, we interpreted these results considering the distinction between absolute and relative familiarity. With our framework, we proposed a novel way to distinguish the contribution of these familiarity mechanisms to the overall feeling of familiarity. By viewing them as complementary, our two models allow us to make new testable predictions that could be of interest to shed light on the familiarity phenomenon.

Theta mediated dynamics of human hippocampal-neocortical learning systems in memory formation and retrieval

Episodic memory arises as a function of dynamic interactions between the hippocampus and the neocortex, yet the mechanisms have remained elusive. Here, using human intracranial recordings during a mnemonic discrimination task, we report that 4-5 Hz (theta) power is differentially recruited during discrimination vs. overgeneralization, and its phase supports hippocampal-neocortical when memories are being formed and correctly retrieved. Interactions were largely bidirectional, with small but significant net directional biases; a hippocampus-to-neocortex bias during acquisition of new information that was subsequently correctly discriminated, and a neocortex-to-hippocampus bias during accurate discrimination of new stimuli from similar previously learned stimuli. The 4-5 Hz rhythm may facilitate the initial stages of information acquisition by neocortex during learning and the recall of stored information from cortex during retrieval. Future work should further probe these dynamics across different types of tasks and stimuli and computational models may need to be expanded accordingly to accommodate these findings.

Cross-modal associative memory impairment in schizophrenia

Impaired associative memory function in patients with schizophrenia has received considerable attention. However, previous studies have primarily concentrated on unisensory materials, which limits our understanding of the broader implications of this impairment. In this study, we sought to expand on this knowledge by examining two types of associative memory domains in individuals with schizophrenia, leveraging both visual (Vis) and auditory (Aud) materials. A total of 32 patients with schizophrenia and 29 healthy controls were recruited to participate in the study. Each participant participated in an experiment composed of three paradigms in which different abstract materials (Aud-Aud, Aud-Vis, and Vis-Vis) were presented. Subsequently, the discriminability scores of the two groups were calculated and compared in different modal tasks. Results from the study indicated that individuals with schizophrenia demonstrated varying degrees of associative memory dysfunction in both the same and cross-modalities, with the latter having a significantly lower score than healthy controls (t = 4.120, p < 0.001). Additionally, the cross-modal associative memory function was significantly and negatively correlated with the severity of negative symptoms among individuals diagnosed with schizophrenia (r = -0.362, p = 0.042). This study provides evidence of abnormalities in the processing and memorization of information that integrates multiple sensory modalities in individuals with schizophrenia. This is of great significance for further understanding the cognitive symptoms and pathological mechanisms of schizophrenia, potentially guiding the development of relevant interventions and treatment methods.

A neural network model of hippocampal contributions to category learning

In addition to its critical role in encoding individual episodes, the hippocampus is capable of extracting regularities across experiences. This ability is central to category learning, and a growing literature indicates that the hippocampus indeed makes important contributions to this form of learning. Using a neural network model that mirrors the anatomy of the hippocampus, we investigated the mechanisms by which the hippocampus may support novel category learning. We simulated three category learning paradigms and evaluated the network's ability to categorize and recognize specific exemplars in each. We found that the trisynaptic pathway within the hippocampus-connecting entorhinal cortex to dentate gyrus, CA3, and CA1-was critical for remembering exemplar-specific information, reflecting the rapid binding and pattern separation capabilities of this circuit. The monosynaptic pathway from entorhinal cortex to CA1, in contrast, specialized in detecting the regularities that define category structure across exemplars, supported by the use of distributed representations and a relatively slower learning rate. Together, the simulations provide an account of how the hippocampus and its constituent pathways support novel category learning.

Prolonged development of forced-choice recognition when targets are paired with non-corresponding lures

Previous research suggests that mnemonic discrimination (i.e., the ability to discriminate between previously encountered and novel stimuli even when they are highly similar) improves substantially during childhood. To further understand the development of mnemonic discrimination during childhood, the current study had 4-year-old children, 6-year-old children, and young adults complete the forced-choice Mnemonic Similarity Task (MST). The forced-choice MST offers a significant advantage in the context of developmental research because it is not sensitive to age-related differences in response criteria and includes three test formats that are theorized to be supported by different cognitive processes. A target (i.e., a previously encountered item) is paired with either a novel item (A-X), a corresponding lure (A-A'; i.e., an item mnemonically similar to the target), or a non-corresponding lure (A-B'; i.e., an item mnemonically similar to a different previously encoded item). We observed that 4-year-olds performed more poorly than 6-year-olds on the A-X and A-A' test formats, whereas both 4- and 6-year-olds performed more poorly than young adults on the A-B' test format. The MINERVA 2.2 computational model effectively accounted for these age-related differences. The model suggested that 4-year-olds have a lower learning rate (i.e., probability of encoding stimulus features) than 6-year-olds and young adults and that both 4- and 6-year-olds have greater encoding variability than young adults. These findings provide new insight into possible mechanisms underlying memory development during childhood and serve as the basis for multiple avenues of future research.

Prediction error and memory across the lifespan

The influence of Prediction Errors (PEs) on episodic memory has generated growing empirical and theoretical interest. This review explores how the relationship between PE and memory may evolve throughout lifespan. Drawing upon the predictive processing framework and the Predictive, Interactive Multiple Memory System (PIMMS) model in particular, the paper highlights the hierarchical organization of memory systems and the interaction between top-down predictions and bottom-up sensory input, proposing that PEs promote synaptic change and improve encoding and consolidation processes. We discuss the neuroscientific mechanisms underlying PE-driven memory enhancement, focusing on the involvement of the hippocampus, the entorhinal cortex-hippocampus pathway, and the noradrenergic sympathetic system. Recognizing the divergent trajectories of episodic and semantic memory across the lifespan is crucial when examining the effects of PEs on memory. This review underscores the heterogeneity of memory processes and neurocognitive mechanisms underlying PE-driven memory enhancement across age. Future research is suggested to directly compare neural networks involved in learning from PEs across different age groups and to contribute to a deeper understanding of PE-driven learning across age.

EEG Amplitude Modulation Analysis across Mental Tasks: Towards Improved Active BCIs

Brain-computer interface (BCI) technology has emerged as an influential communication tool with extensive applications across numerous fields, including entertainment, marketing, mental state monitoring, and particularly medical neurorehabilitation. Despite its immense potential, the reliability of BCI systems is challenged by the intricacies of data collection, environmental factors, and noisy interferences, making the interpretation of high-dimensional electroencephalogram (EEG) data a pressing issue. While the current trends in research have leant towards improving classification using deep learning-based models, our study proposes the use of new features based on EEG amplitude modulation (AM) dynamics. Experiments on an active BCI dataset comprised seven mental tasks to show the importance of the proposed features, as well as their complementarity to conventional power spectral features. Through combining the seven mental tasks, 21 binary classification tests were explored. In 17 of these 21 tests, the addition of the proposed features significantly improved classifier performance relative to using power spectral density (PSD) features only. Specifically, the average kappa score for these classifications increased from 0.57 to 0.62 using the combined feature set. An examination of the top-selected features showed the predominance of the AM-based measures, comprising over 77% of the top-ranked features. We conclude this paper with an in-depth analysis of these top-ranked features and discuss their potential for use in neurophysiology.

On pattern completion, cues and future-oriented cognition

Barzykowski and Moulin's view on involuntary autobiographical memory focuses on automatic activation of representations and inhibitory control mechanisms. We discuss how and when a known neural mechanism - pattern completion - may result in involuntary autobiographical memories, the types of cues that may elicit this phenomenon and consider interactions with future-oriented cognition.

No evidence of fast mapping in healthy adults using an implicit memory measure: failures to replicate the lexical competition results of Coutanche and Thompson-Schill (2014)

Fast mapping (FM) is a hypothetical, incidental learning process that allows rapid acquisition of new words. Using an implicit reaction time measure in a FM paradigm, Coutanche and Thompson-Schill (Coutanche, M. N., & Thompson-Schill, S. L. (2014). Fast mapping rapidly integrates information into existing memory networks. Journal of Experimental Psychology: General, 143(6), 2296-2303. https://doi.org/10.1037/xge0000020) showed evidence of lexical competition within 10 min of non-words being learned as names of unknown items, consistent with same-day lexicalisation. Here, Experiment 1 was a methodological replication (N = 28/group) that found no evidence of this RT competition effect. Instead, a post-hoc analysis suggested evidence of semantic priming. Experiment 2 (N = 60/group, online study, pre-registered on OSF) tested whether semantic priming remained when making the stimulus set fully counterbalanced. No evidence for either lexical competition nor semantic priming was detected. Experiment 3 (n = 64, online study, pre-registered on OSF) tested whether referent (a)typicality boosted lexical competition (Coutanche, M. N., & Koch, G. E. (2017). Variation across individuals and items determine learning outcomes from fast mapping. Neuropsychologia, 106, 187-193. https://doi.org/10.1016/j.neuropsychologia.2017.09.029), but again no evidence of lexical competition was observed, and Bayes Factors for the data combined across all three experiments supported the hypothesis that there is no effect of lexical competition under FM conditions. These results, together with our previous work, question whether fast mapping exists in healthy adults, at least using this specific FM paradigm.

Age differences in the neural correlates of recollection: transient versus sustained fMRI effects

Prior functional magnetic resonance imaging findings in young adults indicate that recollection-sensitive neural regions dissociate according to the time courses of their respective recollection effects. Here, we examined whether such dissociations are also evident in older adults. Young and older participants encoded a series of word-image pairs, judging which of the denoted objects was the smaller. At the test, participants judged whether each of a series of test words was old or new. If a word was old, the requirement was to recall the associated image and maintain it over a variable delay period. Older adults demonstrated significantly lower associative memory performance than young adults. Transient recollection effects were identified in the left hippocampus, medial prefrontal cortex, and posterior cingulate, while sustained effects were widespread across left lateral cortex and were also evident in the bilateral striatum. Except for those in the left insula, all effects were age-invariant. These findings suggest that both transient and sustained recollection effects are largely stable across much of the healthy adult life span.

Separate orexigenic hippocampal ensembles shape dietary choice by enhancing contextual memory and motivation

The hippocampus (HPC), traditionally known for its role in learning and memory, has emerged as a controller of food intake. While prior studies primarily associated the HPC with food intake inhibition, recent research suggests a critical role in appetitive processes. We hypothesized that orexigenic HPC neurons differentially respond to fats and/or sugars, potent natural reinforcers that contribute to obesity development. Results uncover previously-unrecognized, spatially-distinct neuronal ensembles within the dorsal HPC (dHPC) that are responsive to separate nutrient signals originating from the gut. Using activity-dependent genetic capture of nutrient-responsive HPC neurons, we demonstrate a causal role of both populations in promoting nutrient-specific preference through different mechanisms. Sugar-responsive neurons encode an appetitive spatial memory engram for meal location, whereas fat-responsive neurons selectively enhance the preference and motivation for fat intake. Collectively, these findings uncover a neural basis for the exquisite specificity in processing macronutrient signals from a meal that shape dietary choices.

Proximity to boundaries reveals spatial context representation in human hippocampal CA1

Recollection of real-world events is often accompanied by a sense of being in the place where the event transpired. Convergent evidence suggests the hippocampus plays a key role in supporting episodic memory by associating information with the time and place it was originally encountered. This representation is reinstated during memory retrieval. However, little is known about the roles of different subfields of the human hippocampus in this process. Research in humans and non-human animal models has suggested that spatial environmental boundaries have a powerful influence on spatial and episodic memory, as well as hippocampal representations of contexts and events. Here, we used high-resolution fMRI to investigate how boundaries influence hippocampal activity patterns during the recollection of objects encountered in different spatial contexts. During the encoding phase, participants viewed objects once in a naturalistic virtual reality task in which they passively explored two rooms in one of two houses. Following the encoding phase, participants were scanned while they recollected items in the absence of any spatial contextual information. Our behavioral results demonstrated that spatial context memory was enhanced for objects encountered near a boundary. Activity patterns in CA1 carried information about the spatial context associated with each of these boundary items. Exploratory analyses revealed that recollection performance was correlated with the fidelity of retrieved spatial context representations in anterior parahippocampal cortex and subiculum. Our results highlight the privileged role of boundaries in CA1 and suggest more generally a close relationship between memory for spatial contexts and representations in the hippocampus and parahippocampal region.

Mnemonic discrimination deficits in multidimensional schizotypy

Current developmental psychopathology models indicate that schizophrenia can be understood as the most extreme expression of a multidimensional continuum of symptoms and impairment referred to as schizotypy. In nondisordered adults, schizotypy predicts risk for developing schizophrenia-spectrum psychopathology. Schizophrenia is associated with disruptions in detecting subtle differences between objects, which is linked to hippocampal dysfunction. These disruptions have been shown in the Mnemonic Similarity Task (MST) when patients are less likely to reject lures that are similar but not identical to studied objects, and instead mistake them for studied items. This pattern of errors may be a behavioral manifestation of impaired pattern separation, a key episodic memory ability associated with hippocampal integrity and overreliance on pattern completion. We examined whether multidimensional schizotypy is associated with such deficits in nondisordered young adults. Participants (n = 230) were assessed for positive, negative, and disorganized schizotypy and completed the MST and a perceptual discrimination task. MST performance showed that a combination of elevated negative and disorganized schizotypy was associated with decreased rejections of similar lures because they were mistakenly identified as studied items. These deficits were not observed in traditional recognition measures within the same task, nor in perceptual discrimination, suggesting that mnemonic discrimination deficits assessed by MST were selective and did not reflect generalized deficits. These findings extend the results obtained in schizophrenia patients and support a multidimensional model of schizophrenia-spectrum psychopathology.

Predictions transform memories: How expected versus unexpected events are integrated or separated in memory

Our brains constantly generate predictions about the environment based on prior knowledge. Many of the events we experience are consistent with these predictions, while others might be inconsistent with prior knowledge and thus violate our predictions. To guide future behavior, the memory system must be able to strengthen, transform, or add to existing knowledge based on the accuracy of our predictions. We synthesize recent evidence suggesting that when an event is consistent with our predictions, it leads to neural integration between related memories, which is associated with enhanced associative memory, as well as memory biases. Prediction errors, in turn, can promote both neural integration and separation, and lead to multiple mnemonic outcomes. We review these findings and how they interact with factors such as memory reactivation, prediction error strength, and task goals, to offer insight into what determines memory for events that violate our predictions. In doing so, this review brings together recent neural and behavioral research to advance our understanding of how predictions shape memory, and why.

Time-dependent memory transformation in hippocampus and neocortex is semantic in nature

Memories undergo a time-dependent neural reorganization, which is assumed to be accompanied by a transformation from detailed to more gist-like memory. However, the nature of this transformation and its underlying neural mechanisms are largely unknown. Here, we report that the time-dependent transformation of memory is semantic in nature, while we find no credible evidence for a perceptual transformation. Model-based MRI analyses reveal time-dependent increases in semantically transformed representations of events in prefrontal and parietal cortices, while specific pattern representations in the anterior hippocampus decline over time. Posterior hippocampal memory reinstatement, in turn, increases over time and is linked to the semantic gist of the original memory, without a statistically significant link to perceptual details. These findings indicate that qualitative changes in memory over time, associated with distinct representational changes in the neocortex and within the hippocampus, reflect a semantic transformation, which may promote the integration of memories into abstract knowledge structures.

Theta mediated dynamics of human hippocampal-neocortical learning systems in memory formation and retrieval

Episodic memory arises as a function of dynamic interactions between the hippocampus and the neocortex, yet the mechanisms have remained elusive. Here, using human intracranial recordings during a mnemonic discrimination task, we report that 4-5 Hz (theta) power is differentially recruited during discrimination vs. overgeneralization, and its phase supports hippocampal-neocortical when memories are being formed and correctly retrieved. Interactions were largely bidirectional, with small but significant net directional biases; a hippocampus-to-neocortex bias during acquisition of new information that was subsequently correctly discriminated, and a neocortex-to-hippocampus bias during accurate discrimination of new stimuli from similar previously learned stimuli. The 4-5 Hz rhythm may facilitate the initial stages of information acquisition by neocortex during learning and the recall of stored information from cortex during retrieval. Future work should further probe these dynamics across different types of tasks and stimuli and computational models may need to be expanded accordingly to accommodate these findings.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

Integration of event experiences to build relational knowledge in the human brain

We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic memory area important for temporal relations, anterior-lateral entorhinal cortex, and a semantic memory area important for action concepts, middle temporal gyrus, to understand how and when these areas contribute to these processes. Participants underwent functional magnetic resonance imaging while learning and recalling temporal relations among novel events over two sessions 1 week apart. Across distinct contexts, individual temporal relations among events could either be consistent or inconsistent with each other. Within each context, during the recall phase, we measured associative coding as the difference of multivoxel correlations among related vs unrelated pairs of events. Neural regions that form integrative representations should exhibit stronger associative coding in the consistent than the inconsistent contexts. We found evidence of integrative representations that emerged quickly in anterior-lateral entorhinal cortex (at session 1), and only subsequently in middle temporal gyrus, which showed a significant change across sessions. A complementary pattern of findings was seen with signatures during learning. This suggests that integrative representations are established early in anterior-lateral entorhinal cortex and may be a pathway to the later emergence of semantic knowledge in middle temporal gyrus.

Memory, aging and the brain: Old findings and current issues

In this article I reprise some selected findings and issues from my previous behavioural work on age-related differences in memory, and relate them to current work on the neural correlates of encoding, retrieval and representation. In particular, I describe the case study of a woman who had persistent experiences of erroneous recollection. I also describe the results of a study showing a double dissociation of implicit and explicit memory in younger and older adults. Finally, I assess recent work on loss of specificity in older adults' encoding and retrieval processes of episodic events. In all cases I attempt to relate these older findings to current ideas and empirical results in the area of memory, aging, and the brain.

A whole-task brain model of associative recognition that accounts for human behavior and neuroimaging data

Brain models typically focus either on low-level biological detail or on qualitative behavioral effects. In contrast, we present a biologically-plausible spiking-neuron model of associative learning and recognition that accounts for both human behavior and low-level brain activity across the whole task. Based on cognitive theories and insights from machine-learning analyses of M/EEG data, the model proceeds through five processing stages: stimulus encoding, familiarity judgement, associative retrieval, decision making, and motor response. The results matched human response times and source-localized MEG data in occipital, temporal, prefrontal, and precentral brain regions; as well as a classic fMRI effect in prefrontal cortex. This required two main conceptual advances: a basal-ganglia-thalamus action-selection system that relies on brief thalamic pulses to change the functional connectivity of the cortex, and a new unsupervised learning rule that causes very strong pattern separation in the hippocampus. The resulting model shows how low-level brain activity can result in goal-directed cognitive behavior in humans.