Evidence for the incorporation of temporal duration information in human hippocampal long-term memory sequence representations

Memory traces of duration and location in the right intraparietal sulcus

Time and space form an integral part of every human experience, and for the neuronal representation of these perceptual dimensions, previous studies point to the involvement of the right-hemispheric intraparietal sulcus and structures in the medial temporal lobe. Here we used multi-voxel pattern analysis (MVPA) to investigate long-term memory traces for temporal and spatial stimulus features in those areas. Participants were trained on four images associated with short versus long durations and with left versus right locations. Our results demonstrate stable representations of both temporal and spatial information in the right posterior intraparietal sulcus. Building upon previous findings of stable neuronal codes for directly perceived durations and locations, these results show that the reactivation of long-term memory traces for temporal and spatial features can be decoded from neuronal activation patterns in the right parietal cortex.

Scene construction processes in the anterior hippocampus during temporal episodic memory retrieval

Although the hippocampus has been implicated in both the temporal organization of memories and association of scene elements, some theoretical accounts posit that the role of the hippocampus in episodic memory is largely atemporal. In this study, we set out to explore this discrepancy by identifying hippocampal activity patterns related to scene construction while participants performed a temporal order memory task. Participants in the fMRI scanner were shown a sequence of photographs, each consisting of a central object and a contextual background scene. On each retrieval trial, participants were shown a pair of the original photographs (FULL), objects from the scenes without the background (OBJ), or background contexts without the main foreground object (BACK). In the temporal order judgment (TOJ) task, participants judged the temporal order of the pair of scenes; in the Viewing trials, two identical scenes were shown without any task. First, we found that the anterior hippocampus-particularly the CA1 and subiculum-showed similar patterns of activation between the BACK and OBJ conditions, suggesting that scene construction occurred spontaneously during both TOJ and Viewing. Furthermore, neural markers of scene construction in the anterior hippocampus did not apply to incorrect trials, showing that successful temporal memory retrieval was functionally linked to scene construction. In the cortex, time-processing areas, such as the supplementary motor area and the precuneus, and scene-processing areas, such as the parahippocampal cortex, were activated and functionally connected with the hippocampus. Together, these results support the view that the hippocampus is concurrently involved in scene construction and temporal organization of memory and propose a model of hippocampal episodic memory that takes both processes into account.

Emotional state dynamics impacts temporal memory

Emotional fluctuations are ubiquitous in everyday life, but precisely how they sculpt the temporal organisation of memories remains unclear. Here, we designed a novel task - the Emotion Boundary Task - wherein participants viewed sequences of negative and neutral images surrounded by a colour border. We manipulated perceptual context (border colour), emotional-picture valence, as well as the direction of emotional-valence shifts (i.e., shifts from neutral-to-negative and negative-to-neutral events) to create events with a shared perceptual and/or emotional context. We measured memory for temporal order and temporal distances for images processed within and across events. Negative images processed within events were remembered as closer in time compared to neutral ones. In contrast, temporal distances were remembered as longer for images spanning neutral-to-negative shifts - suggesting temporal dilation in memory with the onset of a negative event following a previously-neutral state. The extent of negative-picture induced temporal dilation in memory correlated with dispositional negativity across individuals. Lastly, temporal order memory was enhanced for recently-presented negative (versus neutral) images. These findings suggest that emotional-state dynamics matters when considering emotion-temporal memory interactions: While persistent negative events may compress subjectively remembered time, dynamic shifts from neutral-to-negative events produce temporal dilation in memory, with implications for adaptive emotional functioning.

Encoding-related Brain Activity Predicts Subsequent Trial-level Control of Proactive Interference in Working Memory

Proactive interference (PI) appears when familiar information interferes with newly acquired information and is a major cause of forgetting in working memory. It has been proposed that encoding of item-context associations might help mitigate familiarity-based PI. Here, we investigate whether encoding-related brain activation could predict subsequent level of PI at retrieval using trial-specific parametric modulation. Participants were scanned with event-related fMRI while performing a 2-back working memory task with embedded 3-back lures designed to induce PI. We found that the ability to control interference in working memory was modulated by level of activation in the left inferior frontal gyrus, left hippocampus, and bilateral caudate nucleus during encoding. These results provide insight to the processes underlying control of PI in working memory and suggest that encoding of temporal context details support subsequent interference control.

Emotional state dynamics impacts temporal memory

Emotional fluctuations are ubiquitous in everyday life, but precisely how they sculpt the temporal organization of memories remains unclear. Here, we designed a novel task-the Emotion Boundary Task-wherein participants viewed sequences of negative and neutral images surrounded by a color border. We manipulated perceptual context (border color), emotional valence, as well as the direction of emotional-valence shifts (i.e., shifts from neutral-to-negative and negative-to-neutral events) to create encoding events comprised of image sequences with a shared perceptual and/or emotional context. We measured memory for temporal order and subjectively remembered temporal distances for images processed within and across events. Negative images processed within events were remembered as closer in time compared to neutral ones. In contrast, temporal distance was remembered as longer for images spanning neutral-to-negative shifts-suggesting temporal dilation in memory with the onset of a negative event following a previously-neutral state. The extent of this negative-picture induced temporal dilation in memory correlated with dispositional negativity across individuals. Lastly, temporal order memory was enhanced for recently presented negative (compared to neutral) images. These findings suggest that emotional-state dynamics matters when considering emotion-temporal memory interactions: While persistent negative events may compress subjectively remembered time, dynamic shifts from neutral to negative events produce temporal dilation in memory, which may be relevant for adaptive emotional functioning.

Event Integration and Temporal Differentiation: How Hierarchical Knowledge Emerges in Hippocampal Subfields through Learning

Everyday life is composed of events organized by changes in contexts, with each event containing an unfolding sequence of occurrences. A major challenge facing our memory systems is how to integrate sequential occurrences within events while also maintaining their details and avoiding over-integration across different contexts. We asked if and how distinct hippocampal subfields come to hierarchically and, in parallel, represent both event context and subevent occurrences with learning. Female and male human participants viewed sequential events defined as sequences of objects superimposed on shared color frames while undergoing high-resolution fMRI. Importantly, these events were repeated to induce learning. Event segmentation, as indexed by increased reaction times at event boundaries, was observed in all repetitions. Temporal memory decisions were quicker for items from the same event compared to across different events, indicating that events shaped memory. With learning, hippocampal CA3 multivoxel activation patterns clustered to reflect the event context, with more clustering correlated with behavioral facilitation during event transitions. In contrast, in the dentate gyrus (DG), temporally proximal items that belonged to the same event became associated with more differentiated neural patterns. A computational model explained these results by dynamic inhibition in the DG. Additional similarity measures support the notion that CA3 clustered representations reflect shared voxel populations, while DG's distinct item representations reflect different voxel populations. These findings suggest an interplay between temporal differentiation in the DG and attractor dynamics in CA3. They advance our understanding of how knowledge is structured through integration and separation across time and context.

Investigating the impact of healthy aging on memory for temporal duration and order

Temporal information, including information about temporal order and duration, is a fundamental component of event sequence memory. While previous research has demonstrated that aging can have a detrimental effect on memory for temporal order, there has been limited insight into the effect of aging on memory for durations, particularly within the context of sequences. In the current study, neurologically healthy young and older participants were administered two temporal match-mismatch tasks: one in which they were instructed on each trial to compare the temporal order or duration information of stimulus sequences presented first in a study phase and then, after a short delay, in a test phase (event sequence task); and a second in which participants were required to compare single durations or sequences of durations across study and test phases of each trial (pinwheel task). Consistent with the literature, the older participants were significantly poorer compared to their younger counterparts at making temporal order match-mismatch judgments in the event sequence task. In addition to this, data from both tasks suggested that the older adults were also less accurate at match-mismatch judgments based on duration information, with tentative evidence from the pinwheel task to suggest that this age-related effect was most prominent when the duration information was presented within a sequence. We suggest that age-related changes to medial temporal and frontal lobe function may contribute to changes in memory for temporal information in older adults, given the importance of these regions to event sequence memory.

Testing the generalization of neural representations

Multivariate analysis methods are widely used in neuroscience to investigate the presence and structure of neural representations. Representational similarities across time or contexts are often investigated using pattern generalization, e.g. by training and testing multivariate decoders in different contexts, or by comparable pattern-based encoding methods. It is however unclear what conclusions can be validly drawn on the underlying neural representations when significant pattern generalization is found in mass signals such as LFP, EEG, MEG, or fMRI. Using simulations, we show how signal mixing and dependencies between measurements can drive significant pattern generalization even though the true underlying representations are orthogonal. We suggest that, using an accurate estimate of the expected pattern generalization given identical representations, it is nonetheless possible to test meaningful hypotheses about the generalization of neural representations. We offer such an estimate of the expected magnitude of pattern generalization and demonstrate how this measure can be used to assess the similarity and differences of neural representations across time and contexts.

Hippocampal orchestration of associative and sequential memory networks for episodic retrieval

Episodic memory involves the recollection of contextual details replayed mentally across time. Here, we propose the association-sequence network (ASN) model, characterizing complementary cortico-hippocampal networks underlying the retrieval of simultaneously associated and sequentially ordered events. Participants viewed objects, presented singly or in pairs, and later reported whether two objects were shown simultaneously, consecutively, or farther apart in time. Behavioral results and hippocampal activation reveal a correlation between the two sequential conditions but not the simultaneous condition, despite the temporal proximity of consecutive pairs. We also find that anterior hippocampal activity is modulated by temporal distance. Distinct cortical networks are engaged during simultaneous and sequential memory (prefrontal cortex and angular gyrus for association; supplementary motor cortex and precuneus for sequence); notably, these regions show differential connectivity with the hippocampus. The ASN model provides a comprehensive framework for how we reconstruct memories that are both rich in associative detail and temporally dynamic in nature.

Variational relevance evaluation of individual fMRI data enables deconstruction of task-dependent neural dynamics

In neuroimaging research, univariate analysis has always been used to localize "representations" at the microscale, whereas network approaches have been applied to characterize transregional "operations". How are representations and operations linked through dynamic interactions? We developed the variational relevance evaluation (VRE) method to analyze individual task fMRI data, which selects informative voxels during model training to localize the "representation", and quantifies the dynamic contributions of single voxels across the whole-brain to different cognitive functions to characterize the "operation". Using 15 individual fMRI data files for higher visual area localizers, we evaluated the characterization of selected voxel positions of VRE and revealed different object-selective regions functioning in similar dynamics. Using another 15 individual fMRI data files for memory retrieval after offline learning, we found similar task-related regions working in different neural dynamics for tasks with diverse familiarities. VRE demonstrates a promising horizon in individual fMRI research.

Structured memory representations develop at multiple time scales in hippocampal-cortical networks

Influential views of systems memory consolidation posit that the hippocampus rapidly forms representations of specific events, while neocortical networks extract regularities across events, forming the basis of schemas and semantic knowledge. Neocortical extraction of schematic memory representations is thought to occur on a protracted timescale of months, especially for information that is unrelated to prior knowledge. However, this theorized evolution of memory representations across extended timescales, and differences in the temporal dynamics of consolidation across brain regions, lack reliable empirical support. To examine the temporal dynamics of memory representations, we repeatedly exposed human participants to structured information via sequences of fractals, while undergoing longitudinal fMRI for three months. Sequence-specific activation patterns emerged in the hippocampus during the first 1-2 weeks of learning, followed one week later by high-level visual cortex, and subsequently the medial prefrontal and parietal cortices. Schematic, sequence-general representations emerged in the prefrontal cortex after 3 weeks of learning, followed by the medial temporal lobe and anterior temporal cortex. Moreover, hippocampal and most neocortical representations showed sustained rather than time-limited dynamics, suggesting that representations tend to persist across learning. These results show that specific hippocampal representations emerge early, followed by both specific and schematic representations at a gradient of timescales across hippocampal-cortical networks as learning unfolds. Thus, memory representations do not exist only in specific brain regions at a given point in time, but are simultaneously present at multiple levels of abstraction across hippocampal-cortical networks.

Temporal learning in the suprasecond range: insights from cognitive style

The acquisition of information on the timing of events or actions (temporal learning) occurs in both the subsecond and suprasecond range. However, although relevant differences between participants have been reported in temporal learning, the role of dimensions of individual variability in affecting performance in such tasks is still unclear. Here we investigated this issue, assessing the effect of field-dependent/independent cognitive style on temporal learning in the suprasecond range. Since different mechanisms mediate timing when a temporal representation is self-generated, and when it depends on an external referent, temporal learning was assessed in two conditions. Participants observed a stimulus across six repetitions and reproduced it. Unbeknownst to them, in an internally-based learning (IBL) condition, the stimulus duration was fixed within a trial, although the number of events defining it varied; in an externally-cued learning (ECL) condition, the stimulus was defined by the same number of events within each trial, although its duration varied. The effect of the reproduction modality was also assessed (motor vs. perceptual). Error scores were higher in IBL compared to ECL; the reverse was true for variability. Field-independent individuals performed better than field-dependent ones only in IBL, as further confirmed by correlation analyses. Findings provide evidence that differences in dimensions of variability in high-level cognitive functioning, such as field dependence/independence, significantly affect temporal learning in the suprasecond range, and that this effect depends on the type of temporal representation fostered by the specific task demands.

Successor-like representation guides the prediction of future events in human visual cortex and hippocampus

Human agents build models of their environment, which enable them to anticipate and plan upcoming events. However, little is known about the properties of such predictive models. Recently, it has been proposed that hippocampal representations take the form of a predictive map-like structure, the so-called successor representation (SR). Here, we used human functional magnetic resonance imaging to probe whether activity in the early visual cortex (V1) and hippocampus adhere to the postulated properties of the SR after visual sequence learning. Participants were exposed to an arbitrary spatiotemporal sequence consisting of four items (A-B-C-D). We found that after repeated exposure to the sequence, merely presenting single sequence items (e.g., - B - -) resulted in V1 activation at the successor locations of the full sequence (e.g., C-D), but not at the predecessor locations (e.g., A). This highlights that visual representations are skewed toward future states, in line with the SR. Similar results were also found in the hippocampus. Moreover, the hippocampus developed a coactivation profile that showed sensitivity to the temporal distance in sequence space, with fading representations for sequence events in the more distant past and future. V1, in contrast, showed a coactivation profile that was only sensitive to spatial distance in stimulus space. Taken together, these results provide empirical evidence for the proposition that both visual and hippocampal cortex represent a predictive map of the visual world akin to the SR.

Mnemonic Content and Hippocampal Patterns Shape Judgments of Time

Our experience of time can feel dilated or compressed, rather than reflecting true "clock time." Although many contextual factors influence the subjective perception of time, it is unclear how memory accessibility plays a role in constructing our experience of and memory for time. Here, we used a combination of behavioral and functional MRI measures in healthy young adults (N = 147) to ask the question of how memory is incorporated into temporal duration judgments. Behaviorally, we found that event boundaries, which have been shown to disrupt ongoing memory integration processes, result in the temporal compression of duration judgments. Additionally, using a multivoxel pattern similarity analysis of functional MRI data, we found that greater temporal pattern change in the left hippocampus within individual trials was associated with longer duration judgments. Together, these data suggest that mnemonic processes play a role in constructing representations of time.

Intrinsic hippocampal connectivity is associated with individual differences in retrospective duration processing

The estimation of incidentally encoded durations of time intervals (retrospective duration processing) is thought to rely on the retrieval of contextual information associated with a sequence of events, automatically encoded in medial temporal lobe regions. "Time cells" have been described in the hippocampus (HC), encoding the temporal progression of events and their duration. However, whether the HC supports explicit retrospective duration judgments in humans, and which neural dynamics are involved, is still poorly understood. Here we used resting-state fMRI to test the relation between variations in intrinsic connectivity patterns of the HC, and individual differences in retrospective duration processing, assessed using a novel task involving the presentation of ecological stimuli. Results showed that retrospective duration discrimination performance predicted variations in the intrinsic connectivity of the bilateral HC with the right precentral gyrus; follow-up exploratory analyses suggested a role of the CA1 and CA4/DG subfields in driving the observed pattern. Findings provide insights on neural networks associated with implicit processing of durations in the second range.

The tie that binds: temporal coding and adaptive emotion

Emotions are temporally dynamic, but the persistence of emotions outside of their appropriate temporal context is detrimental to health and well-being. Yet, precisely how temporal coding and emotional processing interact remains unclear. Recently unveiled temporal context representations in the hippocampus, entorhinal cortex (EC), and prefrontal cortex (PFC) support memory for what happened when. Here, we discuss how these neural temporal representations may interact with densely interconnected amygdala circuitry to shape emotional functioning. We propose a neuroanatomically informed framework suggesting that high-fidelity temporal representations linked to dynamic experiences promote emotion regulation and adaptive emotional memories. Then, we discuss how newly-identified synaptic and molecular features of amygdala-hippocampal projections suggest that intense, amygdala-dependent emotional responses may distort temporal-coding mechanisms. We conclude by identifying key avenues for future research.

Rapid encoding of task regularities in the human hippocampus guides sensorimotor timing

The brain encodes the statistical regularities of the environment in a task-specific yet flexible and generalizable format. Here, we seek to understand this process by bridging two parallel lines of research, one centered on sensorimotor timing, and the other on cognitive mapping in the hippocampal system. By combining functional magnetic resonance imaging (fMRI) with a fast-paced time-to-contact (TTC) estimation task, we found that the hippocampus signaled behavioral feedback received in each trial as well as performance improvements across trials along with reward-processing regions. Critically, it signaled performance improvements independent from the tested intervals, and its activity accounted for the trial-wise regression-to-the-mean biases in TTC estimation. This is in line with the idea that the hippocampus supports the rapid encoding of temporal context even on short time scales in a behavior-dependent manner. Our results emphasize the central role of the hippocampus in statistical learning and position it at the core of a brain-wide network updating sensorimotor representations in real time for flexible behavior.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

Mnemonic construction and representation of temporal structure in the hippocampal formation

The hippocampal-entorhinal region supports memory for episodic details, such as temporal relations of sequential events, and mnemonic constructions combining experiences for inferential reasoning. However, it is unclear whether hippocampal event memories reflect temporal relations derived from mnemonic constructions, event order, or elapsing time, and whether these sequence representations generalize temporal relations across similar sequences. Here, participants mnemonically constructed times of events from multiple sequences using infrequent cues and their experience of passing time. After learning, event representations in the anterior hippocampus reflected temporal relations based on constructed times. Temporal relations were generalized across sequences, revealing distinct representational formats for events from the same or different sequences. Structural knowledge about time patterns, abstracted from different sequences, biased the construction of specific event times. These findings demonstrate that mnemonic construction and the generalization of relational knowledge combine in the hippocampus, consistent with the simulation of scenarios from episodic details and structural knowledge.

Intrinsic functional connectivity in the default mode network predicts mnemonic discrimination: A connectome-based modeling approach

The ability to distinguish existing memories from similar perceptual experiences is a core feature of episodic memory. This ability is often examined using the mnemonic similarity task in which people discriminate memories of studied objects from perceptually similar lures. Studies of the neural basis of such mnemonic discrimination have mostly focused on hippocampal function and connectivity. However, default mode network (DMN) connectivity may also support such discrimination, given that the DMN includes the hippocampus, and its connectivity supports many aspects of episodic memory. Here, we used connectome-based predictive modeling to identify associations between intrinsic DMN connectivity and mnemonic discrimination. We leveraged a wide range of abilities across healthy younger and older adults to facilitate this predictive approach. Resting-state functional connectivity in the DMN predicted mnemonic discrimination outside the MRI scanner, especially among prefrontal and temporal regions and including several hippocampal regions. This predictive relationship was stronger for younger than older adults, primarily for temporal-prefrontal connectivity. The novel associations established here are consistent with mounting evidence that broader cortical networks including the hippocampus support mnemonic discrimination. They also suggest that age-related network disruptions undermine the extent that the DMN supports this ability. This study provides the first indication of how intrinsic functional properties of the DMN support mnemonic discrimination.

Age-related changes in time perception: The impact of naturalistic environments and retrospective judgements on timing performance

Reduced timing abilities have been reported in older adults and are associated with pathological cognitive decline. However, time perception experiments often lack ecological validity. Especially the reduced complexity of experimental stimuli and the participants' awareness of the time-related nature of the task can influence lab-assessed timing performance and thereby conceal age-related differences. An approximation of more naturalistic paradigms can provide important information about age-related changes in timing abilities. To determine the impact of higher ecological validity on timing experiments, we implemented a paradigm that allowed us to test (1) the effect of embedding the to-be-timed stimuli within a naturalistic visual scene and (2) the effect of retrospective time judgements, which are more common in real life than prospective judgements. The results show that compared with out-of-context stimuli, younger adults benefit from a naturalistic embedding of stimuli (reflected in higher precision and less errors), whereas the performance of older adults is reduced when confronted with naturalistic stimuli. Differences between retrospective and prospective time judgements were not modulated by age. We conclude that, potentially driven by difficulties in suppressing temporally irrelevant environmental information, the contextual embedding of naturalistic stimuli can affect the degree to which age influences the performance in time perception tasks.

Hippocampal resting-state functional connectivity with the mPFC and DLPFC moderates and mediates the association between education level and memory function in subjective cognitive decline

Objective:

This study aims to determine the relationship between education level, memory function, and hippocampus functional and structural alterations in subjective cognitive decline (SCD).

Methods:

Seventy-five participants with SCD were divided into high education (HE) and low education (LE) level groups. A Wechsler Memory Scale–Chinese Revision test and functional and structural MRI were performed within 1 week after participant recruitment. The bilateral hippocampus resting-state functional connectivity (rsFC), gray matter volume (GMV) of brain regions identified by rsFC analysis, and moderating and mediating effects were assessed.

Results:

Compared with the LE group, HE individuals showed 1) higher memory quotient (MQ) and Digit Span subscore, 2) decreased hippocampal rsFC with the right medial prefrontal cortex (mPFC) and dorsolateral prefrontal cortex (DLPFC), and 3) increased GMV in the right mPFC and DLPFC. The bilateral hippocampus–right DLPFC rsFC significantly associated with the MQ and the bilateral hippocampus–right mPFCrsFC with the Digit Span subscore in each group. The bilateral hippocampus–right DLPFC rsFC moderated the relationship between the education level and MQ. The bilateral hippocampus–right mPFC rsFC mediated the relationship between the education level and Digit Span subscore in all subjects.

Conclusion:

The hippocampal rsFC with the right mPFC and DLPFC contributes to the education level effect on memory function in SCD.

Brain Mechanisms Underlying the Subjective Experience of Remembering

The ability to remember events in vivid, multisensory detail is a significant part of human experience, allowing us to relive previous encounters and providing us with the store of memories that shape our identity. Recent research has sought to understand the subjective experience of remembering, that is, what it feels like to have a memory. Such remembering involves reactivating sensory-perceptual features of an event and the thoughts and feelings we had when the event occurred, integrating them into a conscious first-person experience. It allows us to reflect on the content of our memories and to understand and make judgments about them, such as distinguishing events that actually occurred from those we might have imagined or been told about. In this review, we consider recent evidence from functional neuroimaging in healthy participants and studies of neurological and psychiatric conditions, which is shedding new light on how we subjectively experience remembering. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Hippocampal-Medial Prefrontal Event Segmentation and Integration Contribute to Episodic Memory Formation

How do we encode our continuous life experiences for later retrieval? Theories of event segmentation and integration suggest that the hippocampus binds separately represented events into an ordered narrative. Using a functional Magnetic Resonance Imaging (fMRI) movie watching-recall dataset, we quantified two types of neural similarities (i.e., "activation pattern" similarity and within-region voxel-based "connectivity pattern" similarity) between separate events during movie watching and related them to subsequent retrieval of events as well as retrieval of sequential order. We demonstrated that compared with forgotten events, successfully remembered events were associated with distinct "activation patterns" in the hippocampus and medial prefrontal cortex. In contrast, similar "connectivity pattern" between events were associated with memory formation and were also relevant for retaining events in the correct order. We applied the same approaches to an independent movie watching fMRI dataset as validation and highlighted again the role of hippocampal activation pattern and connectivity pattern in memory formation. We propose that distinct activation patterns represent neural segmentation of events, while similar connectivity patterns encode context information and, therefore, integrate events into a narrative. Our results provide novel evidence for the role of hippocampal-medial prefrontal event segmentation and integration in episodic memory formation of real-life experience.

Altered structural covariance of hippocampal subregions in patients with Alzheimer's disease

BACKGROUND AND PURPOSE

Different atrophy of hippocampus subregions is a valuable indicator of patients with Alzheimer's disease (AD). To explore the relationship among the hippocampal subregions of patients with AD, altered gray matter structural covariance of hippocampal subregions in patients with AD was studied.

MATERIALS AND METHODS

Participants were selected from the Open Access Series of Imaging Studies Database. Pearson correlations among the volume of the hippocampal subregions were generated as structural covariance network. Topological metrics for all selected sparsity ranges were calculated in the healthy controls (HCs) and patients with AD by using the GRETNA software package. Spearman correlation analysis was performed to statistically analyze the volume and Mini-mental State Examination (MMSE) scores of the hippocampal subregions of the patients with AD, with age and gender as interference covariates and corrected for false discovery rate (FDR) (p < 0.05).

RESULTS

The structural covariance network properties of the hippocampal subregions of patients with AD changed. The clustering coefficient (Cp) and network efficiency (Ne) decreased, characteristic path length (Lp) increased, and the hub nodes changed. The volumes of left parasubiculum, right granule cell layer of dentate gyrus (GC-DG), right molecular layer of the hippocampus (molecular_layer_HP), right Cornu Ammonis (CA) regions CA1 of the hippocampus proper, right fimbria and right CA4 were significantly correlated with the MMSE scores.

CONCLUSIONS

The structural covariance network of the hippocampal subregions of patients with AD was reorganized, and the transmission efficiency was weakened. This study explored the changes in these subregions from the network level, which may provide a new perspective and theoretical basis for the neurobiological mechanisms of patients with AD.

Temporal Regularity May Not Improve Memory for Item-Specific Detail

Regularities in event timing allow for the allocation of attention to critical time-points when an event is most likely to occur, leading to improved visual perception. Results from recent studies indicate that similar benefits may extend to memory for scenes and objects. Here, we investigated whether benefits of temporal regularity are evident when detailed, item-specific representations are necessary for successful recognition memory performance. In Experiments 1 and 2, pictures of objects were presented with either predictable or randomized event timing, in separate encoding blocks. In the test phase, old and new objects were presented, intermixed with perceptually similar exemplars of encoded objects. In Experiment 3 we attempted to replicate previously reported memory enhancements for scenes. In contrast to predictions, temporal regularity did not affect response times (RT) or improve recognition memory accuracy in any of our experiments. These results suggest that any effects of temporal expectation on memory are subtle and may be sensitive to minor changes in task parameters. In sum, indirect upregulation of attention through imposed temporal structure may not be sufficient to have downstream effects on memory performance.

FreeSurfer ‐based segmentation of hippocampal subfields: A review of methods and applications, with a novel quality control procedure for ENIGMA studies and other collaborative efforts

Structural hippocampal abnormalities are common in many neurological and psychiatric disorders, and variation in hippocampal measures is related to cognitive performance and other complex phenotypes such as stress sensitivity. Hippocampal subregions are increasingly studied, as automated algorithms have become available for mapping and volume quantification. In the context of the Enhancing Neuro Imaging Genetics through Meta Analysis Consortium, several Disease Working Groups are using the FreeSurfer software to analyze hippocampal subregion (subfield) volumes in patients with neurological and psychiatric conditions along with data from matched controls. In this overview, we explain the algorithm's principles, summarize measurement reliability studies, and demonstrate two additional aspects (subfield autocorrelation and volume/reliability correlation) with illustrative data. We then explain the rationale for a standardized hippocampal subfield segmentation quality control (QC) procedure for improved pipeline harmonization. To guide researchers to make optimal use of the algorithm, we discuss how global size and age effects can be modeled, how QC steps can be incorporated and how subfields may be aggregated into composite volumes. This discussion is based on a synopsis of 162 published neuroimaging studies (01/2013–12/2019) that applied the FreeSurfer hippocampal subfield segmentation in a broad range of domains including cognition and healthy aging, brain development and neurodegeneration, affective disorders, psychosis, stress regulation, neurotoxicity, epilepsy, inflammatory disease, childhood adversity and posttraumatic stress disorder, and candidate and whole genome (epi‐)genetics. Finally, we highlight points where FreeSurfer‐based hippocampal subfield studies may be optimized.

Hippocampal-striatal functional connectivity supports processing of temporal expectations from associative memory

The hippocampus and dorsal striatum are both associated with temporal processing, but they are thought to play distinct roles. The hippocampus has been reported to contribute to storing temporal structure of events in memory, whereas the striatum contributes to temporal motor preparation and reward anticipation. Here, we asked whether the striatum cooperates with the hippocampus in processing the temporal context of memorized visual associations. In our task, participants were trained to implicitly form temporal expectations for one of two possible time intervals associated to specific cue-target associations, and subsequently were scanned using ultra-high-field 7T functional magnetic resonance imaging. During scanning, learned temporal expectations could be violated when the pairs were presented at either the associated or not-associated time intervals. When temporal expectations were met during testing trials, activity in left and right hippocampal subfields and right putamen decreased, compared to when temporal expectations were not met. Further, psycho-physiological interactions showed that functional connectivity between left hippocampal subfields and caudate decreased when temporal expectations were not met. Our results indicate that the hippocampus and striatum cooperate to process implicit temporal expectation from mnemonic associations. Our findings provide further support for a hippocampal-striatal network in temporal associative processing.

Sequence Memory in the Hippocampal-Entorhinal Region

Episodic memories are constructed from sequences of events. When recalling such a memory, we not only recall individual events, but we also retrieve information about how the sequence of events unfolded. Here, we focus on the role of the hippocampal-entorhinal region in processing and remembering sequences of events, which are thought to be stored in relational networks. We summarize evidence that temporal relations are a central organizational principle for memories in the hippocampus. Importantly, we incorporate novel insights from recent studies about the role of the adjacent entorhinal cortex in sequence memory. In rodents, the lateral entorhinal subregion carries temporal information during ongoing behavior. The human homologue is recruited during memory recall where its representations reflect the temporal relationships between events encountered in a sequence. We further introduce the idea that the hippocampal-entorhinal region might enable temporal scaling of sequence representations. Flexible changes of sequence progression speed could underlie the traversal of episodic memories and mental simulations at different paces. In conclusion, we describe how the entorhinal cortex and hippocampus contribute to remembering event sequences-a core component of episodic memory.

The Medial Temporal Lobe Is Critical for Spatial Relational Perception

The medial temporal lobe (MTL) is traditionally considered to be a system that is specialized for long-term memory. Recent work has challenged this notion by demonstrating that this region can contribute to many domains of cognition beyond long-term memory, including perception and attention. One potential reason why the MTL (and hippocampus specifically) contributes broadly to cognition is that it contains relational representations-representations of multidimensional features of experience and their unique relationship to one another-that are useful in many different cognitive domains. Here, we explore the hypothesis that the hippocampus/MTL plays a critical role in attention and perception via relational representations. We compared human participants with MTL damage to healthy age- and education-matched individuals on attention tasks that varied in relational processing demands. On each trial, participants viewed two images (rooms with paintings). On "similar room" trials, they judged whether the rooms had the same spatial layout from a different perspective. On "similar art" trials, they judged whether the paintings could have been painted by the same artist. On "identical" trials, participants simply had to detect identical paintings or rooms. MTL lesion patients were significantly and selectively impaired on the similar room task. This work provides further evidence that the hippocampus/MTL plays a ubiquitous role in cognition by virtue of its relational and spatial representations and highlights its important contributions to rapid perceptual processes that benefit from attention.

The Human Medial Temporal Lobe Is Necessary for Remembering Durations within a Sequence of Events but Not Durations of Individual Events

Recent interest in the role of the hippocampus in temporal aspects of cognition has been fueled, in part, by the observation of “time” cells in the rodent hippocampus—that is, cells that have differential firing patterns depending on how long ago an event occurred. Such cells are thought to provide an internal representation of elapsed time. Yet, the hippocampus is not needed for processing temporal duration information per se, at least on the order of seconds, as evidenced by intact duration judgments in rodents and humans with hippocampal damage. Rather, it has been proposed that the hippocampus may be essential for coding higher order aspects of temporal mnemonic processing, such as those needed to temporally organize a sequence of events that form an episode. To examine whether (1) the hippocampus uses duration information in the service of establishing temporal relations among events and (2) its role in memory for duration is unique to sequences, we tested amnesic patients with medial-temporal lobe damage (including the hippocampus). We hypothesized that medial-temporal lobe damage should impair the ability to remember sequential duration information but leave intact judgments about duration devoid of a sequential demand. We found that amnesics were impaired in making judgments about durations within a sequence but not in judging single durations. This impairment was not due to higher cognitive load associated with duration judgments about sequences. In convergence with rodent and human fMRI work, these findings shed light on how time coding in the hippocampus may contribute to temporal cognition.

Context-Dependent Coding of Temporal Distance Between Cinematic Events in the Human Precuneus

How temporal and contextual information interactively impact on behavior and brain activity during the retrieval of temporal order about naturalistic episodes remains incompletely understood. Here, we used fMRI to examine the effects of contextual signals derived from the content of the movie on the neural correlates underlying memory retrieval of temporal-order in human subjects of both sexes. By contrasting SAME versus DIFF storyline conditions during the retrieval of the temporal order of cinematic events, we found that the activation in the precuneus, as well as behavior, are significantly modulated according to storyline condition, supporting our prediction of contextual information contributing to temporal retrieval. We suggest that the precuneus engages in memory retrieval via reconstructive mechanisms, entailing search within a movie-specific, situational knowledge-structure. Furthermore, information-based analyses of multivoxel activity revealed that the precuneus also contains a context-independent linear representation of temporal distances, consistent with a chronological organization of memory traces. We thus put forward that the retrieval of the temporal-order of naturalistic events encoded in rich and dynamic contexts relies on the joint contribution of chronological and reconstructive mechanisms, both of which rely on the medioposterior parietal cortex in humans.SIGNIFICANCE STATEMENT Successful retrieval of episodic memory is dependent on both temporal and contextual signals. However, when contextual signals derived from multiple storylines or narratives are complex and intertwined, the behavioral and neural correlates underpinning the interplay between time and context is not completely understood. Here we characterized the activation level and multivoxel pattern of BOLD signals underlying the modulation of such contextual information during temporal order judgment in the precuneus. Our findings provide us with an elucidation of subprocesses implicating the medial parietal cortex in realizing temporal organization of episodic details.

The hippocampus contributes to temporal duration memory in the context of event sequences: A cross-species perspective

Although a large body of research has implicated the hippocampus in the processing of memory for temporal duration, there is an exigent degree of inconsistency across studies that obfuscates the precise contributions of this structure. To shed light on this issue, the present review article surveys both historical and recent cross-species evidence emanating from a wide variety of experimental paradigms, identifying areas of convergence and divergence. We suggest that while factors such as time-scale (e.g. the length of durations involved) and the nature of memory processing (e.g. prospective vs. retrospective memory) are very helpful in the interpretation of existing data, an additional important consideration is the context in which the duration information is experienced and processed, with the hippocampus being preferentially involved in memory for durations that are embedded within a sequence of events. We consider the mechanisms that may underpin temporal duration memory and how the same mechanisms may contribute to memory for other aspects of event sequences such as temporal order.

The spatiotemporal organization of episodic memory and its disruption in a neurodevelopmental disorder

Recent theories of episodic memory (EM) posit that the hippocampus provides a spatiotemporal framework necessary for representing events. If such theories hold true, then does the development of EM in children depend on the ability to first bind spatial and temporal information? And does this ability rely, at least in part, on normal hippocampal function? We investigated the development of EM in children 2–8 years of age (Study 1) and its impairment in Williams Syndrome, a genetic neurodevelopmental disorder characterized by visuospatial deficits and irregular hippocampal function, (Study 2) by implementing a nonverbal object-placement task that dissociates the what, where, and when components of EM. Consistent with the spatiotemporal-framework view of hippocampal EM, our results indicate that the binding of where and when in memory emerges earliest in development, around the age of 3, and is specifically impaired in WS. Space-time binding both preceded and was critical to full EM (what + where + when), and the successful association of objects to spatial locations seemed to mediate this developmental process.

Mapping sequence structure in the human lateral entorhinal cortex

Remembering event sequences is central to episodic memory and presumably supported by the hippocampal-entorhinal region. We previously demonstrated that the hippocampus maps spatial and temporal distances between events encountered along a route through a virtual city (Deuker et al., 2016), but the content of entorhinal mnemonic representations remains unclear. Here, we demonstrate that multi-voxel representations in the anterior-lateral entorhinal cortex (alEC) - the human homologue of the rodent lateral entorhinal cortex - specifically reflect the temporal event structure after learning. Holistic representations of the sequence structure related to memory recall and the timeline of events could be reconstructed from entorhinal multi-voxel patterns. Our findings demonstrate representations of temporal structure in the alEC; dovetailing with temporal information carried by population signals in the lateral entorhinal cortex of navigating rodents and alEC activations during temporal memory retrieval. Our results provide novel evidence for the role of the alEC in representing time for episodic memory.

Episodic memory: Neuronal codes for what, where, and when

Episodic memory is defined as the ability to recall events in a spatiotemporal context. Formation of such memories is critically dependent on the hippocampal formation and its inputs from the entorhinal cortex. To be able to support the formation of episodic memories, entorhinal cortex and hippocampal formation should contain a neuronal code that follows several requirements. First, the code should include information about position of the agent ("where"), sequence of events ("when"), and the content of the experience itself ("what"). Second, the code should arise instantly thereby being able to support memory formation of one-shot experiences. For successful encoding and to avoid interference between memories during recall, variations in location, time, or in content of experience should result in unique ensemble activity. Finally, the code should capture several different resolutions of experience so that the necessary details relevant for future memory-based predictions will be stored. We review how neuronal codes in entorhinal cortex and hippocampus follow these requirements and argue that during formation of episodic memories entorhinal cortex provides hippocampus with instant information about ongoing experience. Such information originates from (a) spatially modulated neurons in medial entorhinal cortex, including grid cells, which provide a stable and universal positional metric of the environment; (b) a continuously varying signal in lateral entorhinal cortex providing a code for the temporal progression of events; and (c) entorhinal neurons coding the content of experiences exemplified by object-coding and odor-selective neurons. During formation of episodic memories, information from these systems are thought to be encoded as unique sequential ensemble activity in hippocampus, thereby encoding associations between the content of an event and its spatial and temporal contexts. Upon exposure to parts of the encoded stimuli, activity in these ensembles can be reinstated, leading to reactivation of the encoded activity pattern and memory recollection.