A Sequence of events model of episodic memory shows parallels in rats and humans

Neuroscientist's Behavioral Toolbox for Studying Episodic-Like Memory

Episodic memory, the ability to recall specific events and experiences, is a cornerstone of human cognition with profound clinical implications. While animal studies have provided valuable insights into the neuronal underpinnings of episodic memory, research has largely relied on a limited subset of tasks that model only some aspects of episodic memory. In this narrative review, we provide an overview of rodent episodic-like memory tasks that expand the methodological repertoire and diversify the approaches used in episodic-like memory research. These tasks assess various aspects of human episodic memory, such as integrated what-where-when or what-where memory, source memory, free recall, temporal binding, and threshold retrieval dynamics. We review each task's general principle and consider whether alternative non-episodic mechanisms can account for the observed behavior. While our list of tasks is not exhaustive, we hope it will guide researchers in selecting models that align with their specific research objectives, leading to novel advancements and a more comprehensive understanding of mechanisms underlying specific aspects of episodic memory.

Integrating and fragmenting memories under stress and alcohol

Stress can powerfully influence the way we form memories, particularly the extent to which they are integrated or situated within an underlying spatiotemporal and broader knowledge architecture. These different representations in turn have significant consequences for the way we use these memories to guide later behavior. Puzzlingly, although stress has historically been argued to promote fragmentation, leading to disjoint memory representations, more recent work suggests that stress can also facilitate memory binding and integration. Understanding the circumstances under which stress fosters integration will be key to resolving this discrepancy and unpacking the mechanisms by which stress can shape later behavior. Here, we examine memory integration at multiple levels: linking together the content of an individual experience, threading associations between related but distinct events, and binding an experience into a pre-existing schema or sense of causal structure. We discuss neural and cognitive mechanisms underlying each form of integration as well as findings regarding how stress, aversive learning, and negative affect can modulate each. In this analysis, we uncover that stress can indeed promote each level of integration. We also show how memory integration may apply to understanding effects of alcohol, highlighting extant clinical and preclinical findings and opportunities for further investigation. Finally, we consider the implications of integration and fragmentation for later memory-guided behavior, and the importance of understanding which type of memory representation is potentiated in order to design appropriate interventions.

Differential effects of bilateral hippocampal CA3 damage on the implicit learning and recognition of complex event sequences

Learning regularities in the environment is a fundament of human cognition, which is supported by a network of brain regions that include the hippocampus. In two experiments, we assessed the effects of selective bilateral damage to human hippocampal subregion CA3, which was associated with autobiographical episodic amnesia extending ~50 years prior to the damage, on the ability to recognize complex, deterministic event sequences presented either in a spatial or a non-spatial configuration. In contrast to findings from related paradigms, modalities, and homologue species, hippocampal damage did not preclude recognition memory for an event sequence studied and tested at four spatial locations, whereas recognition memory for an event sequence presented at a single location was at chance. In two additional experiments, recognition memory for novel single-items was intact, whereas the ability to recognize novel single-items in a different location from that presented at study was at chance. The results are at variance with a general role of the hippocampus in the learning and recognition of complex event sequences based on non-adjacent spatial and temporal dependencies. We discuss the impact of the results on established theoretical accounts of the hippocampal contributions to implicit sequence learning and episodic memory.

Sex differences in the context dependency of episodic memory

Context contributes to multiple aspects of human episodic memory including segmentation and retrieval. The present studies tested if, in adult male and female mice, context influences the encoding of odors encountered in a single unsupervised sampling session of the type used for the routine acquisition of episodic memories. The three paradigms used differed in complexity (single vs. multiple odor cues) and period from sampling to testing. Results show that males consistently encode odors in a context-dependent manner: the mice discriminated novel from previously sampled cues when tested in the chamber of initial cue sampling but not in a distinct yet familiar chamber. This was independent of the interval between cue encounters or the latency from initial sampling to testing. In contrast, female mice acquired both single cues and the elements of multi-cue episodes, but recall of that information was dependent upon the surrounding context only when the cues were presented serially. These results extend the list of episodic memory features expressed by rodents and also introduce a striking and unexpected sex difference in context effects.

Learning of object-in-context sequences in freely-moving macaques

Flexible learning is a hallmark of primate cognition, which arises through interactions with changing environments. Studies of the neural basis for this flexibility are typically limited by laboratory settings that use minimal environmental cues and restrict interactions with the environment, including active sensing and exploration. To address this, we constructed a 3-D enclosure containing touchscreens on its walls, for studying cognition in freely moving macaques. To test flexible learning, two monkeys completed trials consisting of a regular sequence of object selections across four touchscreens. On each screen, the monkeys had to select by touching the sole correct object item ('target') among a set of four items, irrespective of their positions on the screen. Each item was the target on exactly one screen of the sequence, making correct performance conditioned on the spatiotemporal sequence rule across screens. Both monkeys successfully learned multiple 4-item sets (N=14 and 22 sets), totaling over 50 and 80 unique, conditional item-context memoranda, with no indication of capacity limits. The enclosure allowed freedom of movements leading up to and following the touchscreen interactions. To determine whether movement economy changed with learning, we reconstructed 3D position and movement dynamics using markerless tracking software and gyroscopic inertial measurements. Whereas general body positions remained consistent across repeated sequences, fine head movements varied as monkeys learned, within and across sequence sets, demonstrating learning set or "learning to learn". These results demonstrate monkeys' rapid, capacious, and flexible learning within an integrated, multisensory 3-D space. Furthermore, this approach enables the measurement of continuous behavior while ensuring precise experimental control and behavioral repetition of sequences over time. Overall, this approach harmonizes the design features that are needed for electrophysiological studies with tasks that showcase fully situated, flexible cognition.

Nucleus reuniens transiently synchronizes memory networks at beta frequencies

Episodic memory-based decision-making requires top-down medial prefrontal cortex and hippocampal interactions. This integrated prefrontal-hippocampal memory state is thought to be organized by synchronized network oscillations and mediated by connectivity with the thalamic nucleus reuniens (RE). Whether and how the RE synchronizes prefrontal-hippocampal networks in memory, however, remains unknown. Here, we recorded local field potentials from the prefrontal-RE-hippocampal network while rats engaged in a nonspatial sequence memory task, thereby isolating memory-related activity from running-related oscillations. We found that synchronous prefrontal-hippocampal beta bursts (15-30 Hz) dominated during memory trials, whereas synchronous theta activity (6-12 Hz) dominated during non-memory-related running. Moreover, RE beta activity appeared first, followed by prefrontal and hippocampal synchronized beta, suggesting that prefrontal-hippocampal beta could be driven by the RE. To test whether the RE is capable of driving prefrontal-hippocampal beta synchrony, we used an optogenetic approach (retroAAV-ChR2). RE activation induced prefrontal-hippocampal beta coherence and reduced theta coherence, matching the observed memory-driven network state in the sequence task. These findings are the first to demonstrate that the RE contributes to memory by driving transient synchronized beta in the prefrontal-hippocampal system, thereby facilitating interactions that underlie memory-based decision-making.

A rigorous behavioral testing platform for the assessment of radiation-induced neurological outcomes

Behavioral testing is a popular and reliable method of neurocognitive assessment of rodents but the lack of standard operating procedures has led to a high variation of protocols in use. Therefore, there exists a strong need to standardize protocols for a combined behavioral platform in order to maintain consistency across institutions and assist newcomers in the field. This paper provides details on the methodology of several behavioral tasks which have been validated in identifying radiation induced cognitive impairment as well as provide guidance on timescales and best practices. The cognitive assessments outlined here are optimized for rodent studies and either target learning and memory (open field task, object in updated location, novel object recognition, object in place, and temporal order) or mood and cognition (social interaction, elevated plus maze, light dark box, forced swim test, and fear extinction). We have utilized this platform successfully in evaluating cognitive injury induced by various radiation types, doses, fractionation schedules and also with ultra-high dose rate FLASH radiotherapy. Recommended materials and software are provided as well as advice on methods of data analysis. In this way a comprehensive behavioral platform is described with broad applicability to assess cognitive endpoints critical to therapeutic outcome.

Brain Waves Analysis Via a Non-Parametric Bayesian Mixture of Autoregressive Kernels

The standard approach to analyzing brain electrical activity is to examine the spectral density function (SDF) and identify frequency bands, defined a priori, that have the most substantial relative contributions to the overall variance of the signal. However, a limitation of this approach is that the precise frequency and bandwidth of oscillations are not uniform across different cognitive demands. Thus, these bands should not be arbitrarily set in any analysis. To overcome this limitation, the Bayesian mixture auto-regressive decomposition (BMARD) method is proposed, as a data-driven approach that identifies (i) the number of prominent spectral peaks, (ii) the frequency peak locations, and (iii) their corresponding bandwidths (or spread of power around the peaks). Using the BMARD method, the standardized SDF is represented as a Dirichlet process mixture based on a kernel derived from second-order auto-regressive processes which completely characterize the location (peak) and scale (bandwidth) parameters. A Metropolis-Hastings within the Gibbs algorithm is developed for sampling the posterior distribution of the mixture parameters. Simulations demonstrate the robust performance of the proposed method. Finally, the BMARD method is applied to analyze local field potential (LFP) activity from the hippocampus of laboratory rats across different conditions in a non-spatial sequence memory experiment, to identify the most prominent frequency bands and examine the link between specific patterns of brain oscillatory activity and trial-specific cognitive demands.

Proximal CA1 20-40 Hz power dynamics reflect trial-specific information processing supporting nonspatial sequence memory

The hippocampus is known to play a critical role in processing information about temporal context. However, it remains unclear how hippocampal oscillations are involved, and how their functional organization is influenced by connectivity gradients. We examined local field potential activity in CA1 as rats performed a nonspatial odor sequence memory task. We found that odor sequence processing epochs were characterized by distinct spectral profiles and proximodistal CA1 gradients of theta and 20-40 Hz power than track running epochs. We also discovered that 20-40 Hz power was predictive of sequence memory performance, particularly in proximal CA1 and during the plateau of high power observed in trials in which animals had to maintain their decision until instructed to respond. Altogether, these results provide evidence that dynamics of 20-40 Hz power along the CA1 axis are linked to trial-specific processing of nonspatial information critical to order judgments and are consistent with a role for 20-40 Hz power in gating information processing.

Hippocampal ensembles represent sequential relationships among an extended sequence of nonspatial events

The hippocampus is critical to the temporal organization of our experiences. Although this fundamental capacity is conserved across modalities and species, its underlying neuronal mechanisms remain unclear. Here we recorded hippocampal activity as rats remembered an extended sequence of nonspatial events unfolding over several seconds, as in daily life episodes in humans. We then developed statistical machine learning methods to analyze the ensemble activity and discovered forms of sequential organization and coding important for order memory judgments. Specifically, we found that hippocampal ensembles provide significant temporal coding throughout nonspatial event sequences, differentiate distinct types of task-critical information sequentially within events, and exhibit theta-associated reactivation of the sequential relationships among events. We also demonstrate that nonspatial event representations are sequentially organized within individual theta cycles and precess across successive cycles. These findings suggest a fundamental function of the hippocampal network is to encode, preserve, and predict the sequential order of experiences.

It remains unclear how hippocampal activity supports the temporal organization of our experiences. In this paper, the authors recorded from rats performing an odor sequence task and show that hippocampal ensembles represent the sequential relations among nonspatial events at different timescales.

A new paradigm for investigating temporal order memory shows higher order associations are present in recent but not in remote retrieval

Memory of a sequence of distinct events requires encoding the temporal order as well as the intervals that separates these events. In this study, using order-place association task where the animal learns to associate the location of the food pellet to the order of entry into the event arena, we probe the nature of temporal order memory in mice. In our task, individual trials become distinct events, as the animal is trained to form a unique association between entry order and a correct location. The inter-trial intervals (> 30 min) are chosen deliberately to minimize the inputs from working memory. We develop this paradigm initially using four order-place associates and later extend it to five paired associates. Our results show that animals not only acquire these explicit (entry order to place) associations but also higher order associations that can only be inferred implicitly (temporal relation between the events) from the temporal order of these events. As an indicator of such higher order learning during the probe trial, the mice exhibit predominantly prospective errors that decline proportionally with temporal distance. On the other hand, prior to acquiring the sequence, the retrospective errors are dominant. In addition, we also tested the nature of such acquisitions when temporal order CS is presented along with flavored pellet as a compound stimulus comprising of order and flavor both simultaneously being paired with location. Results from these experiments indicate that the animal learns both order-place and flavor-place associations. Comparing with pure order-place training, we find that the additional flavor stimulus in a compound training paradigm did not interfere with the ability of the animals to acquire the order-place associations. When tested remotely, pure order-place associations could be retrieved only after a reminder training. Further higher order associations representing the temporal relationship between the events is markedly absent in the remote time.

Persistent sexually dimorphic effects of adolescent THC exposure on hippocampal synaptic plasticity and episodic memory in rodents

There is evidence that cannabis use during adolescence leads to memory and cognitive problems in young adulthood but little is known about effects of early life cannabis exposure on synaptic operations that are critical for encoding and organizing information. We report here that a 14-day course of daily Δ⁹-tetrahydrocannabinol treatments administered to adolescent rats and mice (aTHC) leads to profound but selective deficits in synaptic plasticity in two axonal systems in female, and to lesser extent male, hippocampus as assessed in adulthood. Adolescent-THC exposure did not alter basic synaptic transmission (input/output curves) and had only modest effects on frequency facilitation. Nevertheless, aTHC severely impaired the endocannabinoid-dependent long-term potentiation in the lateral perforant path in females of both species, and in male mice; this was reliably associated with impaired acquisition of a component of episodic memory that depends on lateral perforant path function. Potentiation in the Schaffer-commissural (S-C) projection to field CA1 was disrupted by aTHC treatment in females only and this was associated with both a deficit in estrogen effects on S-C synaptic responses and impairments to CA1-dependent spatial (object location) memory. In all the results demonstrate sexually dimorphic and projection system-specific effects of aTHC exposure that could underlie discrete effects of early life cannabinoid usage on adult cognitive function. Moreover they suggest that some of the enduring, sexually dimorphic effects of cannabis use reflect changes in synaptic estrogen action.

Medial prefrontal cortex and hippocampal activity differentially contribute to ordinal and temporal context retrieval during sequence memory

Remembering sequences of events defines episodic memory, but retrieval can be driven by both ordinality and temporal contexts. Whether these modes of retrieval operate at the same time or not remains unclear. Theoretically, medial prefrontal cortex (mPFC) confers ordinality, while the hippocampus (HC) associates events in gradually changing temporal contexts. Here, we looked for evidence of each with BOLD fMRI in a sequence task that taxes both retrieval modes. To test ordinal modes, items were transferred between sequences but retained their position (e.g., AB3). Ordinal modes activated mPFC, but not HC. To test temporal contexts, we examined items that skipped ahead across lag distances (e.g., ABD). HC, but not mPFC, tracked temporal contexts. There was a mPFC and HC by retrieval mode interaction. These current results suggest that the mPFC and HC are concurrently engaged in different retrieval modes in support of remembering when an event occurred.

Flexible Bayesian Dynamic Modeling of Correlation and Covariance Matrices

Modeling correlation (and covariance) matrices can be challenging due to the positive-definiteness constraint and potential high-dimensionality. Our approach is to decompose the covariance matrix into the correlation and variance matrices and propose a novel Bayesian framework based on modeling the correlations as products of unit vectors. By specifying a wide range of distributions on a sphere (e.g. the squared-Dirichlet distribution), the proposed approach induces flexible prior distributions for covariance matrices (that go beyond the commonly used inverse-Wishart prior). For modeling real-life spatio-temporal processes with complex dependence structures, we extend our method to dynamic cases and introduce unit-vector Gaussian process priors in order to capture the evolution of correlation among components of a multivariate time series. To handle the intractability of the resulting posterior, we introduce the adaptive Δ-Spherical Hamiltonian Monte Carlo. We demonstrate the validity and flexibility of our proposed framework in a simulation study of periodic processes and an analysis of rat's local field potential activity in a complex sequence memory task.

A Hierarchical Bayesian Model for Differential Connectivity in Multi-trial Brain Signals

There is a strong interest in the neuroscience community to measure brain connectivity and develop methods that can differentiate connectivity across patient groups and across different experimental stimuli. The development of such statistical tools is critical to understand the dynamics of functional relationships among brain structures supporting memory encoding and retrieval. However, the challenge comes from the need to incorporate within-condition similarity with between-conditions heterogeneity in modeling connectivity, as well as how to provide a natural way to conduct trial- and condition-level inference on effective connectivity. A Bayesian hierarchical vector autoregressive (BH-VAR) model is proposed to characterize brain connectivity and infer differences in connectivity across conditions. Within-condition connectivity similarity and between-conditions connectivity heterogeneity are accounted for by the priors on trial-specific models. In addition to the fully Bayesian framework, an alternative two-stage computation approach is also proposed which still allows straightforward uncertainty quantification of between-trial conditions via MCMC posterior sampling, but provides a fast approximate procedure for the estimation of trial-specific VAR parameters. A novel aspect of the approach is the use of a frequency-specific measure, partial directed coherence (PDC), to characterize effective connectivity under the Bayesian framework. More specifically, PDC allows inferring directionality and explaining the extent to which the present oscillatory activity at a certain frequency in a sender channel influences the future oscillatory activity in a specific receiver channel relative to all possible receivers in the brain network. The proposed model is applied to a large electrophysiological dataset collected as rats performed a complex sequence memory task. This unique dataset includes local field potentials (LFPs) activity recorded from an array of electrodes across hippocampal region CA1 while animals were presented with multiple trials from two main conditions. The proposed modeling approach provided novel insights into hippocampal connectivity during memory performance. Specifically, it separated CA1 into two functional units, a lateral and a medial segment, each showing stronger functional connectivity to itself than to the other. This approach also revealed that information primarily flowed in a lateral-to-medial direction across trials (within-condition), and suggested this effect was stronger on one trial condition than the other (between-conditions effect). Collectively, these results indicate that the proposed model is a promising approach to quantify the variation of functional connectivity, both within- and between-conditions, and thus should have broad applications in neuroscience research.

The hippocampus, prefrontal cortex, and perirhinal cortex are critical to incidental order memory

Considerable research in rodents and humans indicates the hippocampus and prefrontal cortex are essential for remembering temporal relationships among stimuli, and accumulating evidence suggests the perirhinal cortex may also be involved. However, experimental parameters differ substantially across studies, which limits our ability to fully understand the fundamental contributions of these structures. In fact, previous studies vary in the type of temporal memory they emphasize (e.g., order, sequence, or separation in time), the stimuli and responses they use (e.g., trial-unique or repeated sequences, and incidental or rewarded behavior), and the degree to which they control for potential confounding factors (e.g., primary and recency effects, or order memory deficits secondary to item memory impairments). To help integrate these findings, we developed a new paradigm testing incidental memory for trial-unique series of events, and concurrently assessed order and item memory in animals with damage to the hippocampus, prefrontal cortex, or perirhinal cortex. We found that this new approach led to robust order and item memory, and that hippocampal, prefrontal and perirhinal damage selectively impaired order memory. These findings suggest the hippocampus, prefrontal cortex and perirhinal cortex are part of a broad network of structures essential for incidentally learning the order of events in episodic memory.

Prefrontal Pathways Provide Top-Down Control of Memory for Sequences of Events

We remember our lives as sequences of events, but it is unclear how these memories are controlled during retrieval. In rats, the medial prefrontal cortex (mPFC) is positioned to influence sequence memory through extensive top-down inputs to regions heavily interconnected with the hippocampus, notably the nucleus reuniens of the thalamus (RE) and perirhinal cortex (PER). Here, we used an hM4Di synaptic-silencing approach to test our hypothesis that specific mPFC→RE and mPFC→PER projections regulate sequence memory retrieval. First, we found non-overlapping populations of mPFC cells project to RE and PER. Second, suppressing mPFC activity impaired sequence memory. Third, inhibiting mPFC→RE and mPFC→PER pathways effectively abolished sequence memory. Finally, a sequential lag analysis showed that the mPFC→RE pathway contributes to a working memory retrieval strategy, whereas the mPFC→PER pathway supports a temporal context memory retrieval strategy. These findings demonstrate that mPFC→RE and mPFC→PER pathways serve as top-down mechanisms that control distinct sequence memory retrieval strategies.

The nucleus reuniens of the thalamus sits at the nexus of a hippocampus and medial prefrontal cortex circuit enabling memory and behavior

The nucleus reuniens of the thalamus (RE) is a key component of an extensive network of hippocampal and cortical structures and is a fundamental substrate for cognition. A common misconception is that RE is a simple relay structure. Instead, a better conceptualization is that RE is a critical component of a canonical higher-order cortico-thalamo-cortical circuit that supports communication between the medial prefrontal cortex (mPFC) and the hippocampus (HC). RE dysfunction is implicated in several clinical disorders including, but not limited to Alzheimer's disease, schizophrenia, and epilepsy. Here, we review key anatomical and physiological features of the RE based primarily on studies in rodents. We present a conceptual model of RE circuitry within the mPFC-RE-HC system and speculate on the computations RE enables. We review the rapidly growing literature demonstrating that RE is critical to, and its neurons represent, aspects of behavioral tasks that place demands on memory focusing on its role in navigation, spatial working memory, the temporal organization of memory, and executive functions.

Hierarchical cognitive control and the frontal lobes

Cognitive control refers to our ability to choose courses of thought and action that achieve our goals over habitual but contextually inappropriate ones. Hierarchical control problems are those in which multiple goals or contextual contingency must be managed at once and related to one another. In the open-ended complexity of the real world, hierarchical control arguably characterizes most of the problems faced by our control systems. And, it is these cases of hierarchical control where patients with damage to executive systems are most apt to fail, even those that perform well on simplified laboratory tasks. In this chapter, we consider the functional organization of frontal brain systems that support hierarchical cognitive control. We focus on two particular cases of hierarchical control. First, we discuss a line of work testing how managing multiple contingencies en route to a response relates to processing along the rostrocaudal axis of frontal cortex. Second, we consider cases of sequential tasks that require monitoring and behaving according to a series of tasks performed in time. In this latter case, we focus on the particular role of rostrolateral prefrontal cortex. We conclude with considerations of future directions of basic and clinically relevant research in this domain.

Sequential Control Underlies Robust Ramping Dynamics in the Rostrolateral Prefrontal Cortex

An essential human skill is our capacity to monitor and execute a sequence of tasks in the service of an overarching goal. Such a sequence can be as mundane as making a cup of coffee or as complex as flying a fighter plane. Previously, we showed that, during sequential control, the rostrolateral prefrontal cortex (RLPFC) exhibits activation that ramps steadily through the sequence and is necessary for sequential task execution using fMRI in humans (Desrochers et al., 2015). It remains unknown what computations may underlie this ramping dynamic. Across two independent fMRI experiments, we manipulated three features that were unique to the sequential control task to determine whether and how they modulated ramping activity in the RLPFC: (1) sequence position uncertainty, (2) sequential monitoring without external position cues (i.e., from memory), and (3) sequential monitoring without multilevel decision making (i.e., task execution). We replicated the ramping activation in RLPFC and found it to be remarkably robust regardless of the level of task abstraction or engagement of memory functions. Therefore, these results both replicate and extend previous findings regarding the function of the RLPFC. They suggest that sequential control processes are integral to the dynamics of RLPFC activity. Advancing knowledge of the neural bases of sequential control is crucial for our understanding of the sequential processes that are necessary for daily living.SIGNIFICANCE STATEMENT We perform sequences of tasks every day, but little is known about how they are controlled in the brain. Previously we found that ramping activity in the rostrolateral prefrontal cortex (RLPFC) was necessary to perform a sequence of tasks. We designed two independent fMRI experiments in human participants to determine which features of the previous sequential task potentially engaged ramping in the RLPFC. We found that any demand to monitor a sequence of state transitions consistently elicited ramping in the RLPFC, regardless of the level of the decisions made at each step in the sequence or engagement of memory functions. These results provide a framework for understanding RLPFC function during sequential control, and consequently, daily life.

Theta oscillations promote temporal sequence learning

Many theoretical models suggest that neural oscillations play a role in learning or retrieval of temporal sequences, but the extent to which oscillations support sequence representation remains unclear. To address this question, we used scalp electroencephalography (EEG) to examine oscillatory activity over learning of different object sequences. Participants made semantic decisions on each object as they were presented in a continuous stream. For three "Consistent" sequences, the order of the objects was always fixed. Activity during Consistent sequences was compared to "Random" sequences that consisted of the same objects presented in a different order on each repetition. Over the course of learning, participants made faster semantic decisions to objects in Consistent, as compared to objects in Random sequences. Thus, participants were able to use sequence knowledge to predict upcoming items in Consistent sequences. EEG analyses revealed decreased oscillatory power in the theta (4-7 Hz) band at frontal sites following decisions about objects in Consistent sequences, as compared with objects in Random sequences. The theta power difference between Consistent and Random only emerged in the second half of the task, as participants were more effectively able to predict items in Consistent sequences. Moreover, we found increases in parieto-occipital alpha (10-13 Hz) and beta (14-28 Hz) power during the pre-response period for objects in Consistent sequences, relative to objects in Random sequences. Linear mixed effects modeling revealed that single trial theta oscillations were related to reaction time for future objects in a sequence, whereas beta and alpha oscillations were only predictive of reaction time on the current trial. These results indicate that theta and alpha/beta activity preferentially relate to future and current events, respectively. More generally our findings highlight the importance of band-specific neural oscillations in the learning of temporal order information.

What's in a context? Cautions, limitations, and potential paths forward

The purpose of memory is to guide current and future behavior based on previous experiences. Part of this process involves either discriminating between or generalizing across similar experiences that contain overlapping conditions (such as space, time, or internal state), which we often conceptualize as "contexts". In this review, we highlight major challenges facing the field as we attempt a neuroscience-based approach to the study of context and its impact on learning and memory. Here, we review some of the methodologies and approaches used to investigate context in both animals and humans, including the neurobiological mechanisms involved. Finally, we propose three tenets for operationalizing context in the experimental setting: 1) contexts must be stable over time along an experiential dimension; 2) contexts must be at least moderately complex in nature and their representations must be modifiable or adaptable, and 3) contexts must have some behavioral relevance (be it overt or incidental) so that its role can be measured.

Fundamental computational constraints on the time course of perception and action

A cognitive system faced with contingent events that cause rapid changes in sensory data may (i) incrementally incorporate new data into the ongoing perceptual and motor processing; or (ii) restart processing on each new event; or (iii) sample the data and hold onto the sample until its processing is complete, while disregarding any contingent changes. We offer a set of computational first-principles arguments for a hypothesis, according to which any system that contends with certain classes of perception and behavioral control tasks must include the sample-and-hold option (possibly alongside the other two, which may be useful in other tasks). This hypothesis has implications for understanding the dynamics of perception and action. In particular, a sample-and-hold channel necessarily processes sensory data on some kind of cycle (which does not imply precise periodicity). Further, being prepared to face the world at all times requires that the sampling that initiates each cycle be triggered by every significant action on part of the agent itself, such as saccades. We survey a range of evidence for the sample-and-hold functionality, touching upon diverse phenomena such as attentional blink and backward masking, the yoking of olfaction to respiration, thalamocortical interactions, and metastable brain dynamics in perception and consciousness.

Dendrites, deep learning, and sequences in the hippocampus

The hippocampus places us both in time and space. It does so over remarkably large spans: milliseconds to years, and centimeters to kilometers. This works for sensory representations, for memory, and for behavioral context. How does it fit in such wide ranges of time and space scales, and keep order among the many dimensions of stimulus context? A key organizing principle for a wide sweep of scales and stimulus dimensions is that of order in time, or sequences. Sequences of neuronal activity are ubiquitous in sensory processing, in motor control, in planning actions, and in memory. Against this strong evidence for the phenomenon, there are currently more models than definite experiments about how the brain generates ordered activity. The flip side of sequence generation is discrimination. Discrimination of sequences has been extensively studied at the behavioral, systems, and modeling level, but again physiological mechanisms are fewer. It is against this backdrop that I discuss two recent developments in neural sequence computation, that at face value share little beyond the label "neural." These are dendritic sequence discrimination, and deep learning. One derives from channel physiology and molecular signaling, the other from applied neural network theory - apparently extreme ends of the spectrum of neural circuit detail. I suggest that each of these topics has deep lessons about the possible mechanisms, scales, and capabilities of hippocampal sequence computation.

Nonspatial sequence coding varies along the CA1 transverse axis

The hippocampus plays a critical role in the memory for sequences of events, a defining feature of episodic memory. To shed light on the fundamental mechanisms supporting this capacity, we recently recorded neural activity in CA1 as rats performed a nonspatial odor sequence memory task. Our main finding was that, while the animals' location and behavior remained constant, a proportion of CA1 neurons fired differentially to odors depending on whether they were presented in or out of sequence (sequence cells). Here, we further examined if such sequence coding varied along the distal-to-proximal axis of the dorsal CA1 region (distal: toward subiculum; proximal: toward CA3). Differences in information processing along this axis have been suggested by recent anatomical and electrophysiological evidence that odor information may be more strongly represented in the distal segment, whereas spatial information may be more strongly represented in the proximal segment. Recorded neurons were grouped into four arbitrary sections of dorsal CA1, ranging from distal to proximal. We found that, although sequence cell coding was observed across the distal-to-proximal extent of CA1 from which we recorded, it was significantly higher in intermediate CA1, a region with more balanced anatomical input from lateral and medial entorhinal regions. More specifically, in that particular segment of CA1, we observed a significant increase in the magnitude of sequence coding of all cells, as well as in the sequential information content of sequence cells. Importantly, a different pattern was observed when examining the distribution of spatial coding from the same electrodes. Consistent with previous reports, our results suggest that spatial information was more strongly represented in the proximal section of CA1 (higher proportion of cells with place fields). These findings indicate that nonspatial sequence memory coding is not uniformly distributed along the transverse axis of CA1, and that this distribution does not simply follow the expected gradient based on the stimulus modality or the degree of spatial selectivity. Instead, the observed distribution suggests this form of sequence coding may be associated with convergent input from lateral and medial entorhinal regions, which is present throughout the proximodistal axis but greater in intermediate CA1.

Time (and space) in the hippocampus

There is considerable recent evidence that, in addition to its representation of space, the hippocampus also represents the temporal organization of memories. Time plays a central role in episodic memory, and studies have identified the hippocampus as playing an essential role in the temporal organization of memories in humans and animals. Temporal organization is supported by a gradually changing temporal context signal in the hippocampus, and this changing context signal involves "time cells" in the hippocampus that code sequential moments in temporally organized experiences. Finally, hippocampal temporal context representations mechanisms in intrinsic circuitry and oscillatory patterns throughout hippocampal subfields and likely depend on inputs from parahippocampal cortical areas and a widespread temporal processing system in the neocortex.

Cosmic radiation exposure and persistent cognitive dysfunction

The Mars mission will result in an inevitable exposure to cosmic radiation that has been shown to cause cognitive impairments in rodent models, and possibly in astronauts engaged in deep space travel. Of particular concern is the potential for cosmic radiation exposure to compromise critical decision making during normal operations or under emergency conditions in deep space. Rodents exposed to cosmic radiation exhibit persistent hippocampal and cortical based performance decrements using six independent behavioral tasks administered between separate cohorts 12 and 24 weeks after irradiation. Radiation-induced impairments in spatial, episodic and recognition memory were temporally coincident with deficits in executive function and reduced rates of fear extinction and elevated anxiety. Irradiation caused significant reductions in dendritic complexity, spine density and altered spine morphology along medial prefrontal cortical neurons known to mediate neurotransmission interrogated by our behavioral tasks. Cosmic radiation also disrupted synaptic integrity and increased neuroinflammation that persisted more than 6 months after exposure. Behavioral deficits for individual animals correlated significantly with reduced spine density and increased synaptic puncta, providing quantitative measures of risk for developing cognitive impairment. Our data provide additional evidence that deep space travel poses a real and unique threat to the integrity of neural circuits in the brain.

Nonspatial Sequence Coding in CA1 Neurons

The hippocampus is critical to the memory for sequences of events, a defining feature of episodic memory. However, the fundamental neuronal mechanisms underlying this capacity remain elusive. While considerable research indicates hippocampal neurons can represent sequences of locations, direct evidence of coding for the memory of sequential relationships among nonspatial events remains lacking. To address this important issue, we recorded neural activity in CA1 as rats performed a hippocampus-dependent sequence-memory task. Briefly, the task involves the presentation of repeated sequences of odors at a single port and requires rats to identify each item as "in sequence" or "out of sequence". We report that, while the animals' location and behavior remained constant, hippocampal activity differed depending on the temporal context of items-in this case, whether they were presented in or out of sequence. Some neurons showed this effect across items or sequence positions (general sequence cells), while others exhibited selectivity for specific conjunctions of item and sequence position information (conjunctive sequence cells) or for specific probe types (probe-specific sequence cells). We also found that the temporal context of individual trials could be accurately decoded from the activity of neuronal ensembles, that sequence coding at the single-cell and ensemble level was linked to sequence memory performance, and that slow-gamma oscillations (20-40 Hz) were more strongly modulated by temporal context and performance than theta oscillations (4-12 Hz). These findings provide compelling evidence that sequence coding extends beyond the domain of spatial trajectories and is thus a fundamental function of the hippocampus.

SIGNIFICANCE STATEMENT

The ability to remember the order of life events depends on the hippocampus, but the underlying neural mechanisms remain poorly understood. Here we addressed this issue by recording neural activity in hippocampal region CA1 while rats performed a nonspatial sequence memory task. We found that hippocampal neurons code for the temporal context of items (whether odors were presented in the correct or incorrect sequential position) and that this activity is linked with memory performance. The discovery of this novel form of temporal coding in hippocampal neurons advances our fundamental understanding of the neurobiology of episodic memory and will serve as a foundation for our cross-species, multitechnique approach aimed at elucidating the neural mechanisms underlying memory impairments in aging and dementia.

The hippocampus: a special place for time

Many findings have demonstrated that memories of past events are temporally organized. It is well known that the hippocampus is critical for such episodic memories, but, until recently, little was known about the temporal organization of mnemonic representations in the hippocampus. Recent developments in human and animal research have revealed important insights into the role of the hippocampus in learning and retrieving sequences of events. Here, we review these findings, including lesion and single-unit recording studies in rodents, functional magnetic resonance imaging studies in humans, and computational models that link findings from these studies to the anatomy of the hippocampal circuit. The findings converge toward the idea that the hippocampus is essential for learning sequences of events, allowing the brain to distinguish between memories for conceptually similar but temporally distinct episodes, and to associate representations of temporally contiguous, but otherwise unrelated experiences.

The Monitoring and Control of Task Sequences in Human and Non-Human Primates

Our ability to plan and execute a series of tasks leading to a desired goal requires remarkable coordination between sensory, motor, and decision-related systems. Prefrontal cortex (PFC) is thought to play a central role in this coordination, especially when actions must be assembled extemporaneously and cannot be programmed as a rote series of movements. A central component of this flexible behavior is the moment-by-moment allocation of working memory and attention. The ubiquity of sequence planning in our everyday lives belies the neural complexity that supports this capacity, and little is known about how frontal cortical regions orchestrate the monitoring and control of sequential behaviors. For example, it remains unclear if and how sensory cortical areas, which provide essential driving inputs for behavior, are modulated by the frontal cortex during these tasks. Here, we review what is known about moment-to-moment monitoring as it relates to visually guided, rule-driven behaviors that change over time. We highlight recent human work that shows how the rostrolateral prefrontal cortex (RLPFC) participates in monitoring during task sequences. Neurophysiological data from monkeys suggests that monitoring may be accomplished by neurons that respond to items within the sequence and may in turn influence the tuning properties of neurons in posterior sensory areas. Understanding the interplay between proceduralized or habitual acts and supervised control of sequences is key to our understanding of sequential task execution. A crucial bridge will be the use of experimental protocols that allow for the examination of the functional homology between monkeys and humans. We illustrate how task sequences may be parceled into components and examined experimentally, thereby opening future avenues of investigation into the neural basis of sequential monitoring and control.

The problem of multimodal concurrent serial order in behavior

The "problem of serial order in behavior," as formulated and discussed by Lashley (1951), is arguably more pervasive and more profound both than originally stated and than currently appreciated. We spell out two complementary aspects of what we term the generalized problem of behavior: (i) multimodality, stemming from the disparate nature of the sensorimotor variables and processes that underlie behavior, and (ii) concurrency, which reflects the parallel unfolding in time of these processes and of their asynchronous interactions. We illustrate these on a number of examples, with a special focus on language, briefly survey the computational approaches to multimodal concurrency, offer some hypotheses regarding the manner in which brains address it, and discuss some of the broader implications of these as yet unresolved issues for cognitive science.

A temporal context repetition effect in rats during a novel object recognition memory task

Recent research in humans has used formal models of temporal context, broadly defined as a lingering representation of recent experience, to explain a wide array of recall and recognition memory phenomena. One difficulty in extending this work to studies of experimental animals has been the challenge of developing a task to test temporal context effects on performance in rodents. The current study presents results from a novel object recognition memory paradigm that was adapted from a task used in humans and demonstrates a temporal context repetition effect in rats. Specifically, the findings indicate that repeating the first two objects from a once-encountered sequence of three objects incidentally cues memory for the third object, even in its absence. These results reveal that temporal context influences item memory in rats similar to the manner in which it influences memory in humans and also highlight a new task for future studies of temporal context in experimental animals.

Memory for sequences of events impaired in typical aging

Typical aging is associated with diminished episodic memory performance. To improve our understanding of the fundamental mechanisms underlying this age-related memory deficit, we previously developed an integrated, cross-species approach to link converging evidence from human and animal research. This novel approach focuses on the ability to remember sequences of events, an important feature of episodic memory. Unlike existing paradigms, this task is nonspatial, nonverbal, and can be used to isolate different cognitive processes that may be differentially affected in aging. Here, we used this task to make a comprehensive comparison of sequence memory performance between younger (18-22 yr) and older adults (62-86 yr). Specifically, participants viewed repeated sequences of six colored, fractal images and indicated whether each item was presented "in sequence" or "out of sequence." Several out of sequence probe trials were used to provide a detailed assessment of sequence memory, including: (i) repeating an item from earlier in the sequence ("Repeats"; e.g., AB A: DEF), (ii) skipping ahead in the sequence ("Skips"; e.g., AB D: DEF), and (iii) inserting an item from a different sequence into the same ordinal position ("Ordinal Transfers"; e.g., AB 3: DEF). We found that older adults performed as well as younger controls when tested on well-known and predictable sequences, but were severely impaired when tested using novel sequences. Importantly, overall sequence memory performance in older adults steadily declined with age, a decline not detected with other measures (RAVLT or BPS-O). We further characterized this deficit by showing that performance of older adults was severely impaired on specific probe trials that required detailed knowledge of the sequence (Skips and Ordinal Transfers), and was associated with a shift in their underlying mnemonic representation of the sequences. Collectively, these findings provide unambiguous evidence that the capacity to remember sequences of events is fundamentally affected by typical aging.