Human Hippocampal Neurons Track Moments in a Sequence of Events

Identification of Early Hippocampal Dynamics during Recognition Memory with Independent Component Analysis

The hippocampus is generally considered to have relatively late involvement in recognition memory, its main electrophysiological signature being between 400 and 800 ms after stimulus onset. However, most electrophysiological studies have analyzed the hippocampus as a single responsive area, selecting only a single-site signal exhibiting the strongest effect in terms of amplitude. These classical approaches may not capture all the dynamics of this structure, hindering the contribution of other hippocampal sources that are not located in the vicinity of the selected site. We combined intracerebral electroencephalogram recordings from epileptic patients with independent component analysis during a recognition memory task involving the recognition of old and new images. We identified two sources with different responses emerging from the hippocampus: a fast one (maximal amplitude at ∼250 ms) that could not be directly identified from raw recordings and a latter one, peaking at ∼400 ms. The former component presented different amplitudes between old and new items in 6 out of 10 patients. The latter component had different delays for each condition, with a faster activation (∼290 ms after stimulus onset) for recognized items. We hypothesize that both sources represent two steps of hippocampal recognition memory, the faster reflecting the input from other structures and the latter the hippocampal internal processing. Recognized images evoking early activations would facilitate neural computation in the hippocampus, accelerating memory retrieval of complementary information. Overall, our results suggest that the hippocampal activity is composed of several sources with an early activation related to recognition memory.

Theory of mind in mild cognitive impairment and Parkinson's disease: The role of memory impairment

BACKGROUND

Social cognition is impaired in Parkinson's disease (PD). Whether social cognitive impairment (iSC) is a by-product of the underlying cognitive deficits in PD or a process independent of cognitive status is unknown. To this end, the present study was designed to investigate the weight of specific cognitive deficits in social cognition, considering different mild cognitive impairment subtypes of PD (PD-MCI).

METHODS

Fifty-eight PD patients underwent a neuropsychological battery assessing executive functions, memory, language, and visuospatial domains, together with social cognitive tests focused on theory of mind (ToM). Patients were divided into subgroups according to their clinical cognitive status: amnestic PD-MCI (PD-aMCI, n = 18), non-amnestic PD-MCI (PD-naMCI, n = 16), and cognitively unimpaired (PD-CU, n = 24). Composite scores for cognitive and social domains were computed to perform mediation analyses.

RESULTS

Memory and language impairments mediated the effect of executive functioning in social cognitive deficits in PD patients. Dividing by MCI subgroups, iSC occurred more frequently in PD-aMCI (77.8%) than in PD-naMCI (18.8%) and PD-CU (8.3%). Moreover, PD-aMCI performed worse than PD-CU in all social cognitive measures, whereas PD-naMCI performed worse than PD-CU in only one subtype of the affective and cognitive ToM tests.

CONCLUSIONS

Our findings suggest that ToM impairment in PD can be explained by memory dysfunction that mediates executive control. ToM downsides in the amnesic forms of PD-MCI may suggest that subtle changes in social cognition could partly explain future transitions into dementia. Hence, the evaluation of social cognition in PD is critical to characterize a possible behavioral marker of cognitive decline.

Distinct neural adaptations to time demand in the striatum and the hippocampus

How do neural codes adjust to track time across a range of resolutions, from milliseconds to multi-seconds, as a function of the temporal frequency at which events occur? To address this question, we studied time-modulated cells in the striatum and the hippocampus, while macaques categorized three nested intervals within the sub-second or the supra-second range (up to 1, 2, 4, or 8 s), thereby modifying the temporal resolution needed to solve the task. Time-modulated cells carried more information for intervals with explicit timing demand, than for any other interval. The striatum, particularly the caudate, supported the most accurate temporal prediction throughout all time ranges. Strikingly, its temporal readout adjusted non-linearly to the time range, suggesting that the striatal resolution shifted from a precise millisecond to a coarse multi-second range as a function of demand. This is in line with monkey's behavioral latencies, which indicated that they tracked time until 2 s but employed a coarse categorization strategy for durations beyond. By contrast, the hippocampus discriminated only the beginning from the end of intervals, regardless of the range. We propose that the hippocampus may provide an overall poor signal marking an event's beginning, whereas the striatum optimizes neural resources to process time throughout an interval adapting to the ongoing timing necessity.

Neural Sequences and the Encoding of Time

Converging experimental and computational evidence indicate that on the scale of seconds the brain encodes time through changing patterns of neural activity. Experimentally, two general forms of neural dynamic regimes that can encode time have been observed: neural population clocks and ramping activity. Neural population clocks provide a high-dimensional code to generate complex spatiotemporal output patterns, in which each neuron exhibits a nonlinear temporal profile. A prototypical example of neural population clocks are neural sequences, which have been observed across species, brain areas, and behavioral paradigms. Additionally, neural sequences emerge in artificial neural networks trained to solve time-dependent tasks. Here, we examine the role of neural sequences in the encoding of time, and how they may emerge in a biologically plausible manner. We conclude that neural sequences may represent a canonical computational regime to perform temporal computations.

Minute-scale periodicity of neuronal firing in the human entorhinal cortex

Grid cells in the entorhinal cortex demonstrate spatially periodic firing, thought to provide a spatial map on behaviorally relevant length scales. Whether such periodicity exists for behaviorally relevant time scales in the human brain remains unclear. We investigate neuronal firing during a temporally continuous experience by presenting 14 neurosurgical patients with a video while recording neuronal activity from multiple brain regions. We report on neurons that modulate their activity in a periodic manner across different time scales-from seconds to many minutes, most prevalently in the entorhinal cortex. These neurons remap their dominant periodicity to shorter time scales during a subsequent recognition memory task. When the video is presented at two different speeds, a significant percentage of these temporally periodic cells (TPCs) maintain their time scales, suggesting a degree of invariance. The TPCs' temporal periodicity might complement the spatial periodicity of grid cells and together provide scalable spatiotemporal metrics for human experience.

A neural code for time and space in the human brain

Time and space are primary dimensions of human experience. Separate lines of investigation have identified neural correlates of time and space, yet little is known about how these representations converge during self-guided experience. Here, 10 subjects with intracranially implanted microelectrodes play a timed, virtual navigation game featuring object search and retrieval tasks separated by fixed delays. Time cells and place cells activate in parallel during timed navigation intervals, whereas a separate time cell sequence spans inter-task delays. The prevalence, firing rates, and behavioral coding strengths of time cells and place cells are indistinguishable-yet time cells selectively remap between search and retrieval tasks, while place cell responses remain stable. Thus, the brain can represent time and space as overlapping but dissociable dimensions. Time cells and place cells may constitute a biological basis for the cognitive map of spatiotemporal context onto which memories are written.

Hippocampal neurons code individual episodic memories in humans

The hippocampus is an essential hub for episodic memory processing. However, how human hippocampal single neurons code multi-element associations remains unknown. In particular, it is debated whether each hippocampal neuron represents an invariant element within an episode or whether single neurons bind together all the elements of a discrete episodic memory. Here we provide evidence for the latter hypothesis. Using single-neuron recordings from a total of 30 participants, we show that individual neurons, which we term episode-specific neurons, code discrete episodic memories using either a rate code or a temporal firing code. These neurons were observed exclusively in the hippocampus. Importantly, these episode-specific neurons do not reflect the coding of a particular element in the episode (that is, concept or time). Instead, they code for the conjunction of the different elements that make up the episode.

Re-expression of CA1 and entorhinal activity patterns preserves temporal context memory at long timescales

Converging, cross-species evidence indicates that memory for time is supported by hippocampal area CA1 and entorhinal cortex. However, limited evidence characterizes how these regions preserve temporal memories over long timescales (e.g., months). At long timescales, memoranda may be encountered in multiple temporal contexts, potentially creating interference. Here, using 7T fMRI, we measured CA1 and entorhinal activity patterns as human participants viewed thousands of natural scene images distributed, and repeated, across many months. We show that memory for an image's original temporal context was predicted by the degree to which CA1/entorhinal activity patterns from the first encounter with an image were re-expressed during re-encounters occurring minutes to months later. Critically, temporal memory signals were dissociable from predictors of recognition confidence, which were carried by distinct medial temporal lobe expressions. These findings suggest that CA1 and entorhinal cortex preserve temporal memories across long timescales by coding for and reinstating temporal context information.

Neural temporal context reinstatement of event structure during memory recall

The transformation of experiences into meaningful events and memories is intertwined with the notion of time. Temporal perception can influence, and be influenced by, segmenting continuous experience into meaningful events. Episodic memories formed from these events become associated with temporal information as well. However, it is less clear how temporal perception contributes to structuring events and organizing memory: whether it plays a more active or passive role, and whether this temporal information is encoded initially during perception or influenced by retrieval processes. To address these questions, we examined how event segmentation influences temporal representations during initial perception and memory retrieval, without testing temporal information explicitly. Using a neural measure of temporal context extracted from scalp electroencephalography in human participants (N = 170), we found reduced temporal context similarity between studied items separated by an event boundary when compared to items from the same event. Furthermore, while participants freely recalled list items, neural activity reflected reinstatement of temporal context representations from the study phase, including temporal disruption. A computational model of episodic memory, the context maintenance and retrieval (CMR) model, predicted these results, and made novel predictions regarding the influence of temporal disruption on recall order. These findings implicate the impact of event structure on memory organization via temporal representations, underscoring the role of temporal information in event segmentation and episodic memory. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Optogenetic manipulation of inhibitory interneurons can be used to validate a model of spatiotemporal sequence learning

The brain uses temporal information to link discrete events into memory structures supporting recognition, prediction, and a wide variety of complex behaviors. It is still an open question how experience-dependent synaptic plasticity creates memories including temporal and ordinal information. Various models have been proposed to explain how this could work, but these are often difficult to validate in a living brain. A recent model developed to explain sequence learning in the visual cortex encodes intervals in recurrent excitatory synapses and uses a learned offset between excitation and inhibition to generate precisely timed "messenger" cells that signal the end of an instance of time. This mechanism suggests that the recall of stored temporal intervals should be particularly sensitive to the activity of inhibitory interneurons that can be easily targeted in vivo with standard optogenetic tools. In this work we examined how simulated optogenetic manipulations of inhibitory cells modifies temporal learning and recall based on these mechanisms. We show that disinhibition and excess inhibition during learning or testing cause characteristic errors in recalled timing that could be used to validate the model in vivo using either physiological or behavioral measurements.

A Learned Map for Places and Concepts in the Human Medial Temporal Lobe

Distinct lines of research in both humans and animals point to a specific role of the hippocampus in both spatial and episodic memory function. The discovery of concept cells in the hippocampus and surrounding medial temporal lobe (MTL) regions suggests that the MTL maps physical and semantic spaces with a similar neural architecture. Here, we studied the emergence of such maps using MTL microwire recordings from 20 patients (9 female, 11 male) navigating a virtual environment featuring salient landmarks with established semantic meaning. We present several key findings. The array of local field potentials in the MTL contains sufficient information for above-chance decoding of subjects' instantaneous location in the environment. Closer examination revealed that as subjects gain experience with the environment the field potentials come to represent both the subjects' locations in virtual space and in high-dimensional semantic space. Similarly, we observe a learning effect on temporal sequence coding. Over time, field potentials come to represent future locations, even after controlling for spatial proximity. This predictive coding of future states, more so than the strength of spatial representations per se, is linked to variability in subjects' navigation performance. Our results thus support the conceptualization of the MTL as a memory space, representing both spatial- and nonspatial information to plan future actions and predict their outcomes.SIGNIFICANCE STATEMENT Using rare microwire recordings, we studied the representation of spatial, semantic, and temporal information in the human MTL. Our findings demonstrate that subjects acquire a cognitive map that simultaneously represents the spatial and semantic relations between landmarks. We further show that the same learned representation is used to predict future states, implicating MTL cell assemblies as the building blocks of prospective memory functions.

An integrative view of human hippocampal function: Differences with other species and capacity considerations

We describe an integrative model that encodes associations between related concepts in the human hippocampal formation, constituting the skeleton of episodic memories. The model, based on partially overlapping assemblies of "concept cells," contrast markedly with the well-established notion of pattern separation, which relies on conjunctive, context dependent single neuron responses, instead of the invariant, context independent responses found in the human hippocampus. We argue that the model of partially overlapping assemblies is better suited to cope with memory capacity limitations, that the finding of different types of neurons and functions in this area is due to a flexible and temporary use of the extraordinary machinery of the hippocampus to deal with the task at hand, and that only information that is relevant and frequently revisited will consolidate into long-term hippocampal representations, using partially overlapping assemblies. Finally, we propose that concept cells are uniquely human and that they may constitute the neuronal underpinnings of cognitive abilities that are much further developed in humans compared to other species.

Neural network based formation of cognitive maps of semantic spaces and the putative emergence of abstract concepts

How do we make sense of the input from our sensory organs, and put the perceived information into context of our past experiences? The hippocampal-entorhinal complex plays a major role in the organization of memory and thought. The formation of and navigation in cognitive maps of arbitrary mental spaces via place and grid cells can serve as a representation of memories and experiences and their relations to each other. The multi-scale successor representation is proposed to be the mathematical principle underlying place and grid cell computations. Here, we present a neural network, which learns a cognitive map of a semantic space based on 32 different animal species encoded as feature vectors. The neural network successfully learns the similarities between different animal species, and constructs a cognitive map of 'animal space' based on the principle of successor representations with an accuracy of around 30% which is near to the theoretical maximum regarding the fact that all animal species have more than one possible successor, i.e. nearest neighbor in feature space. Furthermore, a hierarchical structure, i.e. different scales of cognitive maps, can be modeled based on multi-scale successor representations. We find that, in fine-grained cognitive maps, the animal vectors are evenly distributed in feature space. In contrast, in coarse-grained maps, animal vectors are highly clustered according to their biological class, i.e. amphibians, mammals and insects. This could be a putative mechanism enabling the emergence of new, abstract semantic concepts. Finally, even completely new or incomplete input can be represented by interpolation of the representations from the cognitive map with remarkable high accuracy of up to 95%. We conclude that the successor representation can serve as a weighted pointer to past memories and experiences, and may therefore be a crucial building block to include prior knowledge, and to derive context knowledge from novel input. Thus, our model provides a new tool to complement contemporary deep learning approaches on the road towards artificial general intelligence.

Mnemonic Content and Hippocampal Patterns Shape Judgments of Time

Our experience of time can feel dilated or compressed, rather than reflecting true "clock time." Although many contextual factors influence the subjective perception of time, it is unclear how memory accessibility plays a role in constructing our experience of and memory for time. Here, we used a combination of behavioral and functional MRI measures in healthy young adults (N = 147) to ask the question of how memory is incorporated into temporal duration judgments. Behaviorally, we found that event boundaries, which have been shown to disrupt ongoing memory integration processes, result in the temporal compression of duration judgments. Additionally, using a multivoxel pattern similarity analysis of functional MRI data, we found that greater temporal pattern change in the left hippocampus within individual trials was associated with longer duration judgments. Together, these data suggest that mnemonic processes play a role in constructing representations of time.

Intrinsic hippocampal connectivity is associated with individual differences in retrospective duration processing

The estimation of incidentally encoded durations of time intervals (retrospective duration processing) is thought to rely on the retrieval of contextual information associated with a sequence of events, automatically encoded in medial temporal lobe regions. "Time cells" have been described in the hippocampus (HC), encoding the temporal progression of events and their duration. However, whether the HC supports explicit retrospective duration judgments in humans, and which neural dynamics are involved, is still poorly understood. Here we used resting-state fMRI to test the relation between variations in intrinsic connectivity patterns of the HC, and individual differences in retrospective duration processing, assessed using a novel task involving the presentation of ecological stimuli. Results showed that retrospective duration discrimination performance predicted variations in the intrinsic connectivity of the bilateral HC with the right precentral gyrus; follow-up exploratory analyses suggested a role of the CA1 and CA4/DG subfields in driving the observed pattern. Findings provide insights on neural networks associated with implicit processing of durations in the second range.

The tie that binds: temporal coding and adaptive emotion

Emotions are temporally dynamic, but the persistence of emotions outside of their appropriate temporal context is detrimental to health and well-being. Yet, precisely how temporal coding and emotional processing interact remains unclear. Recently unveiled temporal context representations in the hippocampus, entorhinal cortex (EC), and prefrontal cortex (PFC) support memory for what happened when. Here, we discuss how these neural temporal representations may interact with densely interconnected amygdala circuitry to shape emotional functioning. We propose a neuroanatomically informed framework suggesting that high-fidelity temporal representations linked to dynamic experiences promote emotion regulation and adaptive emotional memories. Then, we discuss how newly-identified synaptic and molecular features of amygdala-hippocampal projections suggest that intense, amygdala-dependent emotional responses may distort temporal-coding mechanisms. We conclude by identifying key avenues for future research.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

Neural network based successor representations to form cognitive maps of space and language

How does the mind organize thoughts? The hippocampal-entorhinal complex is thought to support domain-general representation and processing of structural knowledge of arbitrary state, feature and concept spaces. In particular, it enables the formation of cognitive maps, and navigation on these maps, thereby broadly contributing to cognition. It has been proposed that the concept of multi-scale successor representations provides an explanation of the underlying computations performed by place and grid cells. Here, we present a neural network based approach to learn such representations, and its application to different scenarios: a spatial exploration task based on supervised learning, a spatial navigation task based on reinforcement learning, and a non-spatial task where linguistic constructions have to be inferred by observing sample sentences. In all scenarios, the neural network correctly learns and approximates the underlying structure by building successor representations. Furthermore, the resulting neural firing patterns are strikingly similar to experimentally observed place and grid cell firing patterns. We conclude that cognitive maps and neural network-based successor representations of structured knowledge provide a promising way to overcome some of the short comings of deep learning towards artificial general intelligence.

A Neuroscientific and Cognitive Literary Approach to the Treatment of Time in Calderón's Autos sacramentales

Time processing is a fundamental subject in cognitive sciences and neuroscience. Current research is deepening how our brains process time, revealing its essential role in human functionality and survival. In his autos sacramentales, Early Modern Spanish playwright Pedro Calderón de la Barca portrays the relationships between human inner workings and the Christian concept of time. These plays portray the experience of the present, the perception of the flow of time, the measure of time raging from seconds to eternity, and the mental travel necessary to inhabit the past and future with the help of memory and imagination. Calderón explores how the dramatic form can portray all these temporal phenomena and how that portrait of time can constrain the dramatic structure. The different parts of the brain in charge of executive decisions, projections, memories, computation, and calibration are the basis that leads these characters to make the choices that will take them to the future they have cast for themselves. This paper analyzes how the processes that Calderón ascribed to the soul of his characters in the 17th century relate to ongoing cognitive and neuroscientific findings.

Detecting Time Concept Competence in Children with Autism Spectrum and Attention Disorders

The importance of time concept in human existence is "ancient history" celebrated in the biblical book Ecclesiastes. Indeed, our time-sensitive mechanisms are literally carved into our biology and neurology on a molecular level, gifting us with neural clocks. However, time in human consciousness is not the time indicated by physical clocks: time is a subjective reality in our psychological makeup due to the nature of the temporal neural mechanisms and unique properties of physical time. Nonetheless, subjective time requires anchoring to physical time which permeates our language, endeavors, and entire existence, a process hinging on time-related skills such as estimates and measures of passage and duration of time. Moreover, accurate time reading, a critical adaptive life-skill, is imperative for effective function in all societal activities. Because it embodies the complexity of the time construct, it is central to instruction of time concept in primary education. It is often measured in children by clock drawings, a cognitive integrative skill with errors pointing to neuroanatomical differences impacting the integrity of executive function. Time competence in children with atypical neurobiological development and high prevalence, as in autism spectrum disorders (ASD), and attention disorders (ADHD), is often compromised, calling for investigation of its function. This thematic review article aims to: 1) discuss the complexity of time concept and its underlying bio-neurological mechanisms, 2) elucidate difficulties children with ASD and those with ADHD exhibit in temporal development, and 3) demonstrate the use of a set of clinical tools in uncovering temporal competence and ecological executive function in two children with ASD, and a child with ADHD, using a clock drawing task and error analyses; children's time knowledge questionnaire; a behavior rating parent questionnaire examining ecological executive function, and parent open-ended questions related to their children's time difficulties. A discussion, directions, and a take-home message round out the article.

A Complex Combination Therapy for a Complex Disease-Neuroimaging Evidence for the Effect of Music Therapy in Schizophrenia

Schizophrenia is a disease characterized by clinical polymorphism: a combination of diverse syndromes defined by differences in structure, course and outcome. The etiology and pathogenesis of this mental disorder is still not completely understood, in spite of the achievements in the fields of neuroscience, genetics, neuroimaging and others. Different treatment strategies have been developed for patients with schizophrenia, but the search for new pharmacological agents continues with the mission of achieving a more effective control over the disease manifestations (positive and negative symptoms), improvement of the patients' social functioning and quality of life. The accumulated clinical experience has revealed that drug treatment and the inclusion in various rehabilitation programs and social skills training shows promising results in these patients. In recent years a plethora of evidence has been compiled regarding the role of music therapy as a possible alternative in the combination treatment of patients with mental disorders, schizophrenia included. Thus, the purpose of this review is to present the reader with a more detailed and science-based account of the beneficial effect of music therapy on the general wellbeing of patients diagnosed with schizophrenia. To fulfill our goal, we will focus mainly on the evidence provided by modern neuroimaging research.

The hippocampal formation and action at a distance

The question of why our conceptions of space and time are intertwined with memory in the hippocampal formation is at the forefront of much current theorizing about this brain system. In this article I argue that animals bridge spatial and temporal gaps through the creation of internal models that allow them to act on the basis of things that exist in a distant place and/or existed at a different time. The hippocampal formation plays a critical role in these processes by stitching together spatiotemporally disparate entities and events. It does this by 1) constructing cognitive maps that represent extended spatial contexts, incorporating and linking aspects of an environment that may never have been experienced together; 2) creating neural trajectories that link the parts of an event, whether they occur in close temporal proximity or not, enabling the construction of event representations even when elements of that event were experienced at quite different times; and 3) using these maps and trajectories to simulate possible futures. As a function of these hippocampally driven processes, our subjective sense of both space and time are interwoven constructions of the mind, much as the philosopher Immanuel Kant postulated.

The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory

How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.

Distinct cortical systems reinstate the content and context of episodic memories

Episodic recall depends upon the reinstatement of cortical activity present during the formation of a memory. Evidence from functional neuroimaging and invasive recordings in humans suggest that reinstatement organizes our memories by time or content, yet the neural systems involved in reinstating these unique types of information remain unclear. Here, combining computational modeling and intracranial recordings from 69 epilepsy patients, we show that two cortical systems uniquely reinstate the semantic content and temporal context of previously studied items during free recall. Examining either the posterior medial or anterior temporal networks, we find that forward encoding models trained on the brain's response to the temporal and semantic attributes of items can predict the serial position and semantic category of unseen items. During memory recall, these models uniquely link reinstatement of temporal context and semantic content to these posterior and anterior networks, respectively. These findings demonstrate how specialized cortical systems enable the human brain to target specific memories.