The Persistence of Memory: How the Brain Encodes Time in Memory

Minute-scale periodicity of neuronal firing in the human entorhinal cortex

Grid cells in the entorhinal cortex demonstrate spatially periodic firing, thought to provide a spatial map on behaviorally relevant length scales. Whether such periodicity exists for behaviorally relevant time scales in the human brain remains unclear. We investigate neuronal firing during a temporally continuous experience by presenting 14 neurosurgical patients with a video while recording neuronal activity from multiple brain regions. We report on neurons that modulate their activity in a periodic manner across different time scales-from seconds to many minutes, most prevalently in the entorhinal cortex. These neurons remap their dominant periodicity to shorter time scales during a subsequent recognition memory task. When the video is presented at two different speeds, a significant percentage of these temporally periodic cells (TPCs) maintain their time scales, suggesting a degree of invariance. The TPCs' temporal periodicity might complement the spatial periodicity of grid cells and together provide scalable spatiotemporal metrics for human experience.

Time processing in neurological and psychiatric conditions

A central question in understanding cognition and pathology-related cognitive changes is how we process time. However, time processing difficulties across several neurological and psychiatric conditions remain seldom investigated. The aim of this review is to develop a unifying taxonomy of time processing, and a neuropsychological perspective on temporal difficulties. Four main temporal judgments are discussed: duration processing, simultaneity and synchrony, passage of time, and mental time travel. We present an integrated theoretical framework of timing difficulties across psychiatric and neurological conditions based on selected patient populations. This framework provides new mechanistic insights on both (a) the processes involved in each temporal judgement, and (b) temporal difficulties across pathologies. By identifying underlying transdiagnostic time-processing mechanisms, this framework opens fruitful avenues for future research.

Cognitive and neural mechanisms underlying false memories: misinformation, distortion or erroneous configuration?

Errors can affect our memory, yet even when there are gaps in our recollection of events, memory often serves us fairly well. Memory formation involves at least three different sub-processes, that are regulated by an underlying neural structure. From a cognitive neuropsychological perspective, a complex process of encoding, consolidating, and retrieval is involved in remembering an event, and it might be hindered by one's emotional state, physiological response to the event itself, and misinformation. As a result, it is very likely that one may struggle to remember specifics of what happened which can increase our susceptibility to the formation of false memories. This has major implications for everyday functioning, as in the case when you mistakenly remember you took your pills when you never did, or where errors have led to false accusations about trauma or abuse, and wrongful convictions of crimes. Memories sometimes contain biases and inaccuracies that prevent them from accurately recalling events. The review will provide an updated overview of current research advances on the cognitive and neural mechanisms underlying inaccurate, distorted, or false memories.

Role of the subthalamic nucleus in perceiving and estimating the passage of time

Sense of time (temporal sense) is believed to be processed by various brain regions in a complex manner, among which the basal ganglia, including the striatum and subthalamic nucleus (STN), play central roles. However, the precise mechanism for processing sense of time has not been clarified. To examine the role of the STN in temporal processing of the sense of time by directly manipulating STN function by switching a deep brain stimulation (DBS) device On/Off in 28 patients with Parkinson's disease undergoing STN-DBS therapy. The test session was performed approximately 20 min after switching the DBS device from On to Off or from Off to On. Temporal sense processing was assessed in three different tasks (time reproduction, time production, and bisection). In the three temporal cognitive tasks, switching STN-DBS to Off caused shorter durations to be produced compared with the switching to the On condition in the time production task. In contrast, no effect of STN-DBS was observed in the time bisection or time reproduction tasks. These findings suggest that the STN is involved in the representation process of time duration and that the role of the STN in the sense of time may be limited to the exteriorization of memories formed by experience.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Short-Term Memory for Auditory Temporal Patterns and Meaningless Sentences Predicts Learning of Foreign Word Forms

The ability to accurately repeat meaningless nonwords or lists of spoken digits in correct order have been associated with vocabulary acquisition in both first and second language. Individual differences in these tasks are thought to depend on the phonological loop component of working memory. However, phonological working memory may itself depend on more elementary processes. We asked whether auditory non-verbal short-term memory (STM) for patterns in time supports immediate recall of speech-based sequences. Participants tapped temporal sequences consisting of short and long beeps and repeated nonsense sentences sounding like their native language or an unfamiliar language. As a language learning task, they also memorized familiar-word–foreign-word pairs. Word learning was directly predicted by nonsense sentence repetition accuracy. It was also predicted by temporal pattern STM. However, this association was mediated by performance on the repetition measure. We propose that STM for temporal patterns may reflect a component skill that provides the context signal necessary to encode order in phonological STM. It would be needed to support representation of the prosodic profile of language material, which allows syllables in words and words in sentences to be ordered and temporally grouped for short-term representation and long-term learning.

Memory-Paced Tapping to Auditory Rhythms: Effects of Rate, Speech, and Motor Engagement

PURPOSE

Humans have a near-automatic tendency to entrain their motor actions to rhythms in the environment. Entrainment has been hypothesized to play an important role in processing naturalistic stimuli, such as speech and music, which have intrinsically rhythmic properties. Here, we studied two facets of entraining one's rhythmic motor actions to an external stimulus: (a) synchronized finger tapping to auditory rhythmic stimuli and (b) memory-paced reproduction of a previously heard rhythm.

METHOD

Using modifications of the Synchronization-Continuation tapping paradigm, we studied how these two rhythmic behaviors were affected by different stimulus and task features. We tested synchronization and memory-paced tapping for a broad range of rates, from stimulus onset asynchrony of subsecond to suprasecond, both for strictly isochronous tone sequences and for rhythmic speech stimuli (counting from 1 to 10), which are more ecological yet less isochronous. We also asked what role motor engagement plays in forming a stable internal representation for rhythms and guiding memory-paced tapping.

RESULTS AND CONCLUSIONS

Our results show that individuals can flexibly synchronize their motor actions to a very broad range of rhythms. However, this flexibility does not extend to memory-paced tapping, which is accurate only in a narrower range of rates, around ~1.5 Hz. This pattern suggests that intrinsic rhythmic defaults in the auditory and/or motor system influence the internal representation of rhythms, in the absence of an external pacemaker. Interestingly, memory-paced tapping for speech rhythms and simple tone sequences shared similar "optimal rates," although with reduced accuracy, suggesting that internal constraints on rhythmic entrainment generalize to more ecological stimuli. Last, we found that actively synchronizing to tones versus passively listening to them led to more accurate memory-paced tapping performance, which emphasizes the importance of action-perception interactions in forming stable entrainment to external rhythms.

Training the attentional blink: subclinical depression decreases learning potential

The attentional blink (AB) reflects a temporal restriction of selective attention and is generally regarded as a very robust phenomenon. However, previous studies have found large individual differences in AB performance, and under some training conditions the AB can be reduced significantly. One factor that may account for individual differences in AB magnitude is the ability to accurately time attention. In the current study, we focus on the sensitivity for temporal information on the ability to control attention. Following a visual AB task, a time estimation task was presented in either the visual or auditory modality, followed by another visual AB task. It was found that the time estimation training in both the auditory and visual modality reduced AB magnitude. Although a reduction in AB magnitude was also observed when individuals were trained on a control task (either an auditory frequency or visual line length estimation task), the effect was significantly larger following the time estimation tasks. In addition, it was found that individuals who showed most improvement on the visual time estimation task, also showed the largest reduction in AB magnitude, which was not the case for individuals who were trained on the control tasks. Finally, a negative correlation was observed between depression scores (tested by Beck Depression Inventory-Short Form (BDI-SF) scores and the improvement in the AB and time estimation tasks. Our findings demonstrate clear links between timing ability and mechanisms to control attention and emotion.

Neural responses to shot changes by cut in cinematographic editing: An EEG (ERD/ERS) study

In order to analyze and detect neural activations and inhibitions in film spectators to shot changes by cut in films, we developed a methodology based on comparisons of recorded EEG signals and analyzed the event-related desynchronization/synchronization (ERD/ERS). The aim of the research is isolating these neuronal responses from other visual and auditory features that covary with film editing. This system of comparing pairs of signals using permutation tests, the Spearman correlation, and slope analysis is implemented in an automated way through sliding windows, analyzing all the registered electrodes signals at all the frequency bands defined. Through this methodology, we are able to locate, identify, and quantify the variations in neuronal rhythms in specific cortical areas and frequency ranges with temporal precision. Our results detected that after a cut there is a synchronization in theta rhythms during the first 188 ms with left lateralization, and also a desynchronization between 250 ms and 750 ms in the delta frequency band. The cortical area where most of these neuronal responses are detected in both cases is the parietal area.

Spontaneous and stimulus-driven rhythmic behaviors in ADHD adults and controls

Many aspects of human behavior are inherently rhythmic, requiring production of rhythmic motor actions as well as synchronizing to rhythms in the environment. It is well-established that individuals with ADHD exhibit deficits in temporal estimation and timing functions, which may impact their ability to accurately produce and interact with rhythmic stimuli. In the current study we seek to understand the specific aspects of rhythmic behavior that are implicated in ADHD. We specifically ask whether they are attributed to imprecision in the internal generation of rhythms or to reduced acuity in rhythm perception. We also test key predictions of the Preferred Period Hypothesis, which suggests that both perceptual and motor rhythmic behaviors are biased towards a specific personal 'default' tempo. To this end, we tested several aspects of rhythmic behavior and the correspondence between them, including spontaneous motor tempo (SMT), preferred auditory perceptual tempo (PPT) and synchronization-continuations tapping in a broad range of rhythms, from sub-second to supra-second intervals. Moreover, we evaluate the intra-subject consistency of rhythmic preferences, as a means for testing the reality and reliability of personal 'default-rhythms'. We used a modified operational definition for assessing SMT and PPT, instructing participants to tap or calibrate the rhythms most comfortable for them to count along with, to avoid subjective interpretations of the task. Our results shed new light on the specific aspect of rhythmic deficits implicated in ADHD adults. We find that individuals with ADHD are primarily challenged in producing and maintaining isochronous self-generated motor rhythms, during both spontaneous and memory-paced tapping. However, they nonetheless exhibit good flexibility for synchronizing to a broad range of external rhythms, suggesting that auditory-motor entrainment for simple rhythms is preserved in ADHD, and that the presence of an external pacer allows overcoming their inherent difficulty in self-generating isochronous motor rhythms. In addition, both groups showed optimal memory-paced tapping for rhythms near their 'counting-based' SMT and PPT, which were slightly faster in the ADHD group. This is in line with the predictions of the Preferred Period Hypothesis, indicating that at least for this well-defined rhythmic behavior (i.e., counting), individuals tend to prefer similar time-scales in both motor production and perceptual evaluation.

The Human Medial Temporal Lobe Is Necessary for Remembering Durations within a Sequence of Events but Not Durations of Individual Events

Recent interest in the role of the hippocampus in temporal aspects of cognition has been fueled, in part, by the observation of “time” cells in the rodent hippocampus—that is, cells that have differential firing patterns depending on how long ago an event occurred. Such cells are thought to provide an internal representation of elapsed time. Yet, the hippocampus is not needed for processing temporal duration information per se, at least on the order of seconds, as evidenced by intact duration judgments in rodents and humans with hippocampal damage. Rather, it has been proposed that the hippocampus may be essential for coding higher order aspects of temporal mnemonic processing, such as those needed to temporally organize a sequence of events that form an episode. To examine whether (1) the hippocampus uses duration information in the service of establishing temporal relations among events and (2) its role in memory for duration is unique to sequences, we tested amnesic patients with medial-temporal lobe damage (including the hippocampus). We hypothesized that medial-temporal lobe damage should impair the ability to remember sequential duration information but leave intact judgments about duration devoid of a sequential demand. We found that amnesics were impaired in making judgments about durations within a sequence but not in judging single durations. This impairment was not due to higher cognitive load associated with duration judgments about sequences. In convergence with rodent and human fMRI work, these findings shed light on how time coding in the hippocampus may contribute to temporal cognition.

Internal Clocks, mGluR7 and Microtubules: A Primer for the Molecular Encoding of Target Durations in Cerebellar Purkinje Cells and Striatal Medium Spiny Neurons

The majority of studies in the field of timing and time perception have generally focused on sub- and supra-second time scales, specific behavioral processes, and/or discrete neuronal circuits. In an attempt to find common elements of interval timing from a broader perspective, we review the literature and highlight the need for cell and molecular studies that can delineate the neural mechanisms underlying temporal processing. Moreover, given the recent attention to the function of microtubule proteins and their potential contributions to learning and memory consolidation/re-consolidation, we propose that these proteins play key roles in coding temporal information in cerebellar Purkinje cells (PCs) and striatal medium spiny neurons (MSNs). The presence of microtubules at relevant neuronal sites, as well as their adaptability, dynamic structure, and longevity, makes them a suitable candidate for neural plasticity at both intra- and inter-cellular levels. As a consequence, microtubules appear capable of maintaining a temporal code or engram and thereby regulate the firing patterns of PCs and MSNs known to be involved in interval timing. This proposed mechanism would control the storage of temporal information triggered by postsynaptic activation of mGluR7. This, in turn, leads to alterations in microtubule dynamics through a "read-write" memory process involving alterations in microtubule dynamics and their hexagonal lattice structures involved in the molecular basis of temporal memory.

Timing the "magical number seven": Presentation rate and regularity affect verbal working memory performance

The informative value of time and temporal structure often remains neglected in cognitive assessments. However, next to information about stimulus identity we can exploit temporal ordering principles, such as regularity, periodicity, or grouping to generate predictions about the timing of future events. Such predictions may improve cognitive performance by optimising adaptation to dynamic stimuli. Here, we investigated the influence of temporal structure on verbal working memory by assessing immediate recall performance for aurally presented digit sequences (forward digit span) as a function of standard (1000 ms stimulus-onset-asynchronies, SOAs), short (700 ms), long (1300 ms) and mixed (700-1300 ms) stimulus timing during the presentation phase. Participant's digit spans were lower for short and mixed SOA presentation relative to standard SOAs. This confirms an impact of temporal structure on the classic "magical number seven," suggesting that working memory performance can in part be regulated through the systematic application of temporal ordering principles.

Time Perception of an Artwork's Manipulation Is Distorted by Patients With Parkinson's Disease

Objectives: In artwork appreciation situations, individuals often show altered time perception. We tested the hypothesis that Parkinson's disease (PD) patients present movement patterns that have an impact on the time perception of artwork manipulation time. We predicted that, compared to healthy controls (non-PD), differences in the exploratory behavior of patients would evoke alteration of artwork manipulation time perception. Methods: Ten PD patients and 10 non-PD participants manipulated two reproductions of artwork with different complexity levels from the series "Bichos" by Lygia Clark. Subsequently, participants performed a verbal estimation regarding the temporal duration of their manipulations. The exploratory behavior was analyzed. Results: All participants overestimated the artwork manipulation time. However, PD patients, regardless of the artwork's level of complexity, showed shorter manipulation time and minor time overestimation compared to the non-PD participants. PD patients touched the artworks more often, especially the more complex artworks, than the non-PD participants; in contrast, PD patients moved the artworks less often, particularly the less complex artwork. Conclusion: PD patients showed an altered perception of artwork manipulation time. This suggests that exploratory behavior influenced temporal estimation. Besides, it is likely that PD patients had presented a decreased ability to manage attention during the task, which interfered in the cognitive reconstruction of its duration. Considered altogether, these appointments indicate that, as a result of cognitive and motor deficits, PD patients showed impairment in temporal information processing. The exploratory behavior facilitated the understanding of these results and processes in terms of motor-timing operations of the basal ganglia-thalamocortical system.

Oscillation patterns of local field potentials in the dorsal striatum and sensorimotor cortex during the encoding, maintenance, and decision stages for the ordinal comparison of sub- and supra-second signal durations

Ordinal comparison of successively presented signal durations requires (a) the encoding of the first signal duration (standard), (b) maintenance of temporal information specific to the standard duration in memory, and (c) timing of the second signal duration (comparison) during which a comparison is made of the first and second durations. Rats were first trained to make ordinal comparisons of signal durations within three time ranges using 0.5, 1.0, and 3.0-s standard durations. Local field potentials were then recorded from the dorsal striatum and sensorimotor cortex in order to investigate the pattern of neural oscillations during each phase of the ordinal-comparison process. Increased power in delta and theta frequency ranges was observed during both the encoding and comparison stages. Active maintenance of a selected response, "shorter" or "longer" (counter-balanced across left and right levers), was represented by an increase of theta and delta oscillations in the contralateral striatum and cortex. Taken together, these data suggest that neural oscillations in the delta-theta range play an important role in the encoding, maintenance, and comparison of signal durations.