Single-trial learning of novel stimuli by individual neurons of the human hippocampus-amygdala complex

Theta phase precession supports memory formation and retrieval of naturalistic experience in humans

Associating different aspects of experience with discrete events is critical for human memory. A potential mechanism for linking memory components is phase precession, during which neurons fire progressively earlier in time relative to theta oscillations. However, no direct link between phase precession and memory has been established. Here we recorded single-neuron activity and local field potentials in the human medial temporal lobe while participants (n = 22) encoded and retrieved memories of movie clips. Bouts of theta and phase precession occurred following cognitive boundaries during movie watching and following stimulus onsets during memory retrieval. Phase precession was dynamic, with different neurons exhibiting precession in different task periods. Phase precession strength provided information about memory encoding and retrieval success that was complementary with firing rates. These data provide direct neural evidence for a functional role of phase precession in human episodic memory.

Spatial dissociation between recognition and navigation in the primate hippocampus

The primate hippocampus, crucial for both episodic memory and spatial navigation, remains an enigma regarding whether these functions share the same neural substrates. We investigated how identical hippocampal neurons in macaque monkeys dynamically shifted their representations between tasks. In a recognition memory task, a notable fraction of hippocampal neurons showed that rate modulation strongly correlated with recognition performance. During free navigation in an open arena, spatial view, rather than position, predominantly influenced the spatial selectivity of hippocampal neurons. Neurons selective for recognition memory displayed minimal spatial tuning, while spatially tuned neurons exhibited limited memory-related activity. These neural correlates of recognition memory and space were more pronounced in the anterior and posterior portions of the hippocampus, respectively. These opposing gradients extended further into the anterior and posterior neocortices. Overall, our findings suggest the presence of orthogonal long-axis gradients between recognition memory and spatial navigation in the hippocampal-neocortical networks of macaque monkeys.

To update or to create? The influence of novelty and prior knowledge on memory networks

Schemas are foundational mental structures shaped by experience. They influence behaviour, guide the encoding of new memories and are shaped by associated information. The adaptability of memory schemas facilitates the integration of new information that aligns with existing knowledge structures. First, we discuss how novel information consistent with an existing schema can be swiftly assimilated when presented. This cognitive updating is facilitated by the interaction between the hippocampus and the prefrontal cortex. Second, when novel information is inconsistent with the schema, it likely engages the hippocampus to encode the information as part of an episodic memory trace. Third, novelty may enhance hippocampal dopamine through either the locus coeruleus or ventral tegmental area pathways, with the pathway involved potentially depending on the type of novelty encountered. We propose a gradient theory of schema and novelty to elucidate the neural processes by which schema updating or novel memory traces are formed. It is likely that experiences vary along a familiarity-novelty continuum, and the degree to which new experiences are increasingly novel will guide whether memory for a new experience either integrates into an existing schema or prompts the creation of a new cognitive framework. This article is part of the theme issue 'Long-term potentiation: 50 years on'.

Co-dependent excitatory and inhibitory plasticity accounts for quick, stable and long-lasting memories in biological networks

The brain's functionality is developed and maintained through synaptic plasticity. As synapses undergo plasticity, they also affect each other. The nature of such 'co-dependency' is difficult to disentangle experimentally, because multiple synapses must be monitored simultaneously. To help understand the experimentally observed phenomena, we introduce a framework that formalizes synaptic co-dependency between different connection types. The resulting model explains how inhibition can gate excitatory plasticity while neighboring excitatory-excitatory interactions determine the strength of long-term potentiation. Furthermore, we show how the interplay between excitatory and inhibitory synapses can account for the quick rise and long-term stability of a variety of synaptic weight profiles, such as orientation tuning and dendritic clustering of co-active synapses. In recurrent neuronal networks, co-dependent plasticity produces rich and stable motor cortex-like dynamics with high input sensitivity. Our results suggest an essential role for the neighborly synaptic interaction during learning, connecting micro-level physiology with network-wide phenomena.

Neural mechanisms of face familiarity and learning in the human amygdala and hippocampus

Recognizing familiar faces and learning new faces play an important role in social cognition. However, the underlying neural computational mechanisms remain unclear. Here, we record from single neurons in the human amygdala and hippocampus and find a greater neuronal representational distance between pairs of familiar faces than unfamiliar faces, suggesting that neural representations for familiar faces are more distinct. Representational distance increases with exposures to the same identity, suggesting that neural face representations are sharpened with learning and familiarization. Furthermore, representational distance is positively correlated with visual dissimilarity between faces, and exposure to visually similar faces increases representational distance, thus sharpening neural representations. Finally, we construct a computational model that demonstrates an increase in the representational distance of artificial units with training. Together, our results suggest that the neuronal population geometry, quantified by the representational distance, encodes face familiarity, similarity, and learning, forming the basis of face recognition and memory.

Reduction in the activity of VTA/SNc dopaminergic neurons underlies aging-related decline in novelty seeking

Curiosity, or novelty seeking, is a fundamental mechanism motivating animals to explore and exploit environments to improve survival, and is also positively associated with cognitive, intrapersonal and interpersonal well-being in humans. However, curiosity declines as humans age, and the decline even positively predicts the extent of cognitive decline in Alzheimer's disease patients. Therefore, determining the underlying mechanism, which is currently unknown, is an urgent task for the present aging society that is growing at an unprecedented rate. This study finds that seeking behaviors for both social and inanimate novelties are compromised in aged mice, suggesting that the aging-related decline in curiosity and novelty-seeking is a biological process. This study further identifies an aging-related reduction in the activity (manifesting as a reduction in spontaneous firing) of dopaminergic neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNc). Finally, this study establishes that this reduction in activity causally underlies the aging-related decline in novelty-seeking behaviors. This study potentially provides an interventional strategy for maintaining high curiosity in the aged population, i.e., compensating for the reduced activity of VTA/SNc dopaminergic neurons, enabling the aged population to cope more smoothly with the present growing aging society, physically, cognitively and socioeconomically.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

Hippocampal neurons code individual episodic memories in humans

The hippocampus is an essential hub for episodic memory processing. However, how human hippocampal single neurons code multi-element associations remains unknown. In particular, it is debated whether each hippocampal neuron represents an invariant element within an episode or whether single neurons bind together all the elements of a discrete episodic memory. Here we provide evidence for the latter hypothesis. Using single-neuron recordings from a total of 30 participants, we show that individual neurons, which we term episode-specific neurons, code discrete episodic memories using either a rate code or a temporal firing code. These neurons were observed exclusively in the hippocampus. Importantly, these episode-specific neurons do not reflect the coding of a particular element in the episode (that is, concept or time). Instead, they code for the conjunction of the different elements that make up the episode.

Mega-scale movie-fields in the mouse visuo-hippocampal network

Natural visual experience involves a continuous series of related images while the subject is immobile. How does the cortico-hippocampal circuit process a visual episode? The hippocampus is crucial for episodic memory, but most rodent single unit studies require spatial exploration or active engagement. Hence, we investigated neural responses to a silent movie (Allen Brain Observatory) in head-fixed mice without any task or locomotion demands, or rewards. Surprisingly, a third (33%, 3379/10263) of hippocampal -dentate gyrus, CA3, CA1 and subiculum- neurons showed movie-selectivity, with elevated firing in specific movie sub-segments, termed movie-fields, similar to the vast majority of thalamo-cortical (LGN, V1, AM-PM) neurons (97%, 6554/6785). Movie-tuning remained intact in immobile or spontaneously running mice. Visual neurons had >5 movie-fields per cell, but only ~2 in hippocampus. The movie-field durations in all brain regions spanned an unprecedented 1000-fold range: from 0.02s to 20s, termed mega-scale coding. Yet, the total duration of all the movie-fields of a cell was comparable across neurons and brain regions. The hippocampal responses thus showed greater continuous-sequence encoding than visual areas, as evidenced by fewer and broader movie-fields than in visual areas. Consistently, repeated presentation of the movie images in a fixed, but scrambled sequence virtually abolished hippocampal but not visual-cortical selectivity. The preference for continuous, compared to scrambled sequence was eight-fold greater in hippocampal than visual areas, further supporting episodic-sequence encoding. Movies could thus provide a unified way to probe neural mechanisms of episodic information processing and memory, even in immobile subjects, across brain regions, and species.

The locus of recognition memory signals in human cortex depends on the complexity of the memory representations

According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.

Single-neuron mechanisms of neural adaptation in the human temporal lobe

A central function of the human brain is to adapt to new situations based on past experience. Adaptation is reflected behaviorally by shorter reaction times to repeating or similar stimuli, and neurophysiologically by reduced neural activity in bulk-tissue measurements with fMRI or EEG. Several potential single-neuron mechanisms have been hypothesized to cause this reduction of activity at the macroscopic level. We here explore these mechanisms using an adaptation paradigm with visual stimuli bearing abstract semantic similarity. We recorded intracranial EEG (iEEG) simultaneously with spiking activity of single neurons in the medial temporal lobes of 25 neurosurgical patients. Recording from 4917 single neurons, we demonstrate that reduced event-related potentials in the macroscopic iEEG signal are associated with a sharpening of single-neuron tuning curves in the amygdala, but with an overall reduction of single-neuron activity in the hippocampus, entorhinal cortex, and parahippocampal cortex, consistent with fatiguing in these areas.

Nonverbal memory tests revisited: Neuroanatomical correlates and differential influence of biasing cognitive functions

The detection of right temporal lobe dysfunction with nonverbal memory tests has remained difficult in the past. Reasons for this might be the potential influence of other biasing cognitive functions such as executive functions or the verbalisability of nonverbal material. The aim of this study was to investigate three classic nonverbal memory tests by identifying their neuroanatomical correlates with lesion-symptom mapping (LSM) and by probing their independence from verbal encoding abilities and executive functions. In a cohort of 119 patients with first-time cerebrovascular accident, memory performance was assessed in the Nonverbal Learning and Memory Test for Routes (NLMTR), the Rey Complex Figure Test (RCFT), and the Visual Design Learning Test (VDLT). Calculating multivariate LSM, we identified crucial brain structures for these three nonverbal memory tests. Behavioural analyses were performed to assess the impact of executive functions and verbal encoding abilities with regression analyses and likelihood-ratio tests. LSM revealed for the RCFT mainly right-hemispheric frontal, insular, subcortical, and white matter structures and for the NLMTR right-hemispheric temporal (hippocampus), insular, subcortical, and white matter structures. The VDLT did not reach significance in LSM analyses. Behavioural results showed that amongst the three nonverbal memory tests the impact of executive functions was most pronounced for RCFT, and the impact of verbal encoding abilities was most important in VDLT. Likelihood-ratio tests confirmed that only for NLMTR did the goodness of fit not significantly improve by adding executive functions or verbal encoding abilities. These results suggest that amongst the three nonverbal memory tests the NLMTR, as a spatial navigation test, could serve as the most suitable marker of right-hemispheric temporal lobe functioning, with the right hippocampus being involved only in this test. In addition, the behavioural results propose that only NLMTR seems mostly unaffected by executive functions and verbal encoding abilities.

Studying memory processes at different levels with simultaneous depth and surface EEG recordings

Investigating cognitive brain functions using non-invasive electrophysiology can be challenging due to the particularities of the task-related EEG activity, the depth of the activated brain areas, and the extent of the networks involved. Stereoelectroencephalographic (SEEG) investigations in patients with drug-resistant epilepsy offer an extraordinary opportunity to validate information derived from non-invasive recordings at macro-scales. The SEEG approach can provide brain activity with high spatial specificity during tasks that target specific cognitive processes (e.g., memory). Full validation is possible only when performing simultaneous scalp SEEG recordings, which allows recording signals in the exact same brain state. This is the approach we have taken in 12 subjects performing a visual memory task that requires the recognition of previously viewed objects. The intracranial signals on 965 contact pairs have been compared to 391 simultaneously recorded scalp signals at a regional and whole-brain level, using multivariate pattern analysis. The results show that the task conditions are best captured by intracranial sensors, despite the limited spatial coverage of SEEG electrodes, compared to the whole-brain non-invasive recordings. Applying beamformer source reconstruction or independent component analysis does not result in an improvement of the multivariate task decoding performance using surface sensor data. By analyzing a joint scalp and SEEG dataset, we investigated whether the two types of signals carry complementary information that might improve the machine-learning classifier performance. This joint analysis revealed that the results are driven by the modality exhibiting best individual performance, namely SEEG.

An integrative view of human hippocampal function: Differences with other species and capacity considerations

We describe an integrative model that encodes associations between related concepts in the human hippocampal formation, constituting the skeleton of episodic memories. The model, based on partially overlapping assemblies of "concept cells," contrast markedly with the well-established notion of pattern separation, which relies on conjunctive, context dependent single neuron responses, instead of the invariant, context independent responses found in the human hippocampus. We argue that the model of partially overlapping assemblies is better suited to cope with memory capacity limitations, that the finding of different types of neurons and functions in this area is due to a flexible and temporary use of the extraordinary machinery of the hippocampus to deal with the task at hand, and that only information that is relevant and frequently revisited will consolidate into long-term hippocampal representations, using partially overlapping assemblies. Finally, we propose that concept cells are uniquely human and that they may constitute the neuronal underpinnings of cognitive abilities that are much further developed in humans compared to other species.

Consideration of different scoring approaches for a verbal incidental learning measure from the WAIS-IV using hippocampal volumes

Objective: While Spencer's verbal incidental learning (IL) task-from Vocabulary and Similarities subtests of the WAIS-has been validated relative to traditional memory measures and Alzheimer's disease (AD) pathology, the effectiveness of the particular scoring method used has not been assessed relative to alternative scoring weightings. The purpose of this study was to compare original and alternative scoring methods of this IL task by using an AD biomarker-benchmark to arrive at an optimal approach. Methods: Fifty-five memory-clinic patients aged 59-87 received neuropsychological assessment, measures of IL, and quantitative brain imaging. Partial correlation coefficients with total hippocampal volume-controlling for age, sex, and intracranial volume-were assessed across several IL scoring methods, and partial correlations with measures of memory were examined to evaluate convergent validity.Results: IL scoring methods maximizing the contribution of paired-associate-recall-performance were significantly correlated with both hippocampal volumes and traditional memory measures, whereas discrimination-emphasized scoring methods were not.Conclusions: IL scoring methods emphasizing memory paired-associate recall appeared to be preferable to those emphasizing memory discrimination. Administration of the IL- Similarities subtest alone, without IL- Vocabulary, may strike a balance between strength of relationships with both hippocampal volumes and standard memory measures, while also limiting administration time.

Lateral septum modulates cortical state to tune responsivity to threat stimuli

Sudden unexpected environmental changes capture attention and, when perceived as potentially dangerous, evoke defensive behavioral states. Perturbations of the lateral septum (LS) can produce extreme hyperdefensiveness even to innocuous stimuli, but how this structure influences stimulus-evoked defensive responses and threat perception remains unclear. Here, we show that Crhr2-expressing neurons in mouse LS exhibit phasic activation upon detection of threatening but not rewarding stimuli. Threat-stimulus-driven activity predicts the probability but not vigor or type of defensive behavior evoked. Although necessary for and sufficient to potentiate stimulus-triggered defensive responses, LSCrhr2 neurons do not promote specific behaviors. Rather, their stimulation elicits negative valence and physiological arousal. Moreover, LSCrhr2 activity tracks brain state fluctuations and drives cortical activation and rapid awakening in the absence of threat. Together, our findings suggest that LS directs bottom-up modulation of cortical function to evoke preparatory defensive internal states and selectively enhance responsivity to threat-related stimuli.

Precise timing of ERK phosphorylation/dephosphorylation determines the outcome of trial repetition during long-term memory formation

Two-trial learning in Aplysia reveals nonlinear interactions between training trials: A single trial has no effect, but two precisely spaced trials induce long-term memory. Extracellularly regulated kinase (ERK) activity is essential for intertrial interactions, but the mechanism remains unresolved. A combination of immunochemical and optogenetic tools reveals unexpected complexity of ERK signaling during the induction of long-term synaptic facilitation by two spaced pulses of serotonin (5-hydroxytryptamine, 5HT). Specifically, dual ERK phosphorylation at its activating TxY motif is accompanied by dephosphorylation at the pT position, leading to a buildup of inactive, singly phosphorylated pY-ERK. Phosphorylation and dephosphorylation occur concurrently but scale differently with varying 5HT concentrations, predicting that mixed two-trial protocols involving both "strong" and "weak" 5HT pulses should be sensitive to the precise order and timing of trials. Indeed, long-term synaptic facilitation is induced only when weak pulses precede strong, not vice versa. This may represent a physiological mechanism to prioritize memory of escalating threats.

Gray-Matter Morphometry of Internalizing-Symptom Dimensions During Adolescence

Understanding the neuroanatomical correlates of internalizing psychopathology during adolescence may shed light on to neurodevelopmental processes that make this a critical period for the trajectory of mental illness. However, few studies have simultaneously examined co-occurring and dissociable features of internalizing psychopathology during this formative developmental stage. In the current study we identify the neuroanatomical correlates of four dimensions of internalizing psychopathology symptoms in adolescents: a common internalizing dimension capturing covariance in symptoms across internalizing disorders, as well as low positive affect-, anxious arousal-, and anxious apprehension-specific residuals. Our results suggest that these dimensions are associated with neuroanatomy across much of the brain, including prefrontal and limbic regions implicated in case-control studies, but also regions supporting visual processing. Importantly, results differed between males and females in regions that are sexually dimorphic in adulthood and the direction of the effects were largely opposite to what has been observed in adults and children.

Uncovering neural distinctions and commodities between two creativity subsets: A meta-analysis of fMRI studies in divergent thinking and insight using activation likelihood estimation

The dual‐process theory that two different systems of thought coexist in creative thinking has attracted considerable attention. In the field of creative thinking, divergent thinking (DT) is the ability to produce multiple solutions to open‐ended problems in a short time. It is mainly considered an associative and fast process. Meanwhile, insight, the new and unexpected comprehension of close‐ended problems, is frequently marked as a deliberate and time‐consuming thinking process requiring concentrated effort. Previous research has been dedicated to revealing their separate neural mechanisms, while few studies have compared their differences and similarities at the brain level. Therefore, the current study applied Activation Likelihood Estimation to decipher common and distinctive neural pathways that potentially underlie DT and insight. We selected 27 DT studies and 30 insight studies for retrospective meta‐analyses. Initially, two single analyses with follow‐up contrast and conjunction analyses were performed. The single analyses showed that DT mainly involved the inferior parietal lobe (IPL), cuneus, and middle frontal gyrus (MFG), while the precentral gyrus, inferior frontal gyrus (IFG), parahippocampal gyrus (PG), amygdala (AMG), and superior parietal lobe were engaged in insight. Compared to insight, DT mainly led to greater activation in the IPL, the crucial part of the default mode network. However, insight caused more significant activation in regions related to executive control functions and emotional responses, such as the IFG, MFG, PG, and AMG. Notably, the conjunction analysis detected no overlapped areas between DT and insight. These neural findings implicate that various neurocognitive circuits may support DT and insight.

MMM - The molecular model of memory

Identifying mechanisms underlying neurons ability to process information including acquisition, storage, and retrieval plays an important role in the understanding of the different types of memory, pathogenesis of many neurological diseases affecting memory and therapeutic target discovery. However, the traditional understanding of the mechanisms of memory associated with the electrical signals having a unique combination of frequency and amplitude does not answer the question how the memories can survive for life-long periods of time, while exposed to synaptic noise. Recent evidence suggests that, apart from neuronal circuits, a diversity of the molecular memory (MM) carriers, are essential for memory performance. The molecular model of memory (MMM) is proposed, according to which each item of incoming information (the elementary memory item - eMI) is encoded by both circuitries, with the unique for a given MI electrical parameters, and also the MM carriers, unique by its molecular composition. While operating as the carriers of incoming information, the MMs, are functioning within the neuron plasma membrane. Inactive (latent) initially, during acquisition each of the eMIs is activated to become a virtual copy of some real fact or events bygone. This activation is accompanied by the considerable remodeling of the MM molecule associated with the resonance effect.

A human single-neuron dataset for face perception

The human amygdala and hippocampus have long been associated with face perception. Here, we present a dataset of single-neuron activity in the human amygdala and hippocampus during face perception. We recorded 2082 neurons from the human amygdala and hippocampus when neurosurgical patients with intractable epilepsy performed a one-back task using natural face stimuli, which mimics natural face perception. Specifically, our data include (1) single-neuron activity from the amygdala (996 neurons) and hippocampus (1086 neurons), (2) eye movements (gaze position and pupil), (3) psychological assessment of the patients, and (4) social trait judgment ratings from a subset of patients and a large sample of participants from the general population. Together, our comprehensive dataset with a large population of neurons can facilitate multifaceted investigation of face perception with the highest spatial and temporal resolution currently available in humans.

Two kinds of memory signals in neurons of the human hippocampus

SignificanceEpisodic memories represent the "what," "when," and "where" of specific episodes. In epilepsy patients, we detected single-unit activity reflecting episodic memory only in the hippocampus. This neural signal is sparsely coded and pattern-separated, consistent with predictions from neurocomputational models. We also detected single-unit activity reflecting a generic memory signal, coding whether an item is old or new without item-specific episodic information. Similar to concept cells, this generic repetition/novelty neural signal was found in multiple brain regions, including the hippocampus. In contrast, the item-specific signal was found only in the hippocampus. Our results indicate the coexistence of two memory signals in the human brain and suggest that the sparsely coded, hippocampus-specific signal is fundamental, whereas the often-studied generic signal is derivative.

Distinct neurocognitive bases for social trait judgments of faces in autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by difficulties in social processes, interactions, and communication. Yet, the neurocognitive bases underlying these difficulties are unclear. Here, we triangulated the 'trans-diagnostic' approach to personality, social trait judgments of faces, and neurophysiology to investigate (1) the relative position of autistic traits in a comprehensive social-affective personality space, and (2) the distinct associations between the social-affective personality dimensions and social trait judgment from faces in individuals with ASD and neurotypical individuals. We collected personality and facial judgment data from a large sample of online participants (N = 89 self-identified ASD; N = 307 neurotypical controls). Factor analysis with 33 subscales of 10 social-affective personality questionnaires identified a 4-dimensional personality space. This analysis revealed that ASD and control participants did not differ significantly along the personality dimensions of empathy and prosociality, antisociality, or social agreeableness. However, the ASD participants exhibited a weaker association between prosocial personality dimensions and judgments of facial trustworthiness and warmth than the control participants. Neurophysiological data also indicated that ASD participants had a weaker association with neuronal representations for trustworthiness and warmth from faces. These results suggest that the atypical association between social-affective personality and social trait judgment from faces may contribute to the social and affective difficulties associated with ASD.

Novel stimuli evoke excess activity in the mouse primary visual cortex

Rapid detection and processing of stimulus novelty are key elements of adaptive behavior. Predictive coding theories postulate that novel stimuli should be encoded differently from familiar stimuli. Here, we show that the majority of neurons in layer 2/3 of the mouse primary visual cortex exhibit a significant excess response to novel visual stimuli. The distinction between novel and familiar images developed rapidly, requiring only a few repeated presentations. We show that this phenomenon can be described by a model of cascading adaptation. This ubiquitous mechanism makes it likely that similar computations could be carried out in many brain areas.

To explore how neural circuits represent novel versus familiar inputs, we presented mice with repeated sets of images with novel images sparsely substituted. Using two-photon calcium imaging to record from layer 2/3 neurons in the mouse primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. This novelty response rapidly emerged, arising with a time constant of 2.6 ± 0.9 s. When a new image set was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which decayed to steady state with a time constant of 1.4 ± 0.4 s. When we increased the number of images in the set, the novelty response’s amplitude decreased, defining a capacity to store ∼15 familiar images under our conditions. These results could be explained quantitatively using an adaptive subunit model in which presynaptic neurons have individual tuning and gain control. This result shows that local neural circuits can create different representations for novel versus familiar inputs using generic, widely available mechanisms.

Task Modulation of Single-Neuron Activity in the Human Amygdala and Hippocampus

The human amygdala and hippocampus are critically involved in various processes in face perception. However, it remains unclear how task demands or evaluative contexts modulate processes underlying face perception. In this study, we employed two task instructions when participants viewed the same faces and recorded single-neuron activity from the human amygdala and hippocampus. We comprehensively analyzed task modulation for three key aspects of face processing and we found that neurons in the amygdala and hippocampus (1) encoded high-level social traits such as perceived facial trustworthiness and dominance and this response was modulated by task instructions; (2) encoded low-level facial features and demonstrated region-based feature coding, which was not modulated by task instructions; and (3) encoded fixations on salient face parts such as the eyes and mouth, which was not modulated by task instructions. Together, our results provide a comprehensive survey of task modulation of neural processes underlying face perception at the single-neuron level in the human amygdala and hippocampus.

Encoding of facial features by single neurons in the human amygdala and hippocampus

Faces are salient social stimuli that attract a stereotypical pattern of eye movement. The human amygdala and hippocampus are involved in various aspects of face processing; however, it remains unclear how they encode the content of fixations when viewing faces. To answer this question, we employed single-neuron recordings with simultaneous eye tracking when participants viewed natural face stimuli. We found a class of neurons in the human amygdala and hippocampus that encoded salient facial features such as the eyes and mouth. With a control experiment using non-face stimuli, we further showed that feature selectivity was specific to faces. We also found another population of neurons that differentiated saccades to the eyes vs. the mouth. Population decoding confirmed our results and further revealed the temporal dynamics of face feature coding. Interestingly, we found that the amygdala and hippocampus played different roles in encoding facial features. Lastly, we revealed two functional roles of feature-selective neurons: 1) they encoded the salient region for face recognition, and 2) they were related to perceived social trait judgments. Together, our results link eye movement with neural face processing and provide important mechanistic insights for human face perception.

Functional coupling between CA3 and laterobasal amygdala supports schema dependent memory formation

The medial temporal lobe drives semantic congruence dependent memory formation. However, the exact roles of hippocampal subfields and surrounding brain regions remain unclear. Here, we used an established paradigm and high-resolution functional magnetic resonance imaging of the medial temporal lobe together with cytoarchitectonic probability estimates in healthy humans. Behaviorally, robust congruence effects emerged in young and older adults, indicating that schema dependent learning is unimpaired during healthy aging. Within the medial temporal lobe, semantic congruence was associated with hemodynamic activity in the subiculum, CA1, CA3 and dentate gyrus, as well as the entorhinal cortex and laterobasal amygdala. Importantly, a subsequent memory analysis showed increased activity for later remembered vs. later forgotten congruent items specifically within CA3, and this subfield showed enhanced functional connectivity to the laterobasal amygdala. As such, our findings extend current models on schema dependent learning by pinpointing the functional properties of subregions within the medial temporal lobe.

Neurons in the human medial temporal lobe track multiple temporal contexts during episodic memory processing

Episodic memory requires associating items with temporal context, a process for which the medial temporal lobe (MTL) is critical. This study uses recordings from 27 human subjects who were undergoing surgical intervention for intractable epilepsy. These same data were also utilized in Umbach et al. (2020). We identify 103 memory-sensitive neurons in the hippocampus and entorhinal cortex, whose firing rates predicted successful episodic memory encoding as subjects performed a verbal free recall task. These neurons exhibit important properties. First, as predicted from the temporal context model, they demonstrate reinstatement of firing patterns observed during encoding at the time of retrieval. The magnitude of reinstatement predicted the tendency of subjects to cluster retrieved memory items according to input serial position. Also, we found that spiking activity of these neurons was locked to the phase of hippocampal theta oscillations, but that the mean phase of spiking shifted between memory encoding versus retrieval. This unique observation is consistent with predictions of the “Separate Phases at Encoding And Retrieval (SPEAR)” model. Together, the properties we identify for memory-sensitive neurons characterize direct electrophysiological mechanisms for the representation of contextual information in the human MTL.

Duplicate Detection of Spike Events: A Relevant Problem in Human Single-Unit Recordings

Single-unit recordings in the brain of behaving human subjects provide a unique opportunity to advance our understanding of neural mechanisms of cognition. These recordings are exclusively performed in medical centers during diagnostic or therapeutic procedures. The presence of medical instruments along with other aspects of the hospital environment limit the control of electrical noise compared to animal laboratory environments. Here, we highlight the problem of an increased occurrence of simultaneous spike events on different recording channels in human single-unit recordings. Most of these simultaneous events were detected in clusters previously labeled as artifacts and showed similar waveforms. These events may result from common external noise sources or from different micro-electrodes recording activity from the same neuron. To address the problem of duplicate recorded events, we introduce an open-source algorithm to identify these artificial spike events based on their synchronicity and waveform similarity. Applying our method to a comprehensive dataset of human single-unit recordings, we demonstrate that our algorithm can substantially increase the data quality of these recordings. Given our findings, we argue that future studies of single-unit activity recorded under noisy conditions should employ algorithms of this kind to improve data quality.

Expectation-driven novelty effects in episodic memory

Novel and unexpected stimuli are often prioritised in memory, given their inherent salience. Nevertheless, not all forms of novelty show such an enhancement effect. Here, we discuss the role expectation plays in modulating the way novelty affects memory processes, circuits, and subsequent performance. We first review independent effects of expectation on memory, and then consider how different types of novelty are characterised by expectation. We argue that different types of novelty defined by expectation implicate differential neurotransmission in memory formation brain regions and may also result in the creation of different types of memory. Contextual novelty, which is unexpected by definition, is often associated with better recollection, supported by dopaminergic-hippocampal interactions. On the other hand, expected stimulus novelty is supported by engagement of medial temporal cortices, as well as the hippocampus, through cholinergic modulation. Furthermore, when expected stimulus novelty results in enhanced memory, it is predominantly driven by familiarity. The literature reviewed here highlights the complexity of novelty-sensitive memory systems, the distinction between types of novelty, and how they are differentially affected by expectancy.

Neural evidence for recognition of naturalistic videos in monkey hippocampus

The role of the hippocampus in recognition memory has long been a source of debate. Tasks used to study recognition that typically require an explicit probe, where the participant must make a response to prove they remember, yield mixed results on hippocampal involvement. Here, we tasked monkeys to freely view naturalistic videos, and only tested their memory via looking times for two separate novel versus repeat video conditions on each trial. Notably, a large proportion (>30%) of hippocampal neurons differentiated these videos via changes in firing rates time-locked to the duration of their presentation on screen, and not during the delay period between them as would be expected for working memory. Many of these single neurons (>15%) contributed to both retrieval conditions, and differentiated novel from repeat videos across trials with trial-unique content, suggesting they detect familiarity. The majority of neurons contributing to the classifier showed an enhancement in firing rate on repeat compared with novel videos, a pattern which has not previously been shown in hippocampus. These results suggest the hippocampus contributes to recognition memory via familiarity during free-viewing.

Novelty processing depends on medial temporal lobe structures

OBJECTIVES

The goal of the present study was to identify the role of the medial temporal lobe (MTL) in the detection and later processing of novelty.

METHODS

Twenty-one epilepsy patients with unilateral MTL resection (10 left-sided; 11 right-sided) and 26 matched healthy controls performed an adapted visual novelty oddball task. In this task two streams of stimuli were presented on the left and right of fixation while the patients' electroencephalogram was measured. The participants had to respond to infrequent target stimuli, while ignoring frequent standard, and infrequent novel stimuli that were presented to the left or right, appearing either contra- or ipsilateral to the patients' resections.

RESULTS

Novelty detection, as indexed by the N2 ERP component elicited by novels, was reduced by the MTL resections, as evidenced by a smaller N2 for patients than healthy controls. Later processing of novels, as indexed by the novelty P3 ERP component, was reduced for novels presented contra- versus ipsilateral to the resected side. Moreover, at a frontal electrode site, the N2-P3 complex showed reduced novelty processing in patients with MTL resections compared to healthy controls. The ERP differences were specific for the novel stimuli, as target processing, as indexed by the P3b, was unaffected in the patients: No P3b differences were found between targets presented ipsi- or contralaterally to the resected side, nor between patients and healthy controls.

CONCLUSIONS

The current results suggest that MTL structures play a role in novelty processing. In contrast, target processing was unaffected by MTL resections.

How Human Single-Neuron Recordings Can Help Us Understand Cognition: Insights from Memory Studies

Understanding human cognition is a key goal of contemporary neuroscience. Due to the complexity of the human brain, animal studies and noninvasive techniques, however valuable, are incapable of providing us with a full understanding of human cognition. In the light of existing cognitive theories, we describe findings obtained thanks to human single-neuron recordings, including the discovery of concept cells and novelty-dependent cells, or activity patterns behind working memory, such as persistent activity. We propose future directions for studies using human single-neuron recordings and we discuss possible opportunities of investigating pathological brain.

Modulation of Dopamine for Adaptive Learning: A Neurocomputational Model

There have been many proposals that learning rates in the brain are adaptive, in the sense that they increase or decrease depending on environmental conditions. The majority of these models are abstract and make no attempt to describe the neural circuitry that implements the proposed computations. This article describes a biologically detailed computational model that overcomes this shortcoming. Specifically, we propose a neural circuit that implements adaptive learning rates by modulating the gain on the dopamine response to reward prediction errors, and we model activity within this circuit at the level of spiking neurons. The model generates a dopamine signal that depends on the size of the tonically active dopamine neuron population and the phasic spike rate. The model was tested successfully against results from two single-neuron recording studies and a fast-scan cyclic voltammetry study. We conclude by discussing the general applicability of the model to dopamine mediated tasks that transcend the experimental phenomena it was initially designed to address.

A predictive account of how novelty influences declarative memory

A rich body of studies in the human and non-human literature has examined the question how novelty influences memory. For a variety of different stimuli, ranging from simple objects and words to vastly complex scenarios, the literature reports that novelty improves memory in some cases, but impairs memory in other cases. In recent attempts to reconcile these conflicting findings, novelty has been divided into different subtypes, such as relative versus absolute novelty, or stimulus versus contextual novelty. Nevertheless, a single overarching theory of novelty and memory has been difficult to attain, probably due to the complexities in the interactions among stimuli, environmental factors (e.g., spatial and temporal context) and level of prior knowledge (but see Duszkiewicz et al., 2019; Kafkas & Montaldi, 2018b; Schomaker & Meeter, 2015). Here we describe how a predictive coding framework might be able to shed new light on different types of novelty and how they affect declarative memory in humans. More precisely, we consider how prior expectations modulate the influence of novelty on encoding episodes into memory, e.g., in terms of surprise, and how novelty/surprise affect memory for surrounding information. By reviewing a range of behavioural findings and their possible underlying neurobiological mechanisms, we highlight where a predictive coding framework succeeds and where it appears to struggle.

Critical aspects of neurodevelopment

Organisms have the unique ability to adapt to their environment by making use of external inputs. In the process, the brain is shaped by experiences that go hand-in-hand with optimisation of neural circuits. As such, there exists a time window for the development of different brain regions, each unique for a particular sensory modality, wherein the propensity of forming strong, irreversible connections are high, referred to as a critical period of development. Over the years, this domain of neurodevelopmental research has garnered considerable attention from many scientists, primarily because of the intensive activity-dependent nature of development. This review discusses the cellular, molecular, and neurophysiological bases of critical periods of different sensory modalities, and the disorders associated in cases the regulators of development are dysfunctional. Eventually, the neurobiological bases of the behavioural abnormalities related to developmental pathologies are discussed. A more in-depth insight into the development of the brain during the critical period of plasticity will eventually aid in developing potential therapeutics for several neurodevelopmental disorders that are categorised under critical period disorders.

Recitation as a structured intervention to enhance the long-term verbatim retention and gist recall of complex texts in kindergarteners

Recitation is an effective way for children to become familiar with basic blocks of knowledge. It is not clear, however, whether repeated structured exposure to complex texts via listening or active reciting benefits the ability of kindergarteners to retain verbal material in long-term memory verbatim and as content. Here, we tested the effectiveness of teaching longer texts to kindergarteners by repeated exposure in terms of long-term retention (6 months). A set of 28 rhyming sentences (224 words) were introduced, 3 in each session, and the increasingly longer text was practiced by either voiced recitation or listening. The rhymes were in a literary language, and word meaning in each new rhyme was elaborated when first introduced. Both groups (recitation and listening) showed good long-term retention, but the recitation group outperformed the listening group when assessed at 24 h, 1 month, and 6 months postintervention in terms of the recall rate, error rate, number of prompts required, and sequence fidelity. In the later assessments, the reciting group was the more fluent group in producing the rhymes. Moreover, at 6 months postintervention, the gist (content) of the rhymes and the meaning of vocabulary items from the texts were robustly retained, with an advantage for the recitation group. Thus, practice in affording multiple repetitions, specifically active recitation, resulted in fluent, effortless, and accurate recall of statements and their content. We propose that these results support the notion that repetition-based practice may promote the mastery of complex verbal material by enabling better engagement of procedural memory, that is, by promoting "proceduralization" processes.

Engrams of Fast Learning

Fast learning designates the behavioral and neuronal mechanisms underlying the acquisition of a long-term memory trace after a unique and brief experience. As such it is opposed to incremental, slower reinforcement or procedural learning requiring repetitive training. This learning process, found in most animal species, exists in a large spectrum of natural behaviors, such as one-shot associative, spatial, or perceptual learning, and is a core principle of human episodic memory. We review here the neuronal and synaptic long-term changes associated with fast learning in mammals and discuss some hypotheses related to their underlying mechanisms. We first describe the variety of behavioral paradigms used to test fast learning memories: those preferentially involve a single and brief (from few hundred milliseconds to few minutes) exposures to salient stimuli, sufficient to trigger a long-lasting memory trace and new adaptive responses. We then focus on neuronal activity patterns observed during fast learning and the emergence of long-term selective responses, before documenting the physiological correlates of fast learning. In the search for the engrams of fast learning, a growing body of evidence highlights long-term changes in gene expression, structural, intrinsic, and synaptic plasticities. Finally, we discuss the potential role of the sparse and bursting nature of neuronal activity observed during the fast learning, especially in the induction plasticity mechanisms leading to the rapid establishment of long-term synaptic modifications. We conclude with more theoretical perspectives on network dynamics that could enable fast learning, with an overview of some theoretical approaches in cognitive neuroscience and artificial intelligence.

The Architecture of Human Memory: Insights from Human Single-Neuron Recordings

Deciphering the mechanisms of human memory is a central goal of neuroscience, both from the point of view of the fundamental biology of memory and for its translational relevance. Here, we review some contributions that recordings from neurons in humans implanted with electrodes for clinical purposes have made toward this goal. Recordings from the medial temporal lobe, including the hippocampus, reveal the existence of two classes of cells: those encoding highly selective and invariant representations of abstract concepts, and memory-selective cells whose activity is related to familiarity and episodic retrieval. Insights derived from observing these cells in behaving humans include that semantic representations are activated before episodic representations, that memory content and memory strength are segregated, and that the activity of both types of cells is related to subjective awareness as expected from a substrate for declarative memory. Visually selective cells can remain persistently active for several seconds, thereby revealing a cellular substrate for working memory in humans. An overarching insight is that the neural code of human memory is interpretable at the single-neuron level. Jointly, intracranial recording studies are starting to reveal aspects of the building blocks of human memory at the single-cell level. This work establishes a bridge to cellular-level work in animals on the one hand, and the extensive literature on noninvasive imaging in humans on the other hand. More broadly, this work is a step toward a detailed mechanistic understanding of human memory that is needed to develop therapies for human memory disorders.

Midbrain circuits of novelty processing

Novelty triggers an increase in orienting behavior that is critical to evaluate the potential salience of unknown events. As novelty becomes familiar upon repeated encounters, this increase in response rapidly habituates as a form of behavioral adaptation underlying goal-directed behaviors. Many neurodevelopmental, psychiatric and neurodegenerative disorders are associated with abnormal responses to novelty and/or familiarity, although the neuronal circuits and cellular/molecular mechanisms underlying these natural behaviors in the healthy brain are largely unknown, as is the maladaptive processes that occur to induce impairment of novelty signaling in diseased brains. In rodents, the development of cutting-edge tools that allow for measurements of real time activity dynamics in selectively identified neuronal ensembles by gene expression signatures is beginning to provide advances in understanding the neural bases of the novelty response. Accumulating evidence indicate that midbrain circuits, the majority of which linked to dopamine transmission, promote exploratory assessments and guide approach/avoidance behaviors to different types of novelty via specific projection sites. The present review article focuses on midbrain circuit analysis relevant to novelty processing and habituation with familiarity.

Habituation during encoding: A new approach to the evaluation of memory deficits in schizophrenia

BACKGROUND

Memory is significantly impaired in schizophrenia. However, memory measures are often complex and confounded by additional impairments such as motivation and task comprehension, which can affect behavioral performance and obscure neural function during memory tasks. Neural signatures of memory encoding that are robust to potential confounds may shed additional light on neural deficits contributing to memory impairment in schizophrenia.

METHODS

Here, we investigate a potential neural signature of memory-habituation-and its relationship with healthy and impaired memory function. To limit potential confounds, we used a passive depth of encoding memory task designed to elicit neural responses associated with memory encoding while limiting other cognitive demands. To determine whether habituation during encoding was predictive of intact memory processing, we first compared neural habituation over repeated encoding exposures with subsequent explicit memory in healthy individuals. We then tested whether a similar relationship existed in patients with schizophrenia.

RESULTS

Explicit memory performance was impaired in patients with schizophrenia relative to healthy control subjects. In healthy participants, more habituation over repeated exposures during encoding was associated with greater repetition-related increases in accuracy during testing. However, in patients with schizophrenia, better performance was associated with less habituation, or a more sustained neural response during encoding.

CONCLUSIONS

These results suggest that sustained neural activity is required for normal repetition-related improvements in memory performance in schizophrenia, in line with a neural inefficiency model. Habituation may serve as a valuable index of neural processes that underlie behavioral memory performance.

Patterns of single-neuron activity during associative recognition memory in the human medial temporal lobe

Electrophysiological activity in medial temporal lobe (MTL) structures is pivotal for declarative long-term memory. Single-neuron and microcircuit findings capitalizing on human microwire recordings from the medial temporal lobe are still fragmentary. In particular, it is an open question whether identical or different groups of neurons participate in different memory functions. Here, we investigated category-specific responses in the human MTL based on single-neuron recordings in presurgical epilepsy patients performing an associative long-term memory task. Additionally, auditory beat stimuli were presented during encoding and retrieval to modulate memory performance. We describe the proportion of neurons in amygdala, entorhinal cortex, hippocampus and parahippocampal cortex belonging to different response classes. These entail neurons coding stimulus-familiarity, neurons coding successful item memory, and neurons coding associated source memory, as well as the overlap between these classes. As major results we demonstrate that neurons responding to stimulus familiarity (old/new effect) can be identified in the MTL even when using previously known rather than entirely novel stimulus material (words). We observed a significant overlap between familiarity-related neurons and neurons coding item retrieval (remembered/forgotten effect). The largest fraction of familiarity-related neurons was found in the parahippocampal cortex, and a considerable fraction of all parahippocampal neurons was related to successful item retrieval. Neurons related to successful source retrieval were different from the neurons coding the associated information. Most importantly, there was no overlap between neurons coding item memory and those coding associated source memory strongly suggesting that these functions are facilitated by different sets of neurons.

Microelectrode recordings in human epilepsy: a case for clinical translation

With their 'all-or-none' action potential responses, single neurons (or units) are accepted as the basic computational unit of the brain. There is extensive animal literature to support the mechanistic importance of studying neuronal firing as a way to understand neuronal microcircuits and brain function. Although most studies have emphasized physiology, there is increasing recognition that studying single units provides novel insight into system-level mechanisms of disease. Microelectrode recordings are becoming more common in humans, paralleling the increasing use of intracranial electroencephalography recordings in the context of presurgical evaluation in focal epilepsy. In addition to single-unit data, microelectrode recordings also record local field potentials and high-frequency oscillations, some of which may be different to that recorded by clinical macroelectrodes. However, microelectrodes are being used almost exclusively in research contexts and there are currently no indications for incorporating microelectrode recordings into routine clinical care. In this review, we summarize the lessons learnt from 65 years of microelectrode recordings in human epilepsy patients. We cover the electrode constructs that can be utilized, principles of how to record and process microelectrode data and insights into ictal dynamics, interictal dynamics and cognition. We end with a critique on the possibilities of incorporating single-unit recordings into clinical care, with a focus on potential clinical indications, each with their specific evidence base and challenges.

Neural Correlates of Voice Perception in Newborns and the Influence of Preterm Birth

Maternal voice is a highly relevant stimulus for newborns. Adult voice processing occurs in specific brain regions. Voice-specific brain areas in newborns and the relevance of an early vocal exposure on these networks have not been defined. This study investigates voice perception in newborns and the impact of prematurity on the cerebral processes. Functional magnetic resonance imaging (fMRI) and high-density electroencephalography (EEG) were used to explore the brain responses to maternal and stranger female voices in full-term newborns and preterm infants at term-equivalent age (TEA). fMRI results and the EEG oddball paradigm showed enhanced processing for voices in preterms at TEA than in full-term infants. Preterm infants showed additional cortical regions involved in voice processing in fMRI and a late mismatch response for maternal voice, considered as a first trace of a recognition process based on memory representation. Full-term newborns showed increased cerebral activity to the stranger voice. Results from fMRI, oddball, and standard auditory EEG paradigms highlighted important change detection responses to novelty after birth. These findings suggest that the main components of the adult voice-processing networks emerge early in development. Moreover, an early postnatal exposure to voices in premature infants might enhance their capacity to process voices.

Examining the Relationship between a Verbal Incidental Learning Measure from the WAIS-IV and Neuroimaging Biomarkers for Alzheimer's Pathology

Convergent validation of a verbal incidental learning (IL) task from the WAIS-IV using neuroimaging biomarkers is warranted to understand its sensitivity to Alzheimer's disease (AD) pathology. Fifty-five memory clinic patients aged 59 to 87 years received neuropsychological assessment, and measures of IL and quantitative brain imaging. Worse IL-Total Score and IL-Similarities performances were significantly associated with smaller hemispheric hippocampal volumes. IL measures were not significantly correlated with cerebral β-amyloid burden, though a trend was present and effect sizes were mild. These hippocampal volume results suggest that this IL task may be sensitive to AD pathology along the AD continuum.

A NWB-based dataset and processing pipeline of human single-neuron activity during a declarative memory task

A challenge for data sharing in systems neuroscience is the multitude of different data formats used. Neurodata Without Borders: Neurophysiology 2.0 (NWB:N) has emerged as a standardized data format for the storage of cellular-level data together with meta-data, stimulus information, and behavior. A key next step to facilitate NWB:N adoption is to provide easy to use processing pipelines to import/export data from/to NWB:N. Here, we present a NWB-formatted dataset of 1863 single neurons recorded from the medial temporal lobes of 59 human subjects undergoing intracranial monitoring while they performed a recognition memory task. We provide code to analyze and export/import stimuli, behavior, and electrophysiological recordings to/from NWB in both MATLAB and Python. The data files are NWB:N compliant, which affords interoperability between programming languages and operating systems. This combined data and code release is a case study for how to utilize NWB:N for human single-neuron recordings and enables easy re-use of this hard-to-obtain data for both teaching and research on the mechanisms of human memory.

Measurement(s)	medial temporal lobe • memory • amygdala • hippocampus
Technology Type(s)	single-unit recording
Factor Type(s)	confidence • remembered/forgotten • old/new • visual category • stimulus onset (visual)
Sample Characteristic - Organism	Homo sapiens

Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.11835801