Medial temporal lobe contributions to short-term memory for faces

Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition

Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.

Spatial Pattern Separation Testing Differentiates Alzheimer's Disease Biomarker-Positive and Biomarker-Negative Older Adults With Amnestic Mild Cognitive Impairment

Background: The hippocampus, entorhinal cortex (EC), and basal forebrain (BF) are among the earliest regions affected by Alzheimer’s disease (AD) pathology. They play an essential role in spatial pattern separation, a process critical for accurate discrimination between similar locations.

Objective: We examined differences in spatial pattern separation performance between older adults with amnestic mild cognitive impairment (aMCI) with AD versus those with non-Alzheimer’s pathologic change (non-AD) and interrelations between volumes of the hippocampal, EC subregions and BF nuclei projecting to these subregions (medial septal nuclei and vertical limb of the diagonal band of Broca – Ch1-2 nuclei) with respect to performance.

Methods: Hundred and eighteen older adults were recruited from the Czech Brain Aging Study. Participants with AD aMCI (n = 37), non-AD aMCI (n = 26), mild AD dementia (n = 26), and cognitively normal older adults (CN; n = 29) underwent spatial pattern separation testing, cognitive assessment and brain magnetic resonance imaging.

Results: The AD aMCI group had less accurate spatial pattern separation performance than the non-AD aMCI (p = 0.039) and CN (p < 0.001) groups. The AD aMCI and non-AD groups did not differ in other cognitive tests. Decreased BF Ch1-2 volume was indirectly associated with worse performance through reduced hippocampal tail volume and reduced posteromedial EC and hippocampal tail or body volumes operating in serial.

Conclusion: The study demonstrates that spatial pattern separation testing differentiates AD biomarker positive and negative older adults with aMCI and provides evidence that BF Ch1-2 nuclei influence spatial pattern separation through the posteromedial EC and the posterior hippocampus.

Functional Connectivity during Encoding Predicts Individual Differences in Long-Term Memory

What is the neural basis of individual differences in the ability to hold information in long-term memory (LTM)? Here, we first characterize two whole-brain functional connectivity networks based on fMRI data acquired during an n-back task that robustly predict individual differences in two important forms of LTM, recognition and recollection. We then focus on the recognition memory model and contrast it with a working memory model. Although functional connectivity during the n-back task also predicts working memory performance and the two networks have some shared components, they are also largely distinct from each other: The recognition memory model performance remains robust when we control for working memory, and vice versa. Functional connectivity only within regions traditionally associated with LTM formation, such as the medial temporal lobe and those that show univariate subsequent memory effect, have little predictive power for both forms of LTM. Interestingly, the interactions between these regions and other brain regions play a more substantial role in predicting recollection memory than recognition memory. These results demonstrate that individual differences in LTM are dependent on the configuration of a whole-brain functional network including but not limited to regions associated with LTM during encoding and that such a network is separable from what supports the retention of information in working memory.

Aging and binding in short-term memory: processes involved in conjunctive and relational binding

In visual short-term binding memory tasks, some studies suggested that aging disrupts relational binding more than conjunctive binding, whereas others report equivalent age-related differences in both types of binding. Yet, demands in controlled resources are potentially the greatest for relational short-term binding. In order to test the hypothesis that aging would affect preferentially tasks demanding in controlled processes, we assessed the contribution of controlled and automatic memory processes to relational and conjunctive short-term binding. Groups of young and older adults studied shape-colour (Exp.1 and 3) or object-colour (Exp.2) pairs in a relational condition in which items were linked to colour patches and a conjunctive condition where colour was integrated into the items. Memory for bindings was tested with a reconstruction task (Exp. 1 and 2) or with a recognition memory task (Exp. 3) under inclusion and exclusion instructions (Process Dissociation Procedure). The three experiments showed that the retrieval of both relational and conjunctive bindings relied primarily on controlled memory processes, the use of which was diminished in older participants. This study brings additional evidence that age-related differences in top-down control processes explain at least partly decreased short-term binding capacities.

Spatial Pattern Separation in Early Alzheimer's Disease

BACKGROUND

The hippocampus, entorhinal cortex, and basal forebrain are among the first brain structures affected by Alzheimer's disease (AD). They play an essential role in spatial pattern separation, a process critical for accurate encoding of similar spatial information.

OBJECTIVE

Our aim was to examine spatial pattern separation and its association with volumetric changes of the hippocampus, entorhinal cortex, and basal forebrain nuclei projecting to the hippocampus (the medial septal nuclei and vertical limb of the diagonal band of Broca - Ch1-2 nuclei) in the biomarker-defined early clinical stages of AD.

METHODS

A total of 98 older adults were recruited from the Czech Brain Aging Study cohort. The participants with amnestic mild cognitive impairment (aMCI) due to AD (n = 44), mild AD dementia (n = 31), and cognitively normal older adults (CN; n = 23) underwent spatial pattern separation testing, comprehensive cognitive assessment, and MRI brain volumetry.

RESULTS

Spatial pattern separation accuracy was lower in the early clinical stages of AD compared to the CN group (p < 0.001) and decreased with disease severity (CN > aMCI due to AD > AD dementia). Controlling for general memory and cognitive performance, demographic characteristics and psychological factors did not change the results. Hippocampal and Ch1-2 volumes were directly associated with spatial pattern separation performance while the entorhinal cortex operated on pattern separation indirectly through the hippocampus.

CONCLUSION

Smaller volumes of the hippocampus, entorhinal cortex, and basal forebrain Ch1-2 nuclei are linked to spatial pattern separation impairment in biomarker-defined early clinical AD and may contribute to AD-related spatial memory deficits.

Scale-invariant Characteristics of Forgetting: Toward a Unifying Account of Hippocampal Forgetting across Short and Long Timescales

After over 100 years of relative silence in the cognitive literature, recent advances in the study of the neural underpinnings of memory-specifically, the hippocampus-have led to a resurgence of interest in the topic of forgetting. This review draws a theoretically driven picture of the effects of time on forgetting of hippocampus-dependent memories. We review evidence indicating that time-dependent forgetting across short and long timescales is reflected in progressive degradation of hippocampal-dependent relational information. This evidence provides an important extension to a growing body of research accumulated in recent years, showing that-in contrast to the once prevailing view that the hippocampus is exclusively involved in memory and forgetting over long timescales-the role of the hippocampus also extends to memory and forgetting over short timescales. Thus, we maintain that similar rules govern not only remembering but also forgetting of hippocampus-dependent information over short and long timescales.

Neuropsychological Investigations of Human Amnesia: Insights Into the Role of the Medial Temporal Lobes in Cognition

The past 30 years of research on human amnesia has yielded important changes in our understanding of the role of the medial temporal lobes (MTL) in memory. On the one hand, this body of evidence has highlighted that not all types of memory are impaired in patients with MTL lesions. On the other hand, this research has made apparent that the role of the MTL extends beyond the domain of long-term memory, to include working memory, perception, and future thinking. In this article, we review the discoveries and controversies that have characterized this literature and that set the stage for a new conceptualization of the role of the MTL in cognition. This shift toward a more nuanced understanding of MTL function has direct relevance for a range of clinical disorders in which the MTL is implicated, potentially shaping not only theoretical understanding but also clinical practice. (JINS, 2017, 23, 732-740).

Distractor-resistant Short-Term Memory Is Supported by Transient Changes in Neural Stimulus Representations

Goal-directed behavior in a complex world requires the maintenance of goal-relevant information despite multiple sources of distraction. However, the brain mechanisms underlying distractor-resistant working or short-term memory (STM) are not fully understood. Although early single-unit recordings in monkeys and fMRI studies in humans pointed to an involvement of lateral prefrontal cortices, more recent studies highlighted the importance of posterior cortices for the active maintenance of visual information also in the presence of distraction. Here, we used a delayed match-to-sample task and multivariate searchlight analyses of fMRI data to investigate STM maintenance across three extended delay phases. Participants maintained two samples (either faces or houses) across an unfilled pre-distractor delay, a distractor-filled delay, and an unfilled post-distractor delay. STM contents (faces vs. houses) could be decoded above-chance in all three delay phases from occipital, temporal, and posterior parietal areas. Classifiers trained to distinguish face versus house maintenance successfully generalized from pre- to post-distractor delays and vice versa, but not to the distractor delay period. Furthermore, classifier performance in all delay phases was correlated with behavioral performance in house, but not face, trials. Our results demonstrate the involvement of distributed posterior, but not lateral prefrontal, cortices in active maintenance during and after distraction. They also show that the neural code underlying STM maintenance is transiently changed in the presence of distractors and reinstated after distraction. The correlation with behavior suggests that active STM maintenance is particularly relevant in house trials, whereas face trials might rely more strongly on contributions from long-term memory.

Short-Term Memory Depends on Dissociable Medial Temporal Lobe Regions in Amnestic Mild Cognitive Impairment

Short-term memory (STM) has generally been thought to be independent of the medial temporal lobe (MTL) in contrast to long-term memory (LTM). Prodromal Alzheimer's disease (AD) is a condition in which the MTL is a major early focus of pathology and LTM is thought disproportionately affected relative to STM. However, recent studies have suggested a role for the MTL in STM, particularly hippocampus, when binding of different elements is required. Other work has suggested involvement of extrahippocampal MTL structures, particularly in STM tasks that involve item-level memory. We examined STM for individual objects, locations, and object-location conjunctions in amnestic mild cognitive impairment (MCI), often associated with prodromal AD. Relative to age-matched, cognitively normal controls, MCI patients not only displayed impairment on object-location conjunctions but were similarly impaired for non-bound objects and locations. Moreover, across all participants, these conditions displayed dissociable correlations of cortical thinning along the long axis of the MTL and associated cortical nodes of anterior and posterior MTL networks. These findings support the role of the MTL in visual STM tasks and the division of labor of MTL in support of different types of memory representations, overlapping with findings in LTM.

The role of relational binding in item memory: evidence from face recognition in a case of developmental amnesia

Current theories state that the hippocampus is responsible for the formation of memory representations regarding relations, whereas extrahippocampal cortical regions support representations for single items. However, findings of impaired item memory in hippocampal amnesics suggest a more nuanced role for the hippocampus in item memory. The hippocampus may be necessary when the item elements need to be bound within and across episodes to form a lasting representation that can be used flexibly. The current investigation was designed to test this hypothesis in face recognition. H.C., an individual who developed with a compromised hippocampal system, and control participants incidentally studied individual faces that either varied in presentation viewpoint across study repetitions or remained in a fixed viewpoint across the study repetitions. Eye movements were recorded during encoding and participants then completed a surprise recognition memory test. H.C. demonstrated altered face viewing during encoding. Although the overall number of fixations made by H.C. was not significantly different from that of controls, the distribution of her viewing was primarily directed to the eye region. Critically, H.C. was significantly impaired in her ability to subsequently recognize faces studied from variable viewpoints, but demonstrated spared performance in recognizing faces she encoded from a fixed viewpoint, implicating a relationship between eye movement behavior in the service of a hippocampal binding function. These findings suggest that a compromised hippocampal system disrupts the ability to bind item features within and across study repetitions, ultimately disrupting recognition when it requires access to flexible relational representations.

Hippocampal subfield and medial temporal cortical persistent activity during working memory reflects ongoing encoding

Previous neuroimaging studies support a role for the medial temporal lobes in maintaining novel stimuli over brief working memory (WM) delays, and suggest delay period activity predicts subsequent memory. Additionally, slice recording studies have demonstrated neuronal persistent spiking in entorhinal cortex, perirhinal cortex (PrC), and hippocampus (CA1, CA3, subiculum). These data have led to computational models that suggest persistent spiking in parahippocampal regions could sustain neuronal representations of sensory information over many seconds. This mechanism may support both WM maintenance and encoding of information into long term episodic memory. The goal of the current study was to use high-resolution fMRI to elucidate the contributions of the MTL cortices and hippocampal subfields to WM maintenance as it relates to later episodic recognition memory. We scanned participants while they performed a delayed match to sample task with novel scene stimuli, and assessed their memory for these scenes post-scan. We hypothesized stimulus-driven activation that persists into the delay period-a putative correlate of persistent spiking-would predict later recognition memory. Our results suggest sample and delay period activation in the parahippocampal cortex (PHC), PrC, and subiculum (extending into DG/CA3 and CA1) was linearly related to increases in subsequent memory strength. These data extend previous neuroimaging studies that have constrained their analysis to either the sample or delay period by modeling these together as one continuous ongoing encoding process, and support computational frameworks that predict persistent activity underlies both WM and episodic encoding.

Memory integration in amnesia: prior knowledge supports verbal short-term memory

Short-term memory (STM) and long-term memory (LTM) have traditionally been considered cognitively distinct. However, it is known that STM can improve when to-be-remembered information appears in contexts that make contact with prior knowledge, suggesting a more interactive relationship between STM and LTM. The current study investigated whether the ability to leverage LTM in support of STM critically depends on the integrity of the hippocampus. Specifically, we investigated whether the hippocampus differentially supports between-domain versus within-domain STM-LTM integration given prior evidence that the representational domain of the elements being integrated in memory is a critical determinant of whether memory performance depends on the hippocampus. In Experiment 1, we investigated hippocampal contributions to within-domain STM-LTM integration by testing whether immediate verbal recall of words improves in MTL amnesic patients when words are presented in familiar verbal contexts (meaningful sentences) compared to unfamiliar verbal contexts (random word lists). Patients demonstrated a robust sentence superiority effect, whereby verbal STM performance improved in familiar compared to unfamiliar verbal contexts, and the magnitude of this effect did not differ from that in controls. In Experiment 2, we investigated hippocampal contributions to between-domain STM-LTM integration by testing whether immediate verbal recall of digits improves in MTL amnesic patients when digits are presented in a familiar visuospatial context (a typical keypad layout) compared to an unfamiliar visuospatial context (a random keypad layout). Immediate verbal recall improved in both patients and controls when digits were presented in the familiar compared to the unfamiliar keypad array, indicating a preserved ability to integrate activated verbal information with stored visuospatial knowledge. Together, these results demonstrate that immediate verbal recall in amnesia can benefit from two distinct types of semantic support, verbal and visuospatial, and that the hippocampus is not critical for leveraging stored semantic knowledge to improve memory performance.

Sharing mental simulations and stories: hippocampal contributions to discourse integration

Accumulating evidence suggests that mental simulation of the future and past relies on common processes supported by the hippocampus. However, it is currently unknown whether the hippocampus also supports the ability to share these mental simulations with others. Recently, it has been proposed that language and language-related structures in the brain are particularly important for communicating information not tied to the immediate environment, and indeed specifically evolved so that humans could share their mental time travels into the future and the past with others. The current study investigated whether processes supported by the hippocampus are necessary for effectively communicating the contents of one's mental simulations by examining the discourse of amnesic patients with medial temporal lobe damage. In Experiment 1 we tested whether patients can produce integrated discourse about future and past events by measuring lower-level discourse cohesion and higher-level discourse coherence. Striking reductions in both measures were observed in amnesic patients' narratives about novel future events and experienced past events. To investigate whether these deficits simply reflected concurrent reductions in narrative content, in Experiment 2 we examined the status of discourse integration in patients' verbal narratives about pictures, which contained an equivalent amount of narrative content as controls'. Discourse cohesion and coherence deficits were also present when patients generated narratives based on pictures, and these deficits did not depend on the presence of neural damage outside the hippocampus. Together, these results reveal a pervasive linguistic integration deficit in amnesia that is not limited to discourse about the past or the future and is not simply secondary to reductions in narrative content. More broadly, this study demonstrates that the hippocampus supports the integration of individual narrative elements into coherent and cohesive discourse when constructing complex verbal accounts, and plays a critical role in the effective communication of information to others.

The human hippocampus beyond the cognitive map: evidence from a densely amnesic patient

We tested a densely amnesic patient (P9), with bilateral hippocampal damage resulting from an autoimmune disorder, and 12 age- and sex-matched controls on a series of memory tasks designed to characterize allocentric spatial learning and memory abilities. We compared P9's ability to perform spatial memory tasks with her ability to perform non-spatial, color memory tasks. First, P9's performance was impaired as compared to controls even in the simplest versions of an allocentric spatial memory task, in which she had to find repeatedly over 10 trials the same location(s) of one, two or three illuminating foot pad(s) among 23 pads distributed in an open-field arena. In contrast, she performed as well as controls when she had to find repeatedly over 10 trials the same one, two or three pad(s) marked by color cue(s), whose locations varied between trials. Second, P9's performance was severely impaired in working memory tasks, when she had to learn on a trial-unique basis and remember the location(s) or the color(s) of one, two or three pad(s), while performing an interfering task during the 1-min interval separating encoding and retrieval. Without interference during the retention interval of the trial-unique tasks, P9's performance was partially preserved in the color tasks, whereas it remained severely impaired in the allocentric spatial tasks. Detailed behavioral analyses indicate that P9's memory representations are more limited than those of controls both in their precision (metric coding) and in the number of items that can be maintained in memory (capacity). These findings are consistent with the theory that the hippocampus contributes to the integration or binding of multiple items, in order to produce high-resolution/high-capacity representations of spatial and non-spatial information in the service of short-term/working and long-term memory.

Mechanisms for widespread hippocampal involvement in cognition

The quintessential memory system in the human brain--the hippocampus and surrounding medial temporal lobe--is often treated as a module for the formation of conscious, or declarative, memories. However, growing evidence suggests that the hippocampus plays a broader role in memory and cognition and that theories organizing memory into strictly dedicated systems may need to be updated. We first consider the historical evidence for the specialized role of the hippocampus in declarative memory. Then, we describe the serendipitous encounter that motivated the special section in this issue, based on parallel research from our labs that suggested a more pervasive contribution of the hippocampus to cognition beyond declarative memory. Finally, we develop a theoretical framework that describes 2 general mechanisms for how the hippocampus interacts with other brain systems and cognitive processes: the memory modulation hypothesis, in which mnemonic representations in the hippocampus modulate the operation of other systems, and the adaptive function hypothesis, in which specialized computations in the hippocampus are recruited as a component of both mnemonic and nonmnemonic functions. This framework is consistent with an emerging view that the most fertile ground for discovery in cognitive psychology and neuroscience lies at the interface between parts of the mind and brain that have traditionally been studied in isolation.

Short-term retention of relational memory in amnesia revisited: accurate performance depends on hippocampal integrity

Traditionally, it has been proposed that the hippocampus and adjacent medial temporal lobe cortical structures are selectively critical for long-term declarative memory, which entails memory for inter-item and item-context relationships. Whether the hippocampus might also contribute to short-term retention of relational memory representations has remained controversial. In two experiments, we revisit this question by testing memory for relationships among items embedded in scenes using a standard working memory trial structure in which a sample stimulus is followed by a brief delay and the corresponding test stimulus. In each experimental block, eight trials using different exemplars of the same scene were presented. The exemplars contained the same items but with different spatial relationships among them. By repeating the pictures across trials, any potential contributions of item or scene memory to performance were minimized, and relational memory could be assessed more directly than has been done previously. When test displays were presented, participants indicated whether any of the item-location relationships had changed. Then, regardless of their responses (and whether any item did change its location), participants indicated on a forced-choice test, which item might have moved, guessing if necessary. Amnesic patients were impaired on the change detection test, and were frequently unable to specify the change after having reported correctly that a change had taken place. Comparison participants, by contrast, frequently identified the change even when they failed to report the mismatch, an outcome that speaks to the sensitivity of the change specification measure. These results confirm past reports of hippocampal contributions to short-term retention of relational memory representations, and suggest that the role of the hippocampus in memory has more to do with relational memory requirements than the length of a retention interval.

Working memory retrieval differences between medial temporal lobe epilepsy patients and controls: a three memory layer approach

Multi-store models of working memory (WM) have given way to more dynamic approaches that conceive WM as an activated subset of long-term memory (LTM). The resulting framework considers that memory representations are governed by a hierarchy of accessibility. The activated part of LTM holds representations in a heightened state of activation, some of which can reach a state of immediate accessibility according to task demands. Recent neuroimaging studies have studied the neural basis of retrieval information with different states of accessibility. It was found that the medial temporal lobe (MTL) was involved in retrieving information within immediate access store and outside this privileged zone. In the current study we further explored the contribution of MTL to WM retrieval by analyzing the consequences of MTL damage to this process considering the state of accessibility of memory representations. The performance of a group of epilepsy patients with left hippocampal sclerosis in a 12-item recognition task was compared with that of a healthy control group. We adopted an embedded model of WM that distinguishes three components: the activated LTM, the region of direct access, and a single-item focus of attention. Groups did not differ when retrieving information from single-item focus, but patients were less accurate retrieving information outside focal attention, either items from LTM or items expected to be in the WM range. Analyses focused on items held in the direct access buffer showed that consequences of MTL damage were modulated by the level of accessibility of memory representations, producing a reduced capacity.