A unified framework for the functional organization of the medial temporal lobes and the phenomenology of episodic memory

Neural correlates of short-term memory reorganization in humans with hippocampal damage

Some patients with disorders affecting the hippocampus have relatively intact memory, but the mechanisms underlying this preservation of function are still debated. In particular, it is unclear whether preserved memory is attributable to significant residual function of unaffected hippocampus or to functional brain reorganization. Here, we investigated brain activation during an associative short-term memory task in two human patient groups matched for extent of postsurgical damage to the right hippocampal formation that differed in two key features, memory performance and preoperative disease course. Patients showed strikingly distinct activation patterns that correlated differentially with behavioral performance, strongly suggesting that intact associative short-term memory with hippocampal dysfunction is indeed related to compensatory brain reorganization. This process appears to depend both on activation of the contralesional hippocampus and on increased engagement of a distributed short-term memory network in neocortex. These data clarify the existence of an efficient hippocampal-neocortical mechanism that compensates for hippocampal dysfunction.

A critical role for the hippocampus and perirhinal cortex in perceptual learning of scenes and faces: complementary findings from amnesia and FMRI

It is debated whether subregions within the medial temporal lobe (MTL), in particular the hippocampus (HC) and perirhinal cortex (PrC), play domain-sensitive roles in learning. In the present study, two patients with differing degrees of MTL damage were first exposed to pairs of highly similar scenes, faces, and dot patterns and then asked to make repeated same/different decisions to preexposed and nonexposed (novel) pairs from the three categories (Experiment 1). We measured whether patients would show a benefit of prior exposure (preexposed > nonexposed) and whether repetition of nonexposed (and preexposed) pairs at test would benefit discrimination accuracy. Although selective HC damage impaired learning of scenes, but not faces and dot patterns, broader MTL damage involving the HC and PrC compromised discrimination learning of scenes and faces but left dot pattern learning unaffected. In Experiment 2, a similar task was run in healthy young participants in the MRI scanner. Functional region-of-interest analyses revealed that posterior HC and posterior parahippocampal gyrus showed greater activity during scene pattern learning, but not face and dot pattern learning, whereas PrC, anterior HC, and posterior fusiform gyrus were recruited during discrimination learning for faces, but not scenes and dot pattern learning. Critically, activity in posterior HC and PrC, but not the other functional region-of-interest analyses, was modulated by accuracy (correct > incorrect within a preferred category). Therefore, both approaches revealed a key role for the HC and PrC in discrimination learning, which is consistent with representational accounts in which subregions in these MTL structures store complex spatial and object representations, respectively.

Hippocampal contributions to language: evidence of referential processing deficits in amnesia

A growing body of work suggests the hippocampus contributes to a variety of cognitive domains beyond its traditional role in memory. We propose that the hippocampus, in its capacity for relational binding, representational flexibility, and online maintenance and integration of multimodal relational representations, is a key contributor to language processing. Here we test the hypothesis that the online interpretation of pronouns is hippocampus-dependent. We combined eye tracking with neuropsychological methods, where participants (4 patients with bilateral hippocampal damage and severe declarative memory impairment, 4 patients with ventromedial prefrontal cortex [vmPFC] damage, and healthy comparison participants) viewed a scene while listening to short dialogues introducing 2 characters; for example, Melissa is playing violin for Debbie/Danny as the sun is shining overhead. She is wearing a blue/purple dress. Consistent with previous work, analysis of eye gaze showed that younger and older healthy comparison participants and the vmPFC patients rapidly identified the intended referent of the pronoun when gender uniquely identified the referent, and when it did not, they showed a preference to interpret the pronoun as referring to the first-mentioned character. By contrast, hippocampal patients, while exhibiting a similar gender effect, exhibited significant disruptions in their ability to use information about which character had been mentioned first to interpret the pronoun. This finding suggests that the hippocampus plays a role in maintaining and integrating information even over a very short discourse history. These observed disruptions in referential processing demonstrate how promiscuously the hallmark processing features of the hippocampus are used in service of a variety of cognitive domains including language.

Hippocampal negative event-related potential recorded in humans during a simple sensorimotor task occurs independently of motor execution

A hippocampal-prominent event-related potential (ERP) with a peak latency at around 450 ms is consistently observed as a correlate of hippocampal activity during various cognitive tasks. Some intracranial EEG studies demonstrated that the amplitude of this hippocampal potential was greater in response to stimuli requiring an overt motor response, in comparison with stimuli for which no motor response is required. These findings could indicate that hippocampal-evoked activity is related to movement execution as well as stimulus evaluation and associated memory processes. The aim of the present study was to investigate the temporal relationship between the hippocampal negative potential latency and motor responses. We analyzed ERPs recorded with 22 depth electrodes implanted into the hippocampi of 11 epileptic patients. Subjects were instructed to press a button after the presentation of a tone. All investigated hippocampi generated a prominent negative ERP peaking at ~420 ms. In 16 from 22 cases, we found that the ERP latency did not correlate with the reaction time; in different subjects, this potential could either precede or follow the motor response. Our results indicate that the hippocampal negative ERP occurs independently of motor execution. We suggest that hippocampal-evoked activity, recorded in a simple sensorimotor task, is related to the evaluation of stimulus meaning within the context of situation.

Re-imagining the future: repetition decreases hippocampal involvement in future simulation

Imagining or simulating future events has been shown to activate the anterior right hippocampus (RHC) more than remembering past events does. One fundamental difference between simulation and memory is that imagining future scenarios requires a more extensive constructive process than remembering past experiences does. Indeed, studies in which this constructive element is reduced or eliminated by “pre-imagining” events in a prior session do not report differential RHC activity during simulation. In this fMRI study, we examined the effects of repeatedly simulating an event on neural activity. During scanning, participants imagined 60 future events; each event was simulated three times. Activation in the RHC showed a significant linear decrease across repetitions, as did other neural regions typically associated with simulation. Importantly, such decreases in activation could not be explained by non-specific linear time-dependent effects, with no reductions in activity evident for the control task across similar time intervals. Moreover, the anterior RHC exhibited significant functional connectivity with the whole-brain network during the first, but not second and third simulations of future events. There was also evidence of a linear increase in activity across repetitions in right ventral precuneus, right posterior cingulate and left anterior prefrontal cortex, which may reflect source recognition and retrieval of internally generated contextual details. Overall, our findings demonstrate that repeatedly imagining future events has a decremental effect on activation of the hippocampus and many other regions engaged by the initial construction of the simulation, possibly reflecting the decreasing novelty of simulations across repetitions, and therefore is an important consideration in the design of future studies examining simulation.

The hippocampus: a manifesto for change

We currently lack a unified and mechanistic account of how the hippocampus supports a range of disparate cognitive functions that includes episodic memory, imagining the future, and spatial navigation. Here, we argue that in order to leverage this long-standing issue, traditional notions regarding the architecture of memory should be eschewed. Instead, we invoke the idea that scenes are central to hippocampal information processing. This view is motivated by mounting evidence that the hippocampus is constantly constructing spatially coherent scenes, automatically anticipating and synthesizing representations of the world beyond the immediate sensorium. By characterizing the precise relationship between scenes and the hippocampus, we believe a theoretically enriched understanding of its fundamental role and its breakdown in pathology can emerge.

Longitudinal investigation of source memory reveals different developmental trajectories for item memory and binding

The present study used a cohort-sequential design to examine developmental changes in children's ability to bind items in memory during early and middle childhood. Three cohorts of children (aged 4, 6, or 8 years) were followed longitudinally for 3 years. Each year, children completed a source memory paradigm assessing memory for items and binding. Results suggest linear increases in memory for individual items (facts or sources) between 4 and 10 years of age but that memory for correct fact/source combinations (indicative of binding) showed accelerated rates of change between 5 and 7 years. Taken together, these results suggest differences exist in developmental trajectories between the development of memory processes underlying successful item memory and processes underlying binding. Implications of these findings are discussed in relation to longitudinal research examining autobiographical memory.

Memory, Imagination, and Predicting the Future: A Common Brain Mechanism?

On the face of it, memory, imagination, and prediction seem to be distinct cognitive functions. However, metacognitive, cognitive, neuropsychological, and neuroimaging evidence is emerging that they are not, suggesting intimate links in their underlying processes. Here, we explore these empirical findings and the evolving theoretical frameworks that seek to explain how a common neural system supports our recollection of times past, imagination, and our attempts to predict the future.

Computational models of perirhinal cortex function

I review seven models of the contribution of perirhinal cortex (PRC) or neighboring neocortical regions to cognition. Five of the models address recognition memory function (Sohal and Hasselmo (2000) Network 11:169-190; Bogacz et al. (2001) J Comput Neurosci 10:5-23; Bogacz and Brown (2003a) Neurocomputing 52:1-6; Norman and O'Reilly (2003) Psychol Rev 110:611-646; Cowell et al. (2006) J Neurosci 26:12186-12197) and two account for the role of PRC in visual discrimination learning (Bussey and Saksida (2002) Eur J Neurosci 15:355-364; Cowell et al. (2010b) J Cogn Neurosci 22:2460-2479). The models span a range of biological scales and target a variety of datasets, such that like for like comparison between them is not always possible. I lay out a novel framework for facilitating comparison by defining some general abstract principles concerning the organization of cognition in the brain about which all of the models make a statement. The controversies that are revealed by scrutinizing the models within this framework highlight the fundamental questions that remain to be answered by future research. Ultimately, it is by combining these disparate accounts to build a unified model that bridges several levels of biological scale and accounts for multiple psychological phenomena that a full account of PRC function will be achieved.

Human intracranial high-frequency activity maps episodic memory formation in space and time

Noninvasive neuroimaging studies have revealed a network of brain regions that activate during human memory encoding; however, the relative timing of such activations remains unknown. Here we used intracranially recorded high-frequency activity (HFA) to first identify regions that activate during successful encoding. Then, we leveraged the high-temporal precision of HFA to investigate the timing of such activations. We found that memory encoding invokes two spatiotemporally distinct activations: early increases in HFA that involve the ventral visual pathway as well as the medial temporal lobe and late increases in HFA that involve the left inferior frontal gyrus, left posterior parietal cortex, and left ventrolateral temporal cortex. We speculate that these activations reflect higher-order visual processing and top-down modulation of attention/semantic information, respectively.

How brain oscillations form memories--a processing based perspective on oscillatory subsequent memory effects

Brain oscillations are increasingly recognized by memory researchers as a useful tool to unravel the neural mechanisms underlying the formation of a memory trace. However, the increasing numbers of published studies paint a rather complex picture of the relation between brain oscillations and memory formation. Concerning oscillatory amplitude, for instance, increases as well as decreases in various frequency bands (theta, alpha, beta and gamma) were associated with memory formation. These results cast doubt on frameworks putting forward the idea of an oscillatory signature that is uniquely related to memory formation. In an attempt to clarify this issue we here provide an alternative perspective, derived from classic cognitive frameworks/principles of memory. On the basis of Craik's levels of processing framework and Tulving's encoding specificity principle we hypothesize that brain oscillations during encoding might primarily reflect the perceptual and cognitive processes engaged by the encoding task. These processes may then lead to later successful retrieval depending on their overlap with the processes engaged by the memory test. As a consequence, brain oscillatory correlates of memory formation could vary dramatically depending on how the memory is encoded, and on how it is being tested later. Focusing on oscillatory amplitude changes and on theta-to-gamma cross-frequency coupling, we here review recent evidence showing how brain oscillatory subsequent memory effects can be modulated, and sometimes even be reversed, by varying encoding tasks, and the contextual overlap between encoding and retrieval.

Dissociable neural correlates of item and context retrieval in the medial temporal lobes

Although it is generally accepted that the medial temporal lobe (MTL) is critical for episodic memory, the contributions of cortical regions in the MTL, such as the perirhinal (PRc) and parahippocampal (PHc) cortices, remain unresolved. Recent studies have asserted that the PRc supports the processing of object and face information, whereas the PHc supports the processing of scene information. These findings have been used to characterize the PRc and PHc as being important for the memory of objects and scenes, respectively. However, these results are also consistent with the idea that these MTL regions are critical for the memory of stimuli that are processed as either items or contexts. It has been difficult to differentiate between these two accounts given that in most studies, item and context are operationalized as different types of memoranda (e.g., memory for objects compared to memory for background scenes). Here, we tested the extent to which different MTL regions are involved in the retrieval of item or context information when the material type is held constant. Participants encoded pairs of fractal images and were oriented to encode one fractal as an item and the other as a context. At test, they were cued with previously studied item or context fractals and asked to retrieve the corresponding associate. Results indicated that on test trials, PRc activity was increased during recall of fractals that were encoded as items, whereas PHc activity was greater during recall of fractals that were encoded as contexts. These results provide direct evidence that, even when stimulus type is held constant, the PRc and PHc are preferentially involved in supporting memory for item and context information, respectively.

The perirhinal cortex and recognition memory interference

There has recently been an increase in interest in the effects of visual interference on memory processing, with the aim of elucidating the role of the perirhinal cortex (PRC) in recognition memory. One view argues that the PRC processes highly complex conjunctions of object features, and recent evidence from rodents suggests that these representations may be vital for buffering against the effects of pre-retrieval interference on object recognition memory. To investigate whether PRC-dependent object representations play a similar role in humans, we used functional magnetic resonance imaging to scan neurologically healthy participants while they performed a novel interference-match-to-sample task. This paradigm was specifically designed to concurrently assess the impact of object versus spatial interference, on recognition memory for objects or scenes, while keeping constant the amount of object and scene information presented across all trials. Activity at retrieval was examined, within an anatomically defined PRC region of interest, according to the demand for object or scene memory, following a period of object compared with spatial interference. Critically, we found greater PRC activity for object memory following object interference, compared with object memory following scene interference, and no difference between object and scene interference for scene recognition. These data demonstrate a role for the human PRC during object recognition memory, following a period of object, but not scene interference, and emphasize the importance of representational content to mnemonic processing.

Perspectives on episodic-like and episodic memory

Episodic memory refers to the conscious recollection of a personal experience that contains information on what has happened and also where and when it happened. Recollection from episodic memory also implies a kind of first-person subjectivity that has been termed autonoetic consciousness. Episodic memory is extremely sensitive to cerebral aging and neurodegenerative diseases. In Alzheimer’s disease deficits in episodic memory function are among the first cognitive symptoms observed. Furthermore, impaired episodic memory function is also observed in a variety of other neuropsychiatric diseases including dissociative disorders, schizophrenia, and Parkinson disease. Unfortunately, it is quite difficult to induce and measure episodic memories in the laboratory and it is even more difficult to measure it in clinical populations. Presently, the tests used to assess episodic memory function do not comply with even down-sized definitions of episodic-like memory as a memory for what happened, where, and when. They also require sophisticated verbal competences and are difficult to apply to patient populations. In this review, we will summarize the progress made in defining behavioral criteria of episodic-like memory in animals (and humans) as well as the perspectives in developing novel tests of human episodic memory which can also account for phenomenological aspects of episodic memory such as autonoetic awareness. We will also define basic behavioral, procedural, and phenomenological criteria which might be helpful for the development of a valid and reliable clinical test of human episodic memory.

Effects of early thyroid hormone deficiency on children's autobiographical memory performance

Memory deficits and hippocampal abnormalities have been described in individuals with thyroid hormone (TH) insufficiencies; however, no study has yet examined their autobiographical memory (AM) abilities, which are known to be compromised by hippocampal damage. Investigations in adults have shown that AM consists of both episodic and semantic components and that the hippocampus is preferentially involved in episodic AM. The present study used the Children's Autobiographical Interview (CAI) to study episodic and semantic AM in 79 children aged 9 to 14 years, including 26 with early-treated congenital hypothyroidism (CH), 23 born to women with inadequately treated hypothyroidism during pregnancy (HYPO), and 30 typically developing controls. Results showed that relative to controls, CH and HYPO groups both exhibited weaknesses in episodic AM, but not semantic AM. In particular, CH and HYPO groups showed difficulty in recalling event details (i.e., the main happenings) and visual details from past experiences. Overall, this study highlights the importance of TH for early neurodevelopment and provides critical new insight into the effects of early treated TH deficiency on long-term memory performance. Furthermore, the present study indicates that the CAI is an effective tool for investigating episodic AM impairment in clinical pediatric populations.

Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning.

Familiarity-based memory as an early cognitive marker of preclinical and prodromal AD

There is great interest in the development of cognitive markers that differentiate "normal" age-associated cognitive change from that of Alzheimer's disease (AD) in its prodromal (i.e., mild cognitive impairment; MCI) or even preclinical stages. Dual process models posit that recognition memory is supported by the dissociable processes of recollection and familiarity. Familiarity-based memory has generally been considered to be spared during normal aging, but it remains controversial whether this type of memory is impaired in early AD. Here, we describe findings of estimates of recollection and familiarity in young adults (YA), cognitively normal older adults (CN), and patients with amnestic-MCI (a-MCI). These measures in the CN and a-MCI patients were then related to a structural imaging biomarker of AD that has previously been demonstrated to be sensitive to preclinical and prodromal AD, the Cortical Signature of AD (ADsig). Consistent with much work in the literature, recollection, but not familiarity, was impaired in CN versus YA. Replicating our prior findings, a-MCI patients displayed impairment in both familiarity and recollection. Finally, the familiarity measure was correlated with the ADsig biomarker across the CN and a-MCI group, as well as within the CN adults alone. No other standard psychometric measure was as highly associated with the ADsig, suggesting that familiarity may be a sensitive biomarker of AD-specific brain changes in preclinical and prodromal AD and that it may offer a qualitatively distinct measure of early AD memory impairment relative to normal age-associated change.

Metaphorical motion in mathematical reasoning: further evidence for pre-motor implementation of structure mapping in abstract domains

The theory of computation and category theory both employ arrow-based notations that suggest that the basic metaphor "state changes are like motions" plays a fundamental role in all mathematical reasoning involving formal manipulations. If this is correct, structure-mapping inferences implemented by the pre-motor action planning system can be expected to be involved in solving any mathematics problems not solvable by table lookups and number line manipulations alone. Available functional imaging studies of multi-digit arithmetic, algebra, geometry and calculus problem solving are consistent with this expectation.

The parahippocampal gyrus links the default-mode cortical network with the medial temporal lobe memory system

The default-mode network (DMN) is a distributed functional-anatomic network implicated in supporting memory. Current resting-state functional connectivity studies in humans remain divided on the exact involvement of medial temporal lobe (MTL) in this network at rest. Notably, it is unclear to what extent the MTL regions involved in successful memory encoding are connected to the cortical nodes of the DMN during resting state. Our findings using functional connectivity MRI analyses of resting-state data indicate that the parahippocampal gyrus (PHG) is the primary hub of the DMN in the MTL during resting state. Also, connectivity of the PHG is distinct from connectivity of hippocampal regions identified by an associative memory-encoding task. We confirmed that several hippocampal encoding regions lack significant functional connectivity with cortical DMN nodes during resting state. Additionally, a mediation analysis showed that resting-state connectivity between the hippocampus and posterior cingulate cortex--a major hub of the DMN--is indirect and mediated by the PHG. Our findings support the hypothesis that the MTL memory system represents a functional subnetwork that relates to the cortical nodes of the DMN through parahippocampal functional connections.

An association between human hippocampal volume and topographical memory in healthy young adults

The association between human hippocampal structure and topographical memory was investigated in healthy adults (N = 30). Structural MR images were acquired, and voxel-based morphometry (VBM) was used to estimate local gray matter volume throughout the brain. A complementary automated mesh-based segmentation approach was used to independently isolate and measure specified structures including the hippocampus. Topographical memory was assessed using a version of the Four Mountains Task, a short test designed to target hippocampal spatial function. Each item requires subjects to briefly study a landscape scene before recognizing the depicted place from a novel viewpoint and under altered non-spatial conditions when presented amongst similar alternative scenes. Positive correlations between topographical memory performance and hippocampal volume were observed in both VBM and segmentation-based analyses. Score on the topographical memory task was also correlated with the volume of some subcortical structures, extra-hippocampal gray matter, and total brain volume, with the most robust and extensive covariation seen in circumscribed neocortical regions in the insula and anterior temporal lobes. Taken together with earlier findings, the results suggest that global variations in brain morphology affect the volume of the hippocampus and its specific contribution to topographical memory. We speculate that behavioral variation might arise directly through the impact of resource constraints on spatial representations in the hippocampal formation and its inputs, and perhaps indirectly through an increased reliance on non-allocentric strategies.

Item familiarity and controlled associative retrieval in Alzheimer's disease: an fMRI study

Typical Alzheimer's disease (AD) is characterized by an impaired form of associative memory, recollection, that includes the controlled retrieval of associations. In contrast, familiarity-based memory for individual items may sometimes be preserved in the early stages of the disease. This is the first study that directly examines whole-brain regional activity during one core aspect of the recollection function: associative controlled episodic retrieval (CER), contrasted to item familiarity in AD patients. Cerebral activity related to associative CER and item familiarity in AD patients and healthy controls (HCs) was measured with functional magnetic resonance imaging during a word-pair recognition task to which the process dissociation procedure was applied. Some patients had null CER estimates (AD-), whereas others did show some CER abilities (AD+), although significantly less than HC. In contrast, familiarity estimates were equivalent in the three groups. In AD+, as in controls, associative CER activated the inferior precuneus/posterior cingulate cortex (PCC). When performing group comparisons, no region was found to be significantly more activated during CER in HC than AD+ and vice versa. However, during associative CER, functional connectivity between this region and the hippocampus, the inferior parietal and dorsolateral prefrontal cortex (DLPFC) was significantly higher in HC than in AD+. In all three groups, item familiarity was related to activation along the intraparietal sulcus (IPS). In conclusion, whereas the preserved automatic detection of an old item (without retrieval of accurate word association) is related to parietal activation centred on the IPS, the inferior precuneus/PCC supports associative CER ability in AD patients, as in HC. However, AD patients have deficient functional connectivity during associative CER, suggesting that the residual recollection function in these patients might be impoverished by the lack of some recollection-related aspects such as autonoetic quality, episodic details and verification.

Association of KIBRA with episodic and working memory: a meta-analysis

WWC1 was first implicated in human cognition through a genome wide association study in 2006 that reported an association of the intronic single nucleotide polymorphism (SNP) rs17070145 with episodic memory performance. WWC1 encodes the protein KIBRA, which is almost ubiquitously expressed. Together with its binding partners, KIBRA is assumed to play a role in synaptic plasticity. T-allele carriers of SNP rs17070145 have been reported to outperform individuals that are homozygous for the C-allele in episodic memory tasks. Here we report two random effects meta-analyses testing the association of rs17070145 with episodic and working memory. All currently available population-based association studies that investigated effects of rs17070145 on episodic or working memory were included in the analyses. Where performance measures for multiple domain-specific tasks were available for a given study population, averaged effect size estimates were calculated. The performed meta-analyses relied on 17 samples that were tested for episodic memory performance (N = 8,909) and 9 samples that had performed working memory tasks (N = 4,696). We report a significant association of rs17070145 with both episodic (r = 0.068, P = 0.001) and working memory (r = 0.035, P = 0.018). In summary, our findings indicate that SNP rs17070145 located within KIBRA explains 0.5% of the variance for episodic memory tasks and 0.1% of the variance for working memory tasks in samples of primarily Caucasian background.

Neural changes underlying the development of episodic memory during middle childhood

Episodic memory is central to the human experience. In typically developing children, episodic memory improves rapidly during middle childhood. While the developmental cognitive neuroscience of episodic memory remains largely uncharted, recent research has begun to provide important insights. It has long been assumed that hippocampus-dependent binding mechanisms are in place by early childhood, and that improvements in episodic memory observed during middle childhood result from the protracted development of the prefrontal cortex. We revisit the notion that binding mechanisms are age-invariant, and propose that changes in the hippocampus and its projections to cortical regions also contribute to the development of episodic memory. We further review the role of developmental changes in lateral prefrontal and parietal cortices in this development. Finally, we discuss changes in white matter tracts connecting brain regions that are critical for episodic memory. Overall, we argue that changes in episodic memory emerge from the concerted effort of a network of relevant brain structures.

Genetic architecture of declarative memory: implications for complex illnesses

Why do memory abilities vary so greatly across individuals and cognitive domains? Although memory functions are highly heritable, what exactly is being genetically transmitted? Here we review evidence for the contribution of both common and partially independent inheritance of distinct aspects of memory function. We begin by discussing the assessment of long-term memory and its underlying neural and molecular basis. We then consider evidence for both specialist and generalist genes underlying individual variability in memory, indicating that carving memory into distinct subcomponents may yield important information regarding its genetic architecture. And finally we review evidence from both complex and single-gene disorders, which provide insight into the molecular mechanisms underlying the genetic basis of human memory function.

Threat of punishment motivates memory encoding via amygdala, not midbrain, interactions with the medial temporal lobe

Neural circuits associated with motivated declarative encoding and active threat avoidance have both been described, but the relative contribution of these systems to punishment-motivated encoding remains unknown. The current study used functional magnetic resonance imaging in humans to examine mechanisms of declarative memory enhancement when subjects were motivated to avoid punishments that were contingent on forgetting. A motivational cue on each trial informed participants whether they would be punished or not for forgetting an upcoming scene image. Items associated with the threat of shock were better recognized 24 h later. Punishment-motivated enhancements in subsequent memory were associated with anticipatory activation of right amygdala and increases in its functional connectivity with parahippocampal and orbitofrontal cortices. On a trial-by-trial basis, right amygdala activation during the motivational cue predicted hippocampal activation during encoding of the subsequent scene; across participants, the strength of this interaction predicted memory advantages due to motivation. Of note, punishment-motivated learning was not associated with activation of dopaminergic midbrain, as would be predicted by valence-independent models of motivation to learn. These data are consistent with the view that motivation by punishment activates the amygdala, which in turn prepares the medial temporal lobe for memory formation. The findings further suggest a brain system for declarative learning motivated by punishment that is distinct from that for learning motivated by reward.

The very same thing: Extending the object token concept to incorporate causal constraints on individual identity

The contributions of feature recognition, object categorization, and recollection of episodic memories to the re-identification of a perceived object as the very same thing encountered in a previous perceptual episode are well understood in terms of both cognitive-behavioral phenomenology and neurofunctional implementation. Human beings do not, however, rely solely on features and context to re-identify individuals; in the presence of featural change and similarly-featured distractors, people routinely employ causal constraints to establish object identities. Based on available cognitive and neurofunctional data, the standard object-token based model of individual re-identification is extended to incorporate the construction of unobserved and hence fictive causal histories (FCHs) of observed objects by the pre-motor action planning system. It is suggested that functional deficits in the construction of FCHs are associated with clinical outcomes in both autism spectrum disorders and later-stage stage Alzheimer’s disease.

A within-subject ERP and fMRI investigation of orientation-specific recognition memory for pictures

Despite a large body of recognition memory research, its temporal, measured with ERPs, and spatial, measured with fMRI, substrates have never been investigated in the same subjects. In the present study, we obtained this information in parallel sessions, in which subjects studied and recognized images of visual objects and their orientation. The results showed that ERP-familiarity processes between 240 and 440 ms temporally preceded recollection processes and were structurally associated with prefrontal brain regions. Recollection processes were most prominent from 440 to 600 ms and correlated with activation in temporal, parietal, and occipital brain regions. Post-retrieval monitoring, which occurred in the ERP between 600 and 1000 ms as a long-lasting slow-wave over frontal channel groups, showed correlations with activation in the prefrontal and parietal cortex. These ERP/fMRI relationships showed some correspondences to source localizations of the investigated ERP memory effects.

Measuring recollection and familiarity: Improving the remember/know procedure

The remember/know (RK) procedure is the most widely used method to investigate recollection and familiarity. It uses trial-by-trial reports to determine how much recollection and familiarity contribute to different kinds of recognition. Few other methods provide information about individual memory judgements and no alternative allows such direct indications of recollection and familiarity influences. Here we review how the RK procedure has been and should be used to help resolve theoretical disagreements about the processing and neural bases of components of recognition memory. Emphasis is placed on procedural weaknesses and a possible confound of recollection and familiarity with recognition memory strength. Recommendations are made about how to minimise these problems including using modified versions of the procedure. The proposals here are important for improving behavioural and lesion research, and vital for brain imaging work.

Neural activity supporting the formation of associative memory versus source memory

The ability to form a new association with discontiguous elements constitutes the very crux of episodic memory. However, it is not fully understood whether different types of associations rely on common neural correlates for encoding associations. In the present study, we investigated whether the formation of associative memory (associations between items) and source memory (associations between an item and its context) recruits common neural activity during encoding, or whether each type of association requires different neural activity for subsequent memory. During study, participants were visually presented a list of object pairs in the scanner while the names of objects were simultaneously presented either in a male or female voice. Participants completed a post-scan recognition test for associative and source memories for object pairs and their contexts. Associative memory was predicted in the left inferior prefrontal cortex, the fusiform gyrus and the medial temporal lobe including both perirhinal and parahippocampal cortices and the posterior hippocampus. Encoding activity for source memory was identified in the right insula and the right anterior hippocampus. Further, neural activity in the right posterior hippocampus was recruited for successful formation of both associative and source memories. Collectively, these findings highlight the pivotal role of the hippocampus in successful encoding of associative and source memories and add more weight to the role of the perirhinal cortex in associative encoding of objects. The present findings have implications for roles of the medial temporal lobe sub-regions for successful formation of associative and source memories.

Differential connectivity of perirhinal and parahippocampal cortices within human hippocampal subregions revealed by high-resolution functional imaging

Numerous studies support the importance of the perirhinal cortex (PRC) and parahippocampal cortex (PHC) in episodic memory. Theories of PRC and PHC function in humans have been informed by neuroanatomical studies of these regions obtained in animal tract-tracing studies, but knowledge of the connectivity of PHC and PRC in humans is limited. To address this issue, we used resting-state functional magnetic resonance imaging to compare the intrinsic functional connectivity profiles associated with the PRC and PHC both across the neocortex and within the subfields of the hippocampus. In Experiment 1, we acquired standard-resolution whole-brain resting-state fMRI data in 15 participants, and in Experiment 2, we acquired high-resolution resting-state fMRI data targeting the hippocampus in an independent sample of 15 participants. Experiment 1 revealed that PRC showed preferential connectivity with the anterior hippocampus, whereas PHC showed preferential connectivity with posterior hippocampus. Experiment 2 indicated that this anterior-posterior functional connectivity dissociation was more evident for subfields CA1 and subiculum than for a combined CA2/CA3/dentate gyrus region. Finally, whole-brain analyses from Experiment 1 revealed preferential PRC connectivity with an anterior temporal and frontal cortical network, and preferential PHC connectivity with a posterior medial temporal, parietal, and occipital network. These results suggest a framework for refining models of the functional organization of the human medial temporal lobes in which the PRC and PHC are associated with distinct neocortical pathways that, in turn, may differentially interact with regions along the anterior-posterior axis of the hippocampus.

Hiding in plain view: lesions of the medial temporal lobe impair online representation

The hippocampus is necessary for the normal formation of enduring declarative memories, but its role in cognitive processes spanning short intervals is less well understood. Within the last decade, several reports have described modest behavioral deficits in medial temporal lobe (MTL)-lesion patients when they perform tasks that do not seem likely to rely on enduring memory. An intriguing but sparsely-tested implication of such results is that the MTL is involved in the online representation of information, possibly of an associative/relational nature, irrespective of delay. We administered several tests that simultaneously presented all information necessary for accurate responses to a group of MTL-lesion patients with severe declarative memory deficits but otherwise normal cognition, and to matched brain-damaged and healthy comparison participants. MTL-lesion patients performed less well than either comparison group in the Hooper Visual Organization Test, and several patients performed outside the normal range on the Overlapping Figures Test. A novel follow-up borrowing characteristics of the Overlapping Figures Test revealed impaired identification of novel items by MTL-lesion patients when target items were obscured by distracters, and two additional novel tests of fragmented object identification further implicated the hippocampus/MTL in the integration of information across very brief intervals. These findings suggest that MTL structures including the hippocampus contribute similarly to cognition irrespective of timescale.

Intrinsic functional connectivity of the human medial temporal lobe suggests a distinction between adjacent MTL cortices and hippocampus

Functional connectivity analyses can offer insights into mechanisms of the brain that might not be revealed by traditional fMRI. These analyses compare seed voxels' activity over time to the activity of other voxels over time and identify correlations between regions. This study is the first to perform functional connectivity analyses in the human medial temporal lobe (MTL) at high enough resolution to resolve the hippocampal subfields. We calculated the average correlation coefficients between the MTL cortices, which include the entorhinal (ERC), perirhinal (PRC), and parahippocampal cortex (PHC), and the hippocampal subfields dentate gyrus/CA3, CA1, and subiculum. We found that the hippocampal subfields had relatively high correlations with each other both within and across hemispheres, but did not have exceptionally strong correlations with the MTL cortices. The opposite was also seen where there was a relatively high correlation coefficient between the ERC and PRC, but both regions had low correlation coefficients with the hippocampal subfields. We also found greater functional connectivity within a hemisphere than across hemispheres. These effects were replicated across multiple datasets which differed in task demands, participants' age, and scanner sequence/slice acquisition. Notably, all datasets were better correlated to these patterns of intrinsic functional connectivity than to a model based on anatomical constraints. This is consistent with evidence that functional connectivity is not a direct mapping of anatomical connectivity. These patterns of functional connectivity imply a distinction between the MTL cortices and the hippocampus and speak to our understanding of the organization of the MTL.

Unconscious relational inference recruits the hippocampus

Relational inference denotes the capacity to encode, flexibly retrieve, and integrate multiple memories to combine past experiences to update knowledge and improve decision-making in new situations. Although relational inference is thought to depend on the hippocampus and consciousness, we now show in young, healthy men that it may occur outside consciousness but still recruits the hippocampus. In temporally distinct and unique subliminal episodes, we presented word pairs that either overlapped ("winter-red", "red-computer") or not. Effects of unconscious relational inference emerged in reaction times recorded during unconscious encoding and in the outcome of decisions made 1 min later at test, when participants judged the semantic relatedness of two supraliminal words. These words were either episodically related through a common word ("winter-computer" related through "red") or unrelated. Hippocampal activity increased during the unconscious encoding of overlapping versus nonoverlapping word pairs and during the unconscious retrieval of episodically related versus unrelated words. Furthermore, hippocampal activity during unconscious encoding predicted the outcome of decisions made at test. Hence, unconscious inference may influence decision-making in new situations.

Contrasting brain activity patterns for item recognition memory and associative recognition memory: insights from immediate-early gene functional imaging

Recognition memory, the discrimination of a novel from a familiar event, can be classified into item recognition and associative recognition. Item recognition concerns the identification of novel individual stimuli, while associative recognition concerns the detection of novelty that arises when familiar items are reconfigured in a novel manner. Experiments in rodents that have mapped the expression of immediate-early genes, e.g., c-fos, highlight key differences between these two forms of recognition memory. Visual item novelty is consistently linked to increased c-fos activity in just two brain sites, the perirhinal cortex and the adjacent visual association area Te2. Typically there are no hippocampal c-fos changes. In contrast, visual associative recognition is consistently linked to c-fos activity changes in the hippocampus, but not the perirhinal cortex. The lack of a c-fos perirhinal change with associative recognition presumably reflects the fact that the individual items in an array remain familiar, even though their combinations are unique. Those exceptions, when item recognition is associated with hippocampal c-fos changes, occur when rats actively explore novel objects. The increased engagement with objects will involve multisensory stimulus processing and potentially create conditions in which rats can readily learn stimulus attributes such as object location or object order, i.e., attributes involved in associative recognition. Correlations based on levels of immediate-early gene expression in the temporal lobe indicate that actively exploring novel stimuli switches patterns of entorhinal-hippocampal functional connectivity to emphasise direct entorhinal-dentate gyrus processing. These gene activity findings help to distinguish models of medial temporal lobe function.

A role for perirhinal cortex in memory for novel object-context associations

It is debated whether functional divisions between structures in the medial temporal lobe (MTL), in particular the perirhinal cortex (PrC) and hippocampus (HC), are best conceptualized according to memory process (Diana et al., 2007; Ranganath, 2010; Wixted et al., 2010) or stimulus category (Graham et al., 2010). In the former account, PrC is critical for item familiarity but not recollection of associations between items and their contexts (which is instead dependent upon the HC; Ranganath et al., 2004). In the latter theory, complex object representations in PrC are capable of supporting memory for objects as well as for object-context associations, particularly when there is a demand to discriminate between highly visually similar objects (Cowell et al., 2010). To adjudicate between these accounts, human participants were scanned while making two different judgments about visually presented objects (is the object common or uncommon, or does the object have more edges or curves). In a subsequent, unscanned, retrieval phase, participants made item (old/new) followed by context (encoding task) judgments about previously seen and novel objects. Neural activity at encoding was separated according to the accuracy of the retrieval judgments. PrC activity predicted successful item-context judgments, a result that remained when item-memory strength was equated across objects for which the context was remembered or forgotten. These data imply that the function of PrC goes beyond processing item-based memory information, contributing additionally to memory for item-context associations when the stimuli are objects (Graham et al., 2010).

PKCα is genetically linked to memory capacity in healthy subjects and to risk for posttraumatic stress disorder in genocide survivors

Strong memory of a traumatic event is thought to contribute to the development and symptoms of posttraumatic stress disorder (PTSD). Therefore, a genetic predisposition to build strong memories could lead to increased risk for PTSD after a traumatic event. Here we show that genetic variability of the gene encoding PKCα (PRKCA) was associated with memory capacity--including aversive memory--in nontraumatized subjects of European descent. This finding was replicated in an independent sample of nontraumatized subjects, who additionally underwent functional magnetic resonance imaging (fMRI). fMRI analysis revealed PRKCA genotype-dependent brain activation differences during successful encoding of aversive information. Further, the identified genetic variant was also related to traumatic memory and to the risk for PTSD in heavily traumatized survivors of the Rwandan genocide. Our results indicate a role for PKCα in memory and suggest a genetic link between memory and the risk for PTSD.

Spatial and temporal dynamics of cortical networks engaged in memory encoding and retrieval

Memory operations such as encoding and retrieval require the coordinated interplay of cortical regions with distinct functional contributions. The mechanistic nature of these interactions, however, remains unspecified. During the performance of a face memory task during fMRI scanning, we measured the magnitude (a measure of the strength of coupling between areas) and phase (a measure of the relative timing across areas) of coherence between regions of interest and the rest of the brain. The fusiform face area (FFA) showed robust coherence with a distributed network of subregions in the prefrontal cortex (PFC), posterior parietal cortex (PPC), precuneus, and hippocampus across both memory operations. While these findings reveal significant overlap in the cortical networks underlying mnemonic encoding and retrieval, coherence phase analyses revealed context-dependent differences in cortical dynamics. During both encoding and retrieval, PFC and PPC exhibited earlier activity than in the FFA and hippocampus. Also, during retrieval, PFC activity preceded PPC activity. These findings are consistent with prior physiology studies suggesting an early contribution of PFC and PPC in mnemonic control. Together, these findings contribute to the growing literature exploring the spatio-temporal dynamics of basic memory operations.

Examining ERP correlates of recognition memory: evidence of accurate source recognition without recollection

Recollection is typically associated with high recognition confidence and accurate source memory. However, subjects sometimes make accurate source memory judgments even for items that are not confidently recognized, and it is not known whether these responses are based on recollection or some other memory process. In the current study, we measured event related potentials (ERPs) while subjects made item and source memory confidence judgments in order to determine whether recollection supported accurate source recognition responses for items that were not confidently recognized. In line with previous studies, we found that recognition memory was associated with two ERP effects: an early on-setting FN400 effect, and a later parietal old-new effect [late positive component (LPC)], which have been associated with familiarity and recollection, respectively. The FN400 increased gradually with item recognition confidence, whereas the LPC was only observed for highly confident recognition responses. The LPC was also related to source accuracy, but only for items that had received a high confidence item recognition response; accurate source judgments to items that were less confidently recognized did not exhibit the typical ERP correlate of recollection or familiarity, but rather showed a late, broadly distributed negative ERP difference. The results indicate that accurate source judgments of episodic context can occur even when recollection fails.

The hippocampus and visual perception

In this review, we will discuss the idea that the hippocampus may be involved in both memory and perception, contrary to theories that posit functional and neuroanatomical segregation of these processes. This suggestion is based on a number of recent neuropsychological and functional neuroimaging studies that have demonstrated that the hippocampus is involved in the visual discrimination of complex spatial scene stimuli. We argue that these findings cannot be explained by long-term memory or working memory processing or, in the case of patient findings, dysfunction beyond the medial temporal lobe (MTL). Instead, these studies point toward a role for the hippocampus in higher-order spatial perception. We suggest that the hippocampus processes complex conjunctions of spatial features, and that it may be more appropriate to consider the representations for which this structure is critical, rather than the cognitive processes that it mediates.

The hippocampus and the flexible use and processing of language

Fundamental to all human languages is an unlimited expressive capacity and creative flexibility that allow speakers to rapidly generate novel and complex utterances. In turn, listeners interpret language “on-line,” incrementally integrating multiple sources of information as words unfold over time. A challenge for theories of language processing has been to understand how speakers and listeners generate, gather, integrate, and maintain representations in service of language processing. We propose that many of the processes by which we use language place high demands on and receive contributions from the hippocampal declarative memory system. The hippocampal declarative memory system is long known to support relational binding and representational flexibility. Recent findings demonstrate that these same functions are engaged during the real-time processes that support behavior in-the-moment. Such findings point to the hippocampus as a potentially key contributor to cognitive functions that require on-line integration of multiple sources of information, such as on-line language processing. Evidence supporting this view comes from findings that individuals with hippocampal amnesia show deficits in the use of language flexibly and on-line. We conclude that the relational binding and representational flexibility afforded by the hippocampal declarative memory system positions the hippocampus as a key contributor to language use and processing.

More than a feeling: Pervasive influences of memory without awareness of retrieval

The subjective experiences of recollection and familiarity have featured prominently in the search for neurocognitive mechanisms of memory. However, these two explicit expressions of memory, which involve conscious awareness of memory retrieval, are distinct from an entire category of implicit expressions of memory that do not entail such awareness. This review summarizes recent evidence showing that neurocognitive processing related to implicit memory can powerfully influence the behavioral and neural measures typically associated with explicit memory. Although there are striking distinctions between the neurocognitive processing responsible for implicit versus explicit memory, tests designed to measure only explicit memory nonetheless often capture implicit memory processing as well. In particular, the evidence described here suggests that investigations of familiarity memory are prone to the accidental capture of implicit memory processing. These findings have considerable implications for neurocognitive accounts of memory, as they suggest that many neural and behavioral measures often accepted as signals of explicit memory instead reflect the distinct operation of implicit memory mechanisms that are only sometimes related to explicit memory expressions. Proper identification of the explicit and implicit mechanisms for memory is vital to understanding the normal operation of memory, in addition to the disrupted memory capabilities associated with many neurological disorders and mental illnesses. We suggest that future progress requires utilizing neural, behavioral, and subjective evidence to dissociate implicit and explicit memory processing so as to better understand their distinct mechanisms as well as their potential relationships. When searching for the neurocognitive mechanisms of memory, it is important to keep in mind that memory involves more than a feeling.