A Mini-Review of fMRI Studies of Human Medial Temporal Lobe Activity Associated with Recognition Memory

Remembering unexpected beauty: Contributions of the ventral striatum to the processing of reward prediction errors regarding the facial attractiveness in face memory

The COVID-19 pandemic has led people to predict facial attractiveness from partially covered faces. Differences in the predicted and observed facial attractiveness (i.e., masked and unmasked faces, respectively) are defined as reward prediction error (RPE) in a social context. Cognitive neuroscience studies have elucidated the neural mechanisms underlying RPE-induced memory improvements in terms of monetary rewards. However, little is known about the mechanisms underlying RPE-induced memory modulation in terms of social rewards. To elucidate this, the present functional magnetic resonance imaging (fMRI) study investigated activity and functional connectivity during face encoding. In encoding trials, participants rated the predicted attractiveness of faces covered except for around the eyes (prediction phase) and then rated the observed attractiveness of these faces without any cover (outcome phase). The difference in ratings between these phases was defined as RPE in facial attractiveness, and RPE was categorized into positive RPE (increased RPE from the prediction to outcome phases), negative RPE (decreased RPE from the prediction to outcome phases), and non-RPE (no difference in RPE between the prediction and outcome phases). During retrieval, participants were presented with individual faces that had been seen and unseen in the encoding trials, and were required to judge whether or not each face had been seen in the encoding trials. Univariate activity in the ventral striatum (VS) exhibited a linear increase with increased RPE in facial attractiveness. In the multivariate pattern analysis (MVPA), activity patterns in the VS and surrounding areas (extended VS) significantly discriminated between positive/negative RPE and non-RPE. In the functional connectivity analysis, significant functional connectivity between the extended VS and the hippocampus was observed most frequently in positive RPE. Memory improvements by face-based RPE could be involved in functional networks between the extended VS (representing RPE) and the hippocampus, and the interaction could be modulated by RPE values in a social context.

Individuals with autism spectrum disorder are differentially sensitive to interference from previous verbal feedback

LAY ABSTRACT

Individuals with autism spectrum disorder can find behavioural flexibility challenging, often exhibited in terms of repetitive behaviours or restricted ranges of interests and activities. An inability to shift efficiently from one situation to another is connected with problems in daily life, and identifying factors associated with this ability may help develop teaching strategies to improve behavioural flexibility. Some existing findings imply shifting performance for individuals with autism spectrum disorder is better with nonverbal, compared to verbal, feedback - even for those with strong verbal abilities. Unfortunately, there are few behavioural examinations that further explore these findings, which is the aim of this study. In this study, 28 children with a diagnosis of autism spectrum disorder and 28 typically developing children matched on cognitive and verbal abilities learned to sort cards according to one out of a possible three dimensions (colour, shape and number), and then had to relearn the sorting rule. One group of typically developing children, and one group of autism spectrum disorder children, received verbal feedback on their performance, and one group received nonverbal feedback. Children with autism spectrum disorder learned an initial categorisation rule as fast as matched typically developing children, and there was little difference in the impact of the type of feedback on acquisition. However, on shifting the classification rule, children with autism spectrum disorder showed slower rates of learning the new rule, which was worse when verbal feedback was used compared to nonverbal feedback. This finding has implications for the interpretations of set-shifting performance and for classroom use of feedback strategies.

The transdiagnostic relationship of cumulative lifetime stress with memory, the hippocampus, and personality psychopathology

Stress has a detrimental impact on memory, the hippocampus, and psychological health. Psychopathology research on stress has centered mainly on psychiatric diagnoses rather than symptom dimensions, and less attention has been given to the neurobiological factors through which stress might be translated into psychopathology. The present work investigates the transdiagnostic relationship of cumulative stress with episodic memory and the hippocampus (both structure and function) and explores the extent to which stress mediates the relationship between personality psychopathology and hippocampal size and activation. Cumulative lifetime stress was assessed in a sample of females recruited to vary in stress exposure and severity of personality psychopathology. Fifty-six participants completed subjective and objective tests of episodic memory, a T2-weighted high-resolution magnetic resonance imaging (MRI) scan of the medial-temporal lobe, and functional MRI (fMRI) scanning during a learning and recognition memory task. Higher cumulative stress was significantly related to memory complaints (but not episodic memory performance), lower bilateral hippocampal volume, and greater encoding-related hippocampal activation during the presentation of novel stimuli. Furthermore, cumulative stress significantly mediated the relationship between personality psychopathology and both hippocampal volume and activation, whereas alternative mediation models were not supported. The findings suggest that structural and functional activation differences in the hippocampus observed in case-control studies of psychiatric diagnoses may share cumulative stress as a common factor, which may mediate broadly reported relationships between psychopathology and hippocampal structure and function.

Reduced Hippocampal-Striatal Interactions during Formation of Durable Episodic Memories in Aging

Encoding of durable episodic memories requires cross-talk between the hippocampus and multiple brain regions. Changes in these hippocampal interactions could contribute to age-related declines in the ability to form memories that can be retrieved after extended time intervals. Here we tested whether hippocampal–neocortical– and subcortical functional connectivity (FC) observed during encoding of durable episodic memories differed between younger and older adults. About 48 younger (20–38 years; 25 females) and 43 older (60–80 years; 25 females) adults were scanned with fMRI while performing an associative memory encoding task. Source memory was tested ~20 min and ~6 days postencoding. Associations recalled after 20 min but later forgotten were classified as transient, whereas memories retained after long delays were classified as durable. Results demonstrated that older adults showed a reduced ability to form durable memories and reduced hippocampal–caudate FC during encoding of durable memories. There was also a positive relationship between hippocampal–caudate FC and higher memory performance among the older adults. No reliable age group differences in durable memory–encoding activity or hippocampal–neocortical connectivity were observed. These results support the classic theory of striatal alterations as one cause of cognitive decline in aging and highlight that age-related changes in episodic memory extend beyond hippocampal–neocortical connections.

How developmental neuroscience can help address the problem of child poverty

Nearly 1 in 5 children in the United States lives in a household whose income is below the official federal poverty line, and more than 40% of children live in poor or near-poor households. Research on the effects of poverty on children's development has been a focus of study for many decades and is now increasing as we accumulate more evidence about the implications of poverty. The American Academy of Pediatrics recently added "Poverty and Child Health" to its Agenda for Children to recognize what has now been established as broad and enduring effects of poverty on child development. A recent addition to the field has been the application of neuroscience-based methods. Various techniques including neuroimaging, neuroendocrinology, cognitive psychophysiology, and epigenetics are beginning to document ways in which early experiences of living in poverty affect infant brain development. We discuss whether there are truly worthwhile reasons for adding neuroscience and related biological methods to study child poverty, and how might these perspectives help guide developmentally based and targeted interventions and policies for these children and their families.

Functional dissociation of hippocampal subregions corresponding to memory types and stages

Background

The hippocampus reportedly plays a crucial role in memory. However, examining individual human hippocampal-subfield function remains challenging because of their small sizes and convoluted structures. Here, we identified hippocampal subregions involved in memory types (implicit and explicit memory) and stages (encoding and retrieval).

Methods

We modified the serial reaction time task to examine four memory types, i.e. implicit encoding, explicit encoding, implicit retrieval, and explicit retrieval. During this task, 7-T functional magnetic resonance imaging was used to compare brain activity evoked by these memory types.

Results

We found hippocampal activation according to all memory types and stages and identified that the hippocampus subserves both implicit and explicit memory processing. Moreover, we confirmed that cornu ammonis (CA) regions 1–3 were implicated in both memory encoding and retrieval, whereas the subiculum was implicated only in memory retrieval. We also found that CA 1–3 was activated more for explicit than implicit memory.

Conclusions

These results elucidate human hippocampal-subfield functioning underlying memory and may support future investigations into hippocampal-subfield functioning in health and neurodegenerative disease.

[Neuropsychological disorders of memory]

This article provides an introduction to the neuropsychology of human memory. The terms short-term memory, working memory, episodic memory, semantic and procedural memory are defined and the anatomical correlates of these various memory systems are presented. Additionally, a brief introduction to the methods for neuropsychological research on human memory is given together with advice on the neuropsychological diagnostics and therapy.

The effect of intrinsic and extrinsic motivation on memory formation: insight from behavioral and imaging study

Motivation can be generated intrinsically or extrinsically, and both kinds of motivation show similar facilitatory effects on memory. However, effects of extrinsic and intrinsic motivation on memory formation have not been studied in combination and thus, it is unknown whether they interact and how such interplay is neurally implemented. In the present study, both extrinsic monetary reward and intrinsic curiosity enhanced memory performance, without evidence for an interaction. Functional magnetic resonance imaging revealed that curiosity-driven activity in the ventral striatal reward network appears to work cooperatively with the fronto-parietal attention network, while enhancing memory formation. In contrast, the monetary reward-modulated subsequent memory effect revealed deactivation in parietal midline regions. Thus, curiosity might enhance memory performance by allocation of attentional resources and reward-related processes; while, monetary reward does so by suppression of task-irrelevant processing.

Progression from Feature-Specific Brain Activity to Hippocampal Binding during Episodic Encoding

The hallmark of episodic memory is recollecting multiple perceptual details tied to a specific spatial-temporal context. To remember an event, it is therefore necessary to integrate such details into a coherent representation during initial encoding. Here we tested how the brain encodes and binds multiple, distinct kinds of features in parallel, and how this process evolves over time during the event itself. We analyzed data from 27 human subjects (16 females, 11 males) who learned a series of objects uniquely associated with a color, a panoramic scene location, and an emotional sound while fMRI data were collected. By modeling how brain activity relates to memory for upcoming or just-viewed information, we were able to test how the neural signatures of individual features as well as the integrated event changed over the course of encoding. We observed a striking dissociation between early and late encoding processes: left inferior frontal and visuo-perceptual signals at the onset of an event tracked the amount of detail subsequently recalled and were dissociable based on distinct remembered features. In contrast, memory-related brain activity shifted to the left hippocampus toward the end of an event, which was particularly sensitive to binding item color and sound associations with spatial information. These results provide evidence of early, simultaneous feature-specific neural responses during episodic encoding that predict later remembering and suggest that the hippocampus integrates these features into a coherent experience at an event transition.SIGNIFICANCE STATEMENT Understanding and remembering complex experiences are crucial for many socio-cognitive abilities, including being able to navigate our environment, predict the future, and share experiences with others. Probing the neural mechanisms by which features become bound into meaningful episodes is a vital part of understanding how we view and reconstruct the rich detail of our environment. By testing memory for multimodal events, our findings show a functional dissociation between early encoding processes that engage lateral frontal and sensory regions to successfully encode event features, and later encoding processes that recruit hippocampus to bind these features together. These results highlight the importance of considering the temporal dynamics of encoding processes supporting multimodal event representations.

Working memory revived in older adults by synchronizing rhythmic brain circuits

Understanding normal brain aging and developing methods to maintain or improve cognition in older adults are major goals of fundamental and translational neuroscience. Here we show a core feature of cognitive decline-working-memory deficits-emerges from disconnected local and long-range circuits instantiated by theta-gamma phase-amplitude coupling in temporal cortex and theta phase synchronization across frontotemporal cortex. We developed a noninvasive stimulation procedure for modulating long-range theta interactions in adults aged 60-76 years. After 25 min of stimulation, frequency-tuned to individual brain network dynamics, we observed a preferential increase in neural synchronization patterns and the return of sender-receiver relationships of information flow within and between frontotemporal regions. The end result was rapid improvement in working-memory performance that outlasted a 50 min post-stimulation period. The results provide insight into the physiological foundations of age-related cognitive impairment and contribute to groundwork for future non-pharmacological interventions targeting aspects of cognitive decline.

Enhanced Neural Reinstatement for Evoked Facial Pain Compared With Evoked Hand Pain

Memory retrieval is accompanied by a reactivation of cortical and subcortical areas that have been active during encoding. This neural reinstatement is stronger during retrieval of pain-associated material compared with other unpleasant events. In this functional magnetic resonance imaging study, we investigated the differences in neural reinstatement during recognition of visual stimuli that had been paired with face or hand pain during memory encoding. Body site-specific neural reinstatement was tested in 23 healthy young volunteers who performed a visual categorization and a surprise recognition task. Our data shows increased neural reinstatement in task-specific and encoding-related areas, such as the parahippocampus (left: x = -26, y = -30, z = -18, t = 4.11; right: x = 26, y = -38, z = -6, t = 4.36), precuneus (x = 2, y = -56, z = 2, t = 3.77), fusiform gyrus (left: x = -24, y = -26, z = -20, t = 5.41; right: x = 18, y = -58, z = -14, t = 4.52), and amygdala (x = -34, y = -4, z = -20, t = 4.49) for pictures that were previously presented with face compared with hand pain. These results correlated with the individual's recognition confidence, although recognition rates did not differ between the conditions. Functional connectivity was increased between the amygdala and parahippocampus (x = 34, y = -10, z = -28, t = 5.13) for pictures that had previously been paired with face compared with hand pain. Our results were positively correlated with pain-related fear, represented by neural activation in the thalamus (x = -14, y = -35, z = 4, t = 3.54). The reported results can be interpreted as compensatory resource activation and support the notion of a stronger affective component of face compared with hand pain, potentially in line with its greater biological relevance. PERSPECTIVE: This study demonstrates neural reinstatement of face pain-related information, which might be related to the increased biological and affective component of face pain compared with pain on the extremities. Our results might contribute to the understanding of the development and prevalence of head and face pain conditions.

Priming by motivationally salient distractors produces hemispheric asymmetries in visual processing

Stimuli that reliably herald the availability of rewards or punishers can acquire value associations, potentially imbuing them with emotional significance and attentional prioritization. Previous work has shown that an emotional stimulus (prime) presented just prior to an attention-demanding task disrupts performance in a lateralized manner that is independent of the prime's emotional valence. Here, we asked whether neutral stimuli with acquired value associations would similarly disrupt attention. In two experiments, adult participants first learned to associate specific face or chair stimuli with a high or low probability of either winning or losing points. These conditioned stimuli then served as primes in a speeded letter-search task. Primes with high versus low outcome probability, regardless of valence, slowed search for targets appearing in the left but not the right visual hemifield, mirroring previous results using emotional primes, and suggesting that motivational mechanisms that compete for control with non-emotional cognitive processes are right-lateralized in the human brain.

Encoding-related brain activity and accelerated forgetting in transient epileptic amnesia

The accelerated forgetting of newly learned information is common amongst patients with epilepsy and, in particular, in the syndrome of transient epileptic amnesia (TEA). However, the neural mechanisms underlying accelerated forgetting are poorly understood. It has been hypothesised that interictal epileptiform activity during longer retention intervals disrupts normally established memory traces. Here, we tested a distinct hypothesis-that accelerated forgetting relates to the abnormal encoding of memories. We studied a group of 15 patients with TEA together with matched, healthy control subjects. Despite normal performance on standard anterograde memory tasks, patients showed accelerated forgetting of a word list over one week. We used a subsequent memory paradigm to compare encoding-related brain activity in patients and controls. Participants studied a series of visually presented scenes whilst undergoing functional MRI scanning. Recognition memory for these scenes was then probed outside the scanner after delays of 45 min and of 4 days. Patients showed poorer memory for the scenes compared with controls. In the patients but not the controls, subsequently forgotten stimuli were associated with reduced hippocampal activation at encoding. Furthermore, patients demonstrated reduced deactivation of posteromedial cortex regions upon viewing subsequently remembered stimuli as compared to subsequently forgotten ones. These data suggest that abnormal encoding-related activity in key memory areas of the brain contributes to accelerated forgetting in TEA. We propose that abnormally encoded memory traces may be particularly vulnerable to interference from subsequently encountered material and hence be forgotten more rapidly. Our results shed light on the mechanisms underlying memory impairment in epilepsy, and offer support to the proposal that accelerated forgetting may be a useful marker of subtle dysfunction in memory-related brain systems.

Action and object words are differentially anchored in the sensory motor system - A perspective on cognitive embodiment

Embodied and grounded cognition theories have assumed that the sensorimotor system is causally involved in processing motor-related language content. Although a causal proof on a single-cell basis is ethically not possible today, the present fMRI study provides confirmation of this longstanding speculation, as far as it is possible with recent methods, employing a new computational approach. More specifically, we were looking for common activation of nouns and objects, and actions and verbs, representing the canonical and mirror neuron system, respectively. Using multivariate pattern analysis, a resulting linear classifier indeed successfully generalized from distinguishing actions from objects in pictures to distinguishing the respective verbs from nouns in written words. Further, these action-related pattern responses were detailed by recently introduced predictive pattern decomposition into the constituent activity atoms and their relative contributions. The findings support the concept of canonical neurons and mirror neurons implementing embodied processes with separate roles in distinguishing objects from actions, and nouns from verbs, respectively. This example of neuronal recycling processing algorithms is consistent with a multimodal brain signature of human action and object concepts. Embodied language theory is thus merged with actual neurobiological implementation.

Electrical Stimulation in Hippocampus and Entorhinal Cortex Impairs Spatial and Temporal Memory

The medial temporal lobe (MTL) is widely implicated in supporting episodic memory and navigation, but its precise functional role in organizing memory across time and space remains elusive. Here we examine the specific cognitive processes implemented by MTL structures (hippocampus and entorhinal cortex) to organize memory by using electrical brain stimulation, leveraging its ability to establish causal links between brain regions and features of behavior. We studied neurosurgical patients of both sexes who performed spatial-navigation and verbal-episodic memory tasks while brain stimulation was applied in various regions during learning. During the verbal memory task, stimulation in the MTL disrupted the temporal organization of encoded memories such that items learned with stimulation tended to be recalled in a more randomized order. During the spatial task, MTL stimulation impaired subjects' abilities to remember items located far away from boundaries. These stimulation effects were specific to the MTL. Our findings thus provide the first causal demonstration in humans of the specific memory processes that are performed by the MTL to encode when and where events occurred.SIGNIFICANCE STATEMENT Numerous studies have implicated the medial temporal lobe (MTL) in encoding spatial and temporal memories, but they have not been able to causally demonstrate the nature of the cognitive processes by which this occurs in real-time. Electrical brain stimulation is able to demonstrate causal links between a brain region and a given function with high temporal precision. By examining behavior in a memory task as subjects received MTL stimulation, we provide the first causal evidence demonstrating the role of the MTL in organizing the spatial and temporal aspects of episodic memory.

The Contribution of the Human Medial Temporal Lobe to Perception: Bridging the Gap between Animal and Human Studies

The medial temporal lobe (MTL) has been considered traditionally to subserve declarative memory processes only. Recent studies in nonhuman primates suggest, however, that the MTL may also be critical to higher order perceptual processes, with the hippocampus and perirhinal cortex being involved in scene and object perception, respectively. The current article reviews the human neuropsychological literature to determine whether there is any evidence to suggest that these same views may apply to the human MTL. Although the majority of existing studies report intact perception following MTL damage in human amnesics, there have been recent studies that suggest that when scene and object perception are assessed systematically, signifi-cant impairments in perception become apparent. These findings have important implications for current mnemonic theories of human MTL function and our understanding of human amnesia as a result of MTL lesions.

The Perirhinal Cortex and Long-Term Familiarity Memory

To analyse the functions of the perirhinal cortex, the activity of single neurons in the perirhinal cortex was recorded while macaques performed a delayed matching-to-sample task with up to three intervening stimuli. Some neurons had activity related to working memory, in that they responded more to the sample than to the match image within a trial, as shown previously. However, when a novel set of stimuli was introduced, the neuronal responses were on average only 47% of the magnitude of the responses to the set of very familiar stimuli. Moreover, it was shown in three monkeys that the responses of the perirhinal cortex neurons gradually increased over hundreds of presentations (mean = 400 over 7–13 days) of the new set of (initially novel) stimuli to become as large as those to the already familiar stimuli. Thus perirhinal cortex neurons represent the very long-term familiarity of visual stimuli. Part of the impairment in temporal lobe amnesia may be related to the difficulty of building representations of the degree of familiarity of stimuli. A neural network model of how the perirhinal cortex could implement tong-term familiarity memory is proposed using Hebbian associative learning.

Verbal memory in breast cancer patients treated with chemotherapy with doxorubicin and cyclophosphamide

Memory is one of the crucial human cognitive functions, and deficits in memory processes may lead to difficulties in everyday functioning. The aim of this study was to analyse the effect of anthracycline-based adjuvant chemotherapy (AC) used in breast cancer treatment on verbal memory and learning. We also evaluated the relationship between verbal memory and psychological, somatic and socio-demographic factors. The study was carried out on a group of 31 women with early breast cancer treated with adjuvant chemotherapy and 30 healthy controls. The patients underwent neuropsychological assessment using the Rey Auditory Verbal Learning Test at three time points: before chemotherapy, mid-chemotherapy and post-chemotherapy. The examination in the controls was conducted at the same time intervals. We found an association between AC-schema chemotherapy and deficits in delayed memory. A deterioration in performance after treatment was observed in 19% of patients. The results showed no deterioration of immediate memory or the verbal learning process. Moreover, a positive relationship was shown between the level of education, physical fitness and the functioning of verbal memory. The results of the study also indicate that age and hormonal status are factors that may increase the possibility of deficits in verbal memory after AC-schema chemotherapy.

Exercise Promotes Neuroplasticity in Both Healthy and Depressed Brains: An fMRI Pilot Study

Memory impairments are a frequently reported cognitive symptom in people suffering from major depressive disorder (MDD) and often persist despite antidepressant therapy. Neuroimaging studies have identified abnormal hippocampal activity during memory processes in MDD. Exercise as an ad-on treatment for MDD is a promising therapeutic strategy shown to improve mood, cognitive function, and neural structure and function. To advance our understanding of how exercise impacts neural function in MDD, we must also understand how exercise impacts healthy individuals without MDD. This pilot study used a subsequent memory paradigm to investigate the effects of an eight-week exercise intervention on hippocampal function in low-active healthy (n = 8) and low-active MDD (n = 8) individuals. Results showed a marked improvement in depression scores for the MDD group (p < 0.0001) and no change in memory performance for either group (p > 0.05). Functional imaging results showed a marginally significant decrease in hippocampal activity in both groups following the exercise intervention. Our whole brain analysis collapsed across groups revealed a similar deactivation pattern across several memory-associated regions. These results suggest that exercise may enhance neural efficiency in low-fit individuals while still resulting in a substantially greater mood effect for those suffering from MDD. This trial is registered with clinical trials.gov NCT03191994.

The cart before the horse: When cognitive neuroscience precedes cognitive neuropsychology

Cognitive neuropsychology (CN) has had an immense impact on the understanding of the normal cognitive processes underlying reading, spelling, spoken language comprehension and production, spatial attention, memory, visual perception, and orchestration of actions, through detailed analysis of behavioural performance by neurologically impaired individuals. However, there are other domains of cognition and communication that have rarely been investigated with this approach. Many cognitive neuropsychologists have extended their work in language, perception, or attention by turning to functional neuroimaging or lesion-symptom mapping to identify the neural mechanisms underlying the cognitive mechanisms they have identified. Another approach to extending one's research in CN is to apply the methodology to other cognitive functions. We briefly review the domains evaluated using methods of CN to develop cognitive architectures and computational models and the domains that have used functional neuroimaging and other brain mapping approaches in healthy controls to identify the neural substrates involved in cognitive tasks over the past 20 years. We argue that in some domains, neuroimaging studies have preceded the careful analysis of the cognitive processes underlying tasks that are studied, with the consequence that results are difficult to interpret. We use this analysis as the basis for discussing opportunities for expanding the field.

Relationships between cardiorespiratory fitness, hippocampal volume, and episodic memory in a population at risk for Alzheimer's disease

INTRODUCTION

Cardiorespiratory fitness (CRF) has been shown to be related to brain health in older adults. In individuals at risk for developing Alzheimer's disease (AD), CRF may be a modifiable risk factor that could attenuate anticipated declines in brain volume and episodic memory. The objective of this study was to determine the association between CRF and both hippocampal volume and episodic memory in a cohort of cognitively healthy older adults with familial and/or genetic risk for Alzheimer's disease (AD).

METHODS

Eighty-six enrollees from the Wisconsin Registry for Alzheimer's Prevention participated in this study. Participants performed a graded maximal exercise test, underwent a T-1 anatomical magnetic resonance imaging scan, and completed the Rey Auditory Verbal Learning Test (RAVLT).

RESULTS

There were no significant relationships between CRF and HV or RAVLT memory scores for the entire sample. When the sample was explored on the basis of gender, CRF was significantly associated with hippocampal volume for women. For men, significant positive associations were observed between CRF and RAVLT memory scores.

SUMMARY

These results suggest that CRF may be protective against both hippocampal volume and episodic memory decline in older adults at risk for AD, but that the relationships may be gender specific.

Differential Effects of Encoding Instructions on Brain Activity Patterns of Item and Associative Memory

Evidence from neuroimaging studies suggests a critical role of hippocampus and inferior frontal gyrus (IFG) in associative relative to item encoding. Here, we investigated similarities and differences in functional brain correlates for associative and item memory as a function of encoding instruction. Participants received either incidental (animacy judgments) or intentional encoding instructions while fMRI was employed during the encoding of associations and items. In a subsequent recognition task, memory performance of participants receiving intentional encoding instructions was higher compared with those receiving incidental encoding instructions. Furthermore, participants remembered more items than associations, regardless of encoding instruction. Greater brain activation in the left anterior hippocampus was observed for intentionally compared with incidentally encoded associations, although activity in this region was not modulated by the type of instruction for encoded items. Furthermore, greater activity in the left anterior hippocampus and left IFG was observed during intentional associative compared with item encoding. The same regions were related to subsequent memory of intentionally encoded associations and were thus task relevant. Similarly, connectivity of the anterior hippocampus to the right superior temporal lobe and IFG was uniquely linked to subsequent memory of intentionally encoded associations. Our study demonstrates the differential involvement of anterior hippocampus in intentional relative to incidental associative encoding. This finding likely reflects that the intent to remember triggers a specific binding process accomplished by this region.

Integrating Theoretical Models with Functional Neuroimaging

The development of mathematical models to characterize perceptual and cognitive processes dates back almost to the inception of the field of psychology. Since the 1990s, human functional neuroimaging has provided for rapid empirical and theoretical advances across a variety of domains in cognitive neuroscience. In more recent work, formal modeling and neuroimaging approaches are being successfully combined, often producing models with a level of specificity and rigor that would not have been possible by studying behavior alone. In this review, we highlight examples of recent studies that utilize this combined approach to provide novel insights into the mechanisms underlying human cognition. The studies described here span domains of perception, attention, memory, categorization, and cognitive control, employing a variety of analytic and model-inspired approaches. Across these diverse studies, a common theme is that individually tailored, creative solutions are often needed to establish compelling links between multi-parameter models and complex sets of neural data. We conclude that future developments in model-based cognitive neuroscience will have great potential to advance our theoretical understanding and ability to model both low-level and high-level cognitive processes.

The human hippocampus contributes to both the recollection and familiarity components of recognition memory

Despite a substantial body of work comprising theoretical modeling, the effects of medial temporal lobe lesions, and electrophysiological signal analysis, the role of the hippocampus in recognition memory remains controversial. In particular, it is not known whether the hippocampus exclusively supports recollection or both recollection and familiarity--the two latent cognitive processes theorized to underlie recognition memory. We studied recognition memory in a large group of patients undergoing intracranial electroencephalographic (iEEG) monitoring for epilepsy. By measuring high-frequency activity (HFA)--a signal associated with precise spatiotemporal properties--we show that hippocampal activity during recognition predicted recognition memory performance and tracked both recollection and familiarity. Through the lens of dual-process models, these results indicate that the hippocampus supports both the recollection and familiarity processes.

Medial temporal lobe activity associated with the successful retrieval of destination memory

Destination memory is the process of remembering to whom we tell particular things. Although recent behavioral studies have clarified the cognitive nature of destination memory, the neural mechanisms underlying destination memory retrieval remain unclear. We used functional magnetic resonance imaging (fMRI) to determine whether the medial temporal lobe (MTL), a structure that has been implicated in recollection-based memory, is activated during the successful retrieval of destination information. During a study phase before fMRI scanning, the subjects told a series of facts to either a woman or a man. During fMRI scanning, the subjects were asked to judge whether each fact presented was old or new, and if they judged it as old, to indicate, including a confidence rating (high or low), whether the subjects had told that fact to either a man or a woman. We found that successful destination retrieval, when compared to failed destination retrieval, was associated with increased activity in the parahippocampal gyrus. We also found that the confidence level (high vs. low) for destination memory retrieval was associated with increased activity in another (posterior) region of the parahippocampal gyrus. The present study suggests that the successful retrieval of destination information depends highly on MTL-mediated recollection processes.

Episodic memory in aspects of large-scale brain networks

Understanding human episodic memory in aspects of large-scale brain networks has become one of the central themes in neuroscience over the last decade. Traditionally, episodic memory was regarded as mostly relying on medial temporal lobe (MTL) structures. However, recent studies have suggested involvement of more widely distributed cortical network and the importance of its interactive roles in the memory process. Both direct and indirect neuro-modulations of the memory network have been tried in experimental treatments of memory disorders. In this review, we focus on the functional organization of the MTL and other neocortical areas in episodic memory. Task-related neuroimaging studies together with lesion studies suggested that specific sub-regions of the MTL are responsible for specific components of memory. However, recent studies have emphasized that connectivity within MTL structures and even their network dynamics with other cortical areas are essential in the memory process. Resting-state functional network studies also have revealed that memory function is subserved by not only the MTL system but also a distributed network, particularly the default-mode network (DMN). Furthermore, researchers have begun to investigate memory networks throughout the entire brain not restricted to the specific resting-state network (RSN). Altered patterns of functional connectivity (FC) among distributed brain regions were observed in patients with memory impairments. Recently, studies have shown that brain stimulation may impact memory through modulating functional networks, carrying future implications of a novel interventional therapy for memory impairment.

Prediction strength modulates responses in human area CA1 to sequence violations

Emerging human, animal, and computational evidence suggest that, within the hippocampus, stored memories are compared with current sensory input to compute novelty, i.e., detecting when inputs deviate from expectations. Hippocampal subfield CA1 is thought to detect mismatches between past and present, and detected novelty is thought to modulate encoding processes, providing a mechanism for gating the entry of information into memory. Using high-resolution functional MRI, we examined human hippocampal subfield and medial temporal lobe cortical activation during prediction violations within a sequence of events unfolding over time. Subjects encountered sequences of four visual stimuli that were then reencountered in the same temporal order (Repeat) or a rearranged order (Violation). Prediction strength was manipulated by varying whether the sequence was initially presented once (Weak) or thrice (Strong) prior to the critical Repeat or Violation sequence. Analyses of blood oxygen level-dependent signals revealed that task-responsive voxels in anatomically defined CA1, CA23/dentate gyrus, and perirhinal cortex were more active when expectations were violated than when confirmed. Additionally, stronger prediction violations elicited greater activity than weaker violations in CA1, and CA1 contained the greatest proportion of voxels displaying this prediction violation pattern relative to other medial temporal lobe regions. Finally, a memory test with a separate group of subjects showed that subsequent recognition memory was superior for items that had appeared in prediction violation trials than in prediction confirmation trials. These findings indicate that CA1 responds to temporal order prediction violations, and that this response is modulated by prediction strength.

Hippocampal contribution to implicit configuration memory expressed via eye movements during scene exploration

Although hippocampus unequivocally supports explicit/declarative memory, fewer findings have demonstrated its role in implicit expressions of memory. We tested for hippocampal contributions to an implicit expression of configural/relational memory for complex scenes using eye-movement tracking during functional magnetic resonance imaging (fMRI) scanning. Participants studied scenes and were later tested using scenes that resembled study scenes in their overall feature configuration but comprised different elements. These configurally similar scenes were used to limit explicit memory, and were intermixed with new scenes that did not resemble studied scenes. Scene configuration memory was expressed through eye movements reflecting exploration overlap (EO), which is the viewing of the same scene locations at both study and test. EO reliably discriminated similar study-test scene pairs from study-new scene pairs, was reliably greater for similarity-based recognition hits than for misses, and correlated with hippocampal fMRI activity. In contrast, subjects could not reliably discriminate similar from new scenes by overt judgments, although ratings of familiarity were slightly higher for similar than new scenes. Hippocampal fMRI correlates of this weak explicit memory were distinct from EO-related activity. These findings collectively suggest that EO was an implicit expression of scene configuration memory associated with hippocampal activity. Visual exploration can therefore reflect implicit hippocampal-related memory processing that can be observed in eye-movement behavior during naturalistic scene viewing.

Evidence for an anterior-posterior differentiation in the human hippocampal formation revealed by meta-analytic parcellation of fMRI coordinate maps: focus on the subiculum

Previous studies, predominantly in experimental animals, have suggested the presence of a differentiation of function across the hippocampal formation. In rodents, ventral regions are thought to be involved in emotional behavior while dorsal regions mediate cognitive or spatial processes. Using a combination of modeling the co-occurrence of significant activations across thousands of neuroimaging experiments and subsequent data-driven clustering of these data we were able to provide evidence of distinct subregions within a region corresponding to the human subiculum, a critical hub within the hippocampal formation. This connectivity-based model consists of a bilateral anterior region, as well as separate posterior and intermediate regions on each hemisphere. Functional connectivity assessed both by meta-analytic and resting fMRI approaches revealed that more anterior regions were more strongly connected to the default mode network, and more posterior regions were more strongly connected to 'task positive' regions. In addition, our analysis revealed that the anterior subregion was functionally connected to the ventral striatum, midbrain and amygdala, a circuit that is central to models of stress and motivated behavior. Analysis of a behavioral taxonomy provided evidence for a role for each subregion in mnemonic processing, as well as implication of the anterior subregion in emotional and visual processing and the right posterior subregion in reward processing. These findings lend support to models which posit anterior-posterior differentiation of function within the human hippocampal formation and complement other early steps toward a comparative (cross-species) model of the region.

Episodic Recollection Difficulties in ASD Result from Atypical Relational Encoding: Behavioral and Neural Evidence

Memory functioning in Autism Spectrum Disorder (ASD) is characterized by impairments in the encoding of relational but not item information and difficulties in the recollection of contextually rich episodic memories but not in the retrieval of relatively context‐free memories through processes of familiarity. The neural underpinnings of this profile and the extent to which encoding difficulties contribute to retrieval difficulties in ASD remain unclear. Using a paradigm developed by Addis and McAndrews [2006; Neuroimage, 33, 1194–1206] we asked adults with and without a diagnosis of ASD to study word‐triplets during functional Magnetic Resonance Imaging (fMRI) scanning that varied in the number of category relations amongst component words. Performance at test confirmed attenuated recollection in the context of preserved familiarity based retrieval in ASD. The results also showed that recollection but not familiarity based retrieval increases as a function of category relations in word triads for both groups, indicating a close link between the encoding of relational information and recollection. This link was further supported by the imaging results, where blood oxygen level dependent (BOLD) signal responses in overlapping regions of the inferior prefrontal cortex were sensitive to the relational encoding manipulation as well as the contrast between recollection versus familiarity based retrieval. Interestingly, however, there was no evidence of prefrontal signal differentiation for this latter contrast in the ASD group for whom signal changes in a left hippocampal region were also marginally attenuated. Together, these observations suggest that attenuated levels of episodic recollection in ASD are, at least in part, attributable to anomalies in relational encoding processes. Autism Res2015, 8: 317–327. © 2015 International Society for Autism Research, Wiley Periodicals, Inc.

Neuropsychology, autobiographical memory, and hippocampal volume in "younger" and "older" patients with chronic schizophrenia

Despite a wide range of studies on neuropsychology in schizophrenia, autobiographical memory (AM) has been scarcely investigated in these patients. Hence, less is known about AM in older patients and hippocampal contribution to autobiographical memories of varying remoteness. Therefore, we investigated hippocampal volume and AM along with important neuropsychological domains in patients with chronic schizophrenia and the respective relationships between these parameters. We compared 25 older patients with chronic schizophrenia to 23 younger patients and an older healthy control group (N = 21) with respect to AM, additional neuropsychological parameters, and hippocampal volume. Personal episodic and semantic memory was investigated using a semi-structured interview. Additional neuropsychological parameters were assessed by using a battery of standard neuropsychological tests. Structural magnetic resonance imaging data were analyzed with an automated region-of-interest procedure. While hippocampal volume reduction and neuropsychological impairment were more pronounced in the older than in the younger patients, both groups showed equivalent reduced AM performance for recent personal episodes. In the patient group, significant correlations between left hippocampal volume and recent autobiographical episodes as well as personal semantic memories arose. Verbal memory and working memory were significantly correlated with right hippocampal volume; executive functions, however, were associated with bilateral hippocampal volumes. These findings underline the complexity of AM and its impairments in the course of schizophrenia in comparison to rather progressive neuropsychological deficits and address the importance of hippocampal contribution.

Subsequent memory effects in schizophrenia

Differential neural activation at encoding can predict which stimuli will be subsequently remembered or forgotten, and memory deficits are pronounced in schizophrenia. We used event-related functional magnetic resonance imaging (fMRI) to investigate subsequent memory (SM) effects for visual fractals in patients with schizophrenia (n=26) and healthy controls (n=28). Participants incidentally encoded the fractals during an oddball task and 10 min later they made old/new recognition memory judgments on 30 target fractals and 30 foil fractals. We found evidence for subsequent memory (SM, subsequently remembered>subsequently forgotten) effects on regional brain activation in both groups but with distinct patterns. Region of interest (ROI) analyses in controls demonstrated SM activation in both medial temporal lobe (MTL) and fusiform cortex (FF), whereas patients showed SM effects only in the FF. There were no significant between group differences in MTL activation; however, patients demonstrated greater FF activation than controls. Notably, greater FF activation during successful encoding was associated with more severe negative symptoms. Exploratory whole brain analyses in patients demonstrated SM activation in the occipital pole, lateral occipital cortex, left inferior temporal gyrus, and fusiform cortex; whereas in controls there was no significant activation that survived correction for multiple comparisons. Our findings suggest that patients, particularly those with prominent negative symptoms, may activate FF as a compensatory strategy to promote successful encoding, with relatively less reliance on MTL recruitment.

Neural substrates of similarity and rule-based strategies in judgment

Making accurate judgments is a core human competence and a prerequisite for success in many areas of life. Plenty of evidence exists that people can employ different judgment strategies to solve identical judgment problems. In categorization, it has been demonstrated that similarity-based and rule-based strategies are associated with activity in different brain regions. Building on this research, the present work tests whether solving two identical judgment problems recruits different neural substrates depending on people's judgment strategies. Combining cognitive modeling of judgment strategies at the behavioral level with functional magnetic resonance imaging (fMRI), we compare brain activity when using two archetypal judgment strategies: a similarity-based exemplar strategy and a rule-based heuristic strategy. Using an exemplar-based strategy should recruit areas involved in long-term memory processes to a larger extent than a heuristic strategy. In contrast, using a heuristic strategy should recruit areas involved in the application of rules to a larger extent than an exemplar-based strategy. Largely consistent with our hypotheses, we found that using an exemplar-based strategy led to relatively higher BOLD activity in the anterior prefrontal and inferior parietal cortex, presumably related to retrieval and selective attention processes. In contrast, using a heuristic strategy led to relatively higher activity in areas in the dorsolateral prefrontal and the temporal-parietal cortex associated with cognitive control and information integration. Thus, even when people solve identical judgment problems, different neural substrates can be recruited depending on the judgment strategy involved.

Functional magnetic resonance imaging study of external source memory and its relation to cognitive insight in non-clinical subjects

AIM

Previous research has linked cognitive insight (a measure of self-reflectiveness and self-certainty) in psychosis with neurocognitive and neuroanatomical disturbances in the fronto-hippocampal neural network. The authors' goal was to use functional magnetic resonance imaging (fMRI) to investigate the neural correlates of cognitive insight during an external source memory paradigm in non-clinical subjects.

METHODS

At encoding, 24 non-clinical subjects travelled through a virtual city where they came across 20 separate people, each paired with a unique object in a distinct location. fMRI data were then acquired while participants viewed images of the city, and completed source recognition memory judgments of where and with whom objects were seen, which is known to involve prefrontal cortex. Cognitive insight was assessed with the Beck Cognitive Insight Scale.

RESULTS

External source memory was associated with neural activity in a widespread network consisting of frontal cortex, including ventrolateral prefrontal cortex (VLPFC), temporal and occipital cortices. Activation in VLPFC correlated with higher self-reflectiveness and activation in midbrain correlated with lower self-certainty during source memory attributions. Neither self-reflectiveness nor self-certainty significantly correlated with source memory accuracy.

CONCLUSION

By means of virtual reality and in the context of an external source memory paradigm, the study identified a preliminary functional neural basis for cognitive insight in the VLPFC in healthy people that accords with our fronto-hippocampal theoretical model as well as recent neuroimaging data in people with psychosis. The results may facilitate the understanding of the role of neural mechanisms in psychotic disorders associated with cognitive insight distortions.

The cognitive and neuroanatomical underpinnings of destination memory

The ability to remember the destination to whom a piece of information has been addressed (e.g., did I tell you about the weekend?) has been labelled destination memory. Although this topic has been relatively scarcely studied, recent studies support the notion that destination recall can be the subject of important distortions in healthy younger and older adults and in individuals with Alzheimer’s disease. This research also links destination recall to several cognitive domains such as episodic memory, executive function, and self-referential processes (e.g., did I tell you about the weekend?). The present review aims to assemble these findings into a comprehensive framework and shed light onto potential neuroanatomical underpinnings of destination memory, thus providing a promising venue for future exploration and research.

Reversible information flow across the medial temporal lobe: the hippocampus links cortical modules during memory retrieval

A simple cue can be sufficient to elicit vivid recollection of a past episode. Theoretical models suggest that upon perceiving such a cue, disparate episodic elements held in neocortex are retrieved through hippocampal pattern completion. We tested this fundamental assumption by applying functional magnetic resonance imaging (fMRI) while objects or scenes were used to cue participants' recall of previously paired scenes or objects, respectively. We first demonstrate functional segregation within the medial temporal lobe (MTL), showing domain specificity in perirhinal and parahippocampal cortices (for object-processing vs scene-processing, respectively), but domain generality in the hippocampus (retrieval of both stimulus types). Critically, using fMRI latency analysis and dynamic causal modeling, we go on to demonstrate functional integration between these MTL regions during successful memory retrieval, with reversible signal flow from the cue region to the target region via the hippocampus. This supports the claim that the human hippocampus provides the vital associative link that integrates information held in different parts of cortex.

Human intracranial high-frequency activity maps episodic memory formation in space and time

Noninvasive neuroimaging studies have revealed a network of brain regions that activate during human memory encoding; however, the relative timing of such activations remains unknown. Here we used intracranially recorded high-frequency activity (HFA) to first identify regions that activate during successful encoding. Then, we leveraged the high-temporal precision of HFA to investigate the timing of such activations. We found that memory encoding invokes two spatiotemporally distinct activations: early increases in HFA that involve the ventral visual pathway as well as the medial temporal lobe and late increases in HFA that involve the left inferior frontal gyrus, left posterior parietal cortex, and left ventrolateral temporal cortex. We speculate that these activations reflect higher-order visual processing and top-down modulation of attention/semantic information, respectively.

Enhanced recognition memory after incidental encoding in children with developmental dyslexia

Developmental dyslexia (DD) has previously been associated with a number of cognitive deficits. Little attention has been directed to cognitive functions that remain intact in the disorder, though the investigation and identification of such strengths might be useful for developing new, and improving current, therapeutical interventions. In this study, an old/new recognition memory paradigm was used to examine previously untested aspects of declarative memory in children with DD and typically developing control children. The DD group was not only not impaired at the task, but actually showed superior recognition memory, as compared to the control children. These findings complement previous reports of enhanced cognition in other domains (e.g., visuo-spatial processing) in DD. Possible underlying mechanisms for the observed DD advantage in declarative memory, and the possibility of compensation by this system for reading deficits in dyslexia, are discussed.

Pain-specific modulation of hippocampal activity and functional connectivity during visual encoding

Acute and chronic pain automatically attract attention and thus interfere with cognitive functioning. Impaired memory is a prominent complaint of patients with chronic pain that substantially contributes to pain-related disability. In this fMRI study, we investigated the specific influence of pain on neural processes of memory encoding in healthy human volunteers using a visual task. To investigate the specificity of the interruptive effect of pain on the encoding of visual objects, objects were presented (1) alone, (2) with painful heat stimuli, or (3) with auditory stimuli that were matched for unpleasantness to the heat stimuli. The interruptive effect of concomitant aversive stimulation on behavioral measures and neural processing was assessed in a categorization task during encoding and in a subsequent recognition task. Pain interfered with object processing and encoding of visual stimuli. On the behavioral level, this resulted in slower reaction times during the categorization task for pain compared with auditory stimuli and in a lower recognition rate in the pain condition but not in the tone condition. Pain catastrophizing amplified this interruptive effect of pain. On the neural level, this pain-related disruption of encoding was associated with reduced activity in the right anterior hippocampus during encoding. Moreover, the hippocampus exhibited reduced functional connectivity with extrastriate regions during painful stimulation relative to auditory stimulation. In summary, our results show a pain-related disruption of visual encoding over and above the unpleasantness of a stimulus, suggesting a pain-specific interruptive mechanism that interferes with an early stage of memory formation.

Dissociating hippocampal and striatal contributions to sequential prediction learning

Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus-stimulus relationships (as in model-based reinforcement learning or goal-directed actions). However, the neural architecture underlying sequential predictive learning is not well understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task in healthy individuals. We used computational learning models to isolate trial-by-trial effects of two distinct learning processes in behavior, and used these as signatures to analyse the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of time-series related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region's effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial-by-trial measurement of the unique contributions of both hippocampus and striatum to response behavior.

Using fMRI to Constrain Theories of Cognition

Research on cognition often leads to debates that are centered on how many processes exist and how they interact to guide behavior. These debates occur across a range of domains and are often difficult to resolve with behavioral data because similar behavioral predictions can be made by models with different core assumptions. Such model mimicry limits researchers’ ability to find differential support for one type of model over the other using behavioral data alone. We argue that functional neuroimaging can help overcome this problem by providing additional dependent measures to constrain model testing. Recent advances in analysis, like multivariate approaches, expand the amount and type of data available for model testing. We illustrate the benefits of this approach by highlighting imaging results that directly speak to the debate over the nature of recollection processes in memory. These results show how functional neuroimaging can advance studies of cognition by providing richer data sets for contrasting cognitive models.

Retrieval search and strength evoke dissociable brain activity during episodic memory recall

Neuroimaging studies of episodic memory retrieval have revealed activations in the human frontal, parietal, and medial-temporal lobes that are associated with memory strength. However, it remains unclear whether these brain responses are veritable signals of memory strength or are instead regulated by concomitant subcomponents of retrieval such as retrieval effort or mental search. This study used event-related fMRI during cued recall of previously memorized word-pair associates to dissociate brain responses modulated by memory search from those modulated by the strength of a recalled memory. Search-related deactivations, dissociated from activity due to memory strength, were observed in regions of the default network, whereas distinctly strength-dependent activations were present in superior and inferior parietal and dorsolateral PFC. Both search and strength regulated activity in dorsal anterior cingulate and anterior insula. These findings suggest that, although highly correlated and partially subserved by overlapping cognitive control mechanisms, search and memory strength engage dissociable regions of frontoparietal attention and default networks.