Specialization in the medial temporal lobe for processing of objects and scenes

Dissociations in perceptual discrimination following selective damage to the dentate gyrus versus CA1 subfield of the hippocampus

The hippocampus (HPC) is well-known for its involvement in declarative (consciously accessible) memory, but there is evidence that it may also play a role in complex perceptual discrimination. Separate research has demonstrated separable contributions of HPC subregions to component memory processes, with the dentate gyrus (DG) required for mnemonic discrimination of similar inputs and the CA1 subfield required for retention and retrieval, but contributions of these subregions to perceptual processes is understudied. The current study examined the nature and extent of a double dissociation between the dentate gyrus (DG) to discrimination processes and CA1 subfield to retention/retrieval by testing two unique individuals with bilateral damage to the DG (case BL) and CA1 (case BR). We tested BL and BR on a wide range of standardized neuropsychological tests to assess information encoding and retention/retrieval and co-opted many measures to assess perceptual discrimination. Compared to normative data, BL exhibited performance below expectations on most measures requiring perceptual discrimination and on measures of encoding but demonstrated intact retention. Conversely, BR showed no difficulties with perceptual discrimination or verbal encoding but exhibited poor verbal retention, as well as poor encoding and retention of spatial/integrative tasks (e.g., object in a location). These results indicate that, despite its prominent role in memory, the DG is necessary for perceptual discrimination and encoding, whereas CA1 is necessary for retention/retrieval and encoding of spatial information. The pattern of results highlights the critical nature of individual case studies in the nuanced understanding of HPC subfield contributions to different memory processes, as well as the utility of repurposing neuropsychological measures to capture individual differences.

Visual training after central retinal loss limits structural white matter degradation: an MRI study

BACKGROUND

Macular degeneration of the eye is a common cause of blindness and affects 8% of the worldwide human population. In adult cats with bilateral lesions of the central retina, we explored the possibility that motion perception training can limit the associated degradation of the visual system. We evaluated how visual training affects behavioral performance and white matter structure. Recently, we proposed (Kozak et al. in Transl Vis Sci Technol 10:9, 2021) a new motion-acuity test for low vision patients, enabling full visual field functional assessment through simultaneous perception of shape and motion. Here, we integrated this test as the last step of a 10-week motion-perception training.

RESULTS

Cats were divided into three groups: retinal-lesioned only and two trained groups, retinal-lesioned trained and control trained. The behavioral data revealed that trained cats with retinal lesions were superior in motion tasks, even when the difficulty relied only on acuity. 7 T-MRI scanning was done before and after lesioning at 5 different timepoints, followed by Fixel-Based and Fractional Anisotropy Analysis. In cats with retinal lesions, training resulted in a more localized and reduced percentage decrease in Fixel-Based Analysis metrics in the dLGN, caudate nucleus and hippocampus compared to untrained cats. In motion-sensitive area V5/PMLS, the significant decreases in fiber density were equally strong in retinal-lesioned untrained and trained cats, up to 40% in both groups. The only cortical area with Fractional Anisotropy values not affected by central retinal loss was area V5/PMLS. In other visual ROIs, the Fractional Anisotropy values increased over time in the untrained retinal lesioned group, whereas they decreased in the retinal lesioned trained group and remained at a similar level as in trained controls.

CONCLUSIONS

Overall, our MRI results showed a stabilizing effect of motion training applied soon after central retinal loss induction on white matter structure. We propose that introducing early motion-acuity training for low vision patients, aimed at the intact and active retinal peripheries, may facilitate brain plasticity processes toward better vision.

Scene-selectivity in CA1/subicular complex: Multivoxel pattern analysis at 7T

Prior univariate functional magnetic resonance imaging (fMRI) studies in humans suggest that the anteromedial subicular complex of the hippocampus is a hub for scene-based cognition. However, it is possible that univariate approaches were not sufficiently sensitive to detect scene-related activity in other subfields that have been implicated in spatial processing (e.g., CA1). Further, as connectivity-based functional gradients in the hippocampus do not respect classical subfield boundary definitions, category selectivity may be distributed across anatomical subfields. Region-of-interest approaches, therefore, may limit our ability to observe category selectivity across discrete subfield boundaries. To address these issues, we applied searchlight multivariate pattern analysis to 7T fMRI data of healthy adults who undertook a simultaneous visual odd-one-out discrimination task for scene and non-scene (including face) visual stimuli, hypothesising that scene classification would be possible in multiple hippocampal regions within, but not constrained to, anteromedial subicular complex and CA1. Indeed, we found that the scene-selective searchlight map overlapped not only with anteromedial subicular complex (distal subiculum, pre/para subiculum), but also inferior CA1, alongside posteromedial (including retrosplenial) and parahippocampal cortices. Probabilistic overlap maps revealed gradients of scene category selectivity, with the strongest overlap located in the medial hippocampus, converging with searchlight findings. This was contrasted with gradients of face category selectivity, which had stronger overlap in more lateral hippocampus, supporting ideas of parallel processing streams for these two categories. Our work helps to map the scene, in contrast to, face processing networks within, and connected to, the human hippocampus.

Do cultural differences emerge at different levels of representational hierarchy?

In prior research, Eastern and Western culture groups differ in memory specificity for objects. However, these studies used concrete object stimuli, which carry semantic information that may be confounded with culture. Additionally, the perceptual properties of the stimuli were not tightly controlled. Therefore, it cannot be precisely determined whether the observed cross-cultural differences are generalizable across different stimulus types and memory task demands. In prior studies, Americans demonstrated higher memory specificity than East Asians, but this may be due to Americans being more attuned to the low-level features that distinguish studied items from similar lures, rather than general memory differences. To determine whether this pattern of cross-cultural memory differences emerges irrespective of stimulus properties, we tested American and East Asian young adults using a recognition memory task employing abstract stimuli for which attention to conjunctions of features was critical for discrimination. Additionally, in order to more precisely determine the influence of stimulus and task on culture differences, participants also completed a concrete objects memory task identical to the one used in prior research. The results of the abstract objects task mirror the pattern seen in prior studies with concrete objects: Americans showed generally higher levels of recognition memory performance than East Asians for studied abstract items, whether discriminating them from similar or entirely new items. Results from the current concrete object task generally replicated this pattern. This suggests cross-cultural memory differences generalize across stimulus types and task demands, rather than reflecting differential sensitivity to low-level features or higher-level conjunctions.

Older adults can use memory for distinctive objects, but not distinctive scenes, to rescue associative memory deficits

Associative memory deficits in aging are frequently characterized by false recognition of novel stimulus associations, particularly when stimuli are similar. Introducing distinctive stimuli, therefore, can help guide item differentiation in memory and can further our understanding of how age-related brain changes impact behavior. How older adults use different types of distinctive information to distinguish overlapping events in memory and to avoid false associative recognition is still unknown. To test this, we manipulated the distinctiveness of items from two stimulus categories, scenes and objects, across three conditions: (1) distinct scenes paired with similar objects, (2) similar scenes paired with distinct objects, and (3) similar scenes paired with similar objects. Young and older adults studied scene-object pairs and then made both remember/know judgments toward single items as well as associative memory judgments to old and novel scene-object pairs ("Were these paired together?"). Older adults showed intact single item recognition of scenes and objects, regardless of whether those objects and scenes were similar or distinct. In contrast, relative to younger adults, older adults showed elevated false recognition for scene-object pairs, even when the scenes were distinct. These age-related associative memory deficits, however, disappeared if the pair contained an object that was visually distinct. In line with neural evidence that hippocampal functioning and scene processing decline with age, these results suggest that older adults can rely on memory for distinct objects, but not for distinct scenes, to distinguish between memories with overlapping features.

Generative replay underlies compositional inference in the hippocampal-prefrontal circuit

Human reasoning depends on reusing pieces of information by putting them together in new ways. However, very little is known about how compositional computation is implemented in the brain. Here, we ask participants to solve a series of problems that each require constructing a whole from a set of elements. With fMRI, we find that representations of novel constructed objects in the frontal cortex and hippocampus are relational and compositional. With MEG, we find that replay assembles elements into compounds, with each replay sequence constituting a hypothesis about a possible configuration of elements. The content of sequences evolves as participants solve each puzzle, progressing from predictable to uncertain elements and gradually converging on the correct configuration. Together, these results suggest a computational bridge between apparently distinct functions of hippocampal-prefrontal circuitry and a role for generative replay in compositional inference and hypothesis testing.

Complex visual discrimination is impaired after right, but not left, anterior temporal lobectomy

The prevailing view in human cognitive neuroscience associates the medial temporal lobes (MTLs) with declarative memory. Compelling experimental evidence has, however, demonstrated that these regions are specialized according to the representations processed, irrespective of the cognitive domain assessed. This account was supported by the study of patients with bilateral medial temporal amnesia, who exhibit impairments in perceptual tasks involving complex visual stimuli. Yet, little is known regarding the impact of unilateral MTL damage on complex visual abilities. To address this issue, we administered a visual matching task to 20 patients who underwent left (N = 12) or right (N = 8) anterior temporal lobectomy for drug-resistant epilepsy and to 38 healthy controls. Presentation viewpoint was manipulated to increase feature ambiguity, as this is critical to reveal impairments in perceptual tasks. Similar to control participants, patients with left-sided damage succeeded in all task conditions. In contrast, patients with right-sided damage had decreased accuracy compared with that of the other two groups, as well as increased response time. Notably, the accuracy of those with right-sided damage did not exceed chance level when feature ambiguity was high (i.e., when stimuli were presented from different viewpoints) for the most complex classes of stimuli (i.e., scenes and buildings, compared with single objects). The pattern reported in bilateral patients in previous studies was therefore reproduced in patients with right, but not left, resection. These results suggest that the complex visual-representation functions supported by the MTL are right-lateralized, and raise the question as to how the representational account of these regions applies to representations supported by left MTL regions.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

The locus of recognition memory signals in human cortex depends on the complexity of the memory representations

According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.

Using image reconstruction to investigate face perception in amnesia

Damage to the medial temporal lobe (MTL), which is traditionally considered to subserve memory exclusively, has been reported to contribute to impaired face perception. However, it remains unknown how exactly such brain lesions may impact face representations and in particular facial shape and surface information, both of which are crucial for face perception. The present study employed a behavioral-based image reconstruction approach to reveal the pictorial representations of face perception in two amnesic patients: DA, who has an extensive bilateral MTL lesion that extends beyond the MTL in the right hemisphere, and BL, who has damage to the hippocampal dentate gyrus (DG). Both patients and their respective matched controls completed similarity judgments for pairs of faces, from which facial shape and surface features were subsequently derived and synthesized to create images of reconstructed facial appearance. Participants also completed a face oddity judgment task (FOJT) that has previously been shown to be sensitive to MTL cortical damage. While BL exhibited an impaired pattern of performance on the FOJT, DA demonstrated intact performance accuracy. Notably, the recovered pictorial content of faces was comparable between both patients and controls, although there was evidence for atypical face representations in BL particularly with regards to color. Our work provides novel insight into the face representations underlying face perception in two well-studied amnesic patients in the literature and demonstrates the applicability of the image reconstruction approach to individuals with brain damage.

Distinct cognitive changes in male patients with obstructive sleep apnoea without co-morbidities

Introduction

Obstructive sleep apnoea (OSA) is a multisystem, debilitating, chronic disorder of breathing during sleep, resulting in a relatively consistent pattern of cognitive deficits. More recently, it has been argued that those cognitive deficits, especially in middle-aged patients, may be driven by cardiovascular and metabolic comorbidities, rather than by distinct OSA-processes, such as are for example ensuing nocturnal intermittent hypoxaemia, oxidative stress, neuroinflammation, and sleep fragmentation.

Methods

Thus, we undertook to define cognitive performance in a group of 27 middle-aged male patients with untreated OSA, who had no concomitant comorbidities, compared with seven matched controls (AHI mean ± S.D.: 1.9 ± 1.4 events/h; mean age 34.0 ± 9.3 years; mean BMI 23.8 ± 2.3 kg/m2). Of the 27 patients, 16 had mild OSA (AHI mean ± S.D.:11.7 ± 4.0 events/h; mean age 42.6 ± 8.2 years; mean BMI 26.7 ± 4.1 kg/m2), and 11 severe OSA (AHI 41.8 ± 20.7 events/h; age: 46.9 ± 10.9 years, BMI: 28.0 ± 3.2 kg/m2).

Results

In our patient cohort, we demonstrate poorer executive-functioning, visuospatial memory, and deficits in vigilance sustained attention, psychomotor and impulse control. Remarkably, we also report, for the first time, effects on social cognition in this group of male, middle-aged OSA patients.

Conclusion

Our findings suggest that distinct, OSA-driven processes may be sufficient for cognitive changes to occur as early as in middle age, in otherwise healthy individuals.

Medial temporal lobe structure, mnemonic and perceptual discrimination in healthy older adults and those at risk for mild cognitive impairment

Cognitive tests sensitive to the integrity of the medial temporal lobe (MTL), such as mnemonic discrimination of perceptually similar stimuli, may be useful early markers of risk for cognitive decline in older populations. Perceptual discrimination of stimuli with overlapping features also relies on MTL but remains relatively unexplored in this context. We assessed mnemonic discrimination in two test formats (Forced Choice, Yes/No) and perceptual discrimination of objects and scenes in 111 community-dwelling older adults at different risk status for cognitive impairment based on neuropsychological screening. We also investigated associations between performance and MTL sub-region volume and thickness. The at-risk group exhibited reduced entorhinal thickness and impaired perceptual and mnemonic discrimination. Perceptual discrimination impairment partially explained group differences in mnemonic discrimination and correlated with entorhinal thickness. Executive dysfunction accounted for Yes/No deficits in at-risk adults, demonstrating the importance of test format for the interpretation of memory decline. These results suggest that perceptual discrimination tasks may be useful tools for detecting incipient cognitive impairment related to reduced MTL integrity in nonclinical populations.

Cortico-thalamocortical interactions for learning, memory and decision-making

The thalamus and cortex are interconnected both functionally and anatomically and share a common developmental trajectory. Interactions between the mediodorsal thalamus (MD) and different parts of the prefrontal cortex are essential in cognitive processes, such as learning and adaptive decision-making. Cortico-thalamocortical interactions involving other dorsal thalamic nuclei, including the anterior thalamus and pulvinar, also influence these cognitive processes. Our work, and that of others, indicates a crucial influence of these interdependent cortico-thalamocortical neural networks that contributes actively to the processing of information within the cortex. Each of these thalamic nuclei also receives potent subcortical inputs that are likely to provide additional influences on their regulation of cortical activity. Here, we highlight our current neuroscientific research aimed at establishing when cortico-MD thalamocortical neural network communication is vital within the context of a rapid learning and memory discrimination task. We are collecting evidence of MD-prefrontal cortex neural network communication in awake, behaving male rhesus macaques. Given the prevailing evidence, further studies are needed to identify both broad and specific mechanisms that govern how the MD, anterior thalamus and pulvinar cortico-thalamocortical interactions support learning, memory and decision-making. Current evidence shows that the MD (and the anterior thalamus) are crucial for frontotemporal communication, and the pulvinar is crucial for frontoparietal communication. Such work is crucial to advance our understanding of the neuroanatomical and physiological bases of these brain functions in humans. In turn, this might offer avenues to develop effective treatment strategies to improve the cognitive deficits often observed in many debilitating neurological disorders and diseases and in neurodegeneration.

Significance of visual scene-based learning in the hippocampal systems across mammalian species

The hippocampus and its associated cortical regions in the medial temporal lobe play essential roles when animals form a cognitive map and use it to achieve their goals. As the nature of map-making involves sampling different local views of the environment and putting them together in a spatially cohesive way, visual scenes are essential ingredients in the formative process of cognitive maps. Visual scenes also serve as important cues during information retrieval from the cognitive map. Research in humans has shown that there are regions in the brain that selectively process scenes and that the hippocampus is involved in scene-based memory tasks. The neurophysiological correlates of scene-based information processing in the hippocampus have been reported as "spatial view cells" in nonhuman primates. Like primates, it is widely accepted that rodents also use visual scenes in their background for spatial navigation and other kinds of problems. However, in rodents, it is not until recently that researchers examined the neural correlates of the hippocampus from the perspective of visual scene-based information processing. With the advent of virtual reality (VR) systems, it has been demonstrated that place cells in the hippocampus exhibit remarkably similar firing correlates in the VR environment compared with that of the real-world environment. Despite some limitations, the new trend of studying hippocampal functions in a visually controlled environment has the potential to allow investigation of the input-output relationships of network functions and experimental testing of traditional computational predictions more rigorously by providing well-defined visual stimuli. As scenes are essential for navigation and episodic memory in humans, further investigation of the rodents' hippocampal systems in scene-based tasks will provide a critical functional link across different mammalian species.

Hippocampal activity during memory and visual perception: The role of representational content

The functional organisation of the medial temporal lobe (MTL) has long been described on the basis of cognitive processes such as recollection or familiarity. However, this view has recently been challenged, and researchers have proposed decomposing cognitive phenomena into representations and operations. According to the representational view, representations, such as scenes for the hippocampus and objects for the perirhinal cortex, are critical in understanding the role of MTL regions in cognition. In the present study, 51 healthy young participants underwent functional magnetic resonance imaging (fMRI) while completing a visual-discrimination task. Subsequently, half of the participants performed a patch-cue recognition procedure in which "Rec" responses are believed to reflect the operation of pattern completion, whereas the other half performed a whole-item remember/know procedure. We replicated the previously-reported demonstration that hippocampal involvement in pattern completion is preferential for scenes as compared with objects. In contrast, the perirhinal cortex was more recruited for object processing than for scene processing. We further extended these results to the operations of strength-signal memory and visual discrimination. Finally, the modulation of hippocampal engagement in pattern completion by representational content was found to be specific to its anterior segment. This observation is consistent with the proposal that this segment would process broad/global representations, whereas the posterior hippocampus would perform sharp/local representations. Taken together, these results favour the representational view of MTL functional organisation, but support that this specialisation differs along the hippocampal long-axis.

Prefrontal and Medial Temporal Lobe Cortical Contributions to Visual Short-Term Memory

A number of recent studies have indicated that the medial temporal lobe (MTL) plays a critical role in working memory (WM) and perception, but these results have been highly controversial given the traditional association of MTL with long-term memory. We review the research and highlight important factors that need to be considered in determining the role of MTL in WM including set-size of used stimuli and feature complexity and/or feature conjunctions/bindings embedded in those stimuli. These factors relate to hierarchical and, accordingly, domain-specific theories of functional organization within the temporal lobe. In addition, one must consider process-specific theories too, because two key processes commonly understood to contribute recognition memory, namely, recollection and familiarity, also have robust support from neurophysiological and neuroimaging research as to their functional dissociations within MTL. PFC has long been heavily implicated in WM; however, relatively less is known about how the PFC contributes to recollection and familiarity, although dynamic prefrontal coding models in WM may help to explain their neural mechanisms. The MTL and PFC are heavily interconnected and do not operate independently in underlying WM. We propose that investigation of the interactions between these two regions in WM, particularly their coordinated neural activities, and the modeling of such interactions, will be crucial for the advancing understanding of the neural mechanisms of WM.

Lifelong changes of neurotransmitter receptor expression and debilitation of hippocampal synaptic plasticity following early postnatal blindness

In the weeks immediately after onset of sensory loss, extensive reorganization of both the cortex and hippocampus occurs. Two fundamental characteristics comprise widespread changes in the relative expression of GABA and glutamate receptors and debilitation of hippocampal synaptic plasticity. Here, we explored whether recovery from adaptive changes in the expression of plasticity-related neurotransmitter receptors and hippocampal synaptic plasticity occurs in the time-period of up to 12 months after onset of sensory loss. We compared receptor expression in CBA/J mice that develop hereditary blindness, with CBA/CaOlaHsd mice that have intact vision and no deficits in other sensory modalities throughout adulthood. GluN1-subunit expression was reduced and the GluN2A:GluN2B ratio was persistently altered in cortex and hippocampus. GABA-receptor expression was decreased and metabotropic glutamate receptor expression was altered. Hippocampal synaptic plasticity was persistently compromised in vivo. But although LTP in blind mice was chronically impaired throughout adulthood, a recovery of the early phase of LTP became apparent when the animals reached 12 months of age. These data show that cortical and hippocampal adaptation to early postnatal blindness progresses into advanced adulthood and is a process that compromises hippocampal function. A partial recovery of hippocampal synaptic plasticity emerges in advanced adulthood, however.

Damage to the human dentate gyrus impairs the perceptual discrimination of complex, novel objects

The hippocampus (HPC), and the dentate gyrus (DG) subregion in particular, is purported to be a pattern separator, orthogonally representing similar information so that distinct memories may be formed. The HPC may also be involved in complex perceptual discrimination. It is unclear if this role is limited to spatial/scene stimuli or extends to the discrimination of objects. Also unclear is whether the DG itself contributes to pattern separation beyond memory. BL, an individual with bilateral DG lesions, was previously shown to have poor discrimination of similar, everyday objects in memory. Here, we demonstrate that BL's deficit extends to complex perceptual discrimination of novel objects. Specifically, BL was presented with closely matched possible and impossible objects, which give rise to fundamentally different 3D perceptual representations despite being visually similar. BL performed significantly worse than controls when asked to select an odd object (e.g., impossible) amongst three identical counterpart objects (e.g., possible) presented at different rotations. His deficit was also evident in an atypical eye fixation pattern during this task. In contrast, BL's performance was indistinguishable from that of controls on other tasks involving the same objects, indicating that he could visually differentiate the object pairs, that he perceived the objects holistically in 3D, and that he has only a mild weakness in categorizing object possibility. Furthermore, his performance on standardized neuropsychological measures indicated intact mental rotation, visual-spatial attention, and working memory (visual and auditory). Collectively, these results provide evidence that the DG is necessary for complex perceptual discrimination of novel objects, indicating that the DG might function as a generic pattern separator of a wide range of stimuli within high-level perception, and that its role is not limited to memory.

Category-sensitive incidental reinstatement in medial temporal lobe subregions during word recognition

During associative retrieval, the brain reinstates neural representations that were present during encoding. The human medial temporal lobe (MTL), with its subregions hippocampus (HC), perirhinal cortex (PRC), and parahippocampal cortex (PHC), plays a central role in neural reinstatement. Previous studies have given compelling evidence for reinstatement in the MTL during explicitly instructed associative retrieval. High-confident recognition may be similarly accompanied by recollection of associated information from the encoding context. It is unclear, however, whether high-confident recognition memory elicits reinstatement in the MTL even in the absence of an explicit instruction to retrieve associated information. Here, we addressed this open question using high-resolution fMRI. Twenty-eight male and female human volunteers engaged in a recognition memory task for words that they had previously encoded together with faces and scenes. Using complementary univariate and multivariate approaches, we show that MTL subregions including the PRC, PHC, and HC differentially reinstate category-sensitive representations during high-confident word recognition, even though no explicit instruction to retrieve the associated category was given. This constitutes novel evidence that high-confident recognition memory is accompanied by incidental reinstatement of associated category information in MTL subregions, and supports a functional model of the MTL that emphasizes content-sensitive representations during both encoding and retrieval.

The impact of aging and repetition on eye movements and recognition memory

The modulation of gaze fixations on neural activity in the hippocampus, a region critical for memory, has been shown to be weaker in older adults compared to younger adults. However, as such research has relied on indirect measures of memory, it remains unclear whether the relationship between visual exploration and direct measures of memory is similarly disrupted in aging. The current study tested older and younger adults on a face memory eye-tracking task previously used by our group that showed that recognition memory for faces presented across variable, but not fixed, viewpoints relies on a hippocampal-dependent binding function. Here, we examined how aging influences eye movement measures that reveal the amount (cumulative sampling) and extent (distribution of gaze fixations) of visual exploration. We also examined how aging influences direct (subsequent conscious recognition) and indirect (eye movement repetition effect) expressions of memory. No age differences were found in direct recognition regardless of facial viewpoint. However, the eye movement measures revealed key group differences. Compared to younger adults, older adults exhibited more cumulative sampling, a different distribution of fixations, and a larger repetition effect. Moreover, there was a positive relationship between cumulative sampling and direct recognition in younger adults, but not older adults. Neither age group showed a relationship between the repetition effect and direct recognition. Thus, despite similar direct recognition, age-related differences were observed in visual exploration and in an indirect eye-movement memory measure, suggesting that the two groups may acquire, retain, and use different facial information to guide recognition.

Flexible Use of Spatial Frames of Reference for Object-Location Memory in Older Adults

In memory, representations of spatial features are stored in different reference frames; features relative to our position are stored egocentrically and features relative to each other are stored allocentrically. Accessing these representations engages many cognitive and neural resources, and so is susceptible to age-related breakdown. Yet, recent findings on the heterogeneity of cognitive function and spatial ability in healthy older adults suggest that aging may not uniformly impact the flexible use of spatial representations. These factors have yet to be explored in a precisely controlled task that explicitly manipulates spatial frames of reference across learning and retrieval. We used a lab-based virtual reality task to investigate the relationship between object-location memory across frames of reference, cognitive status, and self-reported spatial ability. Memory error was measured using Euclidean distance from studied object locations to participants' responses at testing. Older adults recalled object locations less accurately when they switched between frames of reference from learning to testing, compared with when they remained in the same frame of reference. They also showed an allocentric learning advantage, producing less error when switching from an allocentric to an egocentric frame of reference, compared with the reverse direction of switching. Higher MoCA scores and better self-assessed spatial ability predicted less memory error, especially when learning occurred egocentrically. We suggest that egocentric learning deficits are driven by difficulty in binding multiple viewpoints into a coherent representation. Finally, we highlight the heterogeneity of spatial memory performance in healthy older adults as a potential cognitive marker for neurodegeneration, beyond normal aging.

When the ventral visual stream is not enough: A deep learning account of medial temporal lobe involvement in perception

The medial temporal lobe (MTL) supports a constellation of memory-related behaviors. Its involvement in perceptual processing, however, has been subject to enduring debate. This debate centers on perirhinal cortex (PRC), an MTL structure at the apex of the ventral visual stream (VVS). Here we leverage a deep learning framework that approximates visual behaviors supported by the VVS (i.e., lacking PRC). We first apply this approach retroactively, modeling 30 published visual discrimination experiments: excluding non-diagnostic stimulus sets, there is a striking correspondence between VVS-modeled and PRC-lesioned behavior, while each is outperformed by PRC-intact participants. We corroborate and extend these results with a novel experiment, directly comparing PRC-intact human performance to electrophysiological recordings from the macaque VVS: PRC-intact participants outperform a linear readout of high-level visual cortex. By situating lesion, electrophysiological, and behavioral results within a shared computational framework, this work resolves decades of seemingly inconsistent findings surrounding PRC involvement in perception.

Structural impairments in hippocampal and occipitotemporal networks specifically contribute to decline in place and face category processing but not to other visual object categories in healthy aging

BACKGROUND

Functional neuroimaging studies have identified a set of nodes in the occipital-temporal cortex that preferentially respond to faces in comparison with other visual objects. By contrast, the processing of places seems to rely on parahippocampal cortex and structures heavily implicated in memory (e.g., the hippocampus). It has been suggested that human aging leads to decreased neural specialization of core face and place processing areas and impairments in face and place perception.

METHODS

Using mediation analysis, we tested the potential contribution of micro- and macrostructure within the hippocampal and occipitotemporal systems to age-associated effects in face and place category processing (as measured by 1-back working memory tasks) in 55 healthy adults (age range 23-79 years). To test for specific contributions of the studied structures to face/place processing, we also studied a distinct tract (i.e., the anterior thalamic radiation [ATR]) and cognitive performance for other visual object categories (objects, bodies, and verbal material). Constrained spherical deconvolution-based tractography was used to reconstruct the fornix, the inferior longitudinal fasciculus (ILF), and the ATR. Hippocampal volumetric measures were segmented from FSL-FIRST toolbox.

RESULTS

It was found that age associates with (a) decreases in fractional anisotropy (FA) in the fornix, in right ILF (but not left ILF), and in the ATR (b) reduced volume in the right and left hippocampus and (c) decline in visual object category processing. Importantly, mediation analysis showed that micro- and macrostructural impairments in the fornix and right hippocampus, respectively, associated with age-dependent decline in place processing. Alternatively, microstructural impairments in right hemispheric ILF associated with age-dependent decline in face processing. There were no other mediator effects of micro- and macrostructural variables on age-cognition relationships.

CONCLUSION

Together, the findings support specific contributions of the fornix and right hippocampus in visuospatial scene processing and of the long-range right hemispheric occipitotemporal network in face category processing.

Content-specific vulnerability of recent episodic memories in Alzheimer's disease

Endel Tulving's episodic memory framework emphasizes the multifaceted re-experiencing of personal events. Indeed, decades of research focused on the experiential nature of episodic memories, usually treating recent episodic memory as a coherent experiential quality. However, recent insights into the functional architecture of the medial temporal lobe show that different types of mnemonic information are segregated into distinct neural pathways in brain circuits empirically associated with episodic memory. Moreover, recent memories do not fade as a whole under conditions of progressive neurodegeneration in these brain circuits, notably in Alzheimer's disease. Instead, certain memory content seem particularly vulnerable from the moment of their encoding while other content can remain memorable consistently across individuals and contexts. We propose that these observations are related to the content-specific functional architecture of the medial temporal lobe and consequently to a content-specific impairment of memory at different stages of the neurodegeneration. To develop Endel Tulving's inspirational legacy further and to advance our understanding of how memory function is affected by neurodegenerative conditions such as Alzheimer's disease, we postulate that it is compelling to focus on the representational content of recent episodic memories.

•

The functional anatomy of episodic memory segregates different memory content.

•

Alzheimer's disease may cause content-specific loss of recent memories

•

Content-specific memorability across individuals changes with Alzheimer's disease.

•

Content-specific assessment could provide new insights into episodic memory in health and disease

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

Facial memory ability and self-awareness in patients with temporal lobe epilepsy after anterior temporal lobectomy

Anterior temporal lobectomy (ATL) is the most common surgical treatment for drug-resistant temporal lobe epilepsy (TLE). Right ATL has been reported to reduce facial memory ability in patients with TLE, as indicated by poor performance on the Warrington Recognition Memory Test for Faces (RMF), which is commonly used to evaluate visual memory in these patients. However, little is known about whether patients with TLE exhibit difficulties in identifying faces in daily life after ATL. The aim of this study was to investigate facial memory ability and self-awareness of face identification difficulties in patients with TLE after ATL. Sixteen patients with TLE after right ATL, 14 patients with TLE after left ATL, and 29 healthy controls were enrolled in this study. We developed the multiview face recognition test (MFRT), which comprises a learning phase (one or three frontal face images without external facial feature information) and a recognition phase (frontal, oblique, or noise-masked face images). Facial memory abilities were examined in all participants using the MFRT and RMF, and self-awareness of difficulties in face identification was evaluated using the 20-item prosopagnosia index (PI20), which has been widely used to assess developmental prosopagnosia. The MFRT performance in patients with TLE after ATL was significantly worse than that in healthy controls regardless of the resected side, whereas the RMF scores in patients with TLE were significantly worse than those in healthy controls only after right ATL. The MFRT performance in patients with TLE after both left and right ATL was more influenced by working memory load than that in healthy controls. The PI20 scores revealed that patients with TLE after left ATL were aware of their difficulties in identifying faces. These findings suggest that patients with TLE not only after right ATL but also after left ATL might have difficulties in face identification.

Executive function and high ambiguity perceptual discrimination contribute to individual differences in mnemonic discrimination in older adults

Mnemonic discrimination deficits, or impaired ability to discriminate between similar events in memory, is a hallmark of cognitive aging, characterised by a stark age-related increase in false recognition. While individual differences in mnemonic discrimination have gained attention due to potential relevance for early detection of Alzheimer's disease, our understanding of the component processes that contribute to variability in task performance across older adults remains limited. The present investigation explores the roles of representational quality, indexed by perceptual discrimination of objects and scenes with overlapping features, and strategic retrieval ability, indexed by standardised tests of executive function, to mnemonic discrimination in a large cohort of older adults (N=124). We took an individual differences approach and characterised the contributions of these factors to performance under Forced Choice (FC) and Yes/No (YN) recognition memory formats, which place different demands on strategic retrieval. Performance in both test formats declined with age. Accounting for age, individual differences in FC memory performance were best explained by perceptual discrimination score, whereas YN memory performance was best explained by executive functions. A linear mixed model and dominance analyses confirmed the relatively greater importance of perceptual discrimination over executive functioning for FC performance, while the opposite was true for YN. These findings highlight parallels between perceptual and mnemonic discrimination in aging, the importance of considering demands on executive functions in the context of mnemonic discrimination, and the relevance of test format for modulating the impact of these factors on performance in older adults.

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Characterising the hippocampal response to perception, construction and complexity

The precise role played by the hippocampus in supporting cognitive functions such as episodic memory and future thinking is debated, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, questions remain about the specificity and nature of the hippocampal response to scenes. Here, we devised a paradigm in which we had participants search pairs of images for either colour or layout differences, thought to be associated with perceptual or spatial constructive processes respectively. Importantly, images depicted either naturalistic scenes or phase-scrambled versions of the same scenes, and were either simple or complex. Using this paradigm during functional MRI scanning, we addressed three questions: 1. Is the hippocampus recruited specifically during scene processing? 2. If the hippocampus is more active in response to scenes, does searching for colour or layout differences influence its activation? 3. Does the complexity of the scenes affect its response? We found that, compared to phase-scrambled versions of the scenes, the hippocampus was more responsive to scene stimuli. Moreover, a clear anatomical distinction was evident, with colour detection in scenes engaging the posterior hippocampus whereas layout detection in scenes recruited the anterior hippocampus. The complexity of the scenes did not influence hippocampal activity. These findings seem to align with perspectives that propose the hippocampus is especially attuned to scenes, and its involvement occurs irrespective of the cognitive process or the complexity of the scenes.

The Role of Hippocampal-Ventromedial Prefrontal Cortex Neural Dynamics in Building Mental Representations

The hippocampus and ventromedial prefrontal cortex (vmPFC) play key roles in numerous cognitive domains including mind-wandering, episodic memory, and imagining the future. Perspectives differ on precisely how they support these diverse functions, but there is general agreement that it involves constructing representations composed of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multielement stimuli. However, it remains unclear whether scenes, rather than other types of multifeature stimuli, preferentially engage hippocampus and vmPFC. Here, we leveraged the high temporal resolution of magnetoencephalography to test participants as they gradually built scene imagery from three successive auditorily presented object descriptions and an imagined 3-D space. This was contrasted with constructing mental images of nonscene arrays that were composed of three objects and an imagined 2-D space. The scene and array stimuli were, therefore, highly matched, and this paradigm permitted a closer examination of step-by-step mental construction than has been undertaken previously. We observed modulation of theta power in our two regions of interest-anterior hippocampus during the initial stage and vmPFC during the first two stages, of scene relative to array construction. Moreover, the scene-specific anterior hippocampal activity during the first construction stage was driven by the vmPFC, with mutual entrainment between the two brain regions thereafter. These findings suggest that hippocampal and vmPFC neural activity is especially tuned to scene representations during the earliest stage of their formation, with implications for theories of how these brain areas enable cognitive functions such as episodic memory.

Reframing spatial frames of reference: What can aging tell us about egocentric and allocentric navigation?

Representations of space in mind are crucial for navigation, facilitating processes such as remembering landmark locations, understanding spatial relationships between objects, and integrating routes. A significant problem, however, is the lack of consensus on how these representations are encoded and stored in memory. Specifically, the nature of egocentric and allocentric frames of reference in human memory is widely debated. Yet, in recent investigations of the spatial domain across the lifespan, these distinctions in mnemonic spatial frames of reference have identified age-related impairments. In this review, we survey the ways in which different terms related to spatial representations in memory have been operationalized in past aging research and suggest a taxonomy to provide a common language for future investigations and theoretical discussion. This article is categorized under: Psychology > Memory Neuroscience > Cognition Psychology > Development and Aging.

Corticocortical and Thalamocortical Changes in Functional Connectivity and White Matter Structural Integrity after Reward-Guided Learning of Visuospatial Discriminations in Rhesus Monkeys

The frontal cortex and temporal lobes together regulate complex learning and memory capabilities. Here, we collected resting-state functional and diffusion-weighted MRI data before and after male rhesus macaque monkeys received extensive training to learn novel visuospatial discriminations (reward-guided learning). We found functional connectivity changes in orbitofrontal, ventromedial prefrontal, inferotemporal, entorhinal, retrosplenial, and anterior cingulate cortices, the subicular complex, and the dorsal, medial thalamus. These corticocortical and thalamocortical changes in functional connectivity were accompanied by related white matter structural alterations in the uncinate fasciculus, fornix, and ventral prefrontal tract: tracts that connect (sub)cortical networks and are implicated in learning and memory processes in monkeys and humans. After the well-trained monkeys received fornix transection, they were impaired in learning new visuospatial discriminations. In addition, the functional connectivity profile that was observed after the training was altered. These changes were accompanied by white matter changes in the ventral prefrontal tract, although the integrity of the uncinate fasciculus remained unchanged. Our experiments highlight the importance of different communication relayed among corticocortical and thalamocortical circuitry for the ability to learn new visuospatial associations (learning-to-learn) and to make reward-guided decisions.SIGNIFICANCE STATEMENT Frontal neural networks and the temporal lobes contribute to reward-guided learning in mammals. Here, we provide novel insight by showing that specific corticocortical and thalamocortical functional connectivity is altered after rhesus monkeys received extensive training to learn novel visuospatial discriminations. Contiguous white matter fiber pathways linking these gray matter structures, namely, the uncinate fasciculus, fornix, and ventral prefrontal tract, showed structural changes after completing training in the visuospatial task. Additionally, different patterns of functional and structural connectivity are reported after removal of subcortical connections within the extended hippocampal system, via fornix transection. These results highlight the importance of both corticocortical and thalamocortical interactions in reward-guided learning in the normal brain and identify brain structures important for memory capabilities after injury.

Knowledge Across Reference Frames: Cognitive Maps and Image Spaces

In human and non-human animals, conceptual knowledge is partially organized according to low-dimensional geometries that rely on brain structures and computations involved in spatial representations. Recently, two separate lines of research have investigated cognitive maps, that are associated with the hippocampal formation and are similar to world-centered representations of the environment, and image spaces, that are associated with the parietal cortex and are similar to self-centered spatial relationships. We review evidence supporting cognitive maps and image spaces, and we propose a hippocampal-parietal network that can account for the organization and retrieval of knowledge across multiple reference frames. We also suggest that cognitive maps and image spaces may be two manifestations of a more general propensity of the mind to create low-dimensional internal models.

Similar time course of fast familiarity and slow recollection processes for recognition memory in humans and macaques

According to dual-process theory, recognition memory performance draws upon two processes, familiarity and recollection. The relative contribution to recognition memory are commonly distinguished in humans by analyzing receiver-operating-characteristics (ROC) curves; analogous methods are more complex and very rare in animals but fast familiarity and slow recollective-like processes (FF/SR) have been detected in nonhuman primates (NHPs) based on analyzing recognition error response time profiles. The relative utility of these methods to investigate familiarity and recollection/recollection-like processes across species is uncertain; indeed, even how comparable the FF/SR measures are across humans and NHPs remains unclear. Therefore, in this study a broadly similar recognition memory task was exploited in both humans and a NHP to investigate the time course of the two recognition processes. We first show that the FF/SR dissociation exists in this task in human participants and then we demonstrate a similar profile in the NHP which suggests that FF/SR processes are comparable across species. We then verified, using ROC-derived indices for each time-bin in the FF/SR profile, that the ROC and FF/SR measures are related. Hence, we argue that the FF/SR approach, procedurally easier in nonhuman animals, can be used as a decent proxy to investigate these two recognition processes in future animal studies, important given that scant data exists as to the neural basis underlying recollection yet many of the most informative techniques primarily exist in animal models.

The Medial Temporal Lobe Is Critical for Spatial Relational Perception

The medial temporal lobe (MTL) is traditionally considered to be a system that is specialized for long-term memory. Recent work has challenged this notion by demonstrating that this region can contribute to many domains of cognition beyond long-term memory, including perception and attention. One potential reason why the MTL (and hippocampus specifically) contributes broadly to cognition is that it contains relational representations-representations of multidimensional features of experience and their unique relationship to one another-that are useful in many different cognitive domains. Here, we explore the hypothesis that the hippocampus/MTL plays a critical role in attention and perception via relational representations. We compared human participants with MTL damage to healthy age- and education-matched individuals on attention tasks that varied in relational processing demands. On each trial, participants viewed two images (rooms with paintings). On "similar room" trials, they judged whether the rooms had the same spatial layout from a different perspective. On "similar art" trials, they judged whether the paintings could have been painted by the same artist. On "identical" trials, participants simply had to detect identical paintings or rooms. MTL lesion patients were significantly and selectively impaired on the similar room task. This work provides further evidence that the hippocampus/MTL plays a ubiquitous role in cognition by virtue of its relational and spatial representations and highlights its important contributions to rapid perceptual processes that benefit from attention.

Cerebellar-hippocampal processing in passive perception of visuospatial change: An ego- and allocentric axis?

In addition to its role in visuospatial navigation and the generation of spatial representations, in recent years, the hippocampus has been proposed to support perceptual processes. This is especially the case where high‐resolution details, in the form of fine‐grained relationships between features such as angles between components of a visual scene, are involved. An unresolved question is how, in the visual domain, perspective‐changes are differentiated from allocentric changes to these perceived feature relationships, both of which may be argued to involve the hippocampus. We conducted functional magnetic resonance imaging of the brain response (corroborated through separate event‐related potential source‐localization) in a passive visuospatial oddball‐paradigm to examine to what extent the hippocampus and other brain regions process changes in perspective, or configuration of abstract, three‐dimensional structures. We observed activation of the left superior parietal cortex during perspective shifts, and right anterior hippocampus in configuration‐changes. Strikingly, we also found the cerebellum to differentiate between the two, in a way that appeared tightly coupled to hippocampal processing. These results point toward a relationship between the cerebellum and the hippocampus that occurs during perception of changes in visuospatial information that has previously only been reported with regard to visuospatial navigation.

A Memory Computational Basis for the Other-Race Effect

People often recognize and remember faces of individuals within their own race more easily than those of other races. While behavioral research has long suggested that the Other-Race Effect (ORE) is due to extensive experience with one’s own race group, the neural mechanisms underlying the effect have remained elusive. Predominant theories of the ORE have argued that the effect is mainly caused by processing disparities between same and other-race faces during early stages of perceptual encoding. Our findings support an alternative view that the ORE is additionally shaped by mnemonic processing mechanisms beyond perception and attention. Using a “pattern separation” paradigm based on computational models of episodic memory, we report evidence that the ORE may be driven by differences in successful memory discrimination across races as a function of degree of interference or overlap between face stimuli. In contrast, there were no ORE-related differences on a comparable match-to-sample task with no long-term memory load, suggesting that the effect is not simply attributable to visual and attentional processes. These findings suggest that the ORE may emerge in part due to “tuned” memory mechanisms that may enhance same-race, at the expense of other-race face detection.

The hippocampus as a visual area organized by space and time: A spatiotemporal similarity hypothesis

The hippocampus is the canonical memory system in the brain and is not typically considered part of the visual system. Yet, it sits atop the ventral visual stream and has been implicated in certain aspects of vision. Here I review the place of the hippocampal memory system in vision science. After a brief primer on the local circuity, external connectivity, and computational functions of the hippocampus, I explore what can be learned from each field about the other. I first present four areas of vision science (scene perception, imagery, eye movements, attention) that challenge our current understanding of the hippocampus in terms of its role in episodic memory. In the reverse direction, I leverage this understanding to inform vision science in other ways, presenting a working hypothesis about a unique form of visual representation. This spatiotemporal similarity hypothesis states that the hippocampus represents objects according to whether they co-occur in space and/or time, and not whether they look alike, as elsewhere in the visual system. This tuning may reflect hippocampal mechanisms of pattern separation, relational binding, and statistical learning, allowing the hippocampus to generate visual expectations to facilitate search and recognition.

A Roadmap for Understanding Memory: Decomposing Cognitive Processes into Operations and Representations

Thanks to patients Phineas Gage and Henry Molaison, we have long known that behavioral control depends on the frontal lobes, whereas declarative memory depends on the medial temporal lobes (MTL). For decades, cognitive functions-behavioral control, declarative memory-have served as labels for characterizing the division of labor in cortex. This approach has made enormous contributions to understanding how the brain enables the mind, providing a systems-level explanation of brain function that constrains lower-level investigations of neural mechanism. Today, the approach has evolved such that functional labels are often applied to brain networks rather than focal brain regions. Furthermore, the labels have diversified to include both broadly-defined cognitive functions (declarative memory, visual perception) and more circumscribed mental processes (recollection, familiarity, priming). We ask whether a process-a high-level mental phenomenon corresponding to an introspectively-identifiable cognitive event-is the most productive label for dissecting memory. For example, recollection conflates a neurocomputational operation (pattern completion-based retrieval) with a class of representational content (associative, high-dimensional memories). Because a full theory of memory must identify operations and representations separately, and specify how they interact, we argue that processes like recollection constitute inadequate labels for characterizing neural mechanisms. Instead, we advocate considering the component operations and representations of processes like recollection in isolation. For the organization of memory, the evidence suggests that pattern completion is recapitulated widely across the ventral visual stream and MTL, but the division of labor between sites within this pathway can be explained by representational content.

Spared Perception of the Structure of Scenes after Hippocampal Damage

To explore whether the hippocampus might be important for certain spatial operations in addition to its well-known role in memory, we administered two tasks in which participants judged whether objects embedded in scenes or whether scenes themselves could exist in 3-D space. Patients with damage limited to the hippocampus performed as well as controls in both tasks. A patient with large medial-temporal lobe lesions had a bias to judge objects in scenes and scenes themselves as possible, performing well with possible stimuli but poorly with impossible stimuli in both tasks. All patients were markedly impaired at remembering the tasks. The hippocampus appears not to be essential for judging the structural coherence of objects in scenes or the coherence of scenes. The findings conform to what is now a sizeable literature emphasizing the importance of the hippocampus for memory. We discuss our results in light of findings that other patients have sometimes been reported to be disadvantaged by spatial tasks like the ones studied here, despite less hippocampal damage and milder memory impairment.

Object-in-place Memory Predicted by Anterolateral Entorhinal Cortex and Parahippocampal Cortex Volume in Older Adults

The lateral portion of the entorhinal cortex is one of the first brain regions affected by tau pathology, an important biomarker for Alzheimer disease. Improving our understanding of this region's cognitive role may help identify better cognitive tests for early detection of Alzheimer disease. Based on its functional connections, we tested the idea that the human anterolateral entorhinal cortex (alERC) may play a role in integrating spatial information into object representations. We recently demonstrated that the volume of the alERC was related to processing the spatial relationships of the features within an object [Yeung, L. K., Olsen, R. K., Bild-Enkin, H. E. P., D'Angelo, M. C., Kacollja, A., McQuiggan, D. A., et al. Anterolateral entorhinal cortex volume predicted by altered intra-item configural processing. Journal of Neuroscience, 37, 5527–5538, 2017]. In this study, we investigated whether the human alERC might also play a role in processing the spatial relationships between an object and its environment using an eye-tracking task that assessed visual fixations to a critical object within a scene. Guided by rodent work, we measured both object-in-place memory, the association of an object with a given context [Wilson, D. I., Langston, R. F., Schlesiger, M. I., Wagner, M., Watanabe, S., & Ainge, J. A. Lateral entorhinal cortex is critical for novel object-context recognition. Hippocampus, 23, 352–366, 2013], and object-trace memory, the memory for the former location of objects [Tsao, A., Moser, M. B., & Moser, E. I. Traces of experience in the lateral entorhinal cortex. Current Biology, 23, 399–405, 2013]. In a group of older adults with varying stages of brain atrophy and cognitive decline, we found that the volume of the alERC and the volume of the parahippocampal cortex selectively predicted object-in-place memory, but not object-trace memory. These results provide support for the notion that the alERC may integrate spatial information into object representations.

Spontaneous memory retrieval varies based on familiarity with a spatial context

Spatial context can serve as a powerful cue for episodic memory. In daily life, we encounter locations varying in familiarity that may trigger different forms of memory retrieval. While previous research on autobiographical memory suggests that more familiar landmarks cue more detailed memories, theories such as cue overload predict that less familiar cues will more reliably trigger specific memory retrieval. It is therefore possible that more and less familiar cues will differentially elicit more generalized and specific memories, respectively. In this series of studies, we develop a novel paradigm for eliciting spontaneous memory retrieval based on real-world spatial contexts varying in familiarity. We found evidence that more familiar contexts generally lead to higher rates of spontaneous memory retrieval for semantic and generalized memories, but that episodic memories are more frequently retrieved for less familiar cues. These patterns demonstrate how related memories lead to the formation of more generalized representations over time, while memories with fewer associates remain episodic. We discuss these findings in relation to those obtained in a version of the study in which participants were instructed to retrieve thoughts. Together these findings provide novel insight into the dynamics of context familiarity and memory retrieval in a naturalistic autobiographical memory paradigm.

A Computational Model of Visual Recognition Memory via Grid Cells

Models of face, object, and scene recognition traditionally focus on massively parallel processing of low-level features, with higher-order representations emerging at later processing stages. However, visual perception is tightly coupled to eye movements, which are necessarily sequential. Recently, neurons in entorhinal cortex have been reported with grid cell-like firing in response to eye movements, i.e., in visual space. Following the presumed role of grid cells in vector navigation, we propose a model of recognition memory for familiar faces, objects, and scenes, in which grid cells encode translation vectors between salient stimulus features. A sequence of saccadic eye-movement vectors, moving from one salient feature to the expected location of the next, potentially confirms an initial hypothesis (accumulating evidence toward a threshold) about stimulus identity, based on the relative feature layout (i.e., going beyond recognition of individual features). The model provides an explicit neural mechanism for the long-held view that directed saccades support hypothesis-driven, constructive perception and recognition; is compatible with holistic face processing; and constitutes the first quantitative proposal for a role of grid cells in visual recognition. The variance of grid cell activity along saccade trajectories exhibits 6-fold symmetry across 360 degrees akin to recently reported fMRI data. The model suggests that disconnecting grid cells from occipitotemporal inputs may yield prosopagnosia-like symptoms. The mechanism is robust with regard to partial visual occlusion, can accommodate size and position invariance, and suggests a functional explanation for medial temporal lobe involvement in visual memory for relational information and memory-guided attention.

Understanding perirhinal contributions to perception and memory: Evidence through the lens of selective perirhinal damage

Although a memory systems view of the medial temporal lobe (MTL) has been widely influential in understanding how memory processes are implemented, a large body of work across humans and animals has converged on the idea that the MTL can support various other decisions, beyond those involving memory. Specifically, recent work suggests that perception of and memory for visual representations may interact in order to support ongoing cognition. However, given considerations involving lesion profiles in neuropsychological investigations and the correlational nature of fMRI, the precise nature of representations supported by the MTL are not well understood in humans. In the present investigation, three patients with highly specific lesions to MTL were administered a task that taxed perceptual and mnemonic judgments with highly similar face stimuli. A striking double dissociation was observed such that I.R., a patient with a cyst localized to right posterior PRc, displayed a significant impairment in perceptual discriminations, whereas patient A.N., an individual with a lesion in right posterior parahippocampal cortex and the tail of the right hippocampus, and S.D., an individual with bilateral hippocampal damage, did not display impaired performance on the perceptual task. A.N. and S.D. did, however, show impairments in memory performance, whereas patient I.R. did not. These results causally implicate right PRc in successful perceptual oddity judgments, however they suggest that representations supported by PRc are not necessary for correct mnemonic judgments, even in situations of high featural overlap.

Category specificity in the medial temporal lobe: A systematic review

Theoretical accounts of medial temporal lobe (MTL) function ascribe different functions to subregions of the MTL including perirhinal, entorhinal, parahippocampal cortices, and the hippocampus. Some have suggested that the functional roles of these subregions vary in terms of their category specificity, showing preferential coding for certain stimulus types, but the evidence for this functional organization is mixed. In this systematic review, we evaluate existing evidence for regional specialization in the MTL for three categories of visual stimuli: faces, objects, and scenes. We review and synthesize across univariate and multivariate neuroimaging studies, as well as neuropsychological studies of cases with lesions to the MTL. Neuroimaging evidence suggests that faces activate the perirhinal cortex, entorhinal cortex, and the anterior hippocampus, while scenes engage the parahippocampal cortex and both the anterior and posterior hippocampus, depending on the contrast condition. There is some evidence for object-related activity in anterior MTL regions when compared to scenes, and in posterior MTL regions when compared to faces, suggesting that aspects of object representations may share similarities with face and scene representations. While neuroimaging evidence suggests some hippocampal specialization for faces and scenes, neuropsychological evidence shows that hippocampal damage leads to impairments in scene memory and perception, but does not entail equivalent impairments for faces in cases where the perirhinal cortex remains intact. Regional specialization based on stimulus categories has implications for understanding the mechanisms of MTL subregions, and highlights the need for the development of theoretical models of MTL function that can accommodate the differential patterns of specificity observed in the MTL.

Cooperating yet distinct brain networks engaged during naturalistic paradigms: A meta-analysis of functional MRI results

Cognitive processes do not occur by pure insertion and instead depend on the full complement of co-occurring mental processes, including perceptual and motor functions. As such, there is limited ecological validity to human neuroimaging experiments that use highly controlled tasks to isolate mental processes of interest. However, a growing literature shows how dynamic, interactive tasks have allowed researchers to study cognition as it more naturally occurs. Collective analysis across such neuroimaging experiments may answer broader questions regarding how naturalistic cognition is biologically distributed throughout the brain. We applied an unbiased, data-driven, meta-analytic approach that uses k-means clustering to identify core brain networks engaged across the naturalistic functional neuroimaging literature. Functional decoding allowed us to, then, delineate how information is distributed between these networks throughout the execution of dynamical cognition in realistic settings. This analysis revealed six recurrent patterns of brain activation, representing sensory, domain-specific, and attentional neural networks that support the cognitive demands of naturalistic paradigms. Although gaps in the literature remain, these results suggest that naturalistic fMRI paradigms recruit a common set of networks that allow both separate processing of different streams of information and integration of relevant information to enable flexible cognition and complex behavior.