Activating the Medial Temporal Lobe during Oddity Judgment for Faces and Scenes

Scene-selectivity in CA1/subicular complex: Multivoxel pattern analysis at 7T

Prior univariate functional magnetic resonance imaging (fMRI) studies in humans suggest that the anteromedial subicular complex of the hippocampus is a hub for scene-based cognition. However, it is possible that univariate approaches were not sufficiently sensitive to detect scene-related activity in other subfields that have been implicated in spatial processing (e.g., CA1). Further, as connectivity-based functional gradients in the hippocampus do not respect classical subfield boundary definitions, category selectivity may be distributed across anatomical subfields. Region-of-interest approaches, therefore, may limit our ability to observe category selectivity across discrete subfield boundaries. To address these issues, we applied searchlight multivariate pattern analysis to 7T fMRI data of healthy adults who undertook a simultaneous visual odd-one-out discrimination task for scene and non-scene (including face) visual stimuli, hypothesising that scene classification would be possible in multiple hippocampal regions within, but not constrained to, anteromedial subicular complex and CA1. Indeed, we found that the scene-selective searchlight map overlapped not only with anteromedial subicular complex (distal subiculum, pre/para subiculum), but also inferior CA1, alongside posteromedial (including retrosplenial) and parahippocampal cortices. Probabilistic overlap maps revealed gradients of scene category selectivity, with the strongest overlap located in the medial hippocampus, converging with searchlight findings. This was contrasted with gradients of face category selectivity, which had stronger overlap in more lateral hippocampus, supporting ideas of parallel processing streams for these two categories. Our work helps to map the scene, in contrast to, face processing networks within, and connected to, the human hippocampus.

Older adults can use memory for distinctive objects, but not distinctive scenes, to rescue associative memory deficits

Associative memory deficits in aging are frequently characterized by false recognition of novel stimulus associations, particularly when stimuli are similar. Introducing distinctive stimuli, therefore, can help guide item differentiation in memory and can further our understanding of how age-related brain changes impact behavior. How older adults use different types of distinctive information to distinguish overlapping events in memory and to avoid false associative recognition is still unknown. To test this, we manipulated the distinctiveness of items from two stimulus categories, scenes and objects, across three conditions: (1) distinct scenes paired with similar objects, (2) similar scenes paired with distinct objects, and (3) similar scenes paired with similar objects. Young and older adults studied scene-object pairs and then made both remember/know judgments toward single items as well as associative memory judgments to old and novel scene-object pairs ("Were these paired together?"). Older adults showed intact single item recognition of scenes and objects, regardless of whether those objects and scenes were similar or distinct. In contrast, relative to younger adults, older adults showed elevated false recognition for scene-object pairs, even when the scenes were distinct. These age-related associative memory deficits, however, disappeared if the pair contained an object that was visually distinct. In line with neural evidence that hippocampal functioning and scene processing decline with age, these results suggest that older adults can rely on memory for distinct objects, but not for distinct scenes, to distinguish between memories with overlapping features.

Complex visual discrimination is impaired after right, but not left, anterior temporal lobectomy

The prevailing view in human cognitive neuroscience associates the medial temporal lobes (MTLs) with declarative memory. Compelling experimental evidence has, however, demonstrated that these regions are specialized according to the representations processed, irrespective of the cognitive domain assessed. This account was supported by the study of patients with bilateral medial temporal amnesia, who exhibit impairments in perceptual tasks involving complex visual stimuli. Yet, little is known regarding the impact of unilateral MTL damage on complex visual abilities. To address this issue, we administered a visual matching task to 20 patients who underwent left (N = 12) or right (N = 8) anterior temporal lobectomy for drug-resistant epilepsy and to 38 healthy controls. Presentation viewpoint was manipulated to increase feature ambiguity, as this is critical to reveal impairments in perceptual tasks. Similar to control participants, patients with left-sided damage succeeded in all task conditions. In contrast, patients with right-sided damage had decreased accuracy compared with that of the other two groups, as well as increased response time. Notably, the accuracy of those with right-sided damage did not exceed chance level when feature ambiguity was high (i.e., when stimuli were presented from different viewpoints) for the most complex classes of stimuli (i.e., scenes and buildings, compared with single objects). The pattern reported in bilateral patients in previous studies was therefore reproduced in patients with right, but not left, resection. These results suggest that the complex visual-representation functions supported by the MTL are right-lateralized, and raise the question as to how the representational account of these regions applies to representations supported by left MTL regions.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

The locus of recognition memory signals in human cortex depends on the complexity of the memory representations

According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.

Detecting Dementia from Face-Related Features with Automated Computational Methods

Alzheimer's disease (AD) is a type of dementia that is more likely to occur as people age. It currently has no known cure. As the world's population is aging quickly, early screening for AD has become increasingly important. Traditional screening methods such as brain scans or psychiatric tests are stressful and costly. The patients are likely to feel reluctant to such screenings and fail to receive timely intervention. While researchers have been exploring the use of language in dementia detection, less attention has been given to face-related features. The paper focuses on investigating how face-related features can aid in detecting dementia by exploring the PROMPT dataset that contains video data collected from patients with dementia during interviews. In this work, we extracted three types of features from the videos, including face mesh, Histogram of Oriented Gradients (HOG) features, and Action Units (AU). We trained traditional machine learning models and deep learning models on the extracted features and investigated their effectiveness in dementia detection. Our experiments show that the use of HOG features achieved the highest accuracy of 79% in dementia detection, followed by AU features with 71% accuracy, and face mesh features with 66% accuracy. Our results show that face-related features have the potential to be a crucial indicator in automated computational dementia detection.

Using image reconstruction to investigate face perception in amnesia

Damage to the medial temporal lobe (MTL), which is traditionally considered to subserve memory exclusively, has been reported to contribute to impaired face perception. However, it remains unknown how exactly such brain lesions may impact face representations and in particular facial shape and surface information, both of which are crucial for face perception. The present study employed a behavioral-based image reconstruction approach to reveal the pictorial representations of face perception in two amnesic patients: DA, who has an extensive bilateral MTL lesion that extends beyond the MTL in the right hemisphere, and BL, who has damage to the hippocampal dentate gyrus (DG). Both patients and their respective matched controls completed similarity judgments for pairs of faces, from which facial shape and surface features were subsequently derived and synthesized to create images of reconstructed facial appearance. Participants also completed a face oddity judgment task (FOJT) that has previously been shown to be sensitive to MTL cortical damage. While BL exhibited an impaired pattern of performance on the FOJT, DA demonstrated intact performance accuracy. Notably, the recovered pictorial content of faces was comparable between both patients and controls, although there was evidence for atypical face representations in BL particularly with regards to color. Our work provides novel insight into the face representations underlying face perception in two well-studied amnesic patients in the literature and demonstrates the applicability of the image reconstruction approach to individuals with brain damage.

Significance of visual scene-based learning in the hippocampal systems across mammalian species

The hippocampus and its associated cortical regions in the medial temporal lobe play essential roles when animals form a cognitive map and use it to achieve their goals. As the nature of map-making involves sampling different local views of the environment and putting them together in a spatially cohesive way, visual scenes are essential ingredients in the formative process of cognitive maps. Visual scenes also serve as important cues during information retrieval from the cognitive map. Research in humans has shown that there are regions in the brain that selectively process scenes and that the hippocampus is involved in scene-based memory tasks. The neurophysiological correlates of scene-based information processing in the hippocampus have been reported as "spatial view cells" in nonhuman primates. Like primates, it is widely accepted that rodents also use visual scenes in their background for spatial navigation and other kinds of problems. However, in rodents, it is not until recently that researchers examined the neural correlates of the hippocampus from the perspective of visual scene-based information processing. With the advent of virtual reality (VR) systems, it has been demonstrated that place cells in the hippocampus exhibit remarkably similar firing correlates in the VR environment compared with that of the real-world environment. Despite some limitations, the new trend of studying hippocampal functions in a visually controlled environment has the potential to allow investigation of the input-output relationships of network functions and experimental testing of traditional computational predictions more rigorously by providing well-defined visual stimuli. As scenes are essential for navigation and episodic memory in humans, further investigation of the rodents' hippocampal systems in scene-based tasks will provide a critical functional link across different mammalian species.

Hippocampal activity during memory and visual perception: The role of representational content

The functional organisation of the medial temporal lobe (MTL) has long been described on the basis of cognitive processes such as recollection or familiarity. However, this view has recently been challenged, and researchers have proposed decomposing cognitive phenomena into representations and operations. According to the representational view, representations, such as scenes for the hippocampus and objects for the perirhinal cortex, are critical in understanding the role of MTL regions in cognition. In the present study, 51 healthy young participants underwent functional magnetic resonance imaging (fMRI) while completing a visual-discrimination task. Subsequently, half of the participants performed a patch-cue recognition procedure in which "Rec" responses are believed to reflect the operation of pattern completion, whereas the other half performed a whole-item remember/know procedure. We replicated the previously-reported demonstration that hippocampal involvement in pattern completion is preferential for scenes as compared with objects. In contrast, the perirhinal cortex was more recruited for object processing than for scene processing. We further extended these results to the operations of strength-signal memory and visual discrimination. Finally, the modulation of hippocampal engagement in pattern completion by representational content was found to be specific to its anterior segment. This observation is consistent with the proposal that this segment would process broad/global representations, whereas the posterior hippocampus would perform sharp/local representations. Taken together, these results favour the representational view of MTL functional organisation, but support that this specialisation differs along the hippocampal long-axis.

Damage to the human dentate gyrus impairs the perceptual discrimination of complex, novel objects

The hippocampus (HPC), and the dentate gyrus (DG) subregion in particular, is purported to be a pattern separator, orthogonally representing similar information so that distinct memories may be formed. The HPC may also be involved in complex perceptual discrimination. It is unclear if this role is limited to spatial/scene stimuli or extends to the discrimination of objects. Also unclear is whether the DG itself contributes to pattern separation beyond memory. BL, an individual with bilateral DG lesions, was previously shown to have poor discrimination of similar, everyday objects in memory. Here, we demonstrate that BL's deficit extends to complex perceptual discrimination of novel objects. Specifically, BL was presented with closely matched possible and impossible objects, which give rise to fundamentally different 3D perceptual representations despite being visually similar. BL performed significantly worse than controls when asked to select an odd object (e.g., impossible) amongst three identical counterpart objects (e.g., possible) presented at different rotations. His deficit was also evident in an atypical eye fixation pattern during this task. In contrast, BL's performance was indistinguishable from that of controls on other tasks involving the same objects, indicating that he could visually differentiate the object pairs, that he perceived the objects holistically in 3D, and that he has only a mild weakness in categorizing object possibility. Furthermore, his performance on standardized neuropsychological measures indicated intact mental rotation, visual-spatial attention, and working memory (visual and auditory). Collectively, these results provide evidence that the DG is necessary for complex perceptual discrimination of novel objects, indicating that the DG might function as a generic pattern separator of a wide range of stimuli within high-level perception, and that its role is not limited to memory.

Spatial Pattern Separation Testing Differentiates Alzheimer's Disease Biomarker-Positive and Biomarker-Negative Older Adults With Amnestic Mild Cognitive Impairment

Background: The hippocampus, entorhinal cortex (EC), and basal forebrain (BF) are among the earliest regions affected by Alzheimer’s disease (AD) pathology. They play an essential role in spatial pattern separation, a process critical for accurate discrimination between similar locations.

Objective: We examined differences in spatial pattern separation performance between older adults with amnestic mild cognitive impairment (aMCI) with AD versus those with non-Alzheimer’s pathologic change (non-AD) and interrelations between volumes of the hippocampal, EC subregions and BF nuclei projecting to these subregions (medial septal nuclei and vertical limb of the diagonal band of Broca – Ch1-2 nuclei) with respect to performance.

Methods: Hundred and eighteen older adults were recruited from the Czech Brain Aging Study. Participants with AD aMCI (n = 37), non-AD aMCI (n = 26), mild AD dementia (n = 26), and cognitively normal older adults (CN; n = 29) underwent spatial pattern separation testing, cognitive assessment and brain magnetic resonance imaging.

Results: The AD aMCI group had less accurate spatial pattern separation performance than the non-AD aMCI (p = 0.039) and CN (p < 0.001) groups. The AD aMCI and non-AD groups did not differ in other cognitive tests. Decreased BF Ch1-2 volume was indirectly associated with worse performance through reduced hippocampal tail volume and reduced posteromedial EC and hippocampal tail or body volumes operating in serial.

Conclusion: The study demonstrates that spatial pattern separation testing differentiates AD biomarker positive and negative older adults with aMCI and provides evidence that BF Ch1-2 nuclei influence spatial pattern separation through the posteromedial EC and the posterior hippocampus.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

Perirhinal Cortex is Involved in the Resolution of Learned Approach-Avoidance Conflict Associated with Discrete Objects

The rodent ventral and primate anterior hippocampus have been implicated in approach-avoidance (AA) conflict processing. It is unclear, however, whether this structure contributes to AA conflict detection and/or resolution, and if its involvement extends to conditions of AA conflict devoid of spatial/contextual information. To investigate this, neurologically healthy human participants first learned to approach or avoid single novel visual objects with the goal of maximizing earned points. Approaching led to point gain and loss for positive and negative objects, respectively, whereas avoidance had no impact on score. Pairs of these objects, each possessing nonconflicting (positive-positive/negative-negative) or conflicting (positive-negative) valences, were then presented during functional magnetic resonance imaging. Participants either made an AA decision to score points (Decision task), indicated whether the objects had identical or differing valences (Memory task), or followed a visual instruction to approach or avoid (Action task). Converging multivariate and univariate results revealed that within the medial temporal lobe, perirhinal cortex, rather than the anterior hippocampus, was predominantly associated with object-based AA conflict resolution. We suggest the anterior hippocampus may not contribute equally to all learned AA conflict scenarios and that stimulus information type may be a critical and overlooked determinant of the neural mechanisms underlying AA conflict behavior.

Semantic Knowledge of Famous People and Places Is Represented in Hippocampus and Distinct Cortical Networks

Studies have found that anterior temporal lobe (ATL) is critical for detailed knowledge of object categories, suggesting that it has an important role in semantic memory. However, in addition to information about entities, such as people and objects, semantic memory also encompasses information about places. We tested predictions stemming from the PMAT model, which proposes there are distinct systems that support different kinds of semantic knowledge: an anterior temporal (AT) network, which represents information about entities; and a posterior medial (PM) network, which represents information about places. We used representational similarity analysis to test for activation of semantic features when human participants viewed pictures of famous people and places, while controlling for visual similarity. We used machine learning techniques to quantify the semantic similarity of items based on encyclopedic knowledge in the Wikipedia page for each item and found that these similarity models accurately predict human similarity judgments. We found that regions within the AT network, including ATL and inferior frontal gyrus, represented detailed semantic knowledge of people. In contrast, semantic knowledge of places was represented within PM network areas, including precuneus, posterior cingulate cortex, angular gyrus, and parahippocampal cortex. Finally, we found that hippocampus, which has been proposed to serve as an interface between the AT and PM networks, represented fine-grained semantic similarity for both individual people and places. Our results provide evidence that semantic knowledge of people and places is represented separately in AT and PM areas, whereas hippocampus represents semantic knowledge of both categories.SIGNIFICANCE STATEMENT Humans acquire detailed semantic knowledge about people (e.g., their occupation and personality) and places (e.g., their cultural or historical significance). While research has demonstrated that brain regions preferentially respond to pictures of people and places, less is known about whether these regions preferentially represent semantic knowledge about specific people and places. We used machine learning techniques to develop a model of semantic similarity based on information available from Wikipedia, validating the model against similarity ratings from human participants. Using our computational model, we found that semantic knowledge about people and places is represented in distinct anterior temporal and posterior medial brain networks, respectively. We further found that hippocampus, an important memory center, represented semantic knowledge for both types of stimuli.

Roles of the Default Mode and Multiple-Demand Networks in Naturalistic versus Symbolic Decisions

The default mode network (DMN) is often associated with representing semantic, social, and situational content of contexts and episodes. The DMN may therefore be important for contextual decision-making, through representing situational constraints and simulating common courses of events. Most decision-making paradigms, however, use symbolic stimuli and instead implicate cognitive control regions, such as the multiple demand (MD) system. This fMRI study aimed to contrast the brain mechanisms underlying decision-making based on rich naturalistic contexts or symbolic cues. While performing an ongoing task, 40 human participants (25 female) responded to different sounds. For one sound, the stimulus-response mapping was fixed; responses for the other sounds depended on the visual context: either lifelike scenes or letter symbols, varying across participants. Despite minimal behavioral differences between the groups, posterior DMN regions showed increased activity during context-dependent decision-making using the naturalistic scenes only, compared with symbolic cues. More anterior temporal and frontal DMN regions showed a different pattern, with sensitivity to the need for contextual control, but not to the type of context. Furthermore, in the scenes group, widespread DMN regions showed stronger representation of not just the context but also the sound whose significance it modulated. In comparison, the MD system showed strong univariate activity for every decision, but, intriguingly, somewhat reduced activity in the case of a scene-based but demanding context-dependent decision. Depending on context, we suggest, either DMN or MD regions may play a prominent role in selection and control of appropriate behavior.

SIGNIFICANCE STATEMENT Contextual knowledge is widely believed to be important for guiding real-world goal-directed behavior. Much remains to be understood, however, regarding the underlying brain mechanisms. Using a novel paradigm to contrast decisions based on richly meaningful naturalistic scenes with decisions based on symbolic cues, we find that both multiple demand regions and default mode regions may contribute to the cognitive control of behavior. Rich semantic context enhances representation not just of the context itself, but also of the contents of the decision that it controls. Dependence of a decision on naturalistic context can also reverse the common pattern of multiple demand regions responding more, and default mode regions responding less, to more difficult decisions.

Mechanisms of memory: An intermediate level of analysis and organization

Research in the last five years has made great strides toward mechanistic explanations of how the brain enables memory. This progress builds upon decades of research from two complementary strands: a Levels of Analysis approach and a Levels of Organization approach. We review how research in cognitive psychology and cognitive neuroscience under these two approaches has recently converged on mechanistic, brain-based theories, couched at the optimal level for explaining cognitive phenomena - the intermediate level. Furthermore, novel empirical and data analysis techniques are now providing ways to test these theories' predictions, a crucial step in unraveling the mechanisms of memory.

Medial temporal lobe regions mediate complex visual discriminations for both objects and scenes: A process-based view

Debate continues regarding the role of medial temporal lobe regions in object and scene processing. Considerable evidence indicates that the perirhinal cortex (PRC) plays an important role in the perception of objects-namely, in disambiguating complex objects that share conjunctions of features. These findings support a content-specific view of medial temporal lobe functioning in which PRC is critically important for processing complex objects, while the parahippocampal cortex (PHC) and hippocampus (HC) may be selectively engaged during scene processing. However, emerging evidence from both animal and human studies suggest that the PRC is sensitive to spatial configural information as well as object information. In this fMRI study, we observed preliminary evidence for BOLD activation in the PRC during a complex visual discrimination task for objects and scenes, as well as robust activation for both stimulus types in PHC and HC. The results are discussed in light of a recent process-based model of medial temporal lobe functioning.

An Effect of Chronic Stress on Prospective Memory via Alteration of Resting-State Hippocampal Subregion Functional Connectivity

The alteration of hippocampal function by chronic stress impairs higher order cognitive functions such as prospective memory (PM). However, how chronic stress affects hippocampal subregions related to PM remains largely unknown. In this study, the altered functional network of hippocampal subregions related to PM in chronic stress was explored. College students (N = 21) completed PM tasks and resting-state functional magnetic resonance imaging scans one month prior to (baseline) and during the final examination week (chronic stress). Hippocampal subregions’ seed-based functional connectivity (FC) and PM were compared between baseline and chronic stress. PM performance declined in chronic stress. The FC of the cornu ammonis 2, 3 and dentate gyrus (CA23DG) with the bilateral caudate and precuneus was increased in chronic stress, while the FC of the subicular complex (SUBC) with the left middle frontal gyrus, the left inferior parietal gyrus and the right supramarginal gyrus was decreased. There was a negative correlation between PM performance and the FC of hippocampal subregions. We found chronic stress impairs PM by decreasing the FC of SUBC and increasing the FC of CA23DG. These findings suggest functional changes in hippocampal subregion networks as a mechanism underlying the impairment of PM in chronic stress.

Hippocampal Engagement during Recall Depends on Memory Content

The hippocampus is considered pivotal to recall, allowing retrieval of information not available in the immediate environment. In contrast, neocortex is thought to signal familiarity, contributing to recall only when called upon by the hippocampus. However, this view is not compatible with representational accounts of memory, which reject the mapping of cognitive processes onto brain regions. According to representational accounts, the hippocampus is not engaged by recall per se, rather it is engaged whenever hippocampal representations are required. To test whether hippocampus is engaged by recall when hippocampal representations are not required, we used functional imaging and a non-associative recall task, with images (objects, scenes) studied in isolation, and image patches as cues. As predicted by a representational account, hippocampal activation was modulated by the content of the recalled memory, increasing during recall of scenes-which are known to be processed by hippocampus-but not during recall of objects. Object recall instead engaged neocortical regions known to be involved in object-processing. Further supporting the representational account, effective connectivity analyses revealed that changes in functional activation during recall were driven by increased information flow from neocortical sites, rather than by the spreading of recall-related activation from hippocampus back to neocortex.

Examining the representational content of perirhinal cortex and posterior ventral visual pathway regions when maintenance of visual information is interrupted

The perirhinal cortex (PRC) is known to support recognition memory, working memory, and perception for objects. Often, information must be maintained in working memory in the face of ongoing visual perception, raising the question of how PRC and other regions supporting object representation deal with this conflict. Here, we used functional MRI to examine the representational content of human ventral visual pathway (VVP) regions, including perirhinal cortex (PRC), during a visual delayed match-to-sample task. Critically, interfering items from a different stimulus category to the target were presented to participants during the maintenance phase, creating conflict between the contents of working memory and ongoing perception. Using representational similarity analysis, we compared information content across study, interference and test phases to models that differed in the extent to which they predicted that information content would be maintained during the delay period and perturbed by interference. This revealed that lateral occipital and fusiform regions are best fit by models that reflect the stimulus content of the item currently being viewed, whereas PRC reflects the information content of the studied item, even when an interfering stimulus is presented during the delay. This division of labor within the VVP sheds light on the specialized nature of representations in VVP regions, including PRC. Our findings support a representational hierarchical understanding of medial temporal lobe function which posits that representations at the most anterior aspect of the VVP are more robust to ongoing perceptual activity.

A Roadmap for Understanding Memory: Decomposing Cognitive Processes into Operations and Representations

Thanks to patients Phineas Gage and Henry Molaison, we have long known that behavioral control depends on the frontal lobes, whereas declarative memory depends on the medial temporal lobes (MTL). For decades, cognitive functions-behavioral control, declarative memory-have served as labels for characterizing the division of labor in cortex. This approach has made enormous contributions to understanding how the brain enables the mind, providing a systems-level explanation of brain function that constrains lower-level investigations of neural mechanism. Today, the approach has evolved such that functional labels are often applied to brain networks rather than focal brain regions. Furthermore, the labels have diversified to include both broadly-defined cognitive functions (declarative memory, visual perception) and more circumscribed mental processes (recollection, familiarity, priming). We ask whether a process-a high-level mental phenomenon corresponding to an introspectively-identifiable cognitive event-is the most productive label for dissecting memory. For example, recollection conflates a neurocomputational operation (pattern completion-based retrieval) with a class of representational content (associative, high-dimensional memories). Because a full theory of memory must identify operations and representations separately, and specify how they interact, we argue that processes like recollection constitute inadequate labels for characterizing neural mechanisms. Instead, we advocate considering the component operations and representations of processes like recollection in isolation. For the organization of memory, the evidence suggests that pattern completion is recapitulated widely across the ventral visual stream and MTL, but the division of labor between sites within this pathway can be explained by representational content.

Disrupted Habituation in the Early Stage of Psychosis

BACKGROUND

Learning and memory are impaired in schizophrenia. Some theories have proposed that one form of memory, habituation, is particularly impaired. Preliminary evidence suggests that memory impairment is associated with failed hippocampal habituation in patients with chronic schizophrenia. We studied how abnormal habituation of the hippocampus is related to relational memory deficits in the early stage of psychosis.

METHODS

We measured hippocampal activity in 62 patients with early psychosis and 70 healthy individuals using functional magnetic resonance imaging. Habituation was defined as the slope of functional magnetic resonance imaging signal change to repeated presentations of faces and objects. Relational memory ability was measured as the slope of preferential viewing during a face-scene pair eye movement task outside the scanner.

RESULTS

Patients with early psychosis showed impaired relational memory (p < .001) and less hippocampal habituation to objects (p = .01) than healthy control subjects. In the healthy control group, better relational memory was associated with faster anterior hippocampal habituation (faces, r = -.28, p = .03). In contrast, patients with early psychosis showed no brain-behavior relationship (r = .12, p = .40).

CONCLUSIONS

We found evidence for disrupted hippocampal habituation in the early stage of psychosis along with an altered association between hippocampal habituation and relational memory ability. These results suggest that neural habituation may provide a novel target for early cognitive interventions in psychosis.

Neurochemical correlates of scene processing in the precuneus/posterior cingulate cortex: A multimodal fMRI and 1 H-MRS study

Precuneus/posterior cingulate cortex (PCu/PCC) are key components of a midline network, activated during rest but also in tasks that involve construction of scene or situation models. Despite growing interest in PCu/PCC functional alterations in disease and disease risk, the underlying neurochemical modulators of PCu/PCC's task‐evoked activity are largely unstudied. Here, a multimodal imaging approach was applied to investigate whether interindividual differences in PCu/PCC fMRI activity, elicited during perceptual discrimination of scene stimuli, were correlated with local brain metabolite levels, measured during resting‐state ¹H‐MRS. Forty healthy young adult participants completed an fMRI perceptual odd‐one‐out task for scenes, objects and faces. ¹H‐MRS metabolites N‐acetyl‐aspartate (tNAA), glutamate (Glx) and γ‐amino‐butyric acid (GABA+) were quantified via PRESS and MEGA‐PRESS scans in a PCu/PCC voxel and an occipital (OCC) control voxel. Whole brain fMRI revealed a cluster in right dorsal PCu/PCC that showed a greater BOLD response to scenes versus faces and objects. When extracted from an independently defined PCu/PCC region of interest, scene activity (vs. faces and objects and also vs. baseline) was positively correlated with PCu/PCC, but not OCC, tNAA. A voxel‐wise regression analysis restricted to the PCu/PCC ¹H‐MRS voxel area identified a significant PCu/PCC cluster, confirming the positive correlation between scene‐related BOLD activity and PCu/PCC tNAA. There were no correlations between PCu/PCC activity and Glx or GABA+ levels. These results demonstrate, for the first time, that scene activity in PCu/PCC is linked to local tNAA levels, identifying a neurochemical influence on interindividual differences in the task‐driven activity of a key brain hub.

Understanding perirhinal contributions to perception and memory: Evidence through the lens of selective perirhinal damage

Although a memory systems view of the medial temporal lobe (MTL) has been widely influential in understanding how memory processes are implemented, a large body of work across humans and animals has converged on the idea that the MTL can support various other decisions, beyond those involving memory. Specifically, recent work suggests that perception of and memory for visual representations may interact in order to support ongoing cognition. However, given considerations involving lesion profiles in neuropsychological investigations and the correlational nature of fMRI, the precise nature of representations supported by the MTL are not well understood in humans. In the present investigation, three patients with highly specific lesions to MTL were administered a task that taxed perceptual and mnemonic judgments with highly similar face stimuli. A striking double dissociation was observed such that I.R., a patient with a cyst localized to right posterior PRc, displayed a significant impairment in perceptual discriminations, whereas patient A.N., an individual with a lesion in right posterior parahippocampal cortex and the tail of the right hippocampus, and S.D., an individual with bilateral hippocampal damage, did not display impaired performance on the perceptual task. A.N. and S.D. did, however, show impairments in memory performance, whereas patient I.R. did not. These results causally implicate right PRc in successful perceptual oddity judgments, however they suggest that representations supported by PRc are not necessary for correct mnemonic judgments, even in situations of high featural overlap.

Category specificity in the medial temporal lobe: A systematic review

Theoretical accounts of medial temporal lobe (MTL) function ascribe different functions to subregions of the MTL including perirhinal, entorhinal, parahippocampal cortices, and the hippocampus. Some have suggested that the functional roles of these subregions vary in terms of their category specificity, showing preferential coding for certain stimulus types, but the evidence for this functional organization is mixed. In this systematic review, we evaluate existing evidence for regional specialization in the MTL for three categories of visual stimuli: faces, objects, and scenes. We review and synthesize across univariate and multivariate neuroimaging studies, as well as neuropsychological studies of cases with lesions to the MTL. Neuroimaging evidence suggests that faces activate the perirhinal cortex, entorhinal cortex, and the anterior hippocampus, while scenes engage the parahippocampal cortex and both the anterior and posterior hippocampus, depending on the contrast condition. There is some evidence for object-related activity in anterior MTL regions when compared to scenes, and in posterior MTL regions when compared to faces, suggesting that aspects of object representations may share similarities with face and scene representations. While neuroimaging evidence suggests some hippocampal specialization for faces and scenes, neuropsychological evidence shows that hippocampal damage leads to impairments in scene memory and perception, but does not entail equivalent impairments for faces in cases where the perirhinal cortex remains intact. Regional specialization based on stimulus categories has implications for understanding the mechanisms of MTL subregions, and highlights the need for the development of theoretical models of MTL function that can accommodate the differential patterns of specificity observed in the MTL.

Recognition memory shielded from semantic but not perceptual interference in normal aging

Normal aging impairs long-term declarative memory, and evidence suggests that this impairment may be driven partly by structural or functional changes in the medial temporal lobe (MTL). Theories of MTL memory function therefore make predictions for age-related memory loss. One theory - the Representational-Hierarchical account - makes two specific predictions. First, recognition memory performance in older participants should be impaired by feature-level interference, in which studied items contain many shared, and thus repeatedly appearing, perceptual features. Second, if the interference in a recognition memory task - i.e., the information that repeats across items - resides at a higher level of complexity than simple perceptual features, such as semantic gist, older adults should be less impacted by such interference than young adults. We tested these predictions using the Deese-Roediger-McDermott paradigm, by creating feature-level (i.e., perceptual) interference with phonemically/orthographically related word categories, and higher-level associative interference with semantically related word categories. We manipulated category size in order to compare the effect of less versus more interference (i.e., small versus large category size), which served to (1) avoid potential item confounds arising from systematic differences between words belonging to perceptually- versus semantically-related categories, and (2) ensure that any effect of interference was due to information encoded at study, rather than pre-experimentally. Further, we used signal detection theory (SDT) to interpret our data, rather than examining false alarm (FA) rates in isolation. The d' measure derived from SDT avoids contamination of the memory measure by response bias, and lies on an interval scale, allowing memory performance in different conditions to be compared without violating assumptions of the statistical tests. Older participants were relatively more impaired by perceptual interference and less impaired by semantic interference than young adults. This pattern is at odds with many current theories of age-related memory loss, but is in line with the Representational-Hierarchical account.

Animacy and real-world size shape object representations in the human medial temporal lobes

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL.

Evidencing a place for the hippocampus within the core scene processing network

Functional neuroimaging studies have identified several “core” brain regions that are preferentially activated by scene stimuli, namely posterior parahippocampal gyrus (PHG), retrosplenial cortex (RSC), and transverse occipital sulcus (TOS). The hippocampus (HC), too, is thought to play a key role in scene processing, although no study has yet investigated scene‐sensitivity in the HC relative to these other “core” regions. Here, we characterised the frequency and consistency of individual scene‐preferential responses within these regions by analysing a large dataset (n = 51) in which participants performed a one‐back working memory task for scenes, objects, and scrambled objects. An unbiased approach was adopted by applying independently‐defined anatomical ROIs to individual‐level functional data across different voxel‐wise thresholds and spatial filters. It was found that the majority of subjects had preferential scene clusters in PHG (max = 100% of participants), RSC (max = 76%), and TOS (max = 94%). A comparable number of individuals also possessed significant scene‐related clusters within their individually defined HC ROIs (max = 88%), evidencing a HC contribution to scene processing. While probabilistic overlap maps of individual clusters showed that overlap “peaks” were close to those identified in group‐level analyses (particularly for TOS and HC), inter‐individual consistency varied across regions and statistical thresholds. The inter‐regional and inter‐individual variability revealed by these analyses has implications for how scene‐sensitive cortex is localised and interrogated in functional neuroimaging studies, particularly in medial temporal lobe regions, such as the HC. Hum Brain Mapp 37:3779–3794, 2016. © 2016 Wiley Periodicals, Inc.

Structural connections support emotional connections: Uncinate Fasciculus microstructure is related to the ability to decode facial emotion expressions

The Uncinate Fasciculus (UF) is an association fibre tract connecting regions in the frontal and anterior temporal lobes. UF disruption is seen in several disorders associated with impaired social behaviour, but its functional role is unclear. Here we set out to test the hypothesis that the UF is important for facial expression processing, an ability fundamental to adaptive social behaviour. In two separate experiments in healthy adults, we used high-angular resolution diffusion-weighted imaging (HARDI) and constrained spherical deconvolution (CSD) tractography to virtually dissect the UF, plus a control tract (the corticospinal tract (CST)), and quantify, via fractional anisotropy (FA), individual differences in tract microstructure. In Experiment 1, participants completed the Reading the Mind in the Eyes Task (RMET), a well-validated assay of facial expression decoding. In Experiment 2, a different set of participants completed the RMET, plus an odd-emotion-out task of facial emotion discrimination. In both experiments, participants also completed a control odd-identity-out facial identity discrimination task. In Experiment 1, FA of the right-, but not the left-hemisphere, UF was significantly correlated with performance on the RMET task, specifically for emotional, but not neutral expressions. UF FA was not significantly correlated with facial identity discrimination performance. In Experiment 2, FA of the right-, but not left-hemisphere, UF was again significantly correlated with performance on emotional items from the RMET, together with performance on the facial emotion discrimination task. Again, no significant association was found between UF FA and facial identity discrimination performance. Our findings highlight the contribution of right-hemisphere UF microstructure to inter-individual variability in the ability to decode facial emotion expressions, and may explain why disruption of this pathway affects social behaviour.

•

We studied white matter microstructure correlates of facial emotion decoding skills.

•

Focused on the role of a key limbic tract, the Uncinate Fasciculus (UF).

•

Right UF microstructure linked to facial expression decoding skills.

•

UF microstructure not related to facial identity discrimination skills.

•

Right UF has a distinct role in the processing of facial expressions of emotion.

Atrophy of the Posterior Subiculum Is Associated with Memory Impairment, Tau- and Aβ Pathology in Non-demented Individuals

Alzheimer’s disease (AD) is associated with atrophy of the cornu ammonis (CA) 1 and the subiculum subfield of the hippocampus (HC), and with deficits in episodic memory and spatial orientation. These deficits are mainly associated with the functionality of the posterior HC. We therefore hypothesized that key AD pathologies, i.e., β-amyloid and tau pathology would be particularly associated with the volume of the posterior subiculum in non-demented individuals. In our study we included 302 cognitively normal elderly participants (CN), 183 patients with subjective cognitive decline (SCD) and 171 patients with amnestic mild cognitive impairment (MCI), all of whom underwent 3T magnetic resonance images (MRI). The subicular subfield was segmented using Freesurfer 5.3 and divided into 10 volumetric segments moving from the most posterior (segment 1) to the most anterior part along the axis of the hippocampal head and body (segment 10). Cerebrospinal fluid (CSF) Aβ₄₂ and phosphorylated tau (P-tau) were quantified using ELISA and were used as biomarkers for β-amyloid and tau pathology, respectively. In the total sample, tau-pathology and Aβ-pathology and (measured by elevated P-tau and low Aβ₄₂ levels in CSF) and mild memory dysfunction were mostly associated with the volume changes of the posterior subiculum. Both SCD and MCI patients with elevated P-tau or low Aβ₄₂ levels displayed predominantly posterior subicular atrophy in comparisons to control subjects with normal CSF biomarker levels. Finally, there was no main effect of Aβ₄₂ or P-tau when comparing SCD with abnormal P-tau or Aβ₄₂ with SCD with normal levels of these CSF-biomarkers. However, in the left subiculum there was a significant interaction revealing atrophy in the left posterior but not the anterior subiculum in participants with low Aβ₄₂ levels. The same pattern was observed on the contralateral side in participants with elevated P-tau levels. In conclusion, AD pathologies and mild memory dysfunction are mainly associated with atrophy of the posterior parts of the subicular subfields of the HC in non-demented individuals. In light of these findings we suggest that segmentation of the HC subfields may benefit from considering the volume of the different anterior-posterior subsections of each subfield.

Multivoxel Pattern Analysis Reveals 3D Place Information in the Human Hippocampus

The spatial world is three dimensional (3D) and humans and other animals move both horizontally and vertically within it. Extant neuroscientific studies have typically investigated spatial navigation on a horizontal 2D plane, leaving much unknown about how 3D spatial information is represented in the brain. Specifically, horizontal and vertical information may be encoded in the same or different neural structures with equal or unequal sensitivity. Here, we investigated these possibilities using fMRI while participants were passively moved within a 3D lattice structure as if riding a rollercoaster. Multivoxel pattern analysis was used to test for the existence of information relating to where and in which direction participants were heading in this virtual environment. Behaviorally, participants had similarly accurate memory for vertical and horizontal locations and the right anterior hippocampus (HC) expressed place information that was sensitive to changes along both horizontal and vertical axes. This is suggestive of isotropic 3D place encoding. In contrast, participants indicated their heading direction faster and more accurately when they were heading in a tilted-up or tilted-down direction. This direction information was expressed in the right retrosplenial cortex and posterior HC and was only sensitive to vertical pitch, which could reflect the importance of the vertical (gravity) axis as a reference frame. Overall, our findings extend previous knowledge of how we represent the spatial world and navigate within it by taking into account the important third dimension.

SIGNIFICANCE STATEMENT The spatial world is 3D. We can move horizontally across surfaces, but also vertically, going up slopes or stairs. Little is known about how the brain supports representations of 3D space. A key question is whether horizontal and vertical information is equally well represented. Here, we measured fMRI response patterns while participants moved within a virtual 3D environment and found that the anterior hippocampus (HC) expressed location information that was sensitive to the vertical and horizontal axes. In contrast, information about heading direction, found in retrosplenial cortex and posterior HC, favored the vertical axis, perhaps due to gravity effects. These findings provide new insights into how we represent our spatial 3D world and navigate within it.

Ultra-High-Field fMRI Reveals a Role for the Subiculum in Scene Perceptual Discrimination

Recent "representational" accounts suggest a key role for the hippocampus in complex scene perception. Due to limitations in scanner field strength, however, the functional neuroanatomy of hippocampal-dependent scene perception is unknown. Here, we applied 7 T high-resolution functional magnetic resonance imaging (fMRI) alongside a perceptual oddity task, modified from nonhuman primate studies. This task requires subjects to discriminate highly similar scenes, faces, or objects from multiple viewpoints, and has revealed selective impairments during scene discrimination following hippocampal lesions. Region-of-interest analyses identified a preferential response in the subiculum subfield of the hippocampus during scene, but not face or object, discriminations. Notably, this effect was in the anteromedial subiculum and was not modulated by whether scenes were subsequently remembered or forgotten. These results highlight the value of ultra-high-field fMRI in generating more refined, anatomically informed, functional accounts of hippocampal contributions to cognition, and a unique role for the human subiculum in discrimination of complex scenes from different viewpoints.SIGNIFICANCE STATEMENT There is increasing evidence that the human hippocampus supports functions beyond just episodic memory, with human lesion studies suggesting a contribution to the perceptual processing of navigationally relevant, complex scenes. While the hippocampus itself contains several small, functionally distinct subfields, examining the role of these in scene processing has been previously limited by scanner field strength. By applying ultra-high-resolution 7 T fMRI, we delineated the functional contribution of individual hippocampal subfields during a perceptual discrimination task for scenes, faces, and objects. This demonstrated that the discrimination of scenes, relative to faces and objects, recruits the anterior subicular region of the hippocampus, regardless of whether scenes were subsequently remembered or forgotten.

Material Specificity Drives Medial Temporal Lobe Familiarity But Not Hippocampal Recollection

The specific role of the perirhinal (PRC), entorhinal (ERC) and parahippocampal cortices (PHC) in supporting familiarity‐based recognition remains unknown. An fMRI study explored whether these medial temporal lobe (MTL) structures responded in the same way or differentially to familiarity as a function of stimulus type at recognition. A secondary aim was to explore whether the hippocampus responds in the same way to equally strong familiarity and recollection and whether this is influenced by the kind of stimulus involved. Univariate and multivariate analyses revealed that familiarity responses in the PRC, ERC, PHC and the amygdala are material‐specific. Specifically, the PRC and ERC selectively responded to object familiarity, while the PHC responded to both object and scene familiarity. The amygdala only responded to familiarity memory for faces. The hippocampus did not respond to stimulus familiarity for any of the three types of stimuli, but it did respond to recollection for all three types of stimuli. This was true even when recollection was contrasted to equally accurate familiarity. Overall, the findings suggest that the role of the MTL neocortices and the amygdala in familiarity‐based recognition depends on the kind of stimulus in memory, whereas the role of the hippocampus in recollection is independent of the type of cuing stimulus. © 2016 The Authors Hippocampus Published by Wiley Periodicals, Inc.

Perception of Impossible Scenes Reveals Differential Hippocampal and Parahippocampal Place Area Contributions to Spatial Coherency

Surprisingly little is known about how the brain combines spatial elements to form a coherent percept. Regions that may underlie this process include the hippocampus (HC) and parahippocampal place area (PPA), regions central to spatial perception but whose role in spatial coherency has not been explored. Participants were scanned with functional MRI while they judged whether Escher-like scenes were possible or impossible. Univariate analyses revealed differential HC and PPA involvement, with greater HC activity during spatial incoherency detection and more PPA activity during spatial coherency detection. Recognition and eye-tracking data ruled out long- or short-term memory confounds. Multivariate statistics demonstrated spatial coherency-dependent functional connectivity for the HC, but not PPA, with greater HC connectivity to various brain regions including lateral occipital complex during spatial incoherency detection. We suggest the PPA is preferentially involved during the perception of spatially coherent scenes, whereas the HC binds distinct features to create coherent representations. © 2016 Wiley Periodicals, Inc.

Differential contributions of subregions of medial temporal lobe to memory system in amnestic mild cognitive impairment: insights from fMRI study

Altered function of the medial temporal lobe (MTL) is a valuable indicator of conversion from amnestic mild cognitive impairment (aMCI) to Alzheimer’s disease. This study is to delineate the functional circuitry of multiple subdivisions of parahippocampal gyrus and hippocampus (HIP) and to examine how this knowledge contributes to a more principled understanding of the contributions of its subregions to memory in aMCI. The functional connectivity (FC) analysis was performed in 85 aMCI and 129 healthy controls. The aMCI demonstrated the distinct disruptive patterns of the MTL subregional connectivity with the whole-brain. The right entorhinal cortex (ERC) and perirhinal cortex (PRC) showed increased connectivity with the left inferior and middle occipital gyrus, respectively, which potentially indicated a compensatory mechanism. Furthermore, the right altered MTL subregional FC was associated with episodic memory performance in aMCI. These results provide novel insights into the heterogeneous nature of its large-scale connectivity in MTL subregions in memory system underlying the memory deficits in aMCI. It further suggests that altered FC of MTL subregions is associated with the impairment of the differential encoding stages of memories and the functional changes in the specific right HIP-ERC-PRC-temporal circuitry may contribute to the impairment of episodic memory in aMCI.

Fornix and medial temporal lobe lesions lead to comparable deficits in complex visual perception

Recent research dealing with the structures of the medial temporal lobe (MTL) has shifted away from exclusively investigating memory-related processes and has repeatedly incorporated the investigation of complex visual perception. Several studies have demonstrated that higher level visual tasks can recruit structures like the hippocampus and perirhinal cortex in order to successfully perform complex visual discriminations, leading to a perceptual-mnemonic or representational view of the medial temporal lobe. The current study employed a complex visual discrimination paradigm in two patients suffering from brain lesions with differing locations and origin. Both patients, one with extensive medial temporal lobe lesions (VG) and one with a small lesion of the anterior fornix (HJK), were impaired in complex discriminations while showing otherwise mostly intact cognitive functions. The current data confirmed previous results while also extending the perceptual-mnemonic theory of the MTL to the main output structure of the hippocampus, the fornix.

Evidence for Integrated Visual Face and Body Representations in the Anterior Temporal Lobes

Research on visual face perception has revealed a region in the ventral anterior temporal lobes, often referred to as the anterior temporal face patch (ATFP), which responds strongly to images of faces. To date, the selectivity of the ATFP has been examined by contrasting responses to faces against a small selection of categories. Here, we assess the selectivity of the ATFP in humans with a broad range of visual control stimuli to provide a stronger test of face selectivity in this region. In Experiment 1, participants viewed images from 20 stimulus categories in an event-related fMRI design. Faces evoked more activity than all other 19 categories in the left ATFP. In the right ATFP, equally strong responses were observed for both faces and headless bodies. To pursue this unexpected finding, in Experiment 2, we used multivoxel pattern analysis to examine whether the strong response to face and body stimuli reflects a common coding of both classes or instead overlapping but distinct representations. On a voxel-by-voxel basis, face and whole-body responses were significantly positively correlated in the right ATFP, but face and body-part responses were not. This finding suggests that there is shared neural coding of faces and whole bodies in the right ATFP that does not extend to individual body parts. In contrast, the same approach revealed distinct face and body representations in the right fusiform gyrus. These results are indicative of an increasing convergence of distinct sources of person-related perceptual information proceeding from the posterior to the anterior temporal cortex.

Anterior hippocampus: the anatomy of perception, imagination and episodic memory

The brain creates a model of the world around us. We can use this representation to perceive and comprehend what we see at any given moment, but also to vividly re-experience scenes from our past and imagine future (or even fanciful) scenarios. Recent work has shown that these cognitive functions--perception, imagination and recall of scenes and events--all engage the anterior hippocampus. In this Opinion article, we capitalize on new findings from functional neuroimaging to propose a model that links high-level cognitive functions to specific structures within the anterior hippocampus.

The representational-hierarchical view of pattern separation: Not just hippocampus, not just space, not just memory?

Pattern separation (PS) has been defined as a process of reducing overlap between similar input patterns to minimize interference amongst stored representations. The present article describes this putative PS process from the "representational-hierarchical" perspective (R-H), which uses a hierarchical continuum instead of a cognitive modular processing framework to describe the organization of the ventral visual perirhinal-hippocampal processing stream. Instead of trying to map psychological constructs onto anatomical modules in the brain, the R-H model suggests that the function of brain regions depends upon what representations they contain. We begin by discussing a main principle of the R-H framework, the resolution of "ambiguity" of lower level representations via the formation of unique conjunctive representations in higher level areas, and how this process is remarkably similar to definitions of PS. Work from several species and experimental approaches suggest that this principle of resolution of ambiguity via conjunctive representations has considerable explanatory power, leads to wide possibilities for experimentation, and also supports some perhaps surprising conclusions.

Age-related deficits in conjunctive representation of complex objects

Although some evidence is consistent with the notion that distinct cortical systems support memory and perception, mounting evidence supports a representational-hierarchical view of cognition, which posits that distinctions lie in simple feature representations versus more complex conjunctive representations of many stimulus features simultaneously. Thus, typical memory tasks engage different regions from typical perception tasks because they inherently test information on opposing ends of this continuum. Memory deficits are reliably reported with age, but the tasks used to make these conclusions predominantly rely on conjunctive representations. To test the extent to which age-related deficits may be accounted for by perceptual processing, this study investigated discriminations involving conjunctive representations in older adults. Results show that adults aged 50 to 77 are impaired, relative to their younger counterparts, on discriminations requiring feature conjunctions, but not simple feature representations. These findings support recent data showing an agerelated decline in the ability to form conjunctive representations. Furthermore, these data suggest that some ‘mnemonic’ deficits associated with age may in fact be the result of deficits in perception rather than memory.

Distributed category-specific recognition-memory signals in human perirhinal cortex

Evidence from a large body of research suggests that perirhinal cortex (PrC), which interfaces the medial temporal lobe with the ventral visual pathway for object identification, plays a critical role in item-based recognition memory. The precise manner in which PrC codes for the prior occurrence of objects, however, remains poorly understood. In the present functional magnetic resonance imaging (fMRI) study, we used multivoxel pattern analyses to examine whether the prior occurrence of faces is coded by distributed patterns of PrC activity that consist of voxels with decreases as well as increases in signal. We also investigated whether pertinent voxels are preferentially tuned to the specific object category to which judged stimuli belong. We found that, when no a priori constraints were imposed on the direction of signal change, activity patterns that allowed for successful classification of recognition-memory decisions included some voxels with decreases and others with increases in signal in association with perceived prior occurrence. Moreover, successful classification was obtained in the absence of a mean difference in activity across the set of voxels in these patterns. Critically, we observed a positive relationship between classifier accuracy and behavioral performance across participants. Additional analyses revealed that voxels carrying diagnostic information for classification of memory decisions showed category specificity in their tuning for faces when probed with an independent functional localizer in a nonmnemonic task context. These voxels were spatially distributed in PrC, and extended beyond the contiguous voxel clusters previously described as the anterior temporal face patch. Our findings provide support for proposals, recently raised in the neurophysiological literature, that the prior occurrence of objects is coded by distributed PrC representations. They also suggest that the stimulus category to which an item belongs shapes the organization of these distributed representations.

Remembering Preservation in Hippocampal Amnesia

The lesion-deficit model dominates neuropsychology. This is unsurprising given powerful demonstrations that focal brain lesions can affect specific aspects of cognition. Nowhere is this more evident than in patients with bilateral hippocampal damage. In the past 60 years, the amnesia and other impairments exhibited by these patients have helped to delineate the functions of the hippocampus and shape the field of memory. We do not question the value of this approach. However, less prominent are the cognitive processes that remain intact following hippocampal lesions. Here, we collate the piecemeal reports of preservation of function following focal bilateral hippocampal damage, highlighting a wealth of information often veiled by the field's focus on deficits. We consider how a systematic understanding of what is preserved as well as what is lost could add an important layer of precision to models of memory and the hippocampus.

Neural microgenesis of personally familiar face recognition

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Dissociable roles of the inferior longitudinal fasciculus and fornix in face and place perception

We tested a novel hypothesis, generated from representational accounts of medial temporal lobe (MTL) function, that the major white matter tracts converging on perirhinal cortex (PrC) and hippocampus (HC) would be differentially involved in face and scene perception, respectively. Diffusion tensor imaging was applied in healthy participants alongside an odd-one-out paradigm sensitive to PrC and HC lesions in animals and humans. Microstructure of inferior longitudinal fasciculus (ILF, connecting occipital and ventro-anterior temporal lobe, including PrC) and fornix (the main HC input/output pathway) correlated with accuracy on odd-one-out judgements involving faces and scenes, respectively. Similarly, blood oxygen level-dependent (BOLD) response in PrC and HC, elicited during oddity judgements, was correlated with face and scene oddity performance, respectively. We also observed associations between ILF and fornix microstructure and category-selective BOLD response in PrC and HC, respectively. These striking three-way associations highlight functionally dissociable, structurally instantiated MTL neurocognitive networks for complex face and scene perception.

DOI:http://dx.doi.org/10.7554/eLife.07902.001

Perceiving an object or picture stimulates activity in the regions of the brain that make up the visual system. Some of these regions respond differently depending on what is being viewed: for example, some areas are more active when looking at faces, and others respond more when viewing places. One theory is that, rather than working in a self-contained fashion, category-sensitive brain regions are elements or ‘nodes’ within more complex brain networks that are specialised for processing different types of visual stimuli.

The inside of the brain contains regions of dark and light tissue. The lighter regions are known as ‘white matter’ and contain fibres that allow information to travel between different parts of the brain. These fibers may play an important role in how widely distributed brain regions communicate. To investigate this, Hodgetts, Postans et al. used a technique called diffusion MRI to measure the structure, or coherence, of white matter fibers in healthy volunteers. Brain activity was also measured while volunteers completed a task in which they needed to spot the odd-one-out from images of either faces or places.

Hodgetts, Postans et al. investigated the fine structure of a white matter fibre bundle known as the inferior longitudinal fasciculus (ILF). This fibre links two parts of the brain involved in face perception, called the occipital and anterior temporal lobes. Strikingly, ILF structure predicted both face-related brain activity in these regions and how well an individual could discriminate between faces, but not place stimuli.

By contrast, the ability of volunteers to tell apart different places (but not faces) was related to the structure of the fornix. The fornix is a bundle of white matter fibres that carries information to and from the hippocampus, a region that is important for finding one's way around an environment and remembering such journeys afterwards.

Hodgetts, Postans et al.'s findings suggest that the systems that process different visual categories are best thought of as large-scale distributed networks rather than a set of individual, specialised regions in the brain. In the future, research will be needed to further understand how white matter contributes to the perception of different visual categories, and to investigate in finer detail how visual experience influences the structure of white matter pathways.

DOI:http://dx.doi.org/10.7554/eLife.07902.002

Noninvasive functional and anatomical imaging of the human medial temporal lobe

The ability to remember life's events, and to leverage memory to guide behavior, defines who we are and is critical for everyday functioning. The neural mechanisms supporting such mnemonic experiences are multiprocess and multinetwork in nature, which creates challenges for studying them in humans and animals. Advances in noninvasive neuroimaging techniques have enabled the investigation of how specific neural structures and networks contribute to human memory at its many cognitive and mechanistic levels. In this review, we discuss how functional and anatomical imaging has provided novel insights into the types of information represented in, and the computations performed by, specific medial temporal lobe (MTL) regions, and we consider how interactions between the MTL and other cortical and subcortical structures influence what we learn and remember. By leveraging imaging, researchers have markedly advanced understanding of how the MTL subserves declarative memory and enables navigation of our physical and mental worlds.

Constructing, Perceiving, and Maintaining Scenes: Hippocampal Activity and Connectivity

In recent years, evidence has accumulated to suggest the hippocampus plays a role beyond memory. A strong hippocampal response to scenes has been noted, and patients with bilateral hippocampal damage cannot vividly recall scenes from their past or construct scenes in their imagination. There is debate about whether the hippocampus is involved in the online processing of scenes independent of memory. Here, we investigated the hippocampal response to visually perceiving scenes, constructing scenes in the imagination, and maintaining scenes in working memory. We found extensive hippocampal activation for perceiving scenes, and a circumscribed area of anterior medial hippocampus common to perception and construction. There was significantly less hippocampal activity for maintaining scenes in working memory. We also explored the functional connectivity of the anterior medial hippocampus and found significantly stronger connectivity with a distributed set of brain areas during scene construction compared with scene perception. These results increase our knowledge of the hippocampus by identifying a subregion commonly engaged by scenes, whether perceived or constructed, by separating scene construction from working memory, and by revealing the functional network underlying scene construction, offering new insights into why patients with hippocampal lesions cannot construct scenes.