Distributed category-specific recognition-memory signals in human perirhinal cortex

Perirhinal cortex automatically tracks multiple types of familiarity regardless of task-relevance

Perirhinal cortex (PrC) has long been implicated in familiarity assessment for objects and corresponding concepts. However, extant studies have focused mainly on changes in familiarity induced by recent exposure in laboratory settings. There is an increasing appreciation of other types of familiarity signals, in particular graded familiarity accumulated throughout one's lifetime. In prior work (Duke et al., 2017, Cortex, 89, 61-70), PrC has been shown to track lifetime familiarity ratings when participants make related judgements. A theoretically important characteristic of familiarity is its proposed automaticity. Support for automaticity comes from a documented impact of recent stimulus exposure on behavioral performance, and on PrC signals, under conditions in which this exposure is not task relevant. In the current fMRI study, we tested whether PrC also tracks lifetime familiarity of object concepts automatically, and whether this type of familiarity influences behavior even when it is not task relevant. During scanning, neurotypical participants (N = 30, age range 18-40, 7 males) provided animacy judgements about concrete object concepts presented at differing frequencies in an initial study phase. In a subsequent test phase, they made graded judgements of recent or lifetime familiarity. Behavioral performance showed sensitivity to lifetime familiarity even when it was not relevant for the task at hand. Across five sets of fMRI analyses, we found that PrC consistently tracked recent and lifetime familiarity of object concepts regardless of the task performed. Critically, while several other temporal-lobe regions also showed isolated familiarity effects, none of them tracked familiarity with the same consistency. These findings demonstrate that PrC automatically tracks multiple types of familiarity. They support models that assign a broad role in the representation of information about object concepts to this structure.

Category-specific and category-general neural codes of recognition memory in the ventral visual pathway

Researchers have identified category-specific brain regions, such as the fusiform face area (FFA) and parahippocampal place area (PPA) in the ventral visual pathway, which respond preferentially to one particular category of visual objects. In addition to their category-specific role in visual object identification and categorization, regions in the ventral visual pathway play critical roles in recognition memory. Nevertheless, it is not clear whether the contributions of those brain regions to recognition memory are category-specific or category-general. To address this question, the present study adopted a subsequent memory paradigm and multivariate pattern analysis (MVPA) to explore category-specific and category-general neural codes of recognition memory in the visual pathway. The results revealed that the right FFA and the bilateral PPA showed category-specific neural patterns supporting recognition memory of faces and scenes, respectively. In contrast, the lateral occipital cortex seemed to carry category-general neural codes of recognition memory. These results provide neuroimaging evidence for category-specific and category-general neural mechanisms of recognition memory in the ventral visual pathway.

Stimulus-specific random effects inflate false-positive classification accuracy in multivariate-voxel-pattern-analysis: A solution with generalized mixed-effects modelling

When conducting multivariate-voxel pattern analysis (MVPA), researchers typically compute the average accuracy for each subject and statistically test if the average accuracy is different from the chance level across subjects (by-subject analysis). We argue that this traditional by-subject analysis leads to inflated Type-1 error rates, regardless of the type of machine learning method used (e.g., support vector machine). This is because by-subject analysis does not consider the variance attributed to the idiosyncratic features of the stimuli that have a common influence on all subjects (i.e., the random stimulus effect). As a solution, we proposed the use of generalized linear mixed-effects modelling to evaluate average accuracy. This method only requires post-classification data (i.e., it does not consider the type of classification methods used) and is easily implemented in the analysis pipeline with common statistical software (SPSS, R, Python, etc.). Using both statistical simulation and real fMRI data analysis, we demonstrated that the traditional by-subject method indeed increases Type-1 error rates to a considerable degree, while generalized mixed-effects modelling that incorporates random stimulus effects can indeed maintain the nominal Type-1 error rates.

Human faces and face-like stimuli are more memorable

We have previously suggested a distinction in the brain processes governing biological and artifactual stimuli. One of the best examples of the biological category consists of human faces, the perception of which appears to be determined by inherited mechanisms or ones rapidly acquired after birth. In extending this work, we inquire here whether there is a higher memorability for images of human faces and whether memorability declines with increasing departure from human faces; if so, the implication would add to the growing evidence of differences in the processing of biological versus artifactual stimuli. To do so, we used images and memorability scores from a large data set of 58,741 images to compare the relative memorability of the following image categories: real human faces versus buildings, and extending this to a comparison of real human faces with five image categories that differ in their grade of resemblance to a real human face. Our findings show that, in general, when we compare the biological category of faces to the artifactual category of buildings, the former is more memorable. Furthermore, there is a gradient in which the more an image resembles a real human face the more memorable it is. Thus, the previously identified differences in biological and artifactual images extend to the field of memory.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

The impact of threat of shock-induced anxiety on the neural substrates of memory encoding and retrieval

Dysfunctional memory processes are widely reported in anxiety disorders, but the underlying neurocognitive mechanisms are unclear. Recent work shows that the impact of anxiety on memory depends on the context and memory modality. For instance, threat of shock, a translational within-subject anxiety induction, has been shown to impair the encoding of facial stimuli, while improving spatial working memory (WM) accuracy. The present study aimed to delineate the neural circuitry regulating these opposing behavioural effects. Thirty-three healthy volunteers performed the previously assessed facial recognition and a spatial WM tasks inside an fMRI scanner, under alternating within-subject conditions of threat or safe from shock across encoding and retrieval. Facial recognition impairments were replicated when threat was selectively induced at encoding. Neuroimaging results suggest that this effect was driven by increased competition for attentional resources within the anterior cingulate cortex, in which activation correlated positively with stress levels. The impact of threat on spatial WM performance did not, however, replicate in the fMRI environment. Nevertheless, state-dependent hippocampal activation was observed in both tasks. These findings suggest a neurocognitive mechanism by which anxiety impairs facial recognition as well as a state-dependent hippocampal activation pattern, which may putatively underline retrieval of negative experiences in anxiety.

Examining the representational content of perirhinal cortex and posterior ventral visual pathway regions when maintenance of visual information is interrupted

The perirhinal cortex (PRC) is known to support recognition memory, working memory, and perception for objects. Often, information must be maintained in working memory in the face of ongoing visual perception, raising the question of how PRC and other regions supporting object representation deal with this conflict. Here, we used functional MRI to examine the representational content of human ventral visual pathway (VVP) regions, including perirhinal cortex (PRC), during a visual delayed match-to-sample task. Critically, interfering items from a different stimulus category to the target were presented to participants during the maintenance phase, creating conflict between the contents of working memory and ongoing perception. Using representational similarity analysis, we compared information content across study, interference and test phases to models that differed in the extent to which they predicted that information content would be maintained during the delay period and perturbed by interference. This revealed that lateral occipital and fusiform regions are best fit by models that reflect the stimulus content of the item currently being viewed, whereas PRC reflects the information content of the studied item, even when an interfering stimulus is presented during the delay. This division of labor within the VVP sheds light on the specialized nature of representations in VVP regions, including PRC. Our findings support a representational hierarchical understanding of medial temporal lobe function which posits that representations at the most anterior aspect of the VVP are more robust to ongoing perceptual activity.

Content Tuning in the Medial Temporal Lobe Cortex: Voxels that Perceive, Retrieve

How do we recall vivid details from our past based only on sparse cues? Research suggests that the phenomenological reinstatement of past experiences is accompanied by neural reinstatement of the original percept. This process critically depends on the medial temporal lobe (MTL). Within the MTL, perirhinal cortex (PRC) and parahippocampal cortex (PHC) are thought to support encoding and recall of objects and scenes, respectively, with the hippocampus (HC) serving as a content-independent hub. If the fidelity of recall indeed arises from neural reinstatement of perceptual activity, then successful recall should preferentially draw upon those neural populations within content-sensitive MTL cortex that are tuned to the same content during perception. We tested this hypothesis by having eighteen human participants undergo functional MRI (fMRI) while they encoded and recalled objects and scenes paired with words. Critically, recall was cued with the words only. While HC distinguished successful from unsuccessful recall of both objects and scenes, PRC and PHC were preferentially engaged during successful versus unsuccessful object and scene recall, respectively. Importantly, within PRC and PHC, this content-sensitive recall was predicted by content tuning during perception: Across PRC voxels, we observed a positive relationship between object tuning during perception and successful object recall, while across PHC voxels, we observed a positive relationship between scene tuning during perception and successful scene recall. Our results thus highlight content-based roles of MTL cortical regions for episodic memory and reveal a direct mapping between content-specific tuning during perception and successful recall.

Functional connectivity in category-selective brain networks after encoding predicts subsequent memory

Activity in category selective regions of the temporal and parietal lobes during encoding has been associated with subsequent memory for face and scene stimuli. Reactivation theories of memory consolidation predict that after encoding connectivity between these category-selective regions and the hippocampus should be modulated and predict recognition memory. However, support for this proposal has been limited in humans. Here, participants completed a resting-state functional MRI (fMRI) scan, followed by face- and place-encoding tasks, followed by another resting-state fMRI scan during which they were asked to think about the stimuli they had previously encountered. Individual differences in face recognition memory were predicted by the degree to which connectivity between face-responsive regions of the fusiform gyrus and perirhinal cortex increased following the face-encoding task. In contrast, individual differences in scene recognition were predicted by connectivity between the hippocampus and a scene-selective region of the retrosplenial cortex before and after the place-encoding task. Our results provide novel evidence for category specificity in the neural mechanisms supporting memory consolidation.

Animacy and real-world size shape object representations in the human medial temporal lobes

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL.

Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream

A significant body of research in cognitive neuroscience is aimed at understanding how object concepts are represented in the human brain. However, it remains unknown whether and where the visual and abstract conceptual features that define an object concept are integrated. We addressed this issue by comparing the neural pattern similarities among object-evoked fMRI responses with behavior-based models that independently captured the visual and conceptual similarities among these stimuli. Our results revealed evidence for distinctive coding of visual features in lateral occipital cortex, and conceptual features in the temporal pole and parahippocampal cortex. By contrast, we found evidence for integrative coding of visual and conceptual object features in perirhinal cortex. The neuroanatomical specificity of this effect was highlighted by results from a searchlight analysis. Taken together, our findings suggest that perirhinal cortex uniquely supports the representation of fully specified object concepts through the integration of their visual and conceptual features.

How landmark suitability shapes recognition memory signals for objects in the medial temporal lobes

A role of perirhinal cortex (PrC) in recognition memory for objects has been well established. Contributions of parahippocampal cortex (PhC) to this function, while documented, remain less well understood. Here, we used fMRI to examine whether the organization of item-based recognition memory signals across these two structures is shaped by object category, independent of any difference in representing episodic context. Guided by research suggesting that PhC plays a critical role in processing landmarks, we focused on three categories of objects that differ from each other in their landmark suitability as confirmed with behavioral ratings (buildings > trees > aircraft). Participants made item-based recognition-memory decisions for novel and previously studied objects from these categories, which were matched in accuracy. Multi-voxel pattern classification revealed category-specific item-recognition memory signals along the long axis of PrC and PhC, with no sharp functional boundaries between these structures. Memory signals for buildings were observed in the mid to posterior extent of PhC, signals for trees in anterior to posterior segments of PhC, and signals for aircraft in mid to posterior aspects of PrC and the anterior extent of PhC. Notably, item-based memory signals for the category with highest landmark suitability ratings were observed only in those posterior segments of PhC that also allowed for classification of landmark suitability of objects when memory status was held constant. These findings provide new evidence in support of the notion that item-based memory signals for objects are not limited to PrC, and that the organization of these signals along the longitudinal axis that crosses PrC and PhC can be captured with reference to landmark suitability.

I know I've seen you before: Distinguishing recent-single-exposure-based familiarity from pre-existing familiarity

This study examines how individuals differentiate recent-single-exposure-based familiarity from pre-existing familiarity. If these are two distinct cognitive processes, are they supported by the same neural bases? This study examines how recent-single-exposure-based familiarity and multiple-previous-exposure-based familiarity are supported and represented in the brain using functional MRI. In a novel approach, we first behaviorally show that subjects can divide retrieval of items in pre-existing memory into judgments of recollection and familiarity. Then, using functional magnetic resonance imaging, we examine the differences in blood oxygen level dependent activity and regional connectivity during judgments of recent-single-exposure-based and pre-existing familiarity. Judgments of these two types of familiarity showed distinct regions of activation in a whole-brain analysis, in medial temporal lobe (MTL) substructures, and in MTL substructure functional-correlations with other brain regions. Specifically, within the MTL, perirhinal cortex showed increased activation during recent-single-exposure-based familiarity while parahippocampal cortex showed increased activation during judgments of pre-existing familiarity. We find that recent-single-exposure-based and pre-existing familiarity are represented as distinct neural processes in the brain; this is supported by differing patterns of brain activation and regional correlations. This spatially distinct regional brain involvement suggests that the two separate experiences of familiarity, recent-exposure-based familiarity and pre-existing familiarity, may be cognitively distinct.

Perirhinal cortex tracks degree of recent as well as cumulative lifetime experience with object concepts

Evidence from numerous sources indicates that recognition of the prior occurrence of objects requires computations of perirhinal cortex (PrC) in the medial temporal lobe (MTL). Extant research has primarily probed recognition memory based on item exposure in a recent experimental study episode. Outside the laboratory, however, familiarity for objects typically accrues gradually with learning across many different episodic contexts, which can be distributed over a lifetime of experience. It is currently unknown whether PrC also tracks this cumulative lifetime experience with object concepts. To address this issue, we conducted a functional magnetic resonance imaging (fMRI) experiment in healthy individuals in which we compared judgments of the perceived lifetime familiarity with object concepts, a task that has previously been employed in many normative studies on concept knowledge, with frequency judgments for recent laboratory exposure in a study phase. Guided by neurophysiological data showing that neurons in primate PrC signal prior object exposure at multiple time scales, we predicted that PrC responses would track perceived prior experience in both types of judgments. Left PrC and a number of cortical regions that are often co-activated as part of the default-mode network showed an increase in Blood-Oxygen-Level Dependent (BOLD) response in relation to increases in the perceived cumulative lifetime familiarity of object concepts. These regions included the left hippocampus, left mid-lateral temporal cortex, as well as anterior and posterior cortical midline structures. Critically, left PrC was found to be the only region that showed this response in combination with the typically observed decrease in signal for perceived recent exposure in the experimental study phase. These findings provide, to our knowledge, the first evidence that ties signals in human PrC to variations in cumulative lifetime experience with object concepts. They offer a new link between the role of PrC in recognition memory and its broader role in conceptual processing.

Material Specificity Drives Medial Temporal Lobe Familiarity But Not Hippocampal Recollection

The specific role of the perirhinal (PRC), entorhinal (ERC) and parahippocampal cortices (PHC) in supporting familiarity‐based recognition remains unknown. An fMRI study explored whether these medial temporal lobe (MTL) structures responded in the same way or differentially to familiarity as a function of stimulus type at recognition. A secondary aim was to explore whether the hippocampus responds in the same way to equally strong familiarity and recollection and whether this is influenced by the kind of stimulus involved. Univariate and multivariate analyses revealed that familiarity responses in the PRC, ERC, PHC and the amygdala are material‐specific. Specifically, the PRC and ERC selectively responded to object familiarity, while the PHC responded to both object and scene familiarity. The amygdala only responded to familiarity memory for faces. The hippocampus did not respond to stimulus familiarity for any of the three types of stimuli, but it did respond to recollection for all three types of stimuli. This was true even when recollection was contrasted to equally accurate familiarity. Overall, the findings suggest that the role of the MTL neocortices and the amygdala in familiarity‐based recognition depends on the kind of stimulus in memory, whereas the role of the hippocampus in recollection is independent of the type of cuing stimulus. © 2016 The Authors Hippocampus Published by Wiley Periodicals, Inc.

More Than Meets the Eye: The Merging of Perceptual and Conceptual Knowledge in the Anterior Temporal Face Area

An emerging body of research has supported the existence of a small face sensitive region in the ventral anterior temporal lobe (ATL), referred to here as the "anterior temporal face area". The contribution of this region in the greater face-processing network remains poorly understood. The goal of the present study was to test the relative sensitivity of this region to perceptual as well as conceptual information about people and objects. We contrasted the sensitivity of this region to that of two highly-studied face-sensitive regions, the fusiform face area (FFA) and the occipital face area (OFA), as well as a control region in early visual cortex (EVC). Our findings revealed that multivoxel activity patterns in the anterior temporal face area contain information about facial identity, as well as conceptual attributes such as one's occupation. The sensitivity of this region to the conceptual attributes of people was greater than that of posterior face processing regions. In addition, the anterior temporal face area overlaps with voxels that contain information about the conceptual attributes of concrete objects, supporting a generalized role of the ventral ATLs in the identification and conceptual processing of multiple stimulus classes.

Neural representation for object recognition in inferotemporal cortex

We suggest that population representation of objects in inferotemporal cortex lie on a continuum between a purely structural, parts-based description and a purely holistic description. The intrinsic dimensionality of object representation is estimated to be around 100, perhaps with lower dimensionalities for object representations more toward the holistic end of the spectrum. Cognitive knowledge in the form of semantic information and task information feed back to inferotemporal cortex from perirhinal and prefrontal cortex respectively, providing high-level multimodal-based expectations that assist in the interpretation of object stimuli. Integration of object information across eye movements may also contribute to object recognition through a process of active vision.