Integrating visual and tactile information in the perirhinal cortex

Subpopulations of neurons in the perirhinal cortex enable both modality-specific and modality-invariant recognition of objects

The perirhinal cortex (PER) supports multimodal object recognition, but how multimodal information of objects is integrated within the PER remains unknown. Here, we recorded single units within the PER while rats performed a PER-dependent multimodal object-recognition task. In this task, audiovisual cues were presented simultaneously (multimodally) or separately (unimodally). We identified 2 types of object-selective neurons in the PER: crossmodal cells, showing constant firing patterns for an object irrespective of its modality, and unimodal cells, showing a preference for a specific modality. Unimodal cells further dissociated unimodal and multimodal versions of the object by modulating their firing rates according to the modality condition. A population-decoding analysis confirmed that the PER could perform both modality-invariant and modality-specific object decoding-the former for recognizing an object as the same in various conditions and the latter for remembering modality-specific experiences of the same object.

Experience transforms crossmodal object representations in the anterior temporal lobes

Combining information from multiple senses is essential to object recognition, core to the ability to learn concepts, make new inferences, and generalize across distinct entities. Yet how the mind combines sensory input into coherent crossmodal representations - the crossmodal binding problem - remains poorly understood. Here, we applied multi-echo fMRI across a 4-day paradigm, in which participants learned three-dimensional crossmodal representations created from well-characterized unimodal visual shape and sound features. Our novel paradigm decoupled the learned crossmodal object representations from their baseline unimodal shapes and sounds, thus allowing us to track the emergence of crossmodal object representations as they were learned by healthy adults. Critically, we found that two anterior temporal lobe structures - temporal pole and perirhinal cortex - differentiated learned from non-learned crossmodal objects, even when controlling for the unimodal features that composed those objects. These results provide evidence for integrated crossmodal object representations in the anterior temporal lobes that were different from the representations for the unimodal features. Furthermore, we found that perirhinal cortex representations were by default biased toward visual shape, but this initial visual bias was attenuated by crossmodal learning. Thus, crossmodal learning transformed perirhinal representations such that they were no longer predominantly grounded in the visual modality, which may be a mechanism by which object concepts gain their abstraction.

Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Vision- and touch-dependent brain correlates of body-related mental processing

In humans, the nature of sensory input influences body-related mental processing. For instance, behavioral differences (e.g., response time) can be found between mental spatial transformations (e.g., mental rotation) of viewed and touched body parts. It can thus be hypothesized that distinct brain activation patterns are associated with such sensory-dependent body-related mental processing. However, direct evidence that the neural correlates of body-related mental processing can be modulated by the nature of the sensory stimuli is still missing. We thus analyzed event-related functional magnetic resonance imaging (fMRI) data from thirty-one healthy participants performing mental rotation of visually- (images) and haptically-presented (plastic) hands. We also dissociated the neural activity related to rotation or task-related performance using models that either regressed out or included the variance associated with response time. Haptically-mediated mental rotation recruited mostly the sensorimotor brain network. Visually-mediated mental rotation led to parieto-occipital activations. In addition, faster mental rotation was associated with sensorimotor activity, while slower mental rotation was associated with parieto-occipital activations. The fMRI results indicated that changing the type of sensory inputs modulates the neural correlates of body-related mental processing. These findings suggest that distinct sensorimotor brain dynamics can be exploited to execute similar tasks depending on the available sensory input. The present study can contribute to a better evaluation of body-related mental processing in experimental and clinical settings.

Dynamic Weighting of Time-Varying Visual and Auditory Evidence During Multisensory Decision Making

Perceptual decision-making in a dynamic environment requires two integration processes: integration of sensory evidence from multiple modalities to form a coherent representation of the environment, and integration of evidence across time to accurately make a decision. Only recently studies started to unravel how evidence from two modalities is accumulated across time to form a perceptual decision. One important question is whether information from individual senses contributes equally to multisensory decisions. We designed a new psychophysical task that measures how visual and auditory evidence is weighted across time. Participants were asked to discriminate between two visual gratings, and/or two sounds presented to the right and left ear based on respectively contrast and loudness. We varied the evidence, i.e., the contrast of the gratings and amplitude of the sound, over time. Results showed a significant increase in performance accuracy on multisensory trials compared to unisensory trials, indicating that discriminating between two sources is improved when multisensory information is available. Furthermore, we found that early evidence contributed most to sensory decisions. Weighting of unisensory information during audiovisual decision-making dynamically changed over time. A first epoch was characterized by both visual and auditory weighting, during the second epoch vision dominated and the third epoch finalized the weighting profile with auditory dominance. Our results suggest that during our task multisensory improvement is generated by a mechanism that requires cross-modal interactions but also dynamically evokes dominance switching.

Multisensory Rather than Unisensory Representations Contribute to Statistical Context Learning in Tactile Search

Using a combination of behavioral and EEG measures in a tactile odd-one-out search task with collocated visual items, we investigated the mechanisms underlying facilitation of search by repeated (vs. nonrepeated) spatial distractor-target configurations ("contextual cueing") when either the tactile (same-modality) or the visual array (different-modality) context was predictive of the location of the tactile singleton target. Importantly, in both conditions, the stimulation was multisensory, consisting of tactile plus visual items, although the target was singled out in the tactile modality and so the visual items were task-irrelevant. We found that when the predictive context was tactile, facilitation of search RTs by repeated configurations was accompanied by, and correlated with, enhanced lateralized ERP markers of pre-attentive (N1, N2) and, respectively focal-attentional processing (contralateral delay activity) not only over central ("somatosensory"), but also posterior ("visual") electrode sites, although the ERP effects were less marked over visual cortex. A similar pattern-of facilitated RTs and enhanced lateralized (N2 and contralateral delay activity) ERP components-was found when the predictive context was visual, although the ERP effects were less marked over somatosensory cortex. These findings indicate that both somatosensory and visual cortical regions contribute to the more efficient processing of the tactile target in repeated stimulus arrays, although their involvement is differentially weighted depending on the sensory modality that contains the predictive information.

Examining the transition of novel information toward familiarity

Throughout their lives, humans encounter multiple instances of new information that can be inconsistent with prior knowledge (novel). Over time, the once-novel information becomes integrated into their established knowledge base, shifting from novelty to familiarity. In this study, we investigated the processes by which the first steps of this transition take place. We hypothesized that the neural representations of initially novel items gradually change over the course of repeated presentations, expressing a shift toward familiarity. We further assumed that this shift could be traced by examining neural patterns using fMRI. In two experiments, while being scanned, participants read noun-adjective word pairs that were either consistent or inconsistent with their prior knowledge. Stimuli were repeated 3-6 times within the scans. Employing mass univariate and multivariate similarity analyses, we showed that the neural representations associated with the initial presentation of familiar versus novel objects differed in lateral frontal and temporal regions, the medial prefrontal cortex, and the medial temporal lobe. Importantly, the neural representations of novel stimuli gradually changed throughout repetitions until they became indistinguishable from their respective familiar items. We interpret these findings as indicating that an early phase of familiarization can be completed within a few repetitions. This initial familiarization can then serve as the prerequisite to the integration of novel items into existing knowledge. Future empirical and theoretical works can build on the current findings to develop a comprehensive model of the transition from novelty to familiarity.

Perceptual and Semantic Representations at Encoding Contribute to True and False Recognition of Objects

When encoding new episodic memories, visual and semantic processing is proposed to make distinct contributions to accurate memory and memory distortions. Here, we used fMRI and preregistered representational similarity analysis to uncover the representations that predict true and false recognition of unfamiliar objects. Two semantic models captured coarse-grained taxonomic categories and specific object features, respectively, while two perceptual models embodied low-level visual properties. Twenty-eight female and male participants encoded images of objects during fMRI scanning, and later had to discriminate studied objects from similar lures and novel objects in a recognition memory test. Both perceptual and semantic models predicted true memory. When studied objects were later identified correctly, neural patterns corresponded to low-level visual representations of these object images in the early visual cortex, lingual, and fusiform gyri. In a similar fashion, alignment of neural patterns with fine-grained semantic feature representations in the fusiform gyrus also predicted true recognition. However, emphasis on coarser taxonomic representations predicted forgetting more anteriorly in the anterior ventral temporal cortex, left inferior frontal gyrus and, in an exploratory analysis, left perirhinal cortex. In contrast, false recognition of similar lure objects was associated with weaker visual analysis posteriorly in early visual and left occipitotemporal cortex. The results implicate multiple perceptual and semantic representations in successful memory encoding and suggest that fine-grained semantic as well as visual analysis contributes to accurate later recognition, while processing visual image detail is critical for avoiding false recognition errors.SIGNIFICANCE STATEMENT People are able to store detailed memories of many similar objects. We offer new insights into the encoding of these specific memories by combining fMRI with explicit models of how image properties and object knowledge are represented in the brain. When people processed fine-grained visual properties in occipital and posterior temporal cortex, they were more likely to recognize the objects later and less likely to falsely recognize similar objects. In contrast, while object-specific feature representations in fusiform gyrus predicted accurate memory, coarse-grained categorical representations in frontal and temporal regions predicted forgetting. The data provide the first direct tests of theoretical assumptions about encoding true and false memories, suggesting that semantic representations contribute to specific memories as well as errors.

Perirhinal and Postrhinal Damage Have Different Consequences on Attention as Assessed in the Five-Choice Serial Reaction Time Task

The perirhinal (PER) and postrhinal (POR) cortices, structures in the medial temporal lobe, are implicated in learning and memory. The PER is understood to process object information and the POR to process spatial or contextual information. Whether the medial temporal lobe is dedicated to memory, however, is under debate. In this study, we addressed the hypothesis that the PER and POR are also involved in non-mnemonic cognitive functions. Rats with PER or POR damage and SHAM surgical controls were shaped, trained, and tested on the five-choice serial reaction time (5CSRT) task, which assesses attention and executive function. Rats with PER damage were impaired in acquiring the task and at asymptote, although processing information about objects was not relevant to the task. When confronted with attentional challenges, rats with PER damage showed a pattern consistent with decreased attentional capacity, increased response errors, and increased impulsive behavior. Rats with POR damage showed intact acquisition and normal asymptotic performance. They also exhibited faster latencies in the absence of speed accuracy trade-off suggesting enhanced response readiness. We suggest this increased response readiness results from decreased automatic monitoring of the local environment, which might normally compete with response readiness. Our findings are consistent with a role for PER in controlled attention and a role for POR in stimulus-driven attention providing evidence that the PER and POR cortices have functions that go beyond memory for objects and memory for scenes and contexts, respectively. These findings provide new evidence for functional specialization in the medial temporal lobe.

Neuroplasticity and Crossmodal Connectivity in the Normal, Healthy Brain

Objective

Neuroplasticity enables the brain to establish new crossmodal connections or reorganize old connections which are essential to perceiving a multisensorial world. The intent of this review is to identify and summarize the current developments in neuroplasticity and crossmodal connectivity, and deepen understanding of how crossmodal connectivity develops in the normal, healthy brain, highlighting novel perspectives about the principles that guide this connectivity.

Methods

To the above end, a narrative review is carried out. The data documented in prior relevant studies in neuroscience, psychology and other related fields available in a wide range of prominent electronic databases are critically assessed, synthesized, interpreted with qualitative rather than quantitative elements, and linked together to form new propositions and hypotheses about neuroplasticity and crossmodal connectivity.

Results

Three major themes are identified. First, it appears that neuroplasticity operates by following eight fundamental principles and crossmodal integration operates by following three principles. Second, two different forms of crossmodal connectivity, namely direct crossmodal connectivity and indirect crossmodal connectivity, are suggested to operate in both unisensory and multisensory perception. Third, three principles possibly guide the development of crossmodal connectivity into adulthood. These are labeled as the principle of innate crossmodality, the principle of evolution-driven 'neuromodular' reorganization and the principle of multimodal experience. These principles are combined to develop a three-factor interaction model of crossmodal connectivity.

Conclusions

The hypothesized principles and the proposed model together advance understanding of neuroplasticity, the nature of crossmodal connectivity, and how such connectivity develops in the normal, healthy brain.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

The influence of item familiarization on neural discriminability during associative memory encoding and retrieval

Associative memory requires one to encode and form memory representations not just for individual items, but for the association or link between those items. Past work has suggested that associative memory is facilitated when individual items are familiar rather than simultaneously learning the items and their associative link. The current study employed multivoxel pattern analyses (MVPA) to investigate whether item familiarization prior to associative encoding affects the distinctiveness of neural patterns, and whether that distinctiveness is also present during associative retrieval. Our results suggest that prior exposure to item stimuli impacts the representations of their shared association compared to stimuli that are novel at the time of associative encoding throughout most of the associative memory network. While this distinction was also present at retrieval, the overall extent of the difference was diminished. Overall the results suggest that stimulus familiarity influences the representation of associative pairings during memory encoding and retrieval, and the pair-specific representation is maintained across memory phases irrespective of this distinction.

Examining the Neural Basis of Congruent and Incongruent Configural Contexts during Associative Retrieval

Disrupting the configural context, or relative organization and orientation of paired stimuli, between encoding and retrieval negatively impacts memory. Using univariate and multivariate fMRI analyses, we examined the effect of retaining and manipulating the configural context on neural mechanisms supporting associative retrieval. Behavioral results showed participants had significantly higher hit rates for recollecting pairs in a contextually congruent, versus incongruent, configuration. In addition, contextual congruency between memory phases was a critical determinant to characterizing both the magnitude and patterns of neural activation within visual and parietal cortices. Regions within visual cortices also exhibited higher correlations between patterns of activity at encoding and retrieval when configural context was congruent across memory phases than incongruent. Collectively, these findings shed light on how manipulating configural context between encoding and retrieval affects associative recognition, with changes in the configural context leading to reductions in information transfer and increases in task difficulty.

Medial temporal lobe regions mediate complex visual discriminations for both objects and scenes: A process-based view

Debate continues regarding the role of medial temporal lobe regions in object and scene processing. Considerable evidence indicates that the perirhinal cortex (PRC) plays an important role in the perception of objects-namely, in disambiguating complex objects that share conjunctions of features. These findings support a content-specific view of medial temporal lobe functioning in which PRC is critically important for processing complex objects, while the parahippocampal cortex (PHC) and hippocampus (HC) may be selectively engaged during scene processing. However, emerging evidence from both animal and human studies suggest that the PRC is sensitive to spatial configural information as well as object information. In this fMRI study, we observed preliminary evidence for BOLD activation in the PRC during a complex visual discrimination task for objects and scenes, as well as robust activation for both stimulus types in PHC and HC. The results are discussed in light of a recent process-based model of medial temporal lobe functioning.

Different types of associative encoding evoke differential processing in both younger and older adults: Evidence from univariate and multivariate analyses

Age-related deficits in associative processing are well-documented (e.g., Naveh-Benjamin, 2000) and have been assumed to be the result of a general deficit that affects all types of binding. However, recent behavioral research has indicated that the visual configuration of the information that is presented to older adults influences the degree to which this binding deficit is exhibited by older adults (Overman, Dennis et al, 2019; Overman, Dennis, et al., 2018). The purpose of the present study was to further clarify the neural underpinnings of the associative deficit in aging and to examine whether functional activity at encoding differs with respect to the visual configuration and the type of associative being encoded. Using both univariate and multi-voxel pattern analysis, we found differences in both the magnitude of activation and pattern of neural responses associated with the type of association encoded (item-item and item-context). Specifically, our results suggest that, when controlling for stimuli composition, patterns of activation in sensory and frontal regions within the associative encoding network are able to distinguish between different types of associations. With respect to the MTL, multivariate results suggest that only patterns of activation in the PrC in older, but not younger adults, can distinguish between associations types. These findings extend prior work regarding the neural basis of associative memory in young and older adults, and extends the predictions of the binding of item and context model (BIC; Diana, Yonelinas, Ranganath, 2007) to older adults.

The perirhinal cortex supports spatial intertemporal choice stability

In order to optimize outcomes in the face of uncertainty, one must recall past experiences and extrapolate to the future by assigning values to different choice outcomes. This behavior requires an interplay between memory and reward valuation, necessitating communication across many brain regions. At the anatomical nexus of this interplay is the perirhinal cortex (PRC). The PRC is densely connected to the amygdala and orbital frontal cortex, regions that have been implicated in reward-based decision making, as well as the hippocampus. Thus, the PRC could serve as a hub for integrating memory, reward, and prediction. The PRC's role in value-based decision making, however, has not been empirically examined. Therefore, we tested the role of the PRC in a spatial delay discounting task, which allows rats to choose between a 1-s delay for a small food reward and a variable delay for a large food reward, with the delay to the large reward increasing after choice of each large reward and decreasing after each small reward. The rat can therefore adjust the delay by consecutively choosing the same reward or stabilize the delay by alternating between sides. The latter has been shown to occur once the 'temporal cost' of the large reward is established and is a decision-making process termed 'exploitation'. When the PRC was bilaterally inactivated with the GABA(A) agonist muscimol, rats spent fewer trials successfully exploiting to maintain a fixed delay compared to the vehicle control condition. Moreover, PRC inactivation resulted in an increased number of vicarious trial and error (VTE) events at the choice point, where rats had to decide between the two rewards. These behavioral patterns suggest that the PRC is critical for maintaining stability in linking a choice to a reward outcome in the face of a variable cost.

The Shape of Things to Come in Speech Production: A Functional Magnetic Resonance Imaging Study of Visual Form Interference during Lexical Access

Studies of context effects in speech production have shown that semantic feature overlap produces interference in naming of categorically related objects. In neuroimaging studies, this semantic interference effect is consistently associated with involvement of left superior and middle temporal gyri. However, at least part of this effect has recently been shown to be attributable to visual form similarity, as categorically related objects typically share visual features. This fMRI study examined interference produced by visual form overlap in the absence of a category relation in a picture-word interference paradigm. Both visually similar and visually dissimilar distractors led to increased BOLD responses in the left inferior frontal gyrus compared with the congruent condition. Naming pictures in context with a distractor word denoting an object visually similar in form slowed RTs compared with unrelated words and was associated with reduced activity in the left posterior middle temporal gyrus. This area is reliably observed in lexical level processing during language production tasks. No significant differential activity was observed in areas typically engaged by early perceptual or conceptual feature level processing or in areas proposed to be engaged by postlexical language processes, suggesting that visual form interference does not arise from uncertainty or confusion during perceptual or conceptual identification or after lexical processing. We conclude that visual form interference has a lexical locus, consistent with the predictions of competitive lexical selection models.

Impaired discrimination with intact crossmodal association in aged rats: A dissociation of perirhinal cortical-dependent behaviors

The perirhinal cortex (PRC) supports associative memory and perception, and PRC dysfunction impairs animals' abilities to associate stimulus features across sensory modalities. PRC damage also leads to deficits in discriminating between stimuli that share features. Although PRC-dependent stimulus discrimination has been shown to be impaired with advanced age, data regarding the abilities of older adults and other animals to form PRC-dependent associations have been equivocal. Moreover, the extent to which similar neural computations within the PRC support associative memory versus discrimination abilities have not been directly examined. In the current study, young and aged rats were cross-characterized on two PRC-dependent crossmodal object recognition (CMOR) tasks to test associative memory, and a LEGO object discrimination task. In the CMOR tasks, rats were familiarized with an object with access to tactile input and then tested for recognition with visual input only. The relative exploration time of novel versus familiar objects indicated that aged rats showed preference for the novel over familiar object with and without an epoch of multimodal preexposure to the familiar object prior to the testing session. Furthermore, crossmodal recognition performance between young and aged rats was not significantly different. In contrast, for the LEGO object discrimination task, aged rats were impaired relative to young rats. Notably, aged rats that performed poorly on the LEGO object discrimination task had better performance on the CMOR tasks. The dissociation of discrimination and association abilities with age suggests that these behaviors rely on distinct neural computations within PRC-medial temporal lobe circuit. (PsycINFO Database Record

Temporal lobe epilepsy affects spatial organization of entorhinal cortex connectivity

Evidence for structural connectivity patterns within the medial temporal lobe derives primarily from postmortem histological studies. In humans and nonhuman primates, the parahippocampal gyrus (PHg) is subdivided into parahippocampal (PHc) and perirhinal (PRc) cortices, which receive input from distinct cortical networks. Likewise, their efferent projections to the entorhinal cortex (ERc) are distinct. The PHc projects primarily to the medial ERc (M-ERc). The PRc projects primarily to the lateral portion of the ERc (L-ERc). Both M-ERc and L-ERc, via the perforant pathway, project to the dentate gyrus and hippocampal (HC) subfields. Until recently, these neural circuits could not be visualized in vivo. Diffusion tensor imaging algorithms have been developed to segment gray matter structures based on probabilistic connectivity patterns. However, these algorithms have not yet been applied to investigate connectivity in the temporal lobe or changes in connectivity architecture related to disease processes. In this study, this segmentation procedure was used to classify ERc gray matter based on PRc, ERc, and HC connectivity patterns in 7 patients with temporal lobe epilepsy (TLE) without hippocampal sclerosis (mean age, 14.86 ± 3.34 years) and 7 healthy controls (mean age, 23.86 ± 2.97 years). Within samples paired t-tests allowed for comparison of ERc connectivity between epileptogenic and contralateral hemispheres. In healthy controls, there were no significant within-group differences in surface area, volume, or cluster number of ERc connectivity-defined regions (CDR). Likewise, in line with histology results, ERc CDR in the control group were well-organized, uniform, and segregated via PRc/PHc afferent and HC efferent connections. Conversely, in TLE, there were significantly more PRc and HC CDR clusters in the epileptogenic than the contralateral hemisphere. The surface area of the PRc CDR was greater, and that of the HC CDRs was smaller, in the epileptogenic hemisphere as well. Further, there was no clear delineation between M-ERc and L-ERc connectivity with PRc, PHc or HC in TLE. These results suggest a breakdown of the spatial organization of PHg-ERc-HC connectivity in TLE. Whether this breakdown is the cause or result of epileptic activity remains an exciting research question.

Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway

Recognising an object involves rapid visual processing and activation of semantic knowledge about the object, but how visual processing activates and interacts with semantic representations remains unclear. Cognitive neuroscience research has shown that while visual processing involves posterior regions along the ventral stream, object meaning involves more anterior regions, especially perirhinal cortex. Here we investigate visuo-semantic processing by combining a deep neural network model of vision with an attractor network model of semantics, such that visual information maps onto object meanings represented as activation patterns across features. In the combined model, concept activation is driven by visual input and co-occurrence of semantic features, consistent with neurocognitive accounts. We tested the model’s ability to explain fMRI data where participants named objects. Visual layers explained activation patterns in early visual cortex, whereas pattern-information in perirhinal cortex was best explained by later stages of the attractor network, when detailed semantic representations are activated. Posterior ventral temporal cortex was best explained by intermediate stages corresponding to initial semantic processing, when visual information has the greatest influence on the emerging semantic representation. These results provide proof of principle of how a mechanistic model of combined visuo-semantic processing can account for pattern-information in the ventral stream.

The hippocampus is particularly important for building associations across stimulus domains

The medial temporal lobe (MTL) is critical for binding together different attributes that together form memory for prior episodes, but whether it is preferentially involved in supporting specific types of associations is a topic of much debate. Some have argued that the MTL, specifically the hippocampus, may be specialized for binding information from different stimulus domains (e.g., linking visual and auditory stimuli). In the current study, we examined the role of the MTL in memory for associations within- vs. across-domains. Patients with either selective hippocampal lesions or more extensive MTL lesions studied pairs of items within the same stimulus domain (i.e., image-image or sound-sound pairs) or across different domains (i.e., image-sound pairs). Associative memory was subsequently tested by having participants discriminate between previously studied and rearranged pairs. Compared to healthy controls, the patients were significantly more impaired in the across-domain condition than the within-domain conditions. Similar deficits were observed for patients with hippocampal lesions and those with more extensive MTL lesions, suggesting that the hippocampus itself is particularly important for binding associations across stimulus domains.

Representational Account of Memory: Insights from Aging and Synesthesia

The representational account of memory envisages perception and memory to be on a continuum rather than in discretely divided brain systems [Bussey, T. J., & Saksida, L. M. Memory, perception, and the ventral visual-perirhinal-hippocampal stream: Thinking outside of the boxes. Hippocampus, 17, 898-908, 2007]. We tested this account using a novel between-group design with young grapheme-color synesthetes, older adults, and young controls. We investigated how the disparate sensory-perceptual abilities between these groups translated into associative memory performance for visual stimuli that do not induce synesthesia. ROI analyses of the entire ventral visual stream showed that associative retrieval (a pair-associate retrieved in the absence of a visual stimulus) yielded enhanced activity in young and older adults' visual regions relative to synesthetes, whereas associative recognition (deciding whether a visual stimulus was the correct pair-associate) was characterized by enhanced activity in synesthetes' visual regions relative to older adults. Whole-brain analyses at associative retrieval revealed an effect of age in early visual cortex, with older adults showing enhanced activity relative to synesthetes and young adults. At associative recognition, the group effect was reversed: Synesthetes showed significantly enhanced activity relative to young and older adults in early visual regions. The inverted group effects observed between retrieval and recognition indicate that reduced sensitivity in visual cortex (as in aging) comes with increased activity during top-down retrieval and decreased activity during bottom-up recognition, whereas enhanced sensitivity (as in synesthesia) shows the opposite pattern. Our results provide novel evidence for the direct contribution of perceptual mechanisms to visual associative memory based on the examples of synesthesia and aging.

De Novo Emergence of Odor Category Representations in the Human Brain

Categorization allows organisms to efficiently extract relevant information from a diverse environment. Because of the multidimensional nature of odor space, this ability is particularly important for the olfactory system. However, categorization relies on experience, and the processes by which the human brain forms categorical representations about new odor percepts are currently unclear. Here we used olfactory psychophysics and multivariate fMRI techniques, in the context of a paired-associates learning task, to examine the emergence of novel odor category representations in the human brain. We found that learning between novel odors and visual category information induces a perceptual reorganization of those odors, in parallel with the emergence of odor category-specific ensemble patterns in perirhinal, orbitofrontal, piriform, and insular cortices. Critically, the learning-induced pattern effects in orbitofrontal and perirhinal cortex predicted the magnitude of categorical learning and perceptual plasticity. The formation of de novo category-specific representations in olfactory and limbic brain regions suggests that such ensemble patterns subserve the development of perceptual classes of information, and imply that these patterns are instrumental to the brain's capacity for odor categorization.

SIGNIFICANCE STATEMENT

How the human brain assigns novel odors to perceptual classes and categories is poorly understood. We combined an olfactory-visual paired-associates task with multivariate pattern-based fMRI approaches to investigate the de novo formation of odor category representations within the human brain. The identification of emergent odor category codes within the perirhinal, piriform, orbitofrontal, and insular cortices suggests that these regions can integrate multimodal sensory input to shape category-specific olfactory representations for novel odors, and may ultimately play an important role in assembling each individual's semantic knowledge base of the olfactory world.

Tactile Object Familiarity in the Blind Brain Reveals the Supramodal Perceptual-Mnemonic Nature of the Perirhinal Cortex

This study is the first to investigate the neural underpinnings of tactile object familiarity in the blind during both perception and memory. In the sighted, the perirhinal cortex (PRC) has been implicated in the assessment of visual object familiarity-a crucial everyday task-as evidenced by reduced activation when an object becomes familiar. Here, to examine the PRC's role in tactile object familiarity in the absence of vision, we trained blind participants on a unique memory-guided drawing technique and measured brain activity while they perceptually explored raised-line drawings, drew them from tactile memory, and scribbled (control). Functional magnetic resonance imaging (fMRI) before and after a week of training revealed a significant decrease in PRC activation from pre- to post-training (i.e., from unfamiliar to familiar) during perceptual exploration as well as memory-guided drawing, but not scribbling. This familiarity-based reduction is the first evidence that the PRC represents tactile object familiarity in the blind. Furthermore, the finding of this effect during both tactile perception and tactile memory provides the critical link in establishing the PRC as a structure whose representations are supramodal for both perception and memory.

Perirhinal cortex supports tactual discrimination tasks with increasing levels of complexity: Retrograde effect

Recent studies have suggested that the perirhinal cortex (Prh) supports representations of feature conjunctions in the visual modality during the acquisition/encoding of complex discriminations. To extend this idea to other sensory modalities and to another stage of the discrimination process, we studied the effect of Prh lesions on the expression of a series of tactual discrimination tasks learned preoperatively. These tasks differed from one another in the degree of feature overlap of the stimuli and in the difficulty of the task. During pre- and post-operative testing phases, rats had to discriminate among 3 stimuli simultaneously exposed in 3 arms of a 4-arm plus-shaped maze. Prh-damaged rats showed a profound impairment in the expression of tactual discrimination tasks when the stimuli had a high or intermediate degree of feature ambiguity, but not when they had a low degree of ambiguity (experiments 1a-1c). In order to experimentally dissociate between subregions within the medial temporal lobe, experiment 2 was conducted to show that hippocampal lesions did not cause any impairment in task expression even when the stimuli had a high degree of feature ambiguity. When the tactual discrimination tasks used simple/individual nonoverlapping features of the stimuli (size), Prh lesions did not affect the expression of these discriminations despite the high level of difficulty of these tasks (experiments 3a and 3b). These findings suggest that, in the somatosensory modality, the Prh plays an essential role in the processing of complex stimuli with overlapping features but not in simple tactual discriminations. Furthermore, the Prh is necessary not just during acquisition but also during expression/performance of the discrimination task.

The Dynamic Multisensory Engram: Neural Circuitry Underlying Crossmodal Object Recognition in Rats Changes with the Nature of Object Experience

Rats, humans, and monkeys demonstrate robust crossmodal object recognition (CMOR), identifying objects across sensory modalities. We have shown that rats' performance of a spontaneous tactile-to-visual CMOR task requires functional integration of perirhinal (PRh) and posterior parietal (PPC) cortices, which seemingly provide visual and tactile object feature processing, respectively. However, research with primates has suggested that PRh is sufficient for multisensory object representation. We tested this hypothesis in rats using a modification of the CMOR task in which multimodal preexposure to the to-be-remembered objects significantly facilitates performance. In the original CMOR task, with no preexposure, reversible lesions of PRh or PPC produced patterns of impairment consistent with modality-specific contributions. Conversely, in the CMOR task with preexposure, PPC lesions had no effect, whereas PRh involvement was robust, proving necessary for phases of the task that did not require PRh activity when rats did not have preexposure; this pattern was supported by results from c-fos imaging. We suggest that multimodal preexposure alters the circuitry responsible for object recognition, in this case obviating the need for PPC contributions and expanding PRh involvement, consistent with the polymodal nature of PRh connections and results from primates indicating a key role for PRh in multisensory object representation. These findings have significant implications for our understanding of multisensory information processing, suggesting that the nature of an individual's past experience with an object strongly determines the brain circuitry involved in representing that object's multisensory features in memory.

SIGNIFICANCE STATEMENT

The ability to integrate information from multiple sensory modalities is crucial to the survival of organisms living in complex environments. Appropriate responses to behaviorally relevant objects are informed by integration of multisensory object features. We used crossmodal object recognition tasks in rats to study the neurobiological basis of multisensory object representation. When rats had no prior exposure to the to-be-remembered objects, the spontaneous ability to recognize objects across sensory modalities relied on functional interaction between multiple cortical regions. However, prior multisensory exploration of the task-relevant objects remapped cortical contributions, negating the involvement of one region and significantly expanding the role of another. This finding emphasizes the dynamic nature of cortical representation of objects in relation to past experience.

Postmortem imaging and neuropathologic correlations

Postmortem imaging refers to scanning autopsy specimens using magnetic resonance imaging (MRI) or optical imaging. This chapter summarizes postmortem imaging and its usefulness in brain mapping. Standard in vivo MRI has limited resolution due to time constraints and does not deliver cortical boundaries (e.g., Brodmann areas). Postmortem imaging offers a means to obtain ultra-high-resolution images with appropriate contrast for delineating cortical regions. Postmortem imaging provides the ability to validate MRI properties against histologic stained sections. This approach has enabled probabilistic mapping that is based on ex vivo MRI contrast, validated to histology, and subsequently mapped on to an in vivo model. This chapter emphasizes structural imaging, which can be validated with histologic assessment. Postmortem imaging has been applied to neuropathologic studies as well. This chapter includes many ex vivo studies, but focuses on studies of the medial temporal lobe, often involved in neurologic disease. New research using optical imaging is also highlighted.

Time context of cue-outcome associations represented by neurons in perirhinal cortex

The perirhinal cortex (PRh), which has extensive connections with diverse brain sites, may contribute to semantic memory by associating various types of information about objects. However, the extent of the types of associations in which PRh participates is unknown. In the present study, we let monkeys experience a consistent contingency between visual cues and different types of outcomes (water reward and sound-only acknowledgment) in a particular time context for many days and then recorded neuronal activities from PRh and area TE, which is the major source of visual inputs to PRh. We found that PRh cells represented the outcome type in their responses to the visual cues only in the time context in which the monkeys had experienced the cue-outcome contingency. In contrast, TE cells represented the outcome information whenever the cue appeared (i.e., independently from the related time context). These results showed that PRh cells represented not only the cue-outcome contingency but also the time context in which the monkeys had experienced the contingency. We conclude that PRh is not specific to the representation of sensory and associative properties of objects themselves but may represent broader information about objects, including the time context in which the objects are associated with particular outcomes.

The perirhinal cortex and conceptual processing: Effects of feature-based statistics following damage to the anterior temporal lobes

The anterior temporal lobe (ATL) plays a prominent role in models of semantic knowledge, although it remains unclear how the specific subregions within the ATL contribute to semantic memory. Patients with neurodegenerative diseases, like semantic dementia, have widespread damage to the ATL thus making inferences about the relationship between anatomy and cognition problematic. Here we take a detailed anatomical approach to ask which substructures within the ATL contribute to conceptual processing, with the prediction that the perirhinal cortex (PRc) will play a critical role for concepts that are more semantically confusable. We tested two patient groups, those with and without damage to the PRc, across two behavioural experiments - picture naming and word-picture matching. For both tasks, we manipulated the degree of semantic confusability of the concepts. By contrasting the performance of the two groups, along with healthy controls, we show that damage to the PRc results in worse performance in processing concepts with higher semantic confusability across both experiments. Further by correlating the degree of damage across anatomically defined regions of interest with performance, we find that PRc damage is related to performance for concepts with increased semantic confusability. Our results show that the PRc supports a necessary and crucial neurocognitve function that enables fine-grained conceptual processes to take place through the resolution of semantic confusability.

The neural bases of crossmodal object recognition in non-human primates and rodents: a review

The ability to integrate information from different sensory modalities to form unique multisensory object representations is a highly adaptive cognitive function. Surprisingly, non-human animal studies of the neural substrates of this form of multisensory integration have been somewhat sparse until very recently, and this may be due in part to a relative paucity of viable testing methods. Here we review the historical development and use of various "crossmodal" cognition tasks for non-human primates and rodents, focusing on tests of "crossmodal object recognition", the ability to recognize an object across sensory modalities. Such procedures have great potential to elucidate the cognitive and neural bases of object representation as it pertains to perception and memory. Indeed, these studies have revealed roles in crossmodal cognition for various brain regions (e.g., prefrontal and temporal cortices) and neurochemical systems (e.g., acetylcholine). A recent increase in behavioral and physiological studies of crossmodal cognition in rodents augurs well for the future of this research area, which should provide essential information about the basic mechanisms of object representation in the brain, in addition to fostering a better understanding of the causes of, and potential treatments for, cognitive deficits in human diseases characterized by atypical multisensory integration.

The neural representation of 3-dimensional objects in rodent memory circuits

Three-dimensional objects are common stimuli that rodents and other animals encounter in the natural world that contribute to the associations that are the hallmark of explicit memory. Thus, the use of 3-dimensional objects for investigating the circuits that support associative and episodic memories has a long history. In rodents, the neural representation of these types of stimuli is a polymodal process and lesion data suggest that the perirhinal cortex, an area of the medial temporal lobe that receives afferent input from all sensory modalities, is particularly important for integrating sensory information across modalities to support object recognition. Not surprisingly, recent data from in vivo electrophysiological recordings have shown that principal cells within the perirhinal cortex are activated at locations of an environment that contain 3-dimensional objects. Interestingly, it appears that neural activity patterns related to object stimuli are ubiquitous across memory circuits and have now been observed in many medial temporal lobe structures as well as in the anterior cingulate cortex. This review summarizes behavioral and neurophysiological data that examine the representation of 3-dimensional objects across brain regions that are involved in memory.

Knowledge is power: how conceptual knowledge transforms visual cognition

In this review, we synthesize the existing literature demonstrating the dynamic interplay between conceptual knowledge and visual perceptual processing. We consider two theoretical frameworks that demonstrate interactions between processes and brain areas traditionally considered perceptual or conceptual. Specifically, we discuss categorical perception, in which visual objects are represented according to category membership, and highlight studies showing that category knowledge can penetrate early stages of visual analysis. We next discuss the embodied account of conceptual knowledge, which holds that concepts are instantiated in the same neural regions required for specific types of perception and action, and discuss the limitations of this framework. We additionally consider studies showing that gaining abstract semantic knowledge about objects and faces leads to behavioral and electrophysiological changes that are indicative of more efficient stimulus processing. Finally, we consider the role that perceiver goals and motivation may play in shaping the interaction between conceptual and perceptual processing. We hope to demonstrate how pervasive such interactions between motivation, conceptual knowledge, and perceptual processing are in our understanding of the visual environment, and to demonstrate the need for future research aimed at understanding how such interactions arise in the brain.

Object-specific semantic coding in human perirhinal cortex

Category-specificity has been demonstrated in the human posterior ventral temporal cortex for a variety of object categories. Although object representations within the ventral visual pathway must be sufficiently rich and complex to support the recognition of individual objects, little is known about how specific objects are represented. Here, we used representational similarity analysis to determine what different kinds of object information are reflected in fMRI activation patterns and uncover the relationship between categorical and object-specific semantic representations. Our results show a gradient of informational specificity along the ventral stream from representations of image-based visual properties in early visual cortex, to categorical representations in the posterior ventral stream. A key finding showed that object-specific semantic information is uniquely represented in the perirhinal cortex, which was also increasingly engaged for objects that are more semantically confusable. These findings suggest a key role for the perirhinal cortex in representing and processing object-specific semantic information that is more critical for highly confusable objects. Our findings extend current distributed models by showing coarse dissociations between objects in posterior ventral cortex, and fine-grained distinctions between objects supported by the anterior medial temporal lobes, including the perirhinal cortex, which serve to integrate complex object information.

Resources required for processing ambiguous complex features in vision and audition are modality specific

Processing multiple complex features to create cohesive representations of objects is an essential aspect of both the visual and auditory systems. It is currently unclear whether these processes are entirely modality specific or whether there are amodal processes that contribute to complex object processing in both vision and audition. We investigated this using a dual-stream target detection task in which two concurrent streams of novel visual or auditory stimuli were presented. We manipulated the degree to which each stream taxed processing conjunctions of complex features. In two experiments, we found that concurrent visual tasks that both taxed conjunctive processing strongly interfered with each other but that concurrent auditory and visual tasks that both taxed conjunctive processing did not. These results suggest that resources for processing conjunctions of complex features within vision and audition are modality specific.

Dysgranular retrosplenial cortex lesions in rats disrupt cross-modal object recognition

The retrosplenial cortex supports navigation, with one role thought to be the integration of different spatial cue types. This hypothesis was extended by examining the integration of nonspatial cues. Rats with lesions in either the dysgranular subregion of retrosplenial cortex (area 30) or lesions in both the granular and dysgranular subregions (areas 29 and 30) were tested on cross-modal object recognition (Experiment 1). In these tests, rats used different sensory modalities when exploring and subsequently recognizing the same test objects. The objects were first presented either in the dark, i.e., giving tactile and olfactory cues, or in the light behind a clear Perspex barrier, i.e., giving visual cues. Animals were then tested with either constant combinations of sample and test conditions (light to light, dark to dark), or changed “cross-modal” combinations (light to dark, dark to light). In Experiment 2, visual object recognition was tested without Perspex barriers, but using objects that could not be distinguished in the dark. The dysgranular retrosplenial cortex lesions selectively impaired cross-modal recognition when cue conditions switched from dark to light between initial sampling and subsequent object recognition, but no impairment was seen when the cue conditions remained constant, whether dark or light. The combined (areas 29 and 30) lesioned rats also failed the dark to light cross-modal problem but this impairment was less selective. The present findings suggest a role for the dysgranular retrosplenial cortex in mediating the integration of information across multiple cue types, a role that potentially applies to both spatial and nonspatial domains.

A perfusion fMRI investigation of thematic and categorical context effects in the spoken production of object names

The context in which objects are presented influences the speed at which they are named. We employed the blocked cyclic naming paradigm and perfusion functional magnetic resonance imaging (fMRI) to investigate the mechanisms responsible for interference effects reported for thematically and categorically related compared to unrelated contexts. Naming objects in categorically homogeneous contexts induced a significant interference effect that accumulated from the second cycle onwards. This interference effect was associated with significant perfusion signal decreases in left middle and posterior lateral temporal cortex and the hippocampus. By contrast, thematically homogeneous contexts facilitated naming latencies significantly in the first cycle and did not differ from heterogeneous contexts thereafter, nor were they associated with any perfusion signal changes compared to heterogeneous contexts. These results are interpreted as being consistent with an account in which the interference effect both originates and has its locus at the lexical level, with an incremental learning mechanism adapting the activation levels of target lexical representations following access. We discuss the implications of these findings for accounts that assume thematic relations can be active lexical competitors or assume mandatory involvement of top-down control mechanisms in interference effects during naming.

Similarity of fMRI activity patterns in left perirhinal cortex reflects semantic similarity between words

How verbal and nonverbal visuoperceptual input connects to semantic knowledge is a core question in visual and cognitive neuroscience, with significant clinical ramifications. In an event-related functional magnetic resonance imaging (fMRI) experiment we determined how cosine similarity between fMRI response patterns to concrete words and pictures reflects semantic clustering and semantic distances between the represented entities within a single category. Semantic clustering and semantic distances between 24 animate entities were derived from a concept-feature matrix based on feature generation by >1000 subjects. In the main fMRI study, 19 human subjects performed a property verification task with written words and pictures and a low-level control task. The univariate contrast between the semantic and the control task yielded extensive bilateral occipitotemporal activation from posterior cingulate to anteromedial temporal cortex. Entities belonging to a same semantic cluster elicited more similar fMRI activity patterns in left occipitotemporal cortex. When words and pictures were analyzed separately, the effect reached significance only for words. The semantic similarity effect for words was localized to left perirhinal cortex. According to a representational similarity analysis of left perirhinal responses, semantic distances between entities correlated inversely with cosine similarities between fMRI response patterns to written words. An independent replication study in 16 novel subjects confirmed these novel findings. Semantic similarity is reflected by similarity of functional topography at a fine-grained level in left perirhinal cortex. The word specificity excludes perceptually driven confounds as an explanation and is likely to be task dependent.

Intact memory for irrelevant information impairs perception in amnesia

Memory and perception have long been considered separate cognitive processes, and amnesia resulting from medial temporal lobe (MTL) damage is thought to reflect damage to a dedicated memory system. Recent work has questioned these views, suggesting that amnesia can result from impoverished perceptual representations in the MTL, causing an increased susceptibility to interference. Using a perceptual matching task for which fMRI implicated a specific MTL structure, the perirhinal cortex, we show that amnesics with MTL damage including the perirhinal cortex, but not those with damage limited to the hippocampus, were vulnerable to object-based perceptual interference. Importantly, when we controlled such interference, their performance recovered to normal levels. These findings challenge prevailing conceptions of amnesia, suggesting that effects of damage to specific MTL regions are better understood not in terms of damage to a dedicated declarative memory system, but in terms of impoverished representations of the stimuli those regions maintain.

Interactions of memory and perception in amnesia: the figure-ground perspective

The medial temporal lobes (MTLs) have been thought to function exclusively in service of declarative memory. Recent research shows that damage to the perirhinal cortex (PRC) of the MTL impairs the discrimination of objects sharing many similar parts/features, leading to the hypothesis that the PRC contributes to the perception when the feature configurations, rather than the individual features, are required to solve the task. It remains uncertain, however, whether the previous research demands a slight extension of PRC function to include working memory or a more dramatic extension to include perception. We present 2 experiments assessing the implicit effects of familiar configuration on figure assignment, an early and fundamental perceptual outcome. Unlike controls, PRC-damaged individuals failed to perceive the regions portraying familiar configurations, as figure more often, than the regions comprising the same parts rearranged into novel configurations. They were also impaired in identifying the familiar objects. In a third experiment, PRC-damaged individuals performed poorly when asked to choose a familiar object from pairs of familiar and novel objects comprising the same parts. Our results demonstrate that the PRC is involved in both implicit and explicit perceptual discriminations of novel and familiar configurations. These results reveal that complex object representations in the PRC subserve both perception and memory.

Pre-experimental Familiarization Increases Hippocampal Activity for Both Targets and Lures in Recognition Memory: An fMRI Study

In the present study, items pre-exposed in a familiarization series were included in a list discrimination task to manipulate memory strength. At test, participants were required to discriminate strong targets and strong lures from weak targets and new lures. This resulted in a concordant pattern of increased “old” responses to strong targets and lures. Model estimates attributed this pattern to either equivalent increases in memory strength across the two types of items (unequal variance signal detection model) or equivalent increases in both familiarity and recollection (dual process signal detection [DPSD] model). Hippocampal activity associated with strong targets and lures showed equivalent increases compared with missed items. This remained the case when analyses were restricted to high-confidence responses considered by the DPSD model to reflect predominantly recollection. A similar pattern of activity was observed in parahippocampal cortex for high-confidence responses. The present results are incompatible with “noncriterial” or “false” recollection being reflected solely in inflated DPSD familiarity estimates and support a positive correlation between hippocampal activity and memory strength irrespective of the accuracy of list discrimination, consistent with the unequal variance signal detection model account.

Separate but interacting recognition memory systems for different senses: the role of the rat perirhinal cortex

Two different models (convergent and parallel) potentially describe how recognition memory, the ability to detect the re-occurrence of a stimulus, is organized across different senses. To contrast these two models, rats with or without perirhinal cortex lesions were compared across various conditions that controlled available information from specific sensory modalities. Intact rats not only showed visual, tactile, and olfactory recognition, but also overcame changes in the types of sensory information available between object sampling and subsequent object recognition, e.g., between sampling in the light and recognition in the dark, or vice versa. Perirhinal lesions severely impaired object recognition whenever visual cues were available, but spared olfactory recognition and tactile-based object recognition when tested in the dark. The perirhinal lesions also blocked the ability to recognize an object sampled in the light and then tested for recognition in the dark, or vice versa. The findings reveal parallel recognition systems for different senses reliant on distinct brain areas, e.g., perirhinal cortex for vision, but also show that: (1) recognition memory for multisensory stimuli involves competition between sensory systems and (2) perirhinal cortex lesions produce a bias to rely on vision, despite the presence of intact recognition memory systems serving other senses.