Forward Processing of Object-Location Association from the Ventral Stream to Medial Temporal Lobe in Nonhuman Primates

Mnemonically modulated perceptual processing to represent allocentric space in macaque inferotemporal cortex

To encode allocentric space information of a viewing object, it is important to relate perceptual information in the first-person perspective to the representation of an entire scene which would be constructed before. A substantial number of studies investigated the constructed scene information (e.g., cognitive map). However, only few studies have focused on its influence on perceptual processing. Therefore, we designed a visually guided saccade task requiring monkeys to gaze at objects in different locations on different backgrounds clipped from large self-designed mosaic pictures (parental pictures). In each trial, we presented moving backgrounds prior to object presentations, indicating a frame position of the background image on a parental picture. We recorded single-unit activities from 377 neurons in the posterior inferotemporal (PIT) cortex of two macaques. Equivalent numbers of neurons showed space-related (119 of 377) and object-related (125 of 377) information. The space-related neurons coded the gaze locations and background images jointly rather than separately. These results suggest that PIT neurons represent a particular location within a particular background image. Interestingly, frame positions of background images on parental pictures modulated the space-related responses dependently on parental pictures. As the frame positions could be acquired by only preceding visual experiences, the present results may provide neuronal evidence of a mnemonic effect on current perception, which might represent allocentric object location in a scene beyond the current view.

Hippocampal lesions impair non-navigational spatial memory in macaques

Decades of studies robustly support a critical role for the hippocampus in spatial memory across a wide range of species. Hippocampal damage produces clear and consistent deficits in allocentric spatial memory that requires navigating through space in rodents, non-human primates, and humans. By contrast, damage to the hippocampus spares performance in most non-navigational spatial memory tasks-which can typically be resolved using egocentric cues. We previously found that transient inactivation of the hippocampus impairs performance in the Hamilton Search Task (HST), a self-ordered non-navigational spatial search task. A key question, however, still needs to be addressed. Acute, reversible inactivation of the hippocampus may have resulted in an impairment in the HST because this approach does not allow for neuroplastic compensation, may prevent the development of an alternative learning strategy, and/or may produce network-based effects that disrupt performance. We compared learning and performance on the HST in male rhesus macaques (six unoperated control animals and six animals that underwent excitotoxic lesions of the hippocampus). We found a significant impairment in animals with hippocampal lesions. While control animals improved in performance over the course of 45 days of training, performance in animals with hippocampal lesions remained at chance levels. The HST thus represents a sensitive assay for probing the integrity of the hippocampus in non-human primates. These data provide evidence demonstrating that the hippocampus is critical for this type of non-navigational spatial memory, and help to reconcile the many null findings previously reported.

Sequential involvements of the perirhinal cortex and hippocampus in the recall of item-location associative memory in macaques

The standard consolidation theory suggests that the hippocampus (HPC) is critically involved in acquiring new memory, while storage and recall gradually become independent of it. Converging studies have shown separate involvements of the perirhinal cortex (PRC) and parahippocampal cortex (PHC) in item and spatial processes, whereas HPC relates the item to a spatial context. These 2 strands of literature raise the following question; which brain region is involved in the recall process of item-location associative memory? To solve this question, this study applied an item-location associative (ILA) paradigm in a single-unit study of nonhuman primates. We trained 2 macaques to associate 4 visual item pairs with 4 locations on a background map in an allocentric manner before the recording sessions. In each trial, 1 visual item and the map image at a tilt (-90° to 90°) were sequentially presented as the item-cue and the context-cue, respectively. The macaques chose the item-cue location relative to the context-cue by positioning their gaze. Neurons in the PRC, PHC, and HPC, but not area TE, exhibited item-cue responses which signaled retrieval of item-location associative memory. This retrieval signal first appeared in the PRC, followed by the HPC and PHC. We examined whether neural representations of the retrieved locations were related to the external space that the macaques viewed. A positive representation similarity was found in the HPC and PHC, but not in the PRC, thus suggesting a contribution of the HPC to relate the retrieved location from the PRC with a first-person perspective of the subjects and provide the self-referenced retrieved location to the PHC. These results imply distinct but complementary contributions of the PRC and HPC to recall of item-location associative memory that can be used across multiple spatial contexts.

Allocentric information represented by self-referenced spatial coding in the primate medial temporal lobe

For living organisms, the ability to acquire information regarding the external space around them is critical for future actions. While the information must be stored in an allocentric frame to facilitate its use in various spatial contexts, each case of use requires the information to be represented in a particular self-referenced frame. Previous studies have explored neural substrates responsible for the linkage between self-referenced and allocentric spatial representations based on findings in rodents. However, the behaviors of rodents are different from those of primates in several aspects; for example, rodents mainly explore their environments through locomotion, while primates use eye movements. In this review, we discuss the brain mechanisms responsible for the linkage in nonhuman primates. Based on recent physiological studies, we propose that two types of neural substrates link the first-person perspective with allocentric coding. The first is the view-center background signal, which represents an image of the background surrounding the current position of fixation on the retina. This perceptual signal is transmitted from the ventral visual pathway to the hippocampus (HPC) via the perirhinal cortex and parahippocampal cortex. Because images that share the same objective-position in the environment tend to appear similar when seen from different self-positions, the view-center background signals are easily associated with one another in the formation of allocentric position coding and storage. The second type of neural substrate is the HPC neurons' dynamic activity that translates the stored location memory to the first-person perspective depending on the current spatial context.

Distinct networks coupled with parietal cortex for spatial representations inside and outside the visual field

Our mental representation of egocentric space is influenced by the disproportionate sensory perception of the body. Previous studies have focused on the neural architecture for egocentric representations within the visual field. However, the space representation underlying the body is still unclear. To address this problem, we applied both functional Magnitude Resonance Imaging (fMRI) and Magnetoencephalography (MEG) to a spatial-memory paradigm by using a virtual environment in which human participants remembered a target location left, right, or back relative to their own body. Both experiments showed larger involvement of the frontoparietal network in representing a retrieved target on the left/right side than on the back. Conversely, the medial temporal lobe (MTL)-parietal network was more involved in retrieving a target behind the participants. The MEG data showed an earlier activation of the MTL-parietal network than that of the frontoparietal network during retrieval of a target location. These findings suggest that the parietal cortex may represent the entire space around the self-body by coordinating two distinct brain networks.

Reunification of Object and View-Center Background Information in the Primate Medial Temporal Lobe

Recent work has shown that the medial temporal lobe (MTL), including the hippocampus (HPC) and its surrounding limbic cortices, plays a role in scene perception in addition to episodic memory. The two basic factors of scene perception are the object (“what”) and location (“where”). In this review, we first summarize the anatomical knowledge related to visual inputs to the MTL and physiological studies examining object-related information processed along the ventral pathway briefly. Thereafter, we discuss the space-related information, the processing of which was unclear, presumably because of its multiple aspects and a lack of appropriate task paradigm in contrast to object-related information. Based on recent electrophysiological studies using non-human primates and the existing literature, we proposed the “reunification theory,” which explains brain mechanisms which construct object-location signals at each gaze. In this reunification theory, the ventral pathway signals a large-scale background image of the retina at each gaze position. This view-center background signal reflects the first person’s perspective and specifies the allocentric location in the environment by similarity matching between images. The spatially invariant object signal and view-center background signal, both of which are derived from the same retinal image, are integrated again (i.e., reunification) along the ventral pathway-MTL stream, particularly in the perirhinal cortex. The conjunctive signal, which represents a particular object at a particular location, may play a role in scene perception in the HPC as a key constituent element of an entire scene.

Retrospective memory trace sustained by the human hippocampus during working memory task

Working memory is a subcategory of short-term memory that voluntarily maintains behaviourally relevant information to prepare for a subsequent action. An established theory is that working memory is supported by the prefrontal cortex (PFC) for executive control, while the hippocampus (HPC) is largely involved in long-term episodic memory. Recent studies suggest that the HPC is also involved in perception and short-term storage. However, it remains unclear whether the HPC supports active maintenance of short-term memory as working memory. To address this question, we devised a new delayed matching-to-sample task in which two visual items were presented at different locations one by one as samples. The sequential presentations of sample stimuli allowed us to dissociate the contents of working memory (i.e., identities and locations of two samples) from the constituent perceived information of single samples. By applying representational similarity analysis (RSA) to the blood-oxygen-level-dependent (BOLD) signals of human participants, we investigated the delay activity after the two sample presentations. The results of the RSA showed that the right HPC signalled only the second sample as a conjunctional representation of its item identity and location. In contrast, the right PFC, including both lateral and medial parts, represented the conjunctional information of both samples. These results suggested that the HPC may support short-term memory for retrospective coding to retain information of the last event rather than for prospective coding coupled with working memory.

Hippocampal cells integrate past memory and present perception for the future

The ability to use stored information in a highly flexible manner is a defining feature of the declarative memory system. However, the neuronal mechanisms underlying this flexibility are poorly understood. To address this question, we recorded single-unit activity from the hippocampus of 2 nonhuman primates performing a newly devised task requiring the monkeys to retrieve long-term item-location association memory and then use it flexibly in different circumstances. We found that hippocampal neurons signaled both mnemonic information representing the retrieved location and perceptual information representing the external circumstance. The 2 signals were combined at a single-neuron level to construct goal-directed information by 3 sequentially occurring neuronal operations (e.g., convergence, transference, and targeting) in the hippocampus. Thus, flexible use of knowledge may be supported by the hippocampal constructive process linking memory and perception, which may fit the mnemonic information into the current situation to present manageable information for a subsequent action.

This study reveals that three neuronal operations in the macaque hippocampus combine retrieved memory and incoming perceptual information to construct goal-directed information; this constructive memory process may equip us to use past knowledge flexibly according to the current situation.

Medial Prefrontal Cortex Represents the Object-Based Cognitive Map When Remembering an Egocentric Target Location

A cognitive map, representing an environment around oneself, is necessary for spatial navigation. However, compared with its constituent elements such as individual landmarks, neural substrates of coherent spatial information, which consists in a relationship among the individual elements, remain largely unknown. The present study investigated how the brain codes map-like representations in a virtual environment specified by the relative positions of three objects. Representational similarity analysis revealed an object-based spatial representation in the hippocampus (HPC) when participants located themselves within the environment, while the medial prefrontal cortex (mPFC) represented it when they recollected a target object's location relative to their self-body. During recollection, task-dependent functional connectivity increased between the two areas implying exchange of self-location and target location signals between the HPC and mPFC. Together, the object-based cognitive map, whose coherent spatial information could be formed by objects, may be recruited in the HPC and mPFC for complementary functions during navigation, which may generalize to other aspects of cognition, such as navigating social interactions.

Automatic Encoding of a View-Centered Background Image in the Macaque Temporal Lobe

Perceptual processing along the ventral visual pathway to the hippocampus (HPC) is hypothesized to be substantiated by signal transformation from retinotopic space to relational space, which represents interrelations among constituent visual elements. However, our visual perception necessarily reflects the first person’s perspective based on the retinotopic space. To investigate this two-facedness of visual perception, we compared neural activities in the temporal lobe (anterior inferotemporal cortex, perirhinal and parahippocampal cortices, and HPC) between when monkeys gazed on an object and when they fixated on the screen center with an object in their peripheral vision. We found that in addition to the spatially invariant object signal, the temporal lobe areas automatically represent a large-scale background image, which specify the subject’s viewing location. These results suggest that a combination of two distinct visual signals on relational space and retinotopic space may provide the first person’s perspective serving for perception and presumably subsequent episodic memory.