Rapid Onset Relational Memory Effects Are Evident in Eye Movement Behavior, but Not in Hippocampal Amnesia

Eye movements support the link between conscious memory and medial temporal lobe function

When individuals select the recently studied (and familiar) item in a multiple-choice memory test, they direct a greater proportion of viewing time toward the to-be-selected item when their choice is correct than when their choice is incorrect. Thus, for both correct and incorrect choices, individuals indicate that the chosen item is old, but viewing time nevertheless distinguishes between old and new items. What kind of memory supports this preferential viewing effect? We recorded eye movements while participants made three-alternative, forced-choice recognition memory judgments for scenes. In experiment 1 (n = 30), the magnitude of the preferential viewing effect was strongly correlated with measures of conscious, declarative memory: recognition accuracy as well as the difference in confidence ratings and in response times for correct and incorrect choices. In four analyses that minimized the contribution of declarative memory in order to detect a possible contribution from other processes, the preferential viewing effect was absent. In experiment 2, five memory-impaired patients with medial temporal lobe lesions exhibited a diminished preferential viewing effect. These patients also exhibited poor recognition accuracy and reduced differences in confidence ratings and response times for correct and incorrect choices. We propose that the preferential viewing effect is a phenomenon of conscious, declarative memory and is dependent on the medial temporal lobe. The findings support the link between medial temporal lobe function and declarative memory. When the effects of experience depend on the medial temporal lobe, the effects reflect conscious memory.

Subliminal encoding and flexible retrieval of objects in scenes

Our episodic memory stores what happened when and where in life. Episodic memory requires the rapid formation and flexible retrieval of where things are located in space. Consciousness of the encoding scene is considered crucial for episodic memory formation. Here, we question the necessity of consciousness and hypothesize that humans can form unconscious episodic memories. Participants were presented with subliminal scenes, that is, scenes invisible to the conscious mind. The scenes displayed objects at certain locations for participants to form unconscious object-in-space memories. Later, the same scenes were presented supraliminally, that is, visibly, for retrieval testing. Scenes were presented absent the objects and rotated by 90°-270° in perspective to assess the representational flexibility of unconsciously formed memories. During the test phase, participants performed a forced-choice task that required them to place an object in one of two highlighted scene locations and their eye movements were recorded. Evaluation of the eye tracking data revealed that participants remembered object locations unconsciously, irrespective of changes in viewing perspective. This effect of gaze was related to correct placements of objects in scenes, and an intuitive decision style was necessary for unconscious memories to influence intentional behavior to a significant degree. We conclude that conscious perception is not mandatory for spatial episodic memory formation.

Reconstructing relational information

Hippocampal involvement in learning and remembering relational information has an extensive history, often focusing specifically on spatial information. In humans, spatial reconstruction (SR) paradigms are a powerful tool for evaluating an individuals' spatial-relational memory. In SR tasks, participants study locations of items in space and subsequently reconstruct the studied display after a short delay. Previous work has revealed that patients with hippocampal damage are impaired both in overall placement accuracy as well as on a specific measure of relational memory efficacy, "swaps" (i.e., when the relative location of two items is reversed). However, the necessity of the hippocampus for other types of spatial-relational information involved in reconstruction behaviors (e.g., where in the environment and relative to which other items an item was located) have not yet been investigated systematically. In this work, three patients with hippocampal damage and nine healthy matched comparison participants performed an SR task. An analysis framework was developed to independently assess three first-order types of relations: (1) memory for the binding of specific item identities to locations, (2) memory for arrangement of items in relation to each other or the environment bounds, regardless of memory for the item identity, and (3) higher-order, compound relational errors (i.e., errors involving multiple pieces of relational information). Reconstruction errors were evaluated to determine the degree to which patients and comparisons differed (or not) on each type of spatial-relational information. Data revealed that the primary group difference in performance was for identity-location information. However, when the locations of items were evaluated without regarding the identities, no group difference was found in the number of item placements to studied locations. The present work provides a principled approach to analysis of SR data and clarifies our understanding of the types of spatial relations impaired in hippocampal damaged.

What Is Memory-Guided Attention? How Past Experiences Shape Selective Visuospatial Attention in the Present

What controls our attention? It is historically thought that there are two primary factors that determine selective attention: the perceptual salience of the stimuli and the goals based on the task at hand. However, this distinction doesn't neatly capture the varied ways our past experience can influence our ongoing mental processing. In this chapter, we aim to describe how past experience can be systematically characterized by different types of memory, and we outline experimental evidence suggesting how attention can then be guided by each of these different memory types. We highlight findings from human behavioral, neuroimaging, and neuropsychological work from the perspective of two related frameworks of human memory: the multiple memory systems (MMS) framework and the neural processing (NP) framework. The MMS framework underscores how memory can be separated based on consciousness (declarative and non-declarative memory), while the NP framework emphasizes different forms of memory as reflective of different brain processing modes (rapid encoding of flexible associations, slow encoding of rigid associations, and rapid encoding of single or unitized items). We describe how memory defined by these frameworks can guide our attention, even when they do not directly relate to perceptual salience or the goals concerning the current task. We close by briefly discussing theoretical implications as well as some interesting avenues for future research.

Graded expression of source memory revealed by analysis of gaze direction

During source memory studies, knowledge of some detail about the context of a previously experienced item or event is tested. Here, participants attended to different objects presented at different quadrants on a screen. In a later test phase, a single object was presented in all four quadrants, and participants verbally reported whether the object was new or previously seen (item recognition), and if it was previously seen, they indicated the original screen location (source memory). We combined this test with eye-tracking to determine whether attention to an object during encoding would correlate with later recognition of the object and memory of its source location, and whether eye movements at test can reveal attention to the correct source location in the absence of correct explicit verbal responses. The amount of time spent looking at an object during encoding was not related to later object recognition or source recollection. However, we found that eye movements at test reveal retention of source information about an object in the absence of accurate retrieval of source information as assessed by verbal response. When participants correctly recognized an object but incorrectly indicated the source information, significantly more time was spent looking at the correct source location than to incorrect, non-selected locations. Moreover, when participants correctly recognized an object but said they could not remember the source information, significantly more time was spent looking at the correct source location. These results are consistent with the hypothesis that eye movements are sensitive to attention or other graded mental processes which can underlie the retrieval of source memories that can then be expressed verbally in a thresholded manner.

Viewpoints: how the hippocampus contributes to memory, navigation and cognition

The hippocampus serves a critical function in memory, navigation, and cognition. Nature Neuroscience asked John Lisman to lead a group of researchers in a dialog on shared and distinct viewpoints on the hippocampus.

There has been a long history of studying the hippocampus, but recent work has made it possible to study the cellular and network basis of defined operations—operations that include cognitive processes that have been otherwise difficult to study (see Box 1 for useful terminology). These operations deal with the context-dependent representation of complex memories, the role of mental exploration based on imagined rather than real movements, and the use of recalled information for navigation and decision-making. The progress that has been made in understanding the hippocampus has motivated the study of other brain regions that provide hippocampal input or receive hippocampal output; the hippocampus is thus serving as a nucleating point for the larger goal of understanding the neural codes that allow inter-regional communication and more generally, understanding how memory-guided behavior is achieved by large scale integration of brain regions. In generating a discussion among experts in the study of the cognitive processes of the hippocampus, the editors and I have posed questions that probe important principles of hippocampal function. We hope that the resulting discussion will make clear to readers the progress that has been made, while also identifying issues where consensus has not yet been achieved and that should be pursued in future research. – John Lisman

An Eye-Movement Study of relational Memory in Adults with Autism Spectrum Disorder

Persons with Autism Spectrum Disorder (ASD) demonstrate good memory for single items but difficulties remembering contextual information related to these items. Recently, we found compromised explicit but intact implicit retrieval of object-location information in ASD (Ring et al. Autism Res 8(5):609–619, 2015). Eye-movement data collected from a sub-sample of the participants are the focus of the current paper. At encoding, trial-by-trial viewing durations predicted subsequent retrieval success only in typically developing (TD) participants. During retrieval, TD compared to ASD participants looked significantly longer at previously studied object-locations compared to alternative locations. These findings extend similar observations recently reported by Cooper et al. (Cognition 159:127–138, 2017a) and demonstrate that eye-movement data can shed important light on the source and nature of relational memory difficulties in ASD.

Flexible weighting of diverse inputs makes hippocampal function malleable

Classic theories of hippocampal function have emphasized its role as a dedicated memory system, but recent research has shown that it contributes broadly to many aspects of cognition, including attention and perception. We propose that the reason the hippocampus plays such a broad role in cognition is that its function is particularly malleable. We argue that this malleability arises because the hippocampus receives diverse anatomical inputs and these inputs are flexibly weighted based on behavioral goals. We discuss examples of how hippocampal representations can be flexibly weighted, focusing on hippocampal modulation by attention. Finally, we suggest some general neural mechanisms and core hippocampal computations that may enable the hippocampus to support diverse cognitive functions, including attention, perception, and memory. Together, this work suggests that great progress can and has been made in understanding the hippocampus by considering how the domain-general computations it performs allow it to dynamically contribute to many different behaviors.

Aging affects spatial reconstruction more than spatial pattern separation performance even after extended practice

Although the hippocampus experiences age-related anatomical and functional deterioration, the effects of aging vary across hippocampal-dependent cognitive processes. In particular, whether or not the hippocampus is known to be required for a spatial memory process is not an accurate predictor on its own of whether aging will affect performance. Therefore, the primary objective of this study was to compare the effects of healthy aging on a test of spatial pattern separation and a test of spatial relational processing, which are two aspects of spatial memory that uniquely emphasize the use of multiple hippocampal-dependent processes. Spatial pattern separation supports spatial memory by preserving unique representations for distinct locations. Spatial relational processing forms relational representations of objects to locations or between objects and other objects in space. To test our primary objective, 30 young (18-30 years; 21F) and 30 older participants (60-80 years; 21F) all completed a spatial pattern separation task and a task designed to require spatial relational processing through spatial reconstruction. To ensure aging effects were not due to inadequate time to develop optimal strategies or become comfortable with the testing devices, a subset of participants had extended practice across three sessions on each task. Results showed that older adults performed more poorly than young on the spatial reconstruction task that emphasized the use of spatial relational processing, and that age effects persisted even after controlling for pattern separation performance. Further, older adults performed more poorly on spatial reconstruction than young adults even after three testing sessions each separated by 7-10 days, suggesting effects of aging are resistant to extended practice and likely reflect genuine decline in hippocampal memory abilities.

Development of long-term event memory in preverbal infants: an eye-tracking study

The development of long-term event memory in preverbal infants remains elusive. To address this issue, we applied an eye-tracking method that successfully revealed in great apes that they have long-term memory of single events. Six-, 12-, 18- and 24-month-old infants watched a video story in which an aggressive ape-looking character came out from one of two identical doors. While viewing the same video again 24 hours later, 18- and 24-month-old infants anticipatorily looked at the door where the character would show up before it actually came out, but 6- and 12-month-old infants did not. Next, 12-, 18- and 24-month-old infants watched a different video story, in which a human grabbed one of two objects to hit back at the character. In their second viewing after a 24-hour delay, 18- and 24-month-old infants increased viewing time on the objects before the character grabbed one. In this viewing, 24-month-old infants preferentially looked at the object that the human had used, but 18-month-old infants did not show such preference. Our results show that infants at 18 months of age have developed long-term event memory, an ability to encode and retrieve a one-time event and this ability is elaborated thereafter.

Visual Sampling Predicts Hippocampal Activity

Eye movements serve to accumulate information from the visual world, contributing to the formation of coherent memory representations that support cognition and behavior. The hippocampus and the oculomotor network are well connected anatomically through an extensive set of polysynaptic pathways. However, the extent to which visual sampling behavior is related to functional responses in the hippocampus during encoding has not been studied directly in human neuroimaging. In the current study, participants engaged in a face processing task while brain responses were recorded with fMRI and eye movements were monitored simultaneously. The number of gaze fixations that a participant made on a given trial was correlated significantly with hippocampal activation such that more fixations were associated with stronger hippocampal activation. Similar results were also found in the fusiform face area, a face-selective perceptual processing region. Notably, the number of fixations was associated with stronger hippocampal activation when the presented faces were novel, but not when the faces were repeated. Increases in fixations during viewing of novel faces also led to larger repetition-related suppression in the hippocampus, indicating that this fixation-hippocampal relationship may reflect the ongoing development of lasting representations. Together, these results provide novel empirical support for the idea that visual exploration and hippocampal binding processes are inherently linked.

SIGNIFICANCE STATEMENT

The hippocampal and oculomotor networks have each been studied extensively for their roles in the binding of information and gaze function, respectively. Despite the evidence that individuals with amnesia whose damage includes the hippocampus show alterations in their eye movement patterns and recent findings that the two systems are anatomically connected, it has not been demonstrated whether visual exploration is related to hippocampal activity in neurologically intact adults. In this combined fMRI-eye-tracking study, we show how hippocampal responses scale with the number of gaze fixations made during viewing of novel, but not repeated, faces. These findings provide new evidence suggesting that the hippocampus plays an important role in the binding of information, as sampled by gaze fixations, during visual exploration.

Robust memory of where from way back when: evidence from behaviour and visual attention

Retention of events typically exhibits a sharp initial decrease followed by levelling off of forgetting. In an apparent exception to this general rule, college students have robust memory for their own locations in obscured versions of photographs of their entering classes taken during orientation-related activities, whether tested 2 months or 42 months after the event. Experiment 1 of the present research was a test for conceptual replication of this finding in photographs depicting more than twice the number of students (and thus potential distracters). There was no difference in memory accuracy for personal spatial location across retention intervals of 6-30 months. Experiment 2 featured 40-h and 2-month retention intervals, thereby providing a more fine-grained test of the forgetting function. The findings replicated Experiment 1. In Experiment 3, eye-tracking measures of visual attention revealed that participants rapidly fixated their own spatial locations within the photographs, even in the absence of explicit awareness. In all three experiments, memory for temporal features of the orientation activities (e.g., day and time the photograph was taken) followed the typical forgetting function. The findings suggest differential preservation of episodic memory for where relative to other aspects of events and experiences, such as when.

Hippocampal structure predicts cortical indices of reactivation of related items

One of the key components of relational memory is the ability to bind together the constituent elements of a memory experience, and this ability is thought to be supported by the hippocampus. Previously we had shown that these relational bindings can be used to reactivate the cortical processors of an absent item in the presence of a relationally bound associate (Walker et al., 2014). Specifically, we recorded the event-related optical signal (EROS) when presenting the scene of a face-scene pair during a preview period immediately preceding a test display, and demonstrated reactivation of a face-processing cortical area (the superior temporal sulcus, STS) for scenes that had been previously paired with faces, relative to scenes that had not. Here we combined the EROS measures during the same preview paradigm with anatomical estimates of hippocampal integrity (structural MRI measures of hippocampal volume and diffusion tensor imaging measures of mean fractional anisotropy and diffusivity) to provide evidence that the hippocampus is mediating this reactivation phenomenon. The study was run in a sample of older adults aged 55-87, taking advantage of the high amount of hippocampal variability present in aging. We replicated the functional reactivation of STS during the preview period, specific to scenes previously paired with faces. Crucially, we also found that this phenomenon is correlated with structural hippocampus integrity. Both STS reactivation and hippocampal structure predicted subsequent recognition performance. These data support the theory that relational memory is sustained by an interaction between hippocampal and cortical sensory processing regions, and that these functions may be at the basis of episodic memory changes in normal aging.

The Effect of Emotion and Reward Contingencies on Relational Memory in Major Depression: An Eye-Movement Study with Follow-Up

Background: Episodic memory disturbances were found to constitute a potential trait marker for major depression (MD). The recall of positive or rewarding information in a relational context is specifically impaired. Eye-movement recording constitutes a novel, direct approach to examine implicit memory performance. Here we aimed to assess the effect of emotional context and implicit virtual monetary reward or loss on viewing patterns in association with relational memory in a 6-months follow-up study in MD.

Materials and Methods: Twenty-eight patients with MD and 30 healthy participants were trained to associate a face (happy/sad/neutral) with a background scene. After each pair a virtual monetary reward or loss appeared briefly. During testing, scenes were presented as a cue and then overlaid with three previously studied faces. Participants were asked to recall the matching face if present (Match trials), with eye-movements and subsequent forced-choice recognition being recorded.

Results: Explicit recognition of the matching face was impaired in the MD group as compared to controls. In correlation with this, viewing of the matching face was significantly reduced in the MD group. We found a significant interaction of group (MD vs HC) with the relational memory condition (Match and Non-match), facial emotion and monetary reward and loss. MD patients attended longer to previously rewarded stimuli, but significantly less to sad faces in the Match condition. The relational memory impairment persisted at follow-up and correlated with symptom severity both at baseline and follow-up. Viewing patterns associated with previous virtual reward were associated with clinical symptoms at follow-up.

Conclusion: Our current results provide novel evidence for a specific relational memory impairment in MD as supported by abnormal eye-movement behavior and a deficit in explicit recognition. MD patients showed an attentional bias to rewarded stimuli and decreased viewing of sad faces when relational memory information was present.

An Anatomical Interface between Memory and Oculomotor Systems

Visual behavior is guided by memories from prior experience and knowledge of the visual scene. The hippocampal system (HC), in particular, has been implicated in the guidance of saccades: Amnesic patients, following damage to the HC, exhibit selective deficits in their gaze patterns. However, the neural circuitry by which mnemonic representations influence the oculomotor system remains unknown. We used a data-driven, network-based approach on directed anatomical connectivity from the macaque brain to reveal an extensive set of polysnaptic pathways spanning the extrastriate, posterior parietal and prefrontal cortices that potentially mediate the exchange of information between the memory and visuo-oculomotor systems. We additionally show how the potential for directed information flow from the hippocampus to oculomotor control areas is exceptionally high. In particular, the dorsolateral pFC and FEF—regions known to be responsible for the cognitive control of saccades—are topologically well positioned to receive information from the hippocampus. Together with neuropsychological evidence of altered gaze patterns following damage to the hippocampus, our findings suggest that a reconsideration of hippocampal involvement in oculomotor guidance is needed.

Semantic congruence affects hippocampal response to repetition of visual associations

Recent research has shown complementary engagement of the hippocampus and medial prefrontal cortex (mPFC) in encoding and retrieving associations based on pre-existing or experimentally-induced schemas, such that the latter supports schema-congruent information whereas the former is more engaged for incongruent or novel associations. Here, we attempted to explore some of the boundary conditions in the relative involvement of those structures in short-term memory for visual associations. The current literature is based primarily on intentional evaluation of schema-target congruence and on study-test paradigms with relatively long delays between learning and retrieval. We used a continuous recognition paradigm to investigate hippocampal and mPFC activation to first and second presentations of scene-object pairs as a function of semantic congruence between the elements (e.g., beach-seashell versus schoolyard-lamp). All items were identical at first and second presentation and the context scene, which was presented 500ms prior to the appearance of the target object, was incidental to the task which required a recognition response to the central target only. Very short lags 2-8 intervening stimuli occurred between presentations. Encoding the targets with congruent contexts was associated with increased activation in visual cortical regions at initial presentation and faster response time at repetition, but we did not find enhanced activation in mPFC relative to incongruent stimuli at either presentation. We did observe enhanced activation in the right anterior hippocampus, as well as regions in visual and lateral temporal and frontal cortical regions, for the repetition of incongruent scene-object pairs. This pattern demonstrates rapid and incidental effects of schema processing in hippocampal, but not mPFC, engagement during continuous recognition.

More to it than meets the eye: how eye movements can elucidate the development of episodic memory

The ability to recognise past events along with the contexts in which they occurred is a hallmark of episodic memory, a critical capacity. Eye movements have been shown to track veridical memory for the associations between events and their contexts (relational binding). Such eye-movement effects emerge several seconds before, or in the absence of, explicit response, and are linked to the integrity and function of the hippocampus. Drawing from research from infancy through late childhood, and by comparing to investigations from typical adults, patient populations, and animal models, it seems increasingly clear that eye movements reflect item-item, item-temporal, and item-spatial associations in developmental populations. We analyse this line of work, identify missing pieces in the literature and outline future avenues of research, in order to help elucidate the development of episodic memory.

Impaired acquisition of new words after left temporal lobectomy despite normal fast-mapping behavior

Word learning has been proposed to rely on unique brain regions including the temporal lobes, and the left temporal lobe appears to be especially important. In order to investigate the role of the left temporal lobe in word learning under different conditions, we tested whether patients with left temporal lobectomies (N=6) could learn novel words using two distinct formats. Previous research has shown that word learning in contrastive fast mapping conditions may rely on different neural substrates than explicit encoding conditions (Sharon et al., 2011). In the current investigation, we used a previously reported word learning task that implemented two distinct study formats (Warren and Duff, 2014): a contrastive fast mapping condition in which a picture of a novel item was displayed beside a picture of a familiar item while the novel item's name was presented aurally ("Click on the numbat."); and an explicit encoding (i.e., control) condition in which a picture of a novel item was displayed while its name was presented aurally ("This is a numbat."). After a delay, learning of the novel words was evaluated with memory tests including three-alternative forced-choice recognition, free recall, cued recall, and familiarity ratings. During the fast-mapping study condition both the left temporal lobectomy and healthy comparison groups performed well, but at test only the comparison group showed evidence of novel word learning. Our findings indicate that unilateral resection of the left temporal lobe including the hippocampus and temporal pole can severely impair word learning, and that fast-mapping study conditions do not promote subsequent word learning in temporal lobectomy populations.

Selective scanpath repetition during memory-guided visual search

Visual search efficiency improves with repetition of a search display, yet the mechanisms behind these processing gains remain unclear. According to Scanpath Theory, memory retrieval is mediated by repetition of the pattern of eye movements or "scanpath" elicited during stimulus encoding. Using this framework, we tested the prediction that scanpath recapitulation reflects relational memory guidance during repeated search events. Younger and older subjects were instructed to find changing targets within flickering naturalistic scenes. Search efficiency (search time, number of fixations, fixation duration) and scanpath similarity (repetition) were compared across age groups for novel (V1) and repeated (V2) search events. Younger adults outperformed older adults on all efficiency measures at both V1 and V2, while the search time benefit for repeated viewing (V1-V2) did not differ by age. Fixation-binned scanpath similarity analyses revealed repetition of initial and final (but not middle) V1 fixations at V2, with older adults repeating more initial V1 fixations than young adults. In young adults only, early scanpath similarity correlated negatively with search time at test, indicating increased efficiency, whereas the similarity of V2 fixations to middle V1 fixations predicted poor search performance. We conclude that scanpath compression mediates increased search efficiency by selectively recapitulating encoding fixations that provide goal-relevant input. Extending Scanpath Theory, results suggest that scanpath repetition varies as a function of time and memory integrity.

The role of nutrition on cognition and brain health in ageing: a targeted approach

Animal experiments and cross-sectional or prospective longitudinal research in human subjects suggest a role for nutrition in cognitive ageing. However, data from randomised controlled trials (RCT) that seek causal evidence for the impact of nutrients on cognitive ageing in humans often produce null results. Given that RCT test hypotheses in a rigorous fashion, one conclusion could be that the positive effects of nutrition on the aged brain observed in other study designs are spurious. On the other hand, it may be that the design of many clinical trials conducted thus far has been less than optimal. In the present review, we offer a blueprint for a more targeted approach to the design of RCT in nutrition, cognition and brain health in ageing that focuses on three key areas. First, the role of nutrition is more suited for the maintenance of health rather than the treatment of disease. Second, given that cognitive functions and brain regions vary in their susceptibility to ageing, those that especially deteriorate in senescence should be focal points in evaluating the efficacy of an intervention. Third, the outcome measures that assess change due to nutrition, especially in the cognitive domain, should not necessarily be the same neuropsychological tests used to assess gross brain damage or major pathological conditions. By addressing these three areas, we expect that clinical trials of nutrition, cognition and brain health in ageing will align more closely with other research in this field, and aid in revealing the true nature of nutrition's impact on the aged brain.

Competition and Cooperation among Relational Memory Representations

Mnemonic processing engages multiple systems that cooperate and compete to support task performance. Exploring these systems’ interaction requires memory tasks that produce rich data with multiple patterns of performance sensitive to different processing sub-components. Here we present a novel context-dependent relational memory paradigm designed to engage multiple learning and memory systems. In this task, participants learned unique face-room associations in two distinct contexts (i.e., different colored buildings). Faces occupied rooms as determined by an implicit gender-by-side rule structure (e.g., male faces on the left and female faces on the right) and all faces were seen in both contexts. In two experiments, we use behavioral and eye-tracking measures to investigate interactions among different memory representations in both younger and older adult populations; furthermore we link these representations to volumetric variations in hippocampus and ventromedial PFC among older adults. Overall, performance was very accurate. Successful face placement into a studied room systematically varied with hippocampal volume. Selecting the studied room in the wrong context was the most typical error. The proportion of these errors to correct responses positively correlated with ventromedial prefrontal volume. This novel task provides a powerful tool for investigating both the unique and interacting contributions of these systems in support of relational memory.

Eye Movements Index Implicit Memory Expression in Fear Conditioning

The role of contingency awareness in simple associative learning experiments with human participants is currently debated. Since prior work suggests that eye movements can index mnemonic processes that occur without awareness, we used eye tracking to better understand the role of awareness in learning aversive Pavlovian conditioning. A complex real-world scene containing four embedded household items was presented to participants while skin conductance, eye movements, and pupil size were recorded. One item embedded in the scene served as the conditional stimulus (CS). One exemplar of that item (e.g. a white pot) was paired with shock 100 percent of the time (CS+) while a second exemplar (e.g. a gray pot) was never paired with shock (CS-). The remaining items were paired with shock on half of the trials. Participants rated their expectation of receiving a shock during each trial, and these expectancy ratings were used to identify when (i.e. on what trial) each participant became aware of the programmed contingencies. Disproportionate viewing of the CS was found both before and after explicit contingency awareness, and patterns of viewing distinguished the CS+ from the CS-. These observations are consistent with "dual process" models of fear conditioning, as they indicate that learning can be expressed in patterns of viewing prior to explicit contingency awareness.

Relational Memory Is Evident in Eye Movement Behavior despite the Use of Subliminal Testing Methods

While it is generally agreed that perception can occur without awareness, there continues to be debate about the type of representational content that is accessible when awareness is minimized or eliminated. Most investigations that have addressed this issue evaluate access to well-learned representations. Far fewer studies have evaluated whether or not associations encountered just once prior to testing might also be accessed and influence behavior. Here, eye movements were used to examine whether or not memory for studied relationships is evident following the presentation of subliminal cues. Participants assigned to experimental or control groups studied scene-face pairs and test trials evaluated implicit and explicit memory for these pairs. Each test trial began with a subliminal scene cue, followed by three visible studied faces. For experimental group participants, one face was the studied associate of the scene (implicit test); for controls none were a match. Subsequently, the display containing a match was presented to both groups, but now it was preceded by a visible scene cue (explicit test). Eye movements were recorded and recognition memory responses were made. Participants in the experimental group looked disproportionately at matching faces on implicit test trials and participants from both groups looked disproportionately at matching faces on explicit test trials, even when that face had not been successfully identified as the associate. Critically, implicit memory-based viewing effects seemed not to depend on residual awareness of subliminal scene cues, as subjective and objective measures indicated that scenes were successfully masked from view. The reported outcomes indicate that memory for studied relationships can be expressed in eye movement behavior without awareness.

Multivariate fMRI and Eye Tracking Reveal Differential Effects of Visual Interference on Recognition Memory Judgments for Objects and Scenes

Recent work has demonstrated that the perirhinal cortex (PRC) supports conjunctive object representations that aid object recognition memory following visual object interference. It is unclear, however, how these representations interact with other brain regions implicated in mnemonic retrieval and how congruent and incongruent interference influences the processing of targets and foils during object recognition. To address this, multivariate partial least squares was applied to fMRI data acquired during an interference match-to-sample task, in which participants made object or scene recognition judgments after object or scene interference. This revealed a pattern of activity sensitive to object recognition following congruent (i.e., object) interference that included PRC, prefrontal, and parietal regions. Moreover, functional connectivity analysis revealed a common pattern of PRC connectivity across interference and recognition conditions. Examination of eye movements during the same task in a separate study revealed that participants gazed more at targets than foils during correct object recognition decisions, regardless of interference congruency. By contrast, participants viewed foils more than targets for incorrect object memory judgments, but only after congruent interference. Our findings suggest that congruent interference makes object foils appear familiar and that a network of regions, including PRC, is recruited to overcome the effects of interference.

Relating hippocampus to relational memory processing across domains and delays

The hippocampus has been implicated in a diverse set of cognitive domains and paradigms, including cognitive mapping, long-term memory, and relational memory, at long or short study-test intervals. Despite the diversity of these areas, their association with the hippocampus may rely on an underlying commonality of relational memory processing shared among them. Most studies assess hippocampal memory within just one of these domains, making it difficult to know whether these paradigms all assess a similar underlying cognitive construct tied to the hippocampus. Here we directly tested the commonality among disparate tasks linked to the hippocampus by using PCA on performance from a battery of 12 cognitive tasks that included two traditional, long-delay neuropsychological tests of memory and two laboratory tests of relational memory (one of spatial and one of visual object associations) that imposed only short delays between study and test. Also included were different tests of memory, executive function, and processing speed. Structural MRI scans from a subset of participants were used to quantify the volume of the hippocampus and other subcortical regions. Results revealed that the 12 tasks clustered into four components; critically, the two neuropsychological tasks of long-term verbal memory and the two laboratory tests of relational memory loaded onto one component. Moreover, bilateral hippocampal volume was strongly tied to performance on this component. Taken together, these data emphasize the important contribution the hippocampus makes to relational memory processing across a broad range of tasks that span multiple domains.

Building metamemorial knowledge over time: insights from eye tracking about the bases of feeling-of-knowing and confidence judgments

Metamemory processes depend on different factors across the learning and memory time-scale. In the laboratory, subjects are often asked to make prospective feeling-of-knowing (FOK) judgments about target retrievability, or are asked to make retrospective confidence judgments (RCJs) about the retrieved target. We examined distinct and shared contributors to metamemory judgments, and how they were built over time. Eye movements were monitored during a face-scene associative memory task. At test, participants viewed a studied scene, then rated their FOK that they would remember the associated face. This was followed by a forced choice recognition test and RCJs. FOK judgments were less accurate than RCJ judgments, showing that the addition of mnemonic experience can increase metacognitive accuracy over time. However, there was also evidence that the given FOK rating influenced RCJs. Turning to eye movements, initial analyses showed that higher cue fluency was related to both higher FOKs and higher RCJs. However, further analyses revealed that the effects of the scene cue on RCJs were mediated by FOKs. Turning to the target, increased viewing time and faster viewing of the correct associate related to higher FOKs, consistent with the idea that target accessibility is a basis of FOKs. In contrast, the amount of viewing directed to the chosen face, regardless of whether it was correct, predicted higher RCJs, suggesting that choice experience is a significant contributor RCJs. We also examined covariates of the change in RCJ rating from the FOK rating, and showed that increased and faster viewing of the chosen face predicted raising one's confidence above one's FOK. Taken together these results suggest that metamemory judgments should not be thought of only as distinct subjective experiences, but complex processes that interact and evolve as new psychological bases for subjective experience become available.

Accessing Real-Life Episodic Information from Minutes versus Hours Earlier Modulates Hippocampal and High-Order Cortical Dynamics

It is well known that formation of new episodic memories depends on hippocampus, but in real-life settings (e.g., conversation), hippocampal amnesics can utilize information from several minutes earlier. What neural systems outside hippocampus might support this minutes-long retention? In this study, subjects viewed an audiovisual movie continuously for 25 min; another group viewed the movie in 2 parts separated by a 1-day delay. Understanding Part 2 depended on retrieving information from Part 1, and thus hippocampus was required in the day-delay condition. But is hippocampus equally recruited to access the same information from minutes earlier? We show that accessing memories from a few minutes prior elicited less interaction between hippocampus and default mode network (DMN) cortical regions than accessing day-old memories of identical events, suggesting that recent information was available with less reliance on hippocampal retrieval. Moreover, the 2 groups evinced reliable but distinct DMN activity timecourses, reflecting differences in information carried in these regions when Part 1 was recent versus distant. The timecourses converged after 4 min, suggesting a time frame over which the continuous-viewing group may have relied less on hippocampal retrieval. We propose that cortical default mode regions can intrinsically retain real-life episodic information for several minutes.

III. The importance of physical activity and aerobic fitness for cognitive control and memory in children

In this chapter, we review literature that examines the association among physical activity, aerobic fitness, cognition, and the brain in elementary school children (ages 7-10 years). Specifically, physical activity and higher levels of aerobic fitness in children have been found to benefit brain structure, brain function, cognition, and school achievement. For example, higher fit children have larger brain volumes in the basal ganglia and hippocampus, which relate to superior performance on tasks of cognitive control and memory, respectively, when compared to their lower fit peers. Higher fit children also show superior brain function during tasks of cognitive control, better scores on tests of academic achievement, and higher performance on a real-world street crossing task, compared to lower fit and less active children. The cross-sectional findings are strengthened by a few randomized, controlled trials, which demonstrate that children randomly assigned to a physical activity intervention group show greater brain and cognitive benefits compared to a control group. Because these findings suggest that the developing brain is plastic and sensitive to lifestyle factors, we also discuss typical structural and functional brain maturation in children to provide context in which to interpret the effects of physical activity and aerobic fitness on the developing brain. This research is important because children are becoming increasingly sedentary, physically inactive, and unfit. An important goal of this review is to emphasize the importance of physical activity and aerobic fitness for the cognitive and brain health of today's youth.

Brain Imaging, Cognitive Processes, and Brain Networks

The recent, rapid expansion of the application of neuroimaging techniques to a broad variety of questions about the structure and function of mind and brain has led to much necessary and often critical introspection about what these techniques can actually tell us about cognitive processes. In this article, we attempt to place neuroimaging within the broader context of the cognitive neuroscience approach, which emphasizes the benefits of converging methodologies for understanding cognition and how it is supported by the functioning of the brain. Our arguments for what neuroimaging has to offer are supported by two specific examples from research on memory that, we believe, show how neuroimaging data have provided unique insights not only into brain organization, but also into the organization of the mind.

Navigating life

The discoveries of "place cells" in the hippocampus and "grid cells" in the entorhinal cortex are landmark achievements in relating behavior to neural activity, permitting analysis of a powerful system for spatial representation in the brain. The contributions of this work include not only the empirical findings but also the approach this work pioneered of examining neural activity in complex behaviors with real ecological validity in freely moving animals, and of attempting to place the findings in the larger context of how the neural representations of space are used in service of real-world behavior, namely what the Nobel committee described as permitting us to "navigate our way through a complex environment." These discoveries and approaches have had far-ranging impact on and implications for work in human cognitive neuroscience, where we see (1) confirmation in humans that the hippocampus and overlying MTL cortex are critically engaged in supporting a relational representation of space, and that it can be used for flexible spatial navigation and (2) evidence that these regions are also critically involved in aspects of relational memory not limited to space, and in the flexible use of hippocampal memory extending beyond spatial navigation. Recent work, using tasks that emphasize the requirement for the active use of memory in online processing, just as spatial navigation has long placed such a requirement on rodents, suggests that the hippocampus and related MTL cortex can support the navigating of environments even more complex than what is needed in spatial navigation. It allows us to use memory in guiding upcoming actions and choices to act optimally in and on the world, permitting us to navigate life in all its beautiful complexity.

Hierarchical process memory: memory as an integral component of information processing

Models of working memory (WM) commonly focus on how information is encoded into and retrieved from storage at specific moments. However, in the majority of real-life processes, past information is used continuously to process incoming information across multiple timescales. Considering single-unit, electrocorticography, and functional imaging data, we argue that (i) virtually all cortical circuits can accumulate information over time, and (ii) the timescales of accumulation vary hierarchically, from early sensory areas with short processing timescales (10s to 100s of milliseconds) to higher-order areas with long processing timescales (many seconds to minutes). In this hierarchical systems perspective, memory is not restricted to a few localized stores, but is intrinsic to information processing that unfolds throughout the brain on multiple timescales.

Eye movements provide an index of veridical memory for temporal order

The present research examined whether eye movements during retrieval capture the relation between an event and its temporal attributes. In two experiments (N=76), we found converging evidence that eye movements reflected the veridicality of memory for temporal order seconds before overt memory judgments, suggesting that these movements captured indirect access to temporal information. These eye movements did not entirely depend on the amount of contextual cueing available (Experiment 1) and reflected the unique ordinal position of an event in a sequence (Experiment 2). Based on our results, we conclude that eye movements reflected the absolute temporal order of past events.

The eye movement measure of memory and its relationship with explicit measures

This study examined whether the eye movement can be used to measure memory of past events and its relationship with the explicit measures. In Experiment 1, after studying a list of Chinese characters, the participants received a recognition memory test. For each trial the participants had to indicate, among one studied character and two nonstudied homonyms, which character they had studied. Participants' eye movements were monitored while they viewed the three-character test display. Both the time-course and response-locked measures showed that participants viewed the studied character longer than the nonstudied character regardless of their explicit response. Experiment 2 used a wagering task to assess participants' conscious awareness and found that wagering points predicted viewing time for the target better than the recognition accuracy did. These findings suggest that the effect of memory on viewing time occurs automatically and is weakly associated with subsequent conscious awareness of the studied event.

Central adiposity is negatively associated with hippocampal-dependent relational memory among overweight and obese children

OBJECTIVE

To assess associations between adiposity and hippocampal-dependent and hippocampal-independent memory forms among prepubertal children.

STUDY DESIGN

Prepubertal children (age 7-9 years; n = 126), classified as non-overweight (<85th percentile body mass index [BMI]-for-age [n = 73]) or overweight/obese (≥85th percentile BMI-for-age [n = 53]), completed relational (hippocampal-dependent) and item (hippocampal-independent) memory tasks. Performance was assessed with both direct (behavioral accuracy) and indirect (preferential disproportionate viewing [PDV]) measures. Adiposity (ie, percent whole-body fat mass, subcutaneous abdominal adipose tissue, visceral adipose tissue, and total abdominal adipose tissue) was assessed by dual-energy X-ray absorptiometry. Backward regression identified significant (P < .05) predictive models of memory performance. Covariates included age, sex, pubertal timing, socioeconomic status (SES), IQ, oxygen consumption, and BMI z-score.

RESULTS

Among overweight/obese children, total abdominal adipose tissue was a significant negative predictor of relational memory behavioral accuracy, and pubertal timing together with SES jointly predicted the PDV measure of relational memory. In contrast, among non-overweight children, male sex predicted item memory behavioral accuracy, and a model consisting of SES and BMI z-score jointly predicted the PDV measure of relational memory.

CONCLUSION

Regional, but not whole-body, fat deposition was selectively and negatively associated with hippocampal-dependent relational memory among overweight/obese prepubertal children.

A critical role of the human hippocampus in an electrophysiological measure of implicit memory

The hippocampus has traditionally been thought to be critical for conscious explicit memory but not necessary for unconscious implicit memory processing. In a recent study of a group of mild amnesia patients with evidence of MTL damage limited to the hippocampus, subjects were tested on a direct test of item recognition confidence while electroencephalogram (EEG) was acquired, and revealed intact measures of explicit memory from 400 to 600 ms (mid-frontal old-new effect, FN400). The current investigation re-analyzed this data to study event-related potentials (ERPs) of implicit memory, using a recently developed procedure that eliminated declarative memory differences. Prior ERP findings from this technique were first replicated in two independent matched control groups, which exhibited reliable implicit memory effects in posterior scalp regions from 400 to 600 ms, which were topographically dissociated from the explicit memory effects of familiarity. However, patients were found to be dramatically impaired in implicit memory effects relative to control subjects, as quantified by a reliable condition × group interaction. Several control analyses were conducted to consider alternative factors that could account for the results, including outliers, sample size, age, or contamination by explicit memory, and each of these factors was systematically ruled out. Results suggest that the hippocampus plays a fundamental role in aspects of memory processing that are beyond conscious awareness. The current findings therefore indicate that both memory systems of implicit and explicit memory may rely upon the same neural structures - but function in different physiological ways.

Accessing forgotten memory traces from long-term memory via visual movements

Because memory retrieval often requires overt responses, it is difficult to determine to what extend forgetting occurs as a problem in explicit accessing of long-term memory traces. In this study, we used eye-tracking measures in combination with a behavioral task that favored high forgetting rates to investigate the existence of memory traces from long-term memory in spite of failure in accessing them consciously. In two experiments, participants were encouraged to encode a large set of sound-picture-location associations. In a later test, sounds were presented and participants were instructed to visually scan, before a verbal memory report, for the correct location of the associated pictures in an empty screen. We found the reactivation of associated memories by sound cues at test biased oculomotor behavior towards locations congruent with memory representations, even when participants failed to consciously provide a memory report of it. These findings reveal the emergence of a memory-guided behavior that can be used to map internal representations of forgotten memories from long-term memory.

Aerobic Fitness Predicts Relational Memory but Not Item Memory Performance in Healthy Young Adults

Health factors such as an active lifestyle and aerobic fitness have long been linked to decreased risk of cardiovascular disease, stroke, and other adverse health outcomes. Only more recently have researchers begun to investigate the relationship between aerobic fitness and memory function. Based on recent findings in behavioral and cognitive neuroscience showing that the hippocampus might be especially sensitive to the effects of exercise and fitness, the current study assessed hippocampal-dependent relational memory and non-hippocampal-dependent item memory in young adults across a range of aerobic fitness levels. Aerobic fitness was assessed using a graded exercise test to measure oxygen consumption during maximal exercise (VO2max), and relational and item memory were assessed using behavioral and eye movement measures. Behavioral results indicated that aerobic fitness was positively correlated with relational memory performance but not item memory performance, suggesting that the beneficial effects of aerobic fitness selectively affect hippocampal function and not that of the surrounding medial temporal lobe cortex. Eye movement results further supported the specificity of this fitness effect to hippocampal function, in that aerobic fitness predicted disproportionate preferential viewing of previously studied relational associations but not of previously viewed items. Potential mechanisms underlying this pattern of results, including neurogenesis, are discussed.

Recollection can support hybrid visual memory search

On a daily basis, we accomplish the task of searching our visual environment for one of a number of possible objects, like searching for any one of our friends in a crowd, and we do this with ease. Understanding how attention, perception, and long-term memory interact to accomplish this process remains an important question. Recent research (Wolfe in Psychological Science 23:698-703, 2012) has shown that increasing the number of possible targets one is searching for adds little cost to the efficiency of visual search-specifically, that response times increase logarithmically with memory set size. It is unclear, however, what type of recognition memory process (familiarity or recollection) supports a hybrid visual memory search. Previous hybrid search paradigms create conditions that allow participants to rely on the familiarity of perceptually identical targets. In two experiments, we show that hybrid search remains efficient even when the familiarity of targets is minimized (Experiment 1) and when participants are encouraged to flexibly retrieve target information that is perceptually distinct from the information previously studied (Experiment 2). We propose that such efficient and flexible performance on a hybrid search task may engage a rapid from of recollection (Moscovitch in Canadian Journal of Experimental Psychology 62:62-79, 2008). We discuss possible neural correlates supporting simultaneous perception, comparison of incoming information, and recollection of episodic memories.