The eyes have it: hippocampal activity predicts expression of memory in eye movements

The eye movement measure of memory and its relationship with explicit measures

This study examined whether the eye movement can be used to measure memory of past events and its relationship with the explicit measures. In Experiment 1, after studying a list of Chinese characters, the participants received a recognition memory test. For each trial the participants had to indicate, among one studied character and two nonstudied homonyms, which character they had studied. Participants' eye movements were monitored while they viewed the three-character test display. Both the time-course and response-locked measures showed that participants viewed the studied character longer than the nonstudied character regardless of their explicit response. Experiment 2 used a wagering task to assess participants' conscious awareness and found that wagering points predicted viewing time for the target better than the recognition accuracy did. These findings suggest that the effect of memory on viewing time occurs automatically and is weakly associated with subsequent conscious awareness of the studied event.

A critical role of the human hippocampus in an electrophysiological measure of implicit memory

The hippocampus has traditionally been thought to be critical for conscious explicit memory but not necessary for unconscious implicit memory processing. In a recent study of a group of mild amnesia patients with evidence of MTL damage limited to the hippocampus, subjects were tested on a direct test of item recognition confidence while electroencephalogram (EEG) was acquired, and revealed intact measures of explicit memory from 400 to 600 ms (mid-frontal old-new effect, FN400). The current investigation re-analyzed this data to study event-related potentials (ERPs) of implicit memory, using a recently developed procedure that eliminated declarative memory differences. Prior ERP findings from this technique were first replicated in two independent matched control groups, which exhibited reliable implicit memory effects in posterior scalp regions from 400 to 600 ms, which were topographically dissociated from the explicit memory effects of familiarity. However, patients were found to be dramatically impaired in implicit memory effects relative to control subjects, as quantified by a reliable condition × group interaction. Several control analyses were conducted to consider alternative factors that could account for the results, including outliers, sample size, age, or contamination by explicit memory, and each of these factors was systematically ruled out. Results suggest that the hippocampus plays a fundamental role in aspects of memory processing that are beyond conscious awareness. The current findings therefore indicate that both memory systems of implicit and explicit memory may rely upon the same neural structures - but function in different physiological ways.

Can we reconcile the declarative memory and spatial navigation views on hippocampal function?

Some argue that hippocampus supports declarative memory, our capacity to recall facts and events, whereas others view the hippocampus as part of a system dedicated to calculating routes through space, and these two contrasting views are pursued largely independently in current research. Here we offer a perspective on where these views can and cannot be reconciled and update a bridging framework that will improve our understanding of hippocampal function.

Accessing forgotten memory traces from long-term memory via visual movements

Because memory retrieval often requires overt responses, it is difficult to determine to what extend forgetting occurs as a problem in explicit accessing of long-term memory traces. In this study, we used eye-tracking measures in combination with a behavioral task that favored high forgetting rates to investigate the existence of memory traces from long-term memory in spite of failure in accessing them consciously. In two experiments, participants were encouraged to encode a large set of sound-picture-location associations. In a later test, sounds were presented and participants were instructed to visually scan, before a verbal memory report, for the correct location of the associated pictures in an empty screen. We found the reactivation of associated memories by sound cues at test biased oculomotor behavior towards locations congruent with memory representations, even when participants failed to consciously provide a memory report of it. These findings reveal the emergence of a memory-guided behavior that can be used to map internal representations of forgotten memories from long-term memory.

Recollection can support hybrid visual memory search

On a daily basis, we accomplish the task of searching our visual environment for one of a number of possible objects, like searching for any one of our friends in a crowd, and we do this with ease. Understanding how attention, perception, and long-term memory interact to accomplish this process remains an important question. Recent research (Wolfe in Psychological Science 23:698-703, 2012) has shown that increasing the number of possible targets one is searching for adds little cost to the efficiency of visual search-specifically, that response times increase logarithmically with memory set size. It is unclear, however, what type of recognition memory process (familiarity or recollection) supports a hybrid visual memory search. Previous hybrid search paradigms create conditions that allow participants to rely on the familiarity of perceptually identical targets. In two experiments, we show that hybrid search remains efficient even when the familiarity of targets is minimized (Experiment 1) and when participants are encouraged to flexibly retrieve target information that is perceptually distinct from the information previously studied (Experiment 2). We propose that such efficient and flexible performance on a hybrid search task may engage a rapid from of recollection (Moscovitch in Canadian Journal of Experimental Psychology 62:62-79, 2008). We discuss possible neural correlates supporting simultaneous perception, comparison of incoming information, and recollection of episodic memories.

Preschoolers with Down syndrome do not yet show the learning and memory impairments seen in adults with Down syndrome

Individuals with Down syndrome (DS) exhibit a behavioral phenotype of specific strengths and weaknesses, in addition to a generalized cognitive delay. In particular, adults with DS exhibit specific deficits in learning and memory processes that depend on the hippocampus, and there is some suggestion of impairments on executive function tasks that depend on the prefrontal cortex. While these functions have been investigated in adults with DS, it is largely unclear how these processes develop in young children with DS. Here we tested preschoolers with DS and typically developing children, age-matched on either receptive language or non-verbal scores as a proxy for mental age (MA), on a battery of eye-tracking and behavioral measures that have been shown to depend on the hippocampus or the prefrontal cortex. Preschoolers with DS performed equivalently to MA-matched controls, suggesting that the disability-specific memory deficits documented in adults with DS, in addition to a cognitive delay, are not yet evident in preschoolers with DS, and likely emerge progressively with age. Our results reinforce the idea that early childhood may be a critical time frame for targeted early intervention. A video abstract of this article can be viewed at https://www.youtube.com/watch?v=r6GUA6my22Q&list=UU3FIcom6UpITHZOIEa8Onnw.

Cognitive impairments in psychotic disorders: common mechanisms and measurement

Decades of research have provided robust evidence of cognitive impairments in psychotic disorders. Individuals with schizophrenia appear to be impaired on the majority of neuropsychological tasks, leading some researchers to argue for a "generalized deficit", in which the multitude of cognitive impairments are the result of a common neurobiological source. One such common mechanism may be an inability to actively represent goal information in working memory as a means to guide behavior, with the associated neurobiological impairment being a disturbance in the function of the dorsolateral prefrontal cortex. Here, we provide a discussion of the evidence for such impairment in schizophrenia, and how it manifests in domains typically referred to as cognitive control, working memory and episodic memory. We also briefly discuss cognitive impairment in affective psychoses, reporting that the degree of impairment is worse in schizophrenia than in bipolar disorder and psychotic major depression, but the profile of impairment is similar, possibly reflecting common mechanisms at the neural level. Given the recent release of the DSM-5, we end with a brief discussion on assessing cognition in the context of diagnosis and treatment planning in psychotic disorders.

Assessing rodent hippocampal involvement in the novel object recognition task. A review

The novel object recognition (NOR) task has emerged as a popular method for testing the neurobiology of nonspatial memory in rodents. This task exploits the natural tendency of rodents to explore novel items and depending on the amount of time that rodents spend exploring the presented objects, inferences about memory can be established. Despite its wide use, the underlying neural circuitry and mechanisms supporting NOR have not been clearly defined. In particular, considerable debate has focused on whether the hippocampus plays a significant role in the object memory that is encoded, consolidated and then retrieved during discrete stages of the NOR task. Here we analyzed the results of all published reports in which the role of the rodent hippocampus in object memory was inferred from performance in the task with restricted parameters. We note that the remarkable variability in NOR methods across studies complicates the ability to draw meaningful conclusions from the work. Focusing on 12 reports in which a minimum criterion of sample session object exploration was imposed, we find that temporary or permanent lesion of the hippocampus consistently disrupts object memory when a delay of 10 min or greater is imposed between the sample and test sessions. We discuss the significance of a delay-dependent role of the hippocampus in NOR within the framework of the medial temporal lobe. We assert that standardization of the NOR protocol is essential for obtaining reliable data that can then be compared across studies to build consensus as to the specific contribution of the rodent hippocampus to object memory.

Mechanisms for widespread hippocampal involvement in cognition

The quintessential memory system in the human brain--the hippocampus and surrounding medial temporal lobe--is often treated as a module for the formation of conscious, or declarative, memories. However, growing evidence suggests that the hippocampus plays a broader role in memory and cognition and that theories organizing memory into strictly dedicated systems may need to be updated. We first consider the historical evidence for the specialized role of the hippocampus in declarative memory. Then, we describe the serendipitous encounter that motivated the special section in this issue, based on parallel research from our labs that suggested a more pervasive contribution of the hippocampus to cognition beyond declarative memory. Finally, we develop a theoretical framework that describes 2 general mechanisms for how the hippocampus interacts with other brain systems and cognitive processes: the memory modulation hypothesis, in which mnemonic representations in the hippocampus modulate the operation of other systems, and the adaptive function hypothesis, in which specialized computations in the hippocampus are recruited as a component of both mnemonic and nonmnemonic functions. This framework is consistent with an emerging view that the most fertile ground for discovery in cognitive psychology and neuroscience lies at the interface between parts of the mind and brain that have traditionally been studied in isolation.

Brain mechanisms of successful recognition through retrieval of semantic context

Episodic memory is associated with the encoding and retrieval of context information and with a subjective sense of reexperiencing past events. The neural correlates of episodic retrieval have been extensively studied using fMRI, leading to the identification of a "general recollection network" including medial temporal, parietal, and prefrontal regions. However, in these studies, it is difficult to disentangle the effects of context retrieval from recollection. In this study, we used fMRI to determine the extent to which the recruitment of regions in the recollection network is contingent on context reinstatement. Participants were scanned during a cued recognition test for target words from encoded sentences. Studied target words were preceded by either a cue word studied in the same sentence (thus congruent with encoding context) or a cue word studied in a different sentence (thus incongruent with encoding context). Converging fMRI results from independently defined ROIs and whole-brain analysis showed regional specificity in the recollection network. Activity in hippocampus and parahippocampal cortex was specifically increased during successful retrieval following congruent context cues, whereas parietal and prefrontal components of the general recollection network were associated with confident retrieval irrespective of contextual congruency. Our findings implicate medial temporal regions in the retrieval of semantic context, contributing to, but dissociable from, recollective experience.

Neurocognitive mechanisms of statistical-sequential learning: what do event-related potentials tell us?

Statistical-sequential learning (SL) is the ability to process patterns of environmental stimuli, such as spoken language, music, or one's motor actions, that unfold in time. The underlying neurocognitive mechanisms of SL and the associated cognitive representations are still not well understood as reflected by the heterogeneity of the reviewed cognitive models. The purpose of this review is: (1) to provide a general overview of the primary models and theories of SL, (2) to describe the empirical research - with a focus on the event-related potential (ERP) literature - in support of these models while also highlighting the current limitations of this research, and (3) to present a set of new lines of ERP research to overcome these limitations. The review is articulated around three descriptive dimensions in relation to SL: the level of abstractness of the representations learned through SL, the effect of the level of attention and consciousness on SL, and the developmental trajectory of SL across the life-span. We conclude with a new tentative model that takes into account these three dimensions and also point to several promising new lines of SL research.

Hippocampal activity patterns carry information about objects in temporal context

The hippocampus is critical for human episodic memory, but its role remains controversial. One fundamental question concerns whether the hippocampus represents specific objects or assigns context-dependent representations to objects. Here, we used multivoxel pattern similarity analysis of fMRI data during retrieval of learned object sequences to systematically investigate hippocampal coding of object and temporal context information. Hippocampal activity patterns carried information about the temporal positions of objects in learned sequences, but not about objects or temporal positions in random sequences. Hippocampal activity patterns differentiated between overlapping object sequences and between temporally adjacent objects that belonged to distinct sequence contexts. Parahippocampal and perirhinal cortex showed different pattern information profiles consistent with coding of temporal position and object information, respectively. These findings are consistent with models proposing that the hippocampus represents objects within specific temporal contexts, a capability that might explain its critical role in episodic memory.

Identifying and characterizing the effects of nutrition on hippocampal memory

In this review we provide evidence linking relational memory to the hippocampus, as well as examples of sensitive relational memory tasks that may help characterize the subtle effects of nutrition on learning and memory. Research into dietary effects on cognition is in its nascent stages, and many studies have cast a wide net with respect to areas of cognition to investigate. However, it may be that nutrition will have a disproportionate effect on particular cognitive domains. Thus, researchers interested in nutrition-cognition interactions may wish to apply a more targeted approach when selecting cognitive domains. We suggest that hippocampus-based relational memory may be extraordinarily sensitive to the effects of nutrition. The hippocampus shows unique plastic capabilities, making its structure and function responsive to an array of lifestyle factors and environmental conditions, including dietary intake. A major function of the hippocampus is relational memory, defined as learning and memory for the constituent elements and facts that comprise events. Here we identify several sensitive tests of relational memory that may be used to examine what may be subtle effects of nutrition on hippocampus and memory. We then turn to the literature on aerobic exercise and cognition to provide examples of translational research programs that have successfully applied this targeted approach centering on the hippocampus and sensitive relational memory tools. Finally, we discuss selected findings from animal and human research on nutrition and the hippocampus and advocate for the role of relational memory tasks in future research.

Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal-prefrontal interactions for adaptive behavior

Effective choices generally require memory, yet little is known regarding the cognitive or neural mechanisms that allow memory to influence choices. We outline a new framework proposing that covert memory processing of hippocampus interacts with action-generation processing of prefrontal cortex in order to arrive at optimal, memory-guided choices. Covert, rapid action-memory simulation (CRAMS) is proposed here as a framework for understanding cognitive and/or behavioral choices, whereby prefrontal-hippocampal interactions quickly provide multiple simulations of potential outcomes used to evaluate the set of possible choices. We hypothesize that this CRAMS process is automatic, obligatory, and covert, meaning that many cycles of action-memory simulation occur in response to choice conflict without an individual's necessary intention and generally without awareness of the simulations, leading to adaptive behavior with little perceived effort. CRAMS is thus distinct from influential proposals that adaptive memory-based behavior in humans requires consciously experienced memory-based construction of possible future scenarios and deliberate decisions among possible future constructions. CRAMS provides an account of why hippocampus has been shown to make critical contributions to the short-term control of behavior, and it motivates several new experimental approaches and hypotheses that could be used to better understand the ubiquitous role of prefrontal-hippocampal interactions in situations that require adaptively using memory to guide choices. Importantly, this framework provides a perspective that allows for testing decision-making mechanisms in a manner that translates well across human and nonhuman animal model systems.

Respiration phase-locks to fast stimulus presentations: implications for the interpretation of posterior midline "deactivations"

The posterior midline region (PMR)-considered a core of the default mode network-is deactivated during successful performance in different cognitive tasks. The extent of PMR-deactivations is correlated with task-demands and associated with successful performance in various cognitive domains. In the domain of episodic memory, functional MRI (fMRI) studies found that PMR-deactivations reliably predict learning (successful encoding). Yet it is unclear what explains this relation. One intriguing possibility is that PMR-deactivations are partially mediated by respiratory artifacts. There is evidence that the fMRI signal in PMR is particularly prone to respiratory artifacts, because of its large surrounding blood vessels. As respiratory fluctuations have been shown to track changes in attention, it is critical for the general interpretation of fMRI results to clarify the relation between respiratory fluctuations, cognitive performance, and fMRI signal. Here, we investigated this issue by measuring respiration during word encoding, together with a breath-holding condition during fMRI-scanning. Stimulus-locked respiratory analyses showed that respiratory fluctuations predicted successful encoding via a respiratory phase-locking mechanism. At the same time, the fMRI analyses showed that PMR-deactivations associated with learning were reduced during breath-holding and correlated with individual differences in the respiratory phase-locking effect during normal breathing. A left frontal region--used as a control region--did not show these effects. These findings indicate that respiration is a critical factor in explaining the link between PMR-deactivation and successful cognitive performance. Further research is necessary to demonstrate whether our findings are restricted to episodic memory encoding, or also extend to other cognitive domains.

Hippocampal binding of novel information with dominant memory traces can support both memory stability and change

Memory stability and change are considered opposite outcomes. We tested the counterintuitive notion that both depend on one process: hippocampal binding of memory features to associatively novel information, or associative novelty binding (ANB). Building on the idea that dominant memory features, or "traces," are most susceptible to modification, we hypothesized that ANB would selectively involve dominant traces. Therefore, memory stability versus change should depend on whether the currently dominant trace is old versus updated; in either case, novel information will be bound with it, causing either maintenance (when old) or change (when updated). People in our experiment studied objects at locations within scenes (contexts). During reactivation in a new context, subjects moved studied objects to new locations either via active location recall or by passively dragging objects to predetermined locations. After active reactivation, the new object location became dominant in memory, whereas after passive reactivation, the old object location maintained dominance. In both cases, hippocampal ANB bound the currently dominant object-location memory with a context with which it was not paired previously (i.e., associatively novel). Stability occurred in the passive condition when ANB united the dominant original location trace with an associatively novel newer context. Change occurred in the active condition when ANB united the dominant updated object location with an associatively novel and older context. Hippocampal ANB of the currently dominant trace with associatively novel contextual information thus provides a single mechanism to support memory stability and change, with shifts in trace dominance during reactivation dictating the outcome.

Suppressing unwanted memories reduces their unconscious influence via targeted cortical inhibition

Suppressing retrieval of unwanted memories reduces their later conscious recall. It is widely believed, however, that suppressed memories can continue to exert strong unconscious effects that may compromise mental health. Here we show that excluding memories from awareness not only modulates medial temporal lobe regions involved in explicit retention, but also neocortical areas underlying unconscious expressions of memory. Using repetition priming in visual perception as a model task, we found that excluding memories of visual objects from consciousness reduced their later indirect influence on perception, literally making the content of suppressed memories harder for participants to see. Critically, effective connectivity and pattern similarity analysis revealed that suppression mechanisms mediated by the right middle frontal gyrus reduced activity in neocortical areas involved in perceiving objects and targeted the neural populations most activated by reminders. The degree of inhibitory modulation of the visual cortex while people were suppressing visual memories predicted, in a later perception test, the disruption in the neural markers of sensory memory. These findings suggest a neurobiological model of how motivated forgetting affects the unconscious expression of memory that may be generalized to other types of memory content. More generally, they suggest that the century-old assumption that suppression leaves unconscious memories intact should be reconsidered.

Memory-related eye movements challenge behavioral measures of pattern completion and pattern separation

The hippocampus creates distinct episodes from highly similar events through a process called pattern separation and can retrieve memories from partial or degraded cues through a process called pattern completion. These processes have been studied in humans using tasks where participants must distinguish studied items from perceptually similar lure items. False alarms to lures (incorrectly reporting a perceptually similar item as previously studied) are thought to reflect pattern completion, a retrieval-based process. However, false alarms to lures could also result from insufficient encoding of studied items, leading to impoverished memory of item details and a failure to correctly reject lures. The current study investigated the source of lure false alarms by comparing eye movements during the initial presentation of items to eye movements made during the later presentation of item repetitions and similar lures in order to assess mnemonic processing at encoding and retrieval, respectively. Relative to other response types, lure false alarms were associated with fewer fixations to the initially studied items, suggesting that false alarms result from impoverished encoding. Additionally, lure correct rejections and lure false alarms garnered more fixations than hits, denoting additional retrieval-related processing. The results suggest that measures of pattern separation and completion in behavioral paradigms are not process-pure.

A nonparametric method for detecting fixations and saccades using cluster analysis: removing the need for arbitrary thresholds

BACKGROUND

Eye tracking is an important component of many human and non-human primate behavioral experiments. As behavioral paradigms have become more complex, including unconstrained viewing of natural images, eye movements measured in these paradigms have become more variable and complex as well. Accordingly, the common practice of using acceleration, dispersion, or velocity thresholds to segment viewing behavior into periods of fixations and saccades may be insufficient.

NEW METHOD

Here we propose a novel algorithm, called Cluster Fix, which uses k-means cluster analysis to take advantage of the qualitative differences between fixations and saccades. The algorithm finds natural divisions in 4 state space parameters-distance, velocity, acceleration, and angular velocity-to separate scan paths into periods of fixations and saccades. The number and size of clusters adjusts to the variability of individual scan paths.

RESULTS

Cluster Fix can detect small saccades that were often indistinguishable from noisy fixations. Local analysis of fixations helped determine the transition times between fixations and saccades.

COMPARISON WITH EXISTING METHODS

Because Cluster Fix detects natural divisions in the data, predefined thresholds are not needed.

CONCLUSIONS

A major advantage of Cluster Fix is the ability to precisely identify the beginning and end of saccades, which is essential for studying neural activity that is modulated by or time-locked to saccades. Our data suggest that Cluster Fix is more sensitive than threshold-based algorithms but comes at the cost of an increase in computational time.

When memory leads the brain to take scenes at face value: face areas are reactivated at test by scenes that were paired with faces at study

In the first use of the event-related optical signal as a brain imaging tool for the study of long-term memory, we examined relational or associative aspects of memory, widely presumed to involve the interplay among multiple brain regions in representing and reactivating different elements of a given event. Here, we found that a brain region known to be involved in face processing (the posterior superior temporal sulcus) was active not only when viewing faces during the study phase but also when viewing scenes at test that, through prior learning, were associated with specific faces. These findings, demonstrating the activation of stimulus-specific cortical regions in the absence of stimuli of that type, based on learned relations, reveal cortical substrates of the reactivation of relational memories.

Detecting analogies unconsciously

Analogies may arise from the conscious detection of similarities between a present and a past situation. In this functional magnetic resonance imaging study, we tested whether young volunteers would detect analogies unconsciously between a current supraliminal (visible) and a past subliminal (invisible) situation. The subliminal encoding of the past situation precludes awareness of analogy detection in the current situation. First, participants encoded subliminal pairs of unrelated words in either one or nine encoding trials. Later, they judged the semantic fit of supraliminally presented new words that either retained a previously encoded semantic relation (“analog”) or not (“broken analog”). Words in analogs versus broken analogs were judged closer semantically, which indicates unconscious analogy detection. Hippocampal activity associated with subliminal encoding correlated with the behavioral measure of unconscious analogy detection. Analogs versus broken analogs were processed with reduced prefrontal but enhanced medial temporal activity. We conclude that analogous episodes can be detected even unconsciously drawing on the episodic memory network.

Using eye movement analysis to study auditory effects on visual memory recall

Recent studies in affective computing are focused on sensing human cognitive context using biosignals. In this study, electrooculography (EOG) was utilized to investigate memory recall accessibility via eye movement patterns. 12 subjects were participated in our experiment wherein pictures from four categories were presented. Each category contained nine pictures of which three were presented twice and the rest were presented once only. Each picture presentation took five seconds with an adjoining three seconds interval. Similarly, this task was performed with new pictures together with related sounds. The task was free viewing and participants were not informed about the task's purpose. Using pattern recognition techniques, participants' EOG signals in response to repeated and non-repeated pictures were classified for with and without sound stages. The method was validated with eight different participants. Recognition rate in "with sound" stage was significantly reduced as compared with "without sound" stage. The result demonstrated that the familiarity of visual-auditory stimuli can be detected from EOG signals and the auditory input potentially improves the visual recall process.

Saccades curve away from previously inhibited locations: evidence for the role of priming in oculomotor competition

The oculomotor system serves as the basis for representing concurrently competing motor programs. Here, we examine whether the oculomotor system also keeps track of the outcome of competition between target and distractor on the previous trial. Participants had to perform a simple task of making a saccade toward a predefined direction. On two-thirds of the trials, an irrelevant distractor was presented to either the left or right of the fixation. On one-third of the trials, no distractor was present. The results show that on trials without a distractor, saccades curved away from the empty location that was occupied by a distractor on the previous trial. This result was replicated and extended to cases when different saccade directions were used. In addition, we show that repetition of distractor location on the distractor-present trials results in a stronger curvature away and in a shorter saccade latency to the target. Taken together, these results provide strong evidence that the oculomotor system automatically codes and retains locations that had been ignored in the past to bias future behavior.

Spatial reconstruction by patients with hippocampal damage is dominated by relational memory errors

Hippocampal damage causes profound yet circumscribed memory impairment across diverse stimulus types and testing formats. Here, within a single test format involving a single class of stimuli, we identified different performance errors to better characterize the specifics of the underlying deficit. The task involved study and reconstruction of object arrays across brief retention intervals. The most striking feature of patients' with hippocampal damage performance was that they tended to reverse the relative positions of item pairs within arrays of any size, effectively "swapping" pairs of objects. These "swap errors" were the primary error type in amnesia, almost never occurred in healthy comparison participants, and actually contributed to poor performance on more traditional metrics (such as distance between studied and reconstructed location). Patients made swap errors even in trials involving only a single pair of objects. The selectivity and severity of this particular deficit creates serious challenges for theories of memory and hippocampus.

About sleep's role in memory

Over more than a century of research has established the fact that sleep benefits the retention of memory. In this review we aim to comprehensively cover the field of "sleep and memory" research by providing a historical perspective on concepts and a discussion of more recent key findings. Whereas initial theories posed a passive role for sleep enhancing memories by protecting them from interfering stimuli, current theories highlight an active role for sleep in which memories undergo a process of system consolidation during sleep. Whereas older research concentrated on the role of rapid-eye-movement (REM) sleep, recent work has revealed the importance of slow-wave sleep (SWS) for memory consolidation and also enlightened some of the underlying electrophysiological, neurochemical, and genetic mechanisms, as well as developmental aspects in these processes. Specifically, newer findings characterize sleep as a brain state optimizing memory consolidation, in opposition to the waking brain being optimized for encoding of memories. Consolidation originates from reactivation of recently encoded neuronal memory representations, which occur during SWS and transform respective representations for integration into long-term memory. Ensuing REM sleep may stabilize transformed memories. While elaborated with respect to hippocampus-dependent memories, the concept of an active redistribution of memory representations from networks serving as temporary store into long-term stores might hold also for non-hippocampus-dependent memory, and even for nonneuronal, i.e., immunological memories, giving rise to the idea that the offline consolidation of memory during sleep represents a principle of long-term memory formation established in quite different physiological systems.

Cardiorespiratory fitness and motor skills in relation to cognition and academic performance in children - a review

Different elements of physical fitness in children have shown a declining trend during the past few decades. Cardiorespiratory fitness and motor skills have been associated with cognition, but the magnitude of this association remains unknown. The purpose of this review is to provide an overview of the relationship of cardiorespiratory fitness and motor skills with cognitive functions and academic performance in children up to 13 years of age. Cross-sectional studies suggest that children with higher cardiorespiratory fitness have more efficient cognitive processing at the neuroelectric level, as well as larger hippocampal and basal ganglia volumes, compared to children with lower cardiorespiratory fitness. Higher cardiorespiratory fitness has been associated with better inhibitory control in tasks requiring rigorous attention allocation. Better motor skills have been related to more efficient cognitive functions including inhibitory control and working memory. Higher cardiorespiratory fitness and better motor skills have also been associated with better academic performance. Furthermore, none of the studies on cardiorespiratory fitness have revealed independent associations with cognitive functions by controlling for motor skills. Studies concerning the relationship between motor skills and cognitive functions also did not consider cardiorespiratory fitness in the analyses. The results of this review suggest that high levels of cardiorespiratory fitness and motor skills may be beneficial for cognitive development and academic performance but the evidence relies mainly on cross-sectional studies.

Empathy in hippocampal amnesia

Empathy is critical to the quality of our relationships with others and plays an important role in life satisfaction and well-being. The scientific investigation of empathy has focused on characterizing its cognitive and neural substrates, and has pointed to the importance of a network of brain regions involved in emotional experience and perspective taking (e.g., ventromedial prefrontal cortex, amygdala, anterior insula, cingulate). While the hippocampus has rarely been the focus of empathy research, the hallmark properties of the hippocampal declarative memory system (e.g., representational flexibility, relational binding, on-line processing capacity) make it well-suited to meet some of the crucial demands of empathy, and a careful investigation of this possibility could make a significant contribution to the neuroscientific understanding of empathy. The present study is a preliminary investigation of the role of the hippocampal declarative memory system in empathy. Participants were three patients (1 female) with focal, bilateral hippocampal (HC) damage and severe declarative memory impairments and three healthy demographically matched comparison participants. Empathy was measured as a trait through a battery of gold standard questionnaires and through on-line ratings and prosocial behavior in response to a series of empathy inductions. Patients with hippocampal amnesia reported lower cognitive and emotional trait empathy than healthy comparison participants. Unlike healthy comparison participants, in response to the empathy inductions hippocampal patients reported no increase in empathy ratings or prosocial behavior. The results provide preliminary evidence for a role for hippocampal declarative memory in empathy.

Generalization of value in reinforcement learning by humans

Research in decision-making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well described by reinforcement learning theories. However, basic reinforcement learning is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision-making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used functional magnetic resonance imaging and computational model-based analyses to examine the joint contributions of these mechanisms to reinforcement learning. Humans performed a reinforcement learning task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about option values based on experience with the other options and to generalize across them. We observed blood oxygen level-dependent (BOLD) activity related to learning in the striatum and also in the hippocampus. By comparing a basic reinforcement learning model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of reinforcement learning and striatal BOLD, both choices and striatal BOLD activity were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants' choice. Our results thus point toward an interactive model in which striatal reinforcement learning systems may employ relational representations typically associated with the hippocampus.

Memory Systems, Processing Modes, and Components: Functional Neuroimaging Evidence

In the 1980s and 1990s, there was a major theoretical debate in the memory domain regarding the multiple memory systems and processing modes frameworks. The components of processing framework argued for a middle ground: Instead of neatly divided memory systems or processing modes, this framework proposed the existence of numerous processing components that are recruited in different combinations by memory tasks and yield complex patterns of associations and dissociations. Because behavioral evidence was not sufficient to decide among these three frameworks, the debate was largely abandoned. However, functional neuroimaging evidence accumulated during the last two decades resolves the stalemate, because this evidence is more consistent with the components framework than with the other two frameworks. For example, functional neuroimaging evidence shows that brain regions attributed to one memory system can contribute to tasks associated with other memory systems and that brain regions attributed to the same processing mode (perceptual or conceptual) can be dissociated from each other. Functional neuroimaging evidence suggests that memory processes are supported by transient interactions between a few regions called process-specific alliances. These conceptual developments are an example of how functional neuroimaging can contribute to theoretical debates in cognitive psychology.

Tracking the eyes to see what children remember

Relational memory is a canonical form of episodic memory known to rely on the hippocampus. Several lines of evidence suggest that relational memory has a developmental trajectory in which it is fragile, inflexible, and error-prone until around 6 years of age, which seems to mirror maturational changes in the morphology of the hippocampus. However, recent findings from Richmond and Nelson (2009) challenge this idea as they provide evidence suggestive of adult-like relational memory in 9-month-old infants. In this study the authors measured the eye movements of infants and showed that they preferentially gazed at correct, as opposed to incorrect, face-scene pairings at test. The goal of the present study was to evaluate the development of relational memory by assessing 4-year-olds using Richmond and Nelson's task and stimuli, but gathering two dependent measures of relational memory: overt response as well as eye movements. The results show that, overall, preferential looking at correct face-scene pairings was at chance; however, preferential looking was observed when the correct face-scene pair was later explicitly identified. Thus, while eye movements do index explicit memory in 4-year-olds, behavioural data are necessary to obtain a full picture of the development of relational memory in childhood.

Habit and nonhabit systems for unconscious and conscious behavior: implications for multitasking

The study of human consciousness has demonstrated that there are both conscious and unconscious systems. Other work, particularly in animals, has shown that there are habit and nonhabit systems and that these involve different brain regions and memory processes. Here we argue that habits can be equated with unconscious behavior and nonhabits with conscious behavior. This equation makes the extensive physiological literature on habit/nonhabit relevant to the less tractable issue of consciousness. On the basis of this line of reasoning, it appears that different parts of the BG and different memory structures mediate conscious and unconscious processes. It is further argued here that the unconscious system is highly capable; it can both process sensory information and produce behavior. The benefit of such a dual system is multitasking: The unconscious system can execute background tasks, leaving the conscious system to perform more difficult tasks.

It does not look odd to me: perceptual impairments and eye movements in amnesic patients with medial temporal lobe damage

Studies of people with memory impairments have shown that a specific set of brain structures in the medial temporal lobe (MTL) is vital for memory function. However, whether these structures have a role outside of memory remains contentious. Recent studies of amnesic patients with damage to two structures within the MTL, the hippocampus and the perirhinal cortex, indicated that these patients also performed poorly on perceptual tasks. More specifically, they performed worse than controls when discriminating between objects, faces and scenes with overlapping features. In order to investigate whether these perceptual deficits are reflected in their viewing strategies, we tested a group of amnesic patients with MTL damage that included the hippocampus and perirhinal cortex on a series of oddity discrimination tasks in which they had to select an odd item from a visual array. Participants' eye movements were monitored throughout the experiment. Results revealed that patients were impaired on tasks that required them to discriminate between items that shared many features, and tasks that required processing items from different viewpoints. An analysis of their eye movements revealed that they exhibited a similar viewing pattern as controls: they fixated more on the target item on trials answered correctly, but not on trials answered incorrectly. In addition, their impaired performance was not explained by an abnormal viewing-strategy that assessed their use of working memory. These results suggest that the perceptual deficits in the MTL patients are not a consequence of abnormal viewing patterns of the objects and scenes, but instead, could involve an inability to bind information gathered from several fixations into a cohesive percept. These data also support the view that MTL structures are important not only for long-term memory, but are also involved in perceptual tasks.

Preference by association: how memory mechanisms in the hippocampus bias decisions

Every day people make new choices between alternatives that they have never directly experienced. Yet, such decisions are often made rapidly and confidently. Here, we show that the hippocampus, traditionally known for its role in building long-term declarative memories, enables the spread of value across memories, thereby guiding decisions between new choice options. Using functional brain imaging in humans, we discovered that giving people monetary rewards led to activation of a preestablished network of memories, spreading the positive value of reward to nonrewarded items stored in memory. Later, people were biased to choose these nonrewarded items. This decision bias was predicted by activity in the hippocampus, reactivation of associated memories, and connectivity between memory and reward regions in the brain. These findings explain how choices among new alternatives emerge automatically from the associative mechanisms by which the brain builds memories. Further, our findings demonstrate a previously unknown role for the hippocampus in value-based decisions.

Procedural learning and associative memory mechanisms contribute to contextual cueing: Evidence from fMRI and eye-tracking

Using a combination of eye tracking and fMRI in a contextual cueing task, we explored the mechanisms underlying the facilitation of visual search for repeated spatial configurations. When configurations of distractors were repeated, greater activation in the right hippocampus corresponded to greater reductions in the number of saccades to locate the target. A psychophysiological interactions analysis for repeated configurations revealed that a strong functional connectivity between this area in the right hippocampus and the left superior parietal lobule early in learning was significantly reduced toward the end of the task. Practice related changes (which we call "procedural learning") in activation in temporo-occipital and parietal brain regions depended on whether or not spatial context was repeated. We conclude that context repetition facilitates visual search through chunk formation that reduces the number of effective distractors that have to be processed during the search. Context repetition influences procedural learning in a way that allows for continuous and effective chunk updating.

Context-dependent control over attentional capture

A number of studies have demonstrated that the likelihood of a salient item capturing attention is dependent on the "attentional set" an individual employs in a given situation. The instantiation of an attentional set is often viewed as a strategic, voluntary process, relying on working memory systems that represent immediate task priorities. However, influential theories of attention and automaticity propose that goal-directed control can operate more or less automatically on the basis of longer term task representations, a notion supported by a number of recent studies. Here, we provide evidence that longer term contextual learning can rapidly and automatically influence the instantiation of a given attentional set. Observers learned associations between specific attentional sets and specific task-irrelevant background scenes during a training session, and in the ensuing test session, simply reinstating particular scenes on a trial-by-trial basis biased observers to employ the associated attentional set. This directly influenced the magnitude of attentional capture, suggesting that memory for the context in which a task is performed can play an important role in the ability to instantiate a particular attentional set and overcome distraction by salient, task-irrelevant information.

Intermixing forms of memory processing within the functional organization of the medial temporal lobe memory system

Abstract Voss et al. discuss evidence indicating an intermixing of implicit and explicit memory processing, and of familiarity and recollection, in tests of memory. Here I support this view, and add that the anatomy of cortical-medial temporal lobe pathways indicates a hierarchical and bidirectional functional organization of memory in which implicit memory processing contributes to familiarity, and implicit memory and familiarity processing inherently contribute to recollection. Rather than look for new ways to separate these processes, it may be as important to understand how they are integrated.

Reconsidering the use of "explicit" and "implicit" as terms to describe task requirements

Abstract Conscious and unconscious expressions of memory-explicit and implicit memory, respectively-may be used to support performance in a given task, even when the task demands do not ostensibly require one or the other. Work from Voss, Lucas and Paller reveal that just as indirect tasks can capture the influence of explicit memory, direct tasks of memory can capture implicit memory mechanisms. Consequently, tasks cannot be truly labeled as explicit or implicit; as such labels presuppose, perhaps erroneously, the nature of memory that supports performance.

Shaping of object representations in the human medial temporal lobe based on temporal regularities

Regularities are gradually represented in cortex after extensive experience, and yet they can influence behavior after minimal exposure. What kind of representations support such rapid statistical learning? The medial temporal lobe (MTL) can represent information from even a single experience, making it a good candidate system for assisting in initial learning about regularities. We combined anatomical segmentation of the MTL, high-resolution fMRI, and multivariate pattern analysis to identify representations of objects in cortical and hippocampal areas of human MTL, assessing how these representations were shaped by exposure to regularities. Subjects viewed a continuous visual stream containing hidden temporal relationships--pairs of objects that reliably appeared nearby in time. We compared the pattern of blood oxygen level-dependent activity evoked by each object before and after this exposure, and found that perirhinal cortex, parahippocampal cortex, subiculum, CA1, and CA2/CA3/dentate gyrus (CA2/3/DG) encoded regularities by increasing the representational similarity of their constituent objects. Most regions exhibited bidirectional associative shaping, whereas CA2/3/DG represented regularities in a forward-looking predictive manner. These findings suggest that object representations in MTL come to mirror the temporal structure of the environment, supporting rapid and incidental statistical learning.

Relational memory in psychotic bipolar disorder

OBJECTIVES

Recent research has highlighted the phenotypic and genetic overlap of bipolar disorder and schizophrenia. Cognitive deficits in bipolar disorder parallel those seen in schizophrenia, particularly for bipolar disorder patients with a history of psychotic features. Here we explored whether relational memory deficits, which are prominent in schizophrenia, are also present in patients with psychotic bipolar disorder.

METHODS

We tested 25 patients with psychotic bipolar disorder on a relational memory paradigm previously employed to quantify deficits in schizophrenia. During the training, participants learned to associate a set of faces and background scenes. During the testing, participants viewed a single background overlaid by three trained faces and were asked to recall the matching face, which was either present (Match trials) or absent (Non-Match trials). Explicit recognition and eye-movement data were collected and compared to those for 28 schizophrenia patients and 27 healthy subjects from a previously published dataset.

RESULTS

Contrary to our prediction, we found psychotic bipolar disorder patients were less impaired in relational memory than schizophrenia subjects. Bipolar disorder subjects showed eye-movement behavior similar to healthy controls, whereas schizophrenia subjects were impaired relative to both groups. However, bipolar disorder patients with current delusions and/or hallucinations were more impaired than bipolar disorder patients not currently experiencing these symptoms.

CONCLUSIONS

We found that patients with psychotic bipolar disorder had better relational memory performance than schizophrenia patients, indicating that a history of psychotic symptoms does not lead to a significant relational memory deficit.

Repetition related changes in activation and functional connectivity in hippocampus predict subsequent memory

Using fMRI, this study examined the relationship between repetition-related changes in the medial temporal lobe (MTL) activation during encoding and subsequent memory for similarity of repetitions. During scanning, subjects classified pictures of objects as natural or man-made. Each object-type was judged twice with presentations of either identical pictures or pictures of different exemplars of the same object. After scanning, a surprise recognition test required subjects to decide whether a probe word corresponded to pictures judged previously. When a subject judged the word as "old," a second judgment was made concerning the physical similarity of the two pictures. Repetition related changes in MTL activation varied depending on whether or not subjects could correctly state that pictures were different. Moreover, psychophysiological interactions analyses showed that accuracy in recalling whether the two pictures were different was predicted by repetition-related changes in the functional connectivity of MTL with frontal regions. Specifically, correct recollection was predicted by increased connectivity between the left posterior hippocampus and the right inferior frontal gyrus, and also by decreased connectivity between the left posterior hippocampus and the left precentral gyrus on the second stimulus presentation. The opposite pattern was found for trials that were incorrectly judged on the nature of the repetition. These results suggest that successful encoding is predicted by a combination of increases and decreases in both the MTL activation and functional connectivity, and not merely by increases in activation and connectivity as suggested previously.

Unconscious relational inference recruits the hippocampus

Relational inference denotes the capacity to encode, flexibly retrieve, and integrate multiple memories to combine past experiences to update knowledge and improve decision-making in new situations. Although relational inference is thought to depend on the hippocampus and consciousness, we now show in young, healthy men that it may occur outside consciousness but still recruits the hippocampus. In temporally distinct and unique subliminal episodes, we presented word pairs that either overlapped ("winter-red", "red-computer") or not. Effects of unconscious relational inference emerged in reaction times recorded during unconscious encoding and in the outcome of decisions made 1 min later at test, when participants judged the semantic relatedness of two supraliminal words. These words were either episodically related through a common word ("winter-computer" related through "red") or unrelated. Hippocampal activity increased during the unconscious encoding of overlapping versus nonoverlapping word pairs and during the unconscious retrieval of episodically related versus unrelated words. Furthermore, hippocampal activity during unconscious encoding predicted the outcome of decisions made at test. Hence, unconscious inference may influence decision-making in new situations.

The hippocampus supports multiple cognitive processes through relational binding and comparison

It has been well established that the hippocampus plays a pivotal role in explicit long-term recognition memory. However, findings from amnesia, lesion and recording studies with non-human animals, eye-movement recording studies, and functional neuroimaging have recently converged upon a similar message: the functional reach of the hippocampus extends far beyond explicit recognition memory. Damage to the hippocampus affects performance on a number of cognitive tasks including recognition memory after short and long delays and visual discrimination. Additionally, with the advent of neuroimaging techniques that have fine spatial and temporal resolution, findings have emerged that show the elicitation of hippocampal responses within the first few 100 ms of stimulus/task onset. These responses occur for novel and previously viewed information during a time when perceptual processing is traditionally thought to occur, and long before overt recognition responses are made. We propose that the hippocampus is obligatorily involved in the binding of disparate elements across both space and time, and in the comparison of such relational memory representations. Furthermore, the hippocampus supports relational binding and comparison with or without conscious awareness for the relational representations that are formed, retrieved and/or compared. It is by virtue of these basic binding and comparison functions that the reach of the hippocampus extends beyond long-term recognition memory and underlies task performance in multiple cognitive domains.

Distinguishing highly confident accurate and inaccurate memory: insights about relevant and irrelevant influences on memory confidence

It is generally believed that accuracy and confidence in one's memory are related, but there are many instances when they diverge. Accordingly it is important to disentangle the factors that contribute to memory accuracy and confidence, especially those factors that contribute to confidence, but not accuracy. We used eye movements to separately measure fluent cue processing, the target recognition experience, and relative evidence assessment on recognition confidence and accuracy. Eye movements were monitored during a face-scene associative recognition task, in which participants first saw a scene cue, followed by a forced-choice recognition test for the associated face, with confidence ratings. Eye movement indices of the target recognition experience were largely indicative of accuracy, and showed a relationship to confidence for accurate decisions. In contrast, eye movements during the scene cue raised the possibility that more fluent cue processing was related to higher confidence for both accurate and inaccurate recognition decisions. In a second experiment we manipulated cue familiarity, and therefore cue fluency. Participants showed higher confidence for cue-target associations for when the cue was more familiar, especially for incorrect responses. These results suggest that over-reliance on cue familiarity and under-reliance on the target recognition experience may lead to erroneous confidence.

Aerobic fitness enhances relational memory in preadolescent children: the FITKids randomized control trial

It is widely accepted that aerobic exercise enhances hippocampal plasticity. Often, this plasticity co-occurs with gains in hippocampal-dependent memory. Cross-sectional work investigating this relationship in preadolescent children has found behavioral differences in higher versus lower aerobically fit participants for tasks measuring relational memory, which is known to be critically tied to hippocampal structure and function. The present study tested whether similar differences would arise in a clinical intervention setting where a group of preadolescent children were randomly assigned to a 9-month after school aerobic exercise intervention versus a wait-list control group. Performance measures included eye-movements as a measure of memory, based on recent work linking eye-movement indices of relational memory to the hippocampus. Results indicated that only children in the intervention increased their aerobic fitness. Compared to the control group, those who entered the aerobic exercise program displayed eye-movement patterns indicative of superior memory for face-scene relations, with no differences observed in memory for individual faces. The results of this intervention study provide clear support for the proposed linkage among the hippocampus, relational memory, and aerobic fitness, as well as illustrating the sensitivity of eye-movement measures as a means of assessing memory.

The hippocampus reevaluated in unconscious learning and memory: at a tipping point?

Classic findings from the neuropsychological literature invariably indicated that performances on tests of memory that can be accomplished without conscious awareness were largely spared in amnesia, while those that required conscious retrieval (e.g., via recognition or recall) of information learned in the very same sessions was devastatingly impaired. Based on reports of such dissociations, it was proposed that one of the fundamental distinctions between memory systems is whether or not they support conscious access to remembered content. Only recently have we come to realize that the putative systemic division of labor between conscious and unconscious memory is not so clean. A primary goal of this review is to examine recent evidence that has been advanced against the view that the hippocampus is selectively critical for conscious memory. Along the way, consideration is given to criticisms that have been levied against these findings, potential explanations for differences in the reported results are proposed, and methodological pitfalls in investigations of unconscious memory are discussed. Ultimately, it is concluded that a tipping point has been reached, and that while conscious recollection depends critically on hippocampal integrity, the reach of the hippocampus extends to unconscious aspects of memory performance when relational memory processing and representation are required.

More than a feeling: Pervasive influences of memory without awareness of retrieval

The subjective experiences of recollection and familiarity have featured prominently in the search for neurocognitive mechanisms of memory. However, these two explicit expressions of memory, which involve conscious awareness of memory retrieval, are distinct from an entire category of implicit expressions of memory that do not entail such awareness. This review summarizes recent evidence showing that neurocognitive processing related to implicit memory can powerfully influence the behavioral and neural measures typically associated with explicit memory. Although there are striking distinctions between the neurocognitive processing responsible for implicit versus explicit memory, tests designed to measure only explicit memory nonetheless often capture implicit memory processing as well. In particular, the evidence described here suggests that investigations of familiarity memory are prone to the accidental capture of implicit memory processing. These findings have considerable implications for neurocognitive accounts of memory, as they suggest that many neural and behavioral measures often accepted as signals of explicit memory instead reflect the distinct operation of implicit memory mechanisms that are only sometimes related to explicit memory expressions. Proper identification of the explicit and implicit mechanisms for memory is vital to understanding the normal operation of memory, in addition to the disrupted memory capabilities associated with many neurological disorders and mental illnesses. We suggest that future progress requires utilizing neural, behavioral, and subjective evidence to dissociate implicit and explicit memory processing so as to better understand their distinct mechanisms as well as their potential relationships. When searching for the neurocognitive mechanisms of memory, it is important to keep in mind that memory involves more than a feeling.