The eyes have it: hippocampal activity predicts expression of memory in eye movements

Early Eye Disengagement Is Regulated by Task Complexity and Task Repetition in Visual Tracking Task

Understanding human actions often requires in-depth detection and interpretation of bio-signals. Early eye disengagement from the target (EEDT) represents a significant eye behavior that involves the proactive disengagement of the gazes from the target to gather information on the anticipated pathway, thereby enabling rapid reactions to the environment. It remains unknown how task difficulty and task repetition affect EEDT. We aim to provide direct evidence of how these factors influence EEDT. We developed a visual tracking task in which participants viewed arrow movement videos while their eye movements were tracked. The task complexity was increased by increasing movement steps. Every movement pattern was performed twice to assess the effect of repetition on eye movement. Participants were required to recall the movement patterns for recall accuracy evaluation and complete cognitive load assessment. EEDT was quantified by the fixation duration and frequency within the areas of eye before arrow. When task difficulty increased, we found the recall accuracy score decreased, the cognitive load increased, and EEDT decreased significantly. The EEDT was higher in the second trial, but significance only existed in tasks with lower complexity. EEDT was positively correlated with recall accuracy and negatively correlated with cognitive load. Performing EEDT was reduced by task complexity and increased by task repetition. EEDT may be a promising sensory measure for assessing task performance and cognitive load and can be used for the future development of eye-tracking-based sensors.

Peering into the future: Eye movements predict neural repetition effects during episodic simulation

Imagining future scenarios involves recombining different elements of past experiences into a coherent event, a process broadly supported by the brain's default network. Prior work suggests that distinct brain regions may contribute to the inclusion of different simulation features. Here we examine how activity in these brain regions relates to the vividness of future simulations. Thirty-four healthy young adults imagined future events with familiar people and locations in a two-part study involving a repetition suppression paradigm. First, participants imagined events while their eyes were tracked during a behavioral session. Immediately after, participants imagined events during MRI scanning. The events to be imagined were manipulated such that some were identical to those imagined in the behavioral session while others involved new locations, new people, or both. In this way, we could examine how self-report ratings and eye movements predict brain activity during simulation along with specific simulation features. Vividness ratings were negatively correlated with eye movements, in contrast to an often-observed positive relationship with past recollection. Moreover, fewer eye movements predicted greater involvement of the hippocampus during simulation, an effect specific to location features. Our findings suggest that eye movements may facilitate scene construction for future thinking, lending support to frameworks that spatial information forms the foundation of episodic simulation.

Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task

Selective retrieval of context-relevant memories is critical for animal survival. A behavioral index that captures its dynamic nature in real time is necessary to investigate this retrieval process. Here, we found a bias in eye gaze towards the locations previously associated with individual objects during retrieval. Participants learned two locations associated with each visual object and recalled one of them indicated by a contextual cue in the following days. Before the contextual cue presentation, participants often gazed at both locations associated with the given object on the background screen (look-at-both), and the frequency of look-at-both gaze pattern increased as learning progressed. Following the cue presentation, their gaze shifted toward the context-appropriate location. Interestingly, participants showed a higher accuracy of memory retrieval in trials where they gazed at both object-associated locations, implying functional advantage of the look-at-both gaze patterns. Our findings indicate that naturalistic eye movements reflect the dynamic process of memory retrieval and selection, highlighting the potential of eye gaze as an indicator for studying these cognitive processes.

Spontaneous eye movements reflect the representational geometries of conceptual spaces

Functional neuroimaging studies indicate that the human brain can represent concepts and their relational structure in memory using coding schemes typical of spatial navigation. However, whether we can read out the internal representational geometries of conceptual spaces solely from human behavior remains unclear. Here, we report that the relational structure between concepts in memory might be reflected in spontaneous eye movements during verbal fluency tasks: When we asked participants to randomly generate numbers, their eye movements correlated with distances along the left-to-right one-dimensional geometry of the number space (mental number line), while they scaled with distance along the ring-like two-dimensional geometry of the color space (color wheel) when they randomly generated color names. Moreover, when participants randomly produced animal names, eye movements correlated with low-dimensional similarity in word frequencies. These results suggest that the representational geometries used to internally organize conceptual spaces might be read out from gaze behavior.

Concerns about confounds: False memory as an explanation for a hippocampus-supported implicit eye-movement-based relational memory effect

Steinkrauss and Slotnick (2024) propose that implicit eye-movement-based relational memory effects, predicted by hippocampal activity differences (Hannula & Ranganath, 2009), are due to an explicit false memory confound. However, the logic behind this claim is insufficiently fleshed out and alternative accounts of how false memory may have played out in this task were not considered. One such account would predict a pattern of results counter to the observed fMRI results, and another would be consistent with our original conclusions. These alternatives are described along with converging evidence from an additional fMRI study that was not considered by Steinkrauss and Slotnick.

Is implicit memory associated with the hippocampus?

According to the traditional memory-systems view, the hippocampus is critical during explicit (conscious) long-term memory, whereas other brain regions support implicit (nonconscious) memory. In the last two decades, some fMRI studies have reported hippocampal activity during implicit memory tasks. The aim of the present discussion paper was to identify whether any implicit memory fMRI studies have provided convincing evidence that the hippocampus is associated with nonconscious processes without being confounded by conscious processes. Experimental protocol and analysis parameters included the stimulus type(s), task(s), measures of subjective awareness, explicit memory accuracy, the relevant fMRI contrast(s) or analysis, and confound(s). A systematic review was conducted to identify implicit memory studies that reported fMRI activity in the hippocampus. After applying exclusion criteria, 13 articles remained for analysis. We found that there were no implicit memory fMRI studies where subjective awareness was absent, explicit memory performance was at chance, and there were no confounds that could have driven the observed hippocampal activity. The confounds included explicit memory (including false memory), imbalanced attentional states between conditions (yielding activation of the default-mode network), imbalanced stimuli between conditions, and differential novelty. As such, not a single fMRI study provided convincing evidence that implicit memory was associated with the hippocampus. Neuropsychological evidence was also considered, and implicit memory deficits were caused by factors known to disrupt brain regions beyond the hippocampus, such that the behavioral effects could not be attributed to this region. The present results indicate that implicit memory is not associated with the hippocampus.

The dead salmon strikes again: Reports of unconscious processing in the hippocampus may reflect Type-I error

Steinkrauss and Slotnick (2024) reviewed neuroimaging studies linking the hippocampus with implicit memory. They conclude that there is no convincing evidence that the hippocampus is associated with implicit memory because prior studies are confounded by explicit memory (among other factors). Here, we ask a different yet equally important question: do reports of unconscious hippocampal activity reflect a Type-I error (i.e. a false positive)? We find that 39% of studies linking the hippocampus with implicit memory (7 of 18) do not report correcting for multiple comparisons. These results indicate that many unconscious hippocampal effects may reflect a Type-I error.

Divergent thinking modulates interactions between episodic memory and schema knowledge: Controlled and spontaneous episodic retrieval processes

The ability to generate novel ideas, known as divergent thinking, depends on both semantic knowledge and episodic memory. Semantic knowledge and episodic memory are known to interact to support memory decisions, but how they may interact to support divergent thinking is unknown. Moreover, it is debated whether divergent thinking relies on spontaneous or controlled retrieval processes. We addressed these questions by examining whether divergent thinking ability relates to interactions between semantic knowledge and different episodic memory processes. Participants completed the alternate uses task of divergent thinking, and completed a memory task in which they searched for target objects in schema-congruent or schema-incongruent locations within scenes. In a subsequent test, participants indicated where in each scene the target object had been located previously (i.e., spatial accuracy test), and provided confidence-based recognition memory judgments that indexed distinct episodic memory processes (i.e., recollection, familiarity, and unconscious memory) for the scenes. We found that higher divergent thinking ability-specifically in terms of the number of ideas generated-was related to (1) more of a benefit from recollection (a controlled process) and unconscious memory (a spontaneous process) on spatial accuracy and (2) beneficial differences in how semantic knowledge was combined with recollection and unconscious memory to influence spatial accuracy. In contrast, there were no effects with respect to familiarity (a spontaneous process). These findings indicate that divergent thinking is related to both controlled and spontaneous memory processes, and suggest that divergent thinking is related to the ability to flexibly combine semantic knowledge with episodic memory.

Overlapping and distinct phenotypic profiles in Alzheimer's disease and late onset epilepsy: a biologically-based approach

Due to shared hippocampal dysfunction, patients with Alzheimer's dementia and late-onset epilepsy (LOE) report memory decline. Multiple studies have described the epidemiological, pathological, neurophysiological, and behavioral overlap between Alzheimer's Disease and LOE, implying a bi-directional relationship. We describe the neurobiological decline occurring at different spatial in AD and LOE patients, which may explain why their phenotypes overlap and differ. We provide suggestions for clinical recognition of dual presentation and novel approaches for behavioral testing that reflect an "inside-out," or biologically-based approach to testing memory. New memory and language assessments could detect-and treat-memory impairment in AD and LOE at an earlier, actionable stage.

Use of eye tracking in medical education

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Proteomic-Based Studies on Memory Formation in Normal and Neurodegenerative Disease-Affected Brains

A critical aspect of cognition is the ability to acquire, consolidate, and evoke memories, which is considerably impaired by neurodegenerative disorders such as Alzheimer's and Parkinson's diseases. These mnemonic processes are dependent on signaling cascades, which involve protein expression and degradation. Recent mass spectrometry (MS)-based proteomics has opened a range of possibilities for the study of memory formation and impairment, making it possible to research protein systems not studied before. However, in the context of synaptic proteome related to learning processes and memory formation, a deeper understanding of the synaptic proteome temporal dynamics after induction of synaptic plasticity and the molecular changes underlying the cognitive deficits seen in neurodegenerative diseases is needed. This review analyzes the applications of proteomics for understanding memory processes in both normal and neurodegenerative conditions. Moreover, the most critical experimental studies have been summarized using the PANTHER overrepresentation test. Finally, limitations associated with investigations of memory studies in physiological and neurodegenerative disorders have also been discussed.

Mapping the bioimaging marker of Alzheimer's disease based on pupillary light response-driven brain-wide fMRI in awake mice

Pupil dynamics has emerged as a critical non-invasive indicator of brain state changes. In particular, pupillary-light-responses (PLR) in Alzheimer's disease (AD) patients may be used as biomarkers of brain degeneration. To characterize AD-specific PLR and its underlying neuromodulatory sources, we combined high-resolution awake mouse fMRI with real-time pupillometry to map brain-wide event-related correlation patterns based on illumination-driven pupil constriction ( P c ) and post-illumination pupil dilation recovery (amplitude, P d , and time, T ). The P c -driven differential analysis revealed altered visual signal processing coupled with reduced thalamocortical activation in AD mice compared with the wild-type normal mice. In contrast, the post-illumination pupil dilation recovery-based fMRI highlighted multiple brain areas related to AD brain degeneration, including the cingulate cortex, hippocampus, septal area of the basal forebrain, medial raphe nucleus, and pontine reticular nuclei (PRN). Also, brain-wide functional connectivity analysis highlighted the most significant changes in PRN of AD mice, which serves as the major subcortical relay nuclei underlying oculomotor function. This work combined non-invasive pupil-fMRI measurements in preclinical models to identify pupillary biomarkers based on neuromodulatory dysfunction coupled with AD brain degeneration.

Hippocampal mechanisms resolve competition in memory and perception

Behaving adaptively requires selection of relevant memories and sensations and suppression of competing ones. We hypothesized that these mechanisms are linked, such that hippocampal computations that resolve competition in memory also shape the precision of sensory representations to guide selective attention. We leveraged f MRI-based pattern similarity, receptive field modeling, and eye tracking to test this hypothesis in humans performing a memory-dependent visual search task. In the hippocampus, differentiation of competing memories predicted the precision of memory-guided eye movements. In visual cortex, preparatory coding of remembered target locations predicted search successes, whereas preparatory coding of competing locations predicted search failures due to interference. These effects were linked: stronger hippocampal memory differentiation was associated with lower competitor activation in visual cortex, yielding more precise preparatory representations. These results demonstrate a role for memory differentiation in shaping the precision of sensory representations, highlighting links between mechanisms that overcome competition in memory and perception.

An ERP measure of non-conscious memory reveals dissociable implicit processes in human recognition using an open-source automated analytic pipeline

Non-conscious processing of human memory has traditionally been difficult to objectively measure and thus understand. A prior study on a group of hippocampal amnesia (N = 3) patients and healthy controls (N = 6) used a novel procedure for capturing neural correlates of implicit memory using event-related potentials (ERPs): old and new items were equated for varying levels of memory awareness, with ERP differences observed from 400 to 800 ms in bilateral parietal regions that were hippocampal-dependent. The current investigation sought to address the limitations of that study by increasing the sample of healthy subjects (N = 54), applying new controls for construct validity, and developing an improved, open-source tool for automated analysis of the procedure used for equating levels of memory awareness. Results faithfully reproduced prior ERP findings of parietal effects that a series of systematic control analyses validated were not contributed to nor contaminated by explicit memory. Implicit memory effects extended from 600 to 1000 ms, localized to right parietal sites. These ERP effects were found to be behaviorally relevant and specific in predicting implicit memory response times, and were topographically dissociable from other traditional ERP measures of implicit memory (miss vs. correct rejections) that instead occurred in left parietal regions. Results suggest first that equating for reported awareness of memory strength is a valid, powerful new method for revealing neural correlates of non-conscious human memory, and second, behavioral correlations suggest that these implicit effects reflect a pure form of priming, whereas misses represent fluency leading to the subjective experience of familiarity.

Gender and cytoarchitecture differences: Functional connectivity of the hippocampal sub-regions

Introduction

The hippocampus plays a significant role in learning, memory encoding, and spatial navigation. Typically, the hippocampus is investigated as a whole region of interest. However, recent work has developed fully detailed atlases based on cytoarchitecture properties of brain regions, and the hippocampus has been sub-divided into seven sub-areas that have structural differences in terms of distinct numbers of cells, neurons, and other structural and chemical properties. Moreover, gender differences are of increasing concern in neuroscience research. Several neuroscience studies have found structural and functional variations between the brain regions of females and males, and the hippocampus is one of these regions.

Aim

The aim of this study to explore whether the cytoarchitecturally distinct sub-regions of the hippocampus have varying patterns of functional connectivity with different networks of the brain and how these functional connections differ in terms of gender differences.

Method

This study investigated 200 healthy participants using seed-based resting-state functional magnetic resonance imaging (rsfMRI). The primary aim of this study was to explore the resting connectivity and gender distinctions associated with specific sub-regions of the hippocampus and their relationship with major functional brain networks.

Results

The findings revealed that the majority of the seven hippocampal sub-regions displayed functional connections with key brain networks, and distinct patterns of functional connectivity were observed between the hippocampal sub-regions and various functional networks within the brain. Notably, the default and visual networks exhibited the most consistent functional connections. Additionally, gender-based analysis highlighted evident functional resemblances and disparities, particularly concerning the anterior section of the hippocampus.

Conclusion

This study highlighted the functional connectivity patterns and involvement of the hippocampal sub-regions in major brain functional networks, indicating that the hippocampus should be investigated as a region of multiple distinct functions and should always be examined as sub-regions of interest. The results also revealed clear gender differences in functional connectivity.

Conscious awareness and memory systems in the brain

The term "memory" typically refers to conscious retrieval of events and experiences from our past, but experience can also change our behaviour without corresponding awareness of the learning process or the associated outcome. Based primarily on early neuropsychological work, theoretical perspectives have distinguished between conscious memory, said to depend critically on structures in the medial temporal lobe (MTL), and a collection of performance-based memories that do not. The most influential of these memory systems perspectives, the declarative memory theory, continues to be a mainstay of scientific work today despite mounting evidence suggesting that contributions of MTL structures go beyond the kinds or types of memory that can be explicitly reported. Consistent with these reports, more recent perspectives have focused increasingly on the processing operations supported by particular brain regions and the qualities or characteristics of resulting representations whether memory is expressed with or without awareness. These alternatives to the standard model generally converge on two key points. First, the hippocampus is critical for relational memory binding and representation even without awareness and, second, there may be little difference between some types of priming and explicit, familiarity-based recognition. Here, we examine the evolution of memory systems perspectives and critically evaluate scientific evidence that has challenged the status quo. Along the way, we highlight some of the challenges that researchers encounter in the context of this work, which can be contentious, and describe innovative methods that have been used to examine unconscious memory in the lab. This article is categorized under: Psychology > Memory Psychology > Theory and Methods Philosophy > Consciousness.

Computational cross-species views of the hippocampal formation

The discovery of place cells and head direction cells in the hippocampal formation of freely foraging rodents has led to an emphasis of its role in encoding allocentric spatial relationships. In contrast, studies in head-fixed primates have additionally found representations of spatial views. We review recent experiments in freely moving monkeys that expand upon these findings and show that postural variables such as eye/head movements strongly influence neural activity in the hippocampal formation, suggesting that the function of the hippocampus depends on where the animal looks. We interpret these results in the light of recent studies in humans performing challenging navigation tasks which suggest that depending on the context, eye/head movements serve one of two roles-gathering information about the structure of the environment (active sensing) or externalizing the contents of internal beliefs/deliberation (embodied cognition). These findings prompt future experimental investigations into the information carried by signals flowing between the hippocampal formation and the brain regions controlling postural variables, and constitute a basis for updating computational theories of the hippocampal system to accommodate the influence of eye/head movements.

Autobiographical memory impairment in chronic schizophrenia: Significance and clinical correlates

Previous studies of autobiographical memory (AM) in schizophrenia yielded a reduction of specificity, richness of details and conscious recollection, which indicate both, quantitative and qualitative AM changes. However, their associations with psychopathological symptoms and neuropsychological deficits were not resolved. Therefore, we sought to investigate AM with respect to psychopathology and neuropsychology in patients with chronic schizophrenia to rule out the influence of different courses of the disease. AM of four lifetime periods was examined in 75 patients and 50 healthy controls by using a semi-structured interview. The recalled episodes were rated for memory specificity. Subsequently, one single event of each period of life was rated for details and experiential aspects of reliving (originality, vividness/visual imagery, emotional re-experiencing and emotional valence). When contrasted with healthy controls, patients recalled a significantly reduced number of episodes and personal semantic facts; moreover, memory specificity of AM was significantly lower in patients than controls. While the richness of details calculated for single events showed only minor, non-significant group differences, vividness and emotional re-experiencing were significantly less pronounced in the patient group. Along with this, AM performance correlated significantly with negative symptoms including apathy as well as verbal memory and executive functions. Our results underline the significance of overgenerality as a key feature of AM in schizophrenia as well as a dissociation between intact number of details of single events and reduced vividness and emotional re-experiencing. The extent of negative symptoms including apathy and impairments of verbal memory/executive functions may explain AM deficits in chronic schizophrenia.

Neural correlates of paired associate recollection: A neuroimaging meta-analysis

Functional neuroimaging data on paired associate recollection have expanded over the years, raising the need for an integrative understanding of the literature. The present study performed a quantitative meta-analysis of the data to fulfill that need. The meta-analysis focused on the three most widely used types of activation contrast: Hit > Miss, Intact > Rearranged, and Memory > Perception. The major results were as follows. First, the Hit > Miss contrast mainly involved regions in the default mode network (DMN)/medial temporal lobe (MTL), likely reflecting a greater amount of retrieved information during the Hit than Miss trials. Second, the Intact > Rearranged contrast mainly involved regions in the DMN/MTL, supporting the view that rejecting recombination foils is based on familiarity with the component parts in the absence of recollection. Third, the Memory > Perception contrast primarily involved regions in the frontoparietal control network, likely reflecting the greater demands on controlled processing during Memory than Perception conditions. Fourth, the subcortical clusters included the amygdala, caudate nucleus/putamen, and mediodorsal thalamus regions, suggesting that these regions are components of the neural circuits supporting associative recollection. Finally, comparisons with previous meta-analyses suggested that associative recollection involves the DMN regions more strongly than source recollection but less strongly than subjective recollection. In conclusion, this study contributes uniquely to the growing literature on paired associate recollection by clarifying the convergent findings and differences among studies.

Minimal hepatic encephalopathy is associated to alterations in eye movements

Minimal hepatic encephalopathy (MHE) is diagnosed using PHES battery, but other tests are more sensitive, and a simple tool for early MHE detection is required. Assessment of saccadic eye movements is useful for early detection of cognitive alterations in different pathologies. We characterized the alterations in saccadic eye movements in MHE patients, its relationship with cognitive alterations and its utility for MHE diagnosis. One-hundred and eighteen cirrhotic patients (86 without and 32 with MHE) and 35 controls performed PHES and Stroop test and an eye movements test battery by OSCANN system: visual saccades, antisaccades, memory-guided saccades, fixation test and smooth pursuit. We analyzed 177 parameters of eye movements, assessed their diagnostic capacity for MHE, and correlated with cognitive alterations. MHE patients showed alterations in 56 of the 177 variables of eye movements compared to NMHE patients. MHE patients showed longer latencies and worse performance in most eye movements tests, which correlated with mental processing speed and attention impairments. The best correlations found were for antisaccades and memory-guided saccades, and some parameters in these tests could be useful for discriminating MHE and NMHE patients. Eye movements analysis could be a new, rapid, reliable, objective, and reproducible tool for early diagnose MHE.

Episodic Memory and Schizophrenia: From Characterization of Relational Memory Impairments to Neuroimaging Biomarkers

Episodic memory research in schizophrenia has a long history already which has clearly established significant impairments and strong associations with brain measures and functional outcome. The purpose of this chapter is not to make an exhaustive review of the recent literature but to highlight some relatively recent developments in the cognitive neuroscience field of episodic memory and schizophrenia. Hence, we present a contemporary view focusing specifically of relational memory which represents a form of episodic memory that refers to associations or binding among items or elements presented together. We describe the major tasks used and illustrate how their combination with brain imaging has: (1) favored the use of experimental memory tasks to isolate specific processes with specific neural correlates, (2) led to a distributed view of the neural correlates of memory impairments in schizophrenia where multiple regions are contributing, and (3) made possible the identification of fMRI biomarkers specific to episodic memory. We then briefly propose what we see as the next steps for memory research in schizophrenia so that the impact of this work can be maximized.

Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction

Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes.

Eye-movement replay supports episodic remembering

When we bring to mind something we have seen before, our eyes spontaneously unfold in a sequential pattern strikingly similar to that made during the original encounter, even in the absence of supporting visual input. Oculomotor movements of the eye may then serve the opposite purpose of acquiring new visual information; they may serve as self-generated cues, pointing to stored memories. Over 50 years ago Donald Hebb, the forefather of cognitive neuroscience, posited that such a sequential replay of eye movements supports our ability to mentally recreate visuospatial relations during episodic remembering. However, direct evidence for this influential claim is lacking. Here we isolate the sequential properties of spontaneous eye movements during encoding and retrieval in a pure recall memory task and capture their encoding-retrieval overlap. Critically, we show that the fidelity with which a series of consecutive eye movements from initial encoding is sequentially retained during subsequent retrieval predicts the quality of the recalled memory. Our findings provide direct evidence that such scanpaths are replayed to assemble and reconstruct spatio-temporal relations as we remember and further suggest that distinct scanpath properties differentially contribute depending on the nature of the goal-relevant memory.

Eye movements reveal spatiotemporal dynamics of visually-informed planning in navigation

Goal-oriented navigation is widely understood to depend upon internal maps. Although this may be the case in many settings, humans tend to rely on vision in complex, unfamiliar environments. To study the nature of gaze during visually-guided navigation, we tasked humans to navigate to transiently visible goals in virtual mazes of varying levels of difficulty, observing that they took near-optimal trajectories in all arenas. By analyzing participants’ eye movements, we gained insights into how they performed visually-informed planning. The spatial distribution of gaze revealed that environmental complexity mediated a striking trade-off in the extent to which attention was directed towards two complimentary aspects of the world model: the reward location and task-relevant transitions. The temporal evolution of gaze revealed rapid, sequential prospection of the future path, evocative of neural replay. These findings suggest that the spatiotemporal characteristics of gaze during navigation are significantly shaped by the unique cognitive computations underlying real-world, sequential decision making.

Aging changes the interactions between the oculomotor and memory systems

The use of multi-modal approaches, particularly in conjunction with multivariate analytic techniques, can enrich models of cognition, brain function, and how they change with age. Recently, multivariate approaches have been applied to the study of eye movements in a manner akin to that of neural activity (i.e., pattern similarity). Here, we review the literature regarding multi-modal and/or multivariate approaches, with specific reference to the use of eyetracking to characterize age-related changes in memory. By applying multi-modal and multivariate approaches to the study of aging, research has shown that aging is characterized by moment-to-moment alterations in the amount and pattern of visual exploration, and by extension, alterations in the activity and function of the hippocampus and broader medial temporal lobe (MTL). These methodological advances suggest that age-related declines in the integrity of the memory system has consequences for oculomotor behavior in the moment, in a reciprocal fashion. Age-related changes in hippocampal and MTL structure and function may lead to an increase in, and change in the patterns of, visual exploration in an effort to upregulate the encoding of information. However, such visual exploration patterns may be non-optimal and actually reduce the amount and/or type of incoming information that is bound into a lasting memory representation. This research indicates that age-related cognitive impairments are considerably broader in scope than previously realized.

Volume of the posterior hippocampus mediates age-related differences in spatial context memory and is correlated with increased activity in lateral frontal, parietal and occipital regions in healthy aging

Healthy aging is associated with episodic memory decline, particularly in the ability to encode and retrieve object-context associations (context memory). Neuropsychological and neuroimaging studies have highlighted the importance of the medial temporal lobes (MTL) in supporting episodic memory across the lifespan. However, given the functional heterogeneity of the MTL, volumetric declines in distinct regions may impact performance on specific episodic memory tasks, and affect the function of the large-scale neurocognitive networks supporting episodic memory encoding and retrieval. In the current study, we investigated how MTL structure may mediate age-related differences in performance on spatial and temporal context memory tasks, in a sample of 125 healthy adults aged 19-76 years old. Standard T1-weighted MRIs were segmented into the perirhinal, entorhinal and parahippocampal cortices, as well as the anterior and posterior hippocampal subregions. We observed negative linear and quadratic associations between age and volume of the parahippocampal cortex, and anterior and posterior hippocampal subregions. We also found that volume of the posterior hippocampus fully mediated the association between age and spatial, but not temporal context memory performance. Further, we employed a multivariate behavior partial-least-squares analysis to assess how age and regional MTL volumes correlated with brain activity during the encoding and retrieval of spatial context memories. We found that greater activity within lateral prefrontal, parietal, and occipital regions, as well as within the anterior MTL was related to older age and smaller volume of the posterior hippocampus. Our results highlight the heterogeneity of MTL contributions to episodic memory across the lifespan and provide support for the posterior-anterior shift in aging, and scaffolding theory of aging and cognition.

Behavioral Experience-Sampling Methods in Neuroimaging Studies With Movie and Narrative Stimuli

Movies and narratives are increasingly utilized as stimuli in functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) studies. Emotional reactions of subjects, what they pay attention to, what they memorize, and their cognitive interpretations are all examples of inner experiences that can differ between subjects during watching of movies and listening to narratives inside the scanner. Here, we review literature indicating that behavioral measures of inner experiences play an integral role in this new research paradigm via guiding neuroimaging analysis. We review behavioral methods that have been developed to sample inner experiences during watching of movies and listening to narratives. We also review approaches that allow for joint analyses of the behaviorally sampled inner experiences and neuroimaging data. We suggest that building neurophenomenological frameworks holds potential for solving the interrelationships between inner experiences and their neural underpinnings. Finally, we tentatively suggest that recent developments in machine learning approaches may pave way for inferring different classes of inner experiences directly from the neuroimaging data, thus potentially complementing the behavioral self-reports.

Looking for the neural basis of memory

Memory neuroscientists often measure neural activity during task trials designed to recruit specific memory processes. Behavior is championed as crucial for deciphering brain-memory linkages but is impoverished in typical experiments that rely on summary judgments. We criticize this approach as being blind to the multiple cognitive, neural, and behavioral processes that occur rapidly within a trial to support memory. Instead, time-resolved behaviors such as eye movements occur at the speed of cognition and neural activity. We highlight successes using eye-movement tracking with in vivo electrophysiology to link rapid hippocampal oscillations to encoding and retrieval processes that interact over hundreds of milliseconds. This approach will improve research on the neural basis of memory because it pinpoints discrete moments of brain-behavior-cognition correspondence.

The distinct and overlapping brain networks supporting semantic and spatial constructive scene processing

Scene imagery features prominently when we recall autobiographical memories, imagine the future and navigate around in the world. Consequently, in this study we sought to better understand how scene representations are supported by the brain. Processing scenes involves a variety of cognitive processes that in the real world are highly interactive. Here, however, our goal was to separate semantic and spatial constructive scene processes in order to identify the brain areas that were distinct to each process, those they had in common, and the connectivity between regions. To this end, participants searched for either semantic or spatial constructive impossibilities in scenes during functional MRI. We focussed our analyses on only those scenes that were possible, thus removing any error detection that would evoke reactions such as surprise or novelty. Importantly, we also counterbalanced possible scenes across participants, enabling us to examine brain activity and connectivity for the same possible scene images under two different conditions. We found that participants adopted different cognitive strategies, which were reflected in distinct oculomotor behaviour, for each condition. These were in turn associated with increased engagement of lateral temporal and parietal cortices for semantic scene processing, the hippocampus for spatial constructive scene processing, and increased activation of the ventromedial prefrontal cortex (vmPFC) that was common to both. Connectivity analyses showed that the vmPFC switched between semantic and spatial constructive brain networks depending on the task at hand. These findings further highlight the well-known semantic functions of lateral temporal areas, while providing additional support for the previously-asserted contribution of the hippocampus to scene construction, and recent suggestions that the vmPFC may play a key role in orchestrating scene processing.

Rapid coordination of effective learning by the human hippocampus

Although the human hippocampus is necessary for long-term memory, controversial findings suggest that it may also support short-term memory in the service of guiding effective behaviors during learning. We tested the counterintuitive theory that the hippocampus contributes to long-term memory through remarkably short-term processing, as reflected in eye movements during scene encoding. While viewing scenes for the first time, short-term retrieval operative within the episode over only hundreds of milliseconds was indicated by a specific eye-movement pattern, which was effective in that it enhanced spatiotemporal memory formation. This viewing pattern was predicted by hippocampal theta oscillations recorded from depth electrodes and by shifts toward top-down influence of hippocampal theta on activity within visual perception and attention networks. The hippocampus thus supports short-term memory processing that coordinates behavior in the service of effective spatiotemporal learning.

Relating the Past with the Present: Information Integration and Segregation during Ongoing Narrative Processing

This study examined how the brain dynamically updates event representations by integrating new information over multiple minutes while segregating irrelevant input. A professional writer custom-designed a narrative with two independent storylines, interleaving across minute-long segments (ABAB). In the last (C) part, characters from the two storylines meet and their shared history is revealed. Part C is designed to induce the spontaneous recall of past events, upon the recurrence of narrative motifs from A/B, and to shed new light on them. Our fMRI results showed storyline-specific neural patterns, which were reinstated (i.e., became more active) during storyline transitions. This effect increased along the processing timescale hierarchy, peaking in the default mode network. Similarly, the neural reinstatement of motifs was found during Part C. Furthermore, participants showing stronger motif reinstatement performed better in integrating A/B and C events, demonstrating the role of memory reactivation in information integration over intervening irrelevant events.

Gaze-pattern similarity at encoding may interfere with future memory

Human brains have a remarkable ability to separate streams of visual input into distinct memory-traces. It is unclear, however, how this ability relates to the way these inputs are explored via unique gaze-patterns. Moreover, it is yet unknown how motivation to forget or remember influences the link between gaze similarity and memory. In two experiments, we used a modified directed-forgetting paradigm and either showed blurred versions of the encoded scenes (Experiment 1) or pink noise images (Experiment 2) during attempted memory control. Both experiments demonstrated that higher levels of across-stimulus gaze similarity relate to worse future memory. Although this across-stimulus interference effect was unaffected by motivation, it depended on the perceptual overlap between stimuli and was more pronounced for different scene comparisons, than scene–pink noise comparisons. Intriguingly, these findings echo the pattern similarity effects from the neuroimaging literature and pinpoint a mechanism that could aid the regulation of unwanted memories.

Recent updates of eye movement abnormalities in patients with schizophrenia: A scoping review

AIM

Although eye-tracking technology expands beyond capturing eye data just for the sole purpose of ensuring participants maintain their gaze at the presented fixation cross, gaze technology remains of less importance in clinical research. Recently, impairments in visual information encoding processes indexed by novel gaze metrics have been frequently reported in patients with schizophrenia. This work undertakes a scoping review of research on saccadic dysfunctions and exploratory eye movement deficits among patients with schizophrenia. It gathers promising pieces of evidence of eye movement abnormalities in attention-demanding tasks on the schizophrenia spectrum that have mounted in recent years and their outcomes as potential biological markers.

METHODS

The protocol was drafted based on PRISMA for scoping review guidelines. Electronic databases were systematically searched to identify articles published between 2010 and 2020 that examined visual processing in patients with schizophrenia and reported eye movement characteristics as potential biomarkers for this mental illness.

RESULTS

The use of modern eye-tracking instrumentation has been reported by numerous neuroscientific studies to successfully and non-invasively improve the detection of visual information processing impairments among the screened population at risk of and identified with schizophrenia.

CONCLUSIONS

Eye-tracking technology has the potential to contribute to the process of early intervention and more apparent separation of the diagnostic entities, being put together by the syndrome-based approach to the diagnosis of schizophrenia. However, context-processing paradigms should be conducted and reported in equally accessible publications to build comprehensive models.

Examining the development of memory for temporal context and its underlying neural processes using event-related potentials

•

Memory for temporal context, vital for episodic memory, shows prolonged development.

•

Cognitive processes and neural mechanisms driving age-related improvements unclear.

•

Event-related potentials (ERP) used with 7−9-year-olds, 10−12-year-olds, and adults.

•

We found age-related improvements, ERP effects, and brain-behavior relations.

•

Implications for temporal memory and episodic memory development discussed.

Time is a critical feature of episodic memory—memory for events from a specific time and place (Tulving, 1972). Previous research indicates that temporal memory (memory for ‘when’) is slower to develop than memory for other details (e.g., ‘what’ and ‘where’), with improvements observed across middle and late childhood. The factors that drive these changes are not yet clear. We used an event-related potential (ERP) recognition memory paradigm to investigate the underlying processes of memory for temporal context in middle to late childhood (7−9-year-olds; 10−12-year-olds) and young adulthood. Behaviorally, we observed age-related improvements in the ability to place events in temporal context. ERP analyses showed old/new effects for children and adults. We also found brain-behavior relations for 1) episodic memory (ERP mean amplitude difference between source hits and correctly identified new trials was correlated to behavioral accuracy), and 2) temporal memory (ERP mean amplitude difference between source hits and source error trials was correlated to accuracy of temporal memory judgments). This work furthers our understanding of the cognitive processes and neural signatures supporting temporal memory development in middle to late childhood, and has implications for episodic memory development more broadly.

Characterising the hippocampal response to perception, construction and complexity

The precise role played by the hippocampus in supporting cognitive functions such as episodic memory and future thinking is debated, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, questions remain about the specificity and nature of the hippocampal response to scenes. Here, we devised a paradigm in which we had participants search pairs of images for either colour or layout differences, thought to be associated with perceptual or spatial constructive processes respectively. Importantly, images depicted either naturalistic scenes or phase-scrambled versions of the same scenes, and were either simple or complex. Using this paradigm during functional MRI scanning, we addressed three questions: 1. Is the hippocampus recruited specifically during scene processing? 2. If the hippocampus is more active in response to scenes, does searching for colour or layout differences influence its activation? 3. Does the complexity of the scenes affect its response? We found that, compared to phase-scrambled versions of the scenes, the hippocampus was more responsive to scene stimuli. Moreover, a clear anatomical distinction was evident, with colour detection in scenes engaging the posterior hippocampus whereas layout detection in scenes recruited the anterior hippocampus. The complexity of the scenes did not influence hippocampal activity. These findings seem to align with perspectives that propose the hippocampus is especially attuned to scenes, and its involvement occurs irrespective of the cognitive process or the complexity of the scenes.

Effects of Exercise on Explicit Memory Function: Incidental and Intentional Encoding May Depend on Exercise Timing

The present experiment evaluated the effects of self-reported exercise behavior and an acute bout of high-intensity exercise on explicit memory function. The memory tasks were encoded either incidentally or intentionally; for intentional encoding, participants were told to focus on memorizing the stimuli (words), whereas for incidental encoding, participants were unaware that they would be subsequently asked to complete an object recognition task. Among a sample of 150 adults (M_age = 20 years), randomly assigned experimental participants engaged in the following task sequence: (a) incidentally encoded a series of objects, (b) engaged in 20 minutes of high-intensity exercise, (c) intentionally encoded a word list, and (d) completed explicit memory retrieval tasks. Control group participants viewed a time matched video in lieu of high intensity exercise. We measured self-reported exercise behavior via an exercise questionnaire. We did not observe convincing evidence of an effect of high-intensity acute exercise, when occurring during the early consolidation period, on memory function, for either incidental or intentional encoding tasks. However, self-reported engagement in moderate-to-vigorous physical activity was favorably associated with explicit memory performance.

Tracking the Emergence of Location-based Spatial Representations in Human Scene-Selective Cortex

Scene-selective regions of the human brain form allocentric representations of locations in our environment. These representations are independent of heading direction and allow us to know where we are regardless of our direction of travel. However, we know little about how these location-based representations are formed. Using fMRI representational similarity analysis and linear mixed models, we tracked the emergence of location-based representations in scene-selective brain regions. We estimated patterns of activity for two distinct scenes, taken before and after participants learnt they were from the same location. During a learning phase, we presented participants with two types of panoramic videos: (1) an overlap video condition displaying two distinct scenes (0° and 180°) from the same location and (2) a no-overlap video displaying two distinct scenes from different locations (which served as a control condition). In the parahippocampal cortex (PHC) and retrosplenial cortex (RSC), representations of scenes from the same location became more similar to each other only after they had been shown in the overlap condition, suggesting the emergence of viewpoint-independent location-based representations. Whereas these representations emerged in the PHC regardless of task performance, RSC representations only emerged for locations where participants could behaviorally identify the two scenes as belonging to the same location. The results suggest that we can track the emergence of location-based representations in the PHC and RSC in a single fMRI experiment. Further, they support computational models that propose the RSC plays a key role in transforming viewpoint-independent representations into behaviorally relevant representations of specific viewpoints.

Relational memory in the early stage of psychotic bipolar disorder

Relational memory is impaired in psychotic disorders. In non-affective psychotic disorders, relational memory deficits are present in the early stage of illness and become more pronounced in the chronic stage. Previous studies have demonstrated cognitive deficits in early-stage psychotic bipolar disorder, but it is unclear whether relational memory is impaired. We examined relational memory using a face-scene binding task in early-stage psychotic bipolar disorder patients (n = 33) and compared their performance with healthy control (n = 40) and early-stage non-affective psychosis participants (n = 40). During training, participants learned to associate faces with background scenes. During testing, participants viewed a scene overlaid by three faces and were asked to recall the matching face. Relational memory was assessed indirectly using eye movements and explicitly using forced-choice recognition. Preferential viewing of the matching face, as captured by overall proportion of viewing and viewing across time, was significantly lower in psychotic bipolar disorder than in the healthy control group. However, preferential viewing of the matching face in psychotic bipolar disorder was significantly better than in non-affective psychosis. These findings provide novel evidence that relational memory in patients with early-stage psychotic bipolar disorder is intermediate between healthy control and early-stage non-affective psychosis subjects.

The spatial distribution of attention predicts familiarity strength during encoding and retrieval

The memories we form are determined by what we attend to, and conversely, what we attend to is influenced by our memory for past experiences. Although we know that shifts of attention via eye movements are related to memory during encoding and retrieval, the role of specific memory processes in this relationship is unclear. There is evidence that attention may be especially important for some forms of memory (i.e., conscious recollection), and less so for others (i.e., familiarity-based recognition and unconscious influences of memory), but results are conflicting with respect to both the memory processes and eye movement patterns involved. To address this, we used a confidence-based method of isolating eye movement indices of spatial attention that are related to different memory processes (i.e., recollection, familiarity strength, and unconscious memory) during encoding and retrieval of real-world scenes. We also developed a new method of measuring the dispersion of eye movements, which proved to be more sensitive to memory processing than previously used measures. Specifically, in 2 studies, we found that familiarity strength-that is, changes in subjective reports of memory confidence-increased with (a) more dispersed patterns of viewing during encoding, (b) less dispersed viewing during retrieval, and (c) greater overlap in regions viewed between encoding and retrieval (i.e., resampling). Recollection was also related to these eye movements in a similar manner, though the associations with recollection were less consistent across experiments. Furthermore, we found no evidence for effects related to unconscious influences of memory. These findings indicate that attentional processes during viewing may not preferentially relate to recollection, and that the spatial distribution of eye movements is directly related to familiarity-based memory during encoding and retrieval. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Temporal context guides visual exploration during scene recognition

Memories for episodes are temporally structured. Cognitive models derived from list-learning experiments attribute this structure to the retrieval of temporal context information that indicates when a memory occurred. These models predict key features of memory recall, such as the strong tendency to retrieve studied items in the order in which they were first encountered. Can such models explain ecological memory behaviors, such as eye movements during encoding and retrieval of complex visual stimuli? We tested predictions from retrieved-context models using three data sets involving recognition memory and free viewing of complex scenes. Subjects reinstated sequences of eye movements from one scene-viewing episode to the next. Moreover, sequence reinstatement decayed over time and was associated with successful memory. We observed memory-driven reinstatement even after accounting for intrinsic scene properties that produced consistent eye movements. These findings confirm predictions of retrieved-context models, suggesting retrieval of temporal context influences complex behaviors generated during naturalistic memory experiences. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Do eye movements enhance visual memory retrieval?

When remembering an object at a given location, participants tend to return their gaze to that location even after the object has disappeared, known as Looking-at-Nothing (LAN). However, it is unclear whether LAN is associated with better memory performance. Previous studies reporting beneficial effects of LAN have often not systematically manipulated or assessed eye movements. We asked 20 participants to remember the location and identity of eight objects arranged in a circle, shown for 5 s. Participants were prompted to judge whether a location statement (e.g., "Star Right") was correct or incorrect, or referred to a previously unseen object. During memory retrieval, participants either fixated in the screen center or were free to move their eyes. Results reveal no difference in memory accuracy and response time between free-viewing and fixation while a LAN effect was found for saccades during free viewing, but not for microsaccades during fixation. Memory performance was better in those free-viewing trials in which participants made a saccade to the critical location, and scaled with saccade accuracy. These results indicate that saccade kinematics might be related to both memory performance and memory retrieval processes, but the strength of their link would differ between individuals and task demands.

Relational Memory in the Early Stage of Psychosis: A 2-Year Follow-up Study

BACKGROUND

Relational memory, the ability to bind information into complex memories, is moderately impaired in early psychosis and severely impaired in chronic schizophrenia, suggesting relational memory may worsen throughout the course of illness.

METHODS

We examined relational memory in 66 early psychosis patients and 64 healthy control subjects, with 59 patients and 52 control subjects assessed longitudinally at baseline and 2-year follow-up. Relational memory was assessed with 2 complementary tasks, to test how individuals learn relationships between items (face-scene binding task) and make inferences about trained relationships (associative inference task).

RESULTS

The early psychosis group showed impaired relational memory in both tasks relative to the healthy control group. The ability to learn relationships between items remained impaired in early psychosis patients, while the ability to make inferences about trained relationships improved, although never reaching the level of healthy control performance. Early psychosis patients who did not progress to schizophrenia at follow-up had better relational memory than patients who did.

CONCLUSIONS

Relational memory impairments, some of which improve and are less severe in patients who do not progress to schizophrenia, are a target for intervention in early psychosis.

Relational Memory at Short and Long Delays in Individuals With Moderate-Severe Traumatic Brain Injury

Memory deficits are a common and frequently-cited consequence of moderate-severe traumatic brain injury (TBI). However, we know less about how TBI influences relational memory, which allows the binding of the arbitrary elements of experience and the flexible use and recombination of relational representations in novel situations. Relational memory is of special interest for individuals with TBI, given the vulnerability of the hippocampus to injury mechanisms, as well as a growing body of literature establishing the role of relational memory in flexible and goal-directed behavior. In this study, participants with and without a history of moderate-severe TBI completed a continuous relational memory task for face-scene pairings. Participants with TBI exhibited a disruption in relational memory not only when tested after a delay, but also when tested with no experimenter-imposed delay after stimulus presentation. Further, canonical assessments of working and episodic memory did not correspond with performance on the face-scene task, suggesting that this task may tap into relational memory differently and with greater sensitivity than standardized memory assessments. These results highlight the need for rigorous assessment of relational memory in TBI, which is likely to detect deficits that have specific consequences for community reintegration and long-term functional outcomes.

Longitudinal Development of Memory for Temporal Order in Early to Middle Childhood

Existing studies examining the development of temporal order memory show that although young children perform above chance on some tasks assessing temporal order memory, there are significant age-related differences across childhood. Yet, the trajectory of children's ability to retrieve temporal order remains unclear as existing conclusions are drawn from cross-sectional studies. The present study utilized an accelerated longitudinal design in order to characterize the developmental trajectory of temporal order memory in a sample of 200 healthy 4- to 8-year-old children. Specifically, two tasks commonly used in the literature were tested longitudinally: a primacy judgment task and an ordering task. Results revealed that, even after controlling for differences in IQ, linearly increasing trajectories characterized age-related change in performance for both tasks; however, change appeared greater for the temporal ordering task. Further, performance on the two tasks was positively related, suggesting shared underlying mechanisms. These findings provide a more thorough understanding of temporal order memory in early to middle childhood by characterizing the developmental trajectories of two commonly used tasks and have important implications for our understanding of children's developing memory more broadly.

Stress-Induced Increase in Cortisol Negatively Affects the Consolidation of Contextual Elements of Episodic Memories

Stress can modulate episodic memory in various ways. The present study asks how post-encoding stress affects visual context memory. Participants encoded object images centrally positioned on background scenes. After encoding, they were either exposed to cold pressure stress (CPS) or a warm water control procedure. Forty-right hours later, participants were cued with object images, and for each image, they were asked to select the background scene with which it was paired during study among three highly similar options. Only male but not female participants reacted with a significant increase in salivary cortisol to CPS, and the stress and control group did not differ in recognition performance. Comparing recognition performance between stress responders and non-responders, however, revealed a significant impairment in context memory in responders. Additionally, proportional increase in cortisol was negatively correlated with the number of correctly recognized scenes in responders. Due to the small number of responders, these findings need to be interpreted with caution but provide preliminary evidence that stress-induced cortisol increase negatively affects the consolidation of contextual elements of episodic memories.