Looking for the neural basis of memory

Images with harder-to-reconstruct visual representations leave stronger memory traces

Much of what we remember is not because of intentional selection, but simply a by-product of perceiving. This raises a foundational question about the architecture of the mind: how does perception interface with and influence memory? Here, inspired by a classic proposal relating perceptual processing to memory durability, the level-of-processing theory, we present a sparse coding model for compressing feature embeddings of images, and show that the reconstruction residuals from this model predict how well images are encoded into memory. In an open memorability dataset of scene images, we show that reconstruction error not only explains memory accuracy, but also response latencies during retrieval, subsuming, in the latter case, all of the variance explained by powerful vision-only models. We also confirm a prediction of this account with 'model-driven psychophysics'. This work establishes reconstruction error as an important signal interfacing perception and memory, possibly through adaptive modulation of perceptual processing.

Recognition memory deficits detected through eye-tracking in well-controlled children with self-limited epilepsy with centrotemporal spikes

OBJECTIVE

Children with self-limited epilepsy characterized by centrotemporal spikes (SeLECTS) exhibit cognitive deficits in memory during the active phase, but there is currently a lack of studies and techniques to assess their memory development after well-controlled seizures. In this study, we employed eye-tracking techniques to investigate visual memory and its association with clinical factors and global intellectual ability, aiming to identify potential risk factors by examining encoding and recognition processes.

METHODS

A total of 26 recruited patients diagnosed with SeLECTS who had been seizure-free for at least 2 years, along with 24 control subjects, underwent Wechsler cognitive assessment and an eye-movement-based memory task while video-electroencephalographic (EEG) data were recorded. Fixation and pupil data related to eye movements were utilized to detect distinct memory processes and subsequently to compare the cognitive performance of patients exhibiting different regression patterns on EEG.

RESULTS

The findings revealed persistent impairments in visual memory among children with SeLECTS after being well controlled, primarily observed in the recognition stage rather than the encoding phase. Furthermore, the age at onset, frequency of seizures, and interictal epileptiform discharges exhibited significant correlations with eye movement data.

SIGNIFICANCE

Children with SeLECTS exhibit persistent recognition memory impairment after being well controlled for the disease. Controlling the frequency of seizures and reducing prolonged epileptiform activity may improve memory cognitive development. The application of the eye-tracking technique may provide novel insights into exploring memory cognition as well as underlying mechanisms associated with pediatric epilepsy.

Overlapping and distinct phenotypic profiles in Alzheimer's disease and late onset epilepsy: a biologically-based approach

Due to shared hippocampal dysfunction, patients with Alzheimer's dementia and late-onset epilepsy (LOE) report memory decline. Multiple studies have described the epidemiological, pathological, neurophysiological, and behavioral overlap between Alzheimer's Disease and LOE, implying a bi-directional relationship. We describe the neurobiological decline occurring at different spatial in AD and LOE patients, which may explain why their phenotypes overlap and differ. We provide suggestions for clinical recognition of dual presentation and novel approaches for behavioral testing that reflect an "inside-out," or biologically-based approach to testing memory. New memory and language assessments could detect-and treat-memory impairment in AD and LOE at an earlier, actionable stage.

Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion-attention interaction tasks

The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers' abilities to study psychological phenomena. We carried out two studies involving emotion-attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants' screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.

Clock Drawing Test Performance of Young Adults Based on a One-Shot Case Study

OBJECTIVE

The clock drawing test (CDT) is being used regularly by medical professionals in a variety of settings to aid in assessing cognitive functioning in adults of all ages. As our technological environment has changed significantly, because of the inception of this measure, the use of and exposure to the analog clock have diminished. We investigated whether young adults, who have grown up in a mainly digital world, can draw and tell time on an analog clock.

METHOD

Participants aged 18-30 years (N = 80, Mage = 24.2, SD = 3.93), who self-identified as having normal cognition, completed the CDT, as well as setting hands on a pre-drawn clock and identifying analog clock times.

RESULTS

About 25% of participants received a CDT score below the expected range. There was a moderate, positive correlation between analog clock hand setting and time identification in the group who scored below the expected range on the CDT only (rs(16) = 0.472, p = .048). Most participants reported not wearing an analog watch.

CONCLUSIONS

Based on these findings, the CDT should be used with caution to screen cognitive functioning in young adults (i.e., aged 18-30 years). Consideration of an alternative approach to screening cognition and modifying cognitive assessments in which the CDT is embedded is recommended for this population. These findings warrant further investigation into CDT performance in the young adult population.

Autobiographical Implicit Association Test and eye movements: fixations topography enables detection of autobiographical memories

Introduction

Autobiographical memory is the capacity to recollect memories of personally experienced events. The detection of such memories plays a key role in criminal trials. Among behavioral memory-detection methods, the autobiographical Implicit Association Test (aIAT) has gained popularity for its flexibility and suitability for forensic applications. The aIAT is a reaction time-based methodology aiming to assess whether information about an event is encoded in the respondent's mind. Here, we introduced the eye-D index, a measure based on the topography of fixations while performing the aIAT, as an additional measure to detect autobiographical memories covertly.

Methods

In this study, participants were involved in a mock-crime experiment in which they could act as Guilty or Innocent. One week later all participants underwent the aIAT combined with eye-tracking to investigate the presence of the crime-related memory.

Results

Guilty participants showed a higher number of fixations towards the category labels in the block in which true sentences shared the same response key with crime-related sentences, as compared to the block in which true sentences were paired with sentences describing an alternative version. Innocent participants showed the opposite pattern. This unbalanced allocation of attention to the category labels was quantified by the eye-D index and was found to be highly correlated to the standard aIAT-D index.

Discussion

This suggests that more fixations to the category labels could indicate increased cognitive load and monitoring of response conflicts. These preliminary results highlight eye-tracking as a tool to detect autobiographical memories covertly while performing the aIAT.

Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates

When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.

Artificial sharp-wave-ripples to support memory and counter neurodegeneration

Information processed in our sensory neocortical areas is transported to the hippocampus during memory encoding, and between hippocampus and neocortex during memory consolidation, and retrieval. Short bursts of high-frequency oscillations, so called sharp-wave-ripples, have been proposed as a potential mechanism for this information transfer: They can synchronize neural activity to support the formation of local neural networks to store information, and between distant cortical sites to act as a bridge to transfer information between sensory cortical areas and hippocampus. In neurodegenerative diseases like Alzheimer's Disease, different neuropathological processes impair normal neural functioning and neural synchronization as well as sharp-wave-ripples, which impairs consolidation and retrieval of information, and compromises memory. Here, we formulate a new hypothesis, that artificially inducing sharp-wave-ripples with noninvasive high-frequency visual stimulation could potentially support memory functioning, as well as target the neuropathological processes underlying neurodegenerative diseases. We also outline key challenges for empirical tests of the hypothesis.

Mapping sleep's oscillatory events as a biomarker of Alzheimer's disease

INTRODUCTION

Memory-associated neural circuits produce oscillatory events including theta bursts (TBs), sleep spindles (SPs), and slow waves (SWs) in sleep electroencephalography (EEG). Changes in the "coupling" of these events may indicate early Alzheimer's disease (AD) pathogenesis.

METHODS

We analyzed 205 aging adults using single-channel sleep EEG, cerebrospinal fluid (CSF) AD biomarkers, and Clinical Dementia Rating® (CDR®) scale. We mapped SW-TB and SW-SP neural circuit coupling precision to amyloid positivity, cognitive impairment, and CSF AD biomarkers.

RESULTS

Cognitive impairment correlated with lower TB spectral power in SW-TB coupling. Cognitively unimpaired, amyloid positive individuals demonstrated lower precision in SW-TB and SW-SP coupling compared to amyloid negative individuals. Significant biomarker correlations were found in oscillatory event coupling with CSF Aβ42 /Aβ40 , phosphorylated- tau181 , and total-tau.

DISCUSSION

Sleep-dependent memory processing integrity in neural circuits can be measured for both SW-TB and SW-SP coupling. This breakdown associates with amyloid positivity, increased AD pathology, and cognitive impairment.

HIGHLIGHTS

At-home sleep EEG is a potential biomarker of neural circuits linked to memory. Circuit precision is associated with amyloid positivity in asymptomatic aging adults. Levels of CSF amyloid and tau also correlate with circuit precision in sleep EEG. Theta burst EEG power is decreased in very early mild cognitive impairment. This technique may enable inexpensive wearable EEGs for monitoring brain health.

The effect of memory load on object reconstruction: Insights from an online mouse-tracking task

Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.

Dynamic interactions between memory and viewing behaviors: Insights from dyadic modeling of eye movements

Humans use eye movements to build visual memories. We investigated how the contributions of specific viewing behaviors to memory formation evolve over individual study epochs. We used dyadic modeling to explain performance on a spatial reconstruction task based on interactions among two gaze measures: (a) the entropy of the scanpath and (b) the frequency of item-to-item gaze transitions. To measure these interactions, our hypothesized model included causal pathways by which early-trial viewing behaviors impacted subsequent memory via downstream effects on later viewing. We found that lower scanpath entropy throughout the trial predicted better memory performance. By contrast, the effect of item-to-item transition frequency changed from negative to positive as the trial progressed. The model also revealed multiple pathways by which early-trial viewing dynamically altered late-trial viewing, thereby impacting memory indirectly. Finally, individual differences in scores on an independent measure of memory ability were found to predict viewing effectiveness, and viewing behaviors partially mediated the relation between memory ability and reconstruction accuracy. In a second experiment, the model showed a good fit for an independent dataset. These results highlight the dynamic nature of memory formation and suggest that the order in which eye movements occur can critically determine their effectiveness. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Cortico-ocular Coupling in the Service of Episodic Memory Formation

Encoding of visual information is a necessary requirement for most types of episodic memories. In search for a neural signature of memory formation, amplitude modulation of neural activity has been repeatedly shown to correlate with and suggested to be functionally involved in successful memory encoding. We here report a complementary view on why and how brain activity relates to memory, indicating a functional role of cortico-ocular interactions for episodic memory formation. Recording simultaneous magnetoencephalography and eye tracking in 35 human participants, we demonstrate that gaze variability and amplitude modulations of alpha/beta oscillations (10-20Hz) in visual cortex covary and predict subsequent memory performance between and within participants. Amplitude variation during pre-stimulus baseline was associated with gaze direction variability, echoing the co-variation observed during scene encoding. We conclude that encoding of visual information engages unison coupling between oculomotor and visual areas in the service of memory formation.

Mapping Sleep's Oscillatory Events as a Biomarker of Alzheimer's Disease

Objective

Memory-associated neural circuits produce oscillatory events within single-channel sleep electroencephalography (EEG), including theta bursts (TBs), sleep spindles (SPs) and multiple subtypes of slow waves (SWs). Changes in the temporal "coupling" of these events are proposed to serve as a biomarker for early stages of Alzheimer's disease (AD) pathogenesis.

Methods

We analyzed data from 205 aging adults, including single-channel sleep EEG, cerebrospinal fluid (CSF) AD-associated biomarkers, and Clinical Dementia Rating® (CDR®) scale. Individual SW events were sorted into high and low transition frequencies (TF) subtypes. We utilized time-frequency spectrogram locations within sleep EEG to "map" the precision of SW-TB and SW-SP neural circuit coupling in relation to amyloid positivity (by CSF Aβ 42 /Aβ 40 threshold), cognitive impairment (by CDR), and CSF levels of AD-associated biomarkers.

Results

Cognitive impairment was associated with lower TB spectral power in both high and low TF SW-TB coupling (p<0.001, p=0.001). Cognitively unimpaired, amyloid positive aging adults demonstrated lower precision of the neural circuits propagating high TF SW-TB (p<0.05) and low TF SW-SP (p<0.005) event coupling, compared to cognitively unimpaired amyloid negative individuals. Biomarker correlations were significant for high TF SW-TB coupling with CSF Aβ 42 /Aβ 40 (p=0.005), phosphorylated-tau 181 (p<0.005), and total-tau (p<0.05). Low TF SW-SP coupling was also correlated with CSF Aβ 42 /Aβ 40 (p<0.01).

Interpretation

Loss of integrity in neural circuits underlying sleep-dependent memory processing can be measured for both SW-TB and SW-SP coupling in spectral time-frequency space. Breakdown of sleep's memory circuit integrity is associated with amyloid positivity, higher levels of AD-associated pathology, and cognitive impairment.

Episodic memory formation in unrestricted viewing

The brain systems of episodic memory and oculomotor control are tightly linked, suggesting a crucial role of eye movements in memory. But little is known about the neural mechanisms of memory formation across eye movements in unrestricted viewing behavior. Here, we leverage simultaneous eye tracking and EEG recording to examine episodic memory formation in free viewing. Participants memorized multi-element events while their EEG and eye movements were concurrently recorded. Each event comprised elements from three categories (face, object, place), with two exemplars from each category, in different locations on the screen. A subsequent associative memory test assessed participants' memory for the between-category associations that specified each event. We used a deconvolution approach to overcome the problem of overlapping EEG responses to sequential saccades in free viewing. Brain activity was time-locked to the fixation onsets, and we examined EEG power in the theta and alpha frequency bands, the putative oscillatory correlates of episodic encoding mechanisms. Three modulations of fixation-related EEG predicted high subsequent memory performance: (1) theta increase at fixations after between-category gaze transitions, (2) theta and alpha increase at fixations after within-element gaze transitions, (3) alpha decrease at fixations after between-exemplar gaze transitions. Thus, event encoding with unrestricted viewing behavior was characterized by three neural mechanisms, manifested in fixation-locked theta and alpha EEG activity that rapidly turned on and off during the unfolding eye movement sequences. These three distinct neural mechanisms may be the essential building blocks that subserve the buildup of coherent episodic memories during unrestricted viewing behavior.

Entorhinal grid-like codes and time-locked network dynamics track others navigating through space

Navigating through crowded, dynamically changing environments requires the ability to keep track of other individuals. Grid cells in the entorhinal cortex are a central component of self-related navigation but whether they also track others' movement is unclear. Here, we propose that entorhinal grid-like codes make an essential contribution to socio-spatial navigation. Sixty human participants underwent functional magnetic resonance imaging (fMRI) while observing and re-tracing different paths of a demonstrator that navigated a virtual reality environment. Results revealed that grid-like codes in the entorhinal cortex tracked the other individual navigating through space. The activity of grid-like codes was time-locked to increases in co-activation and entorhinal-cortical connectivity that included the striatum, the hippocampus, parahippocampal and right posterior parietal cortices. Surprisingly, the grid-related effects during observation were stronger the worse participants performed when subsequently re-tracing the demonstrator's paths. Our findings suggests that network dynamics time-locked to entorhinal grid-cell-related activity might serve to distribute information about the location of others throughout the brain.

Eye-movement replay supports episodic remembering

When we bring to mind something we have seen before, our eyes spontaneously unfold in a sequential pattern strikingly similar to that made during the original encounter, even in the absence of supporting visual input. Oculomotor movements of the eye may then serve the opposite purpose of acquiring new visual information; they may serve as self-generated cues, pointing to stored memories. Over 50 years ago Donald Hebb, the forefather of cognitive neuroscience, posited that such a sequential replay of eye movements supports our ability to mentally recreate visuospatial relations during episodic remembering. However, direct evidence for this influential claim is lacking. Here we isolate the sequential properties of spontaneous eye movements during encoding and retrieval in a pure recall memory task and capture their encoding-retrieval overlap. Critically, we show that the fidelity with which a series of consecutive eye movements from initial encoding is sequentially retained during subsequent retrieval predicts the quality of the recalled memory. Our findings provide direct evidence that such scanpaths are replayed to assemble and reconstruct spatio-temporal relations as we remember and further suggest that distinct scanpath properties differentially contribute depending on the nature of the goal-relevant memory.