Similar patterns of neural activity predict memory function during encoding and retrieval

Decoding EEG for optimizing naturalistic memory

BACKGROUND

Spectral features of human electroencephalographic (EEG) recordings during learning predict subsequent recall variability.

NEW METHOD

Capitalizing on these fluctuating neural features, we develop a non-invasive closed-loop (NICL) system for real-time optimization of human learning. Participants play a virtual navigation-and-memory game; recording multi-session data across days allowed us to build participant-specific classification models of recall success. In subsequent closed-loop sessions, our platform manipulated the timing of memory encoding, selectively presenting items during periods of predicted good or poor memory function based on EEG features decoded in real time.

RESULTS

The induced memory effect (the difference between recall rates when presenting items during predicted good vs. poor learning periods) increased with the accuracy of neural decoding.

COMPARISON WITH EXISTING METHODS

This study demonstrates greater-than-chance memory decoding from EEG recordings in a naturalistic virtual navigation task with greater real-world validity than basic word-list recall paradigms. Here we modulate memory by timing stimulus presentation based on noninvasive scalp EEG recordings, whereas prior closed-loop studies for memory improvement involved intracranial recordings and direct electrical stimulation. Other noninvasive studies have investigated the use of neurofeedback or remedial study for memory improvement.

CONCLUSIONS

These findings present a proof-of-concept for using non-invasive closed-loop technology to optimize human learning and memory through principled stimulus timing, but only in those participants for whom classifiers reliably predict out-of-sample memory function.

Tongue coating-dependent superior temporal sulcus remodeling in amnestic mild cognitive impairment

Tongue coating affects cognition, and cognitive decline at early stage also showed relations to functional and structural remodeling of superior temporal sulcus (STS) in amnestic mild cognitive impairment (aMCI). The potential correlation between disparate cognitive manifestations in aMCI patients with different tongue coatings, and corresponding mechanisms of STS remodeling remains uncharted. In this case-control study, aMCI patients were divided into thin coating (n = 18) and thick coating (n = 21) groups. All participants underwent neuropsychological evaluations and multimodal magnetic resonance imaging. Group comparisons were conducted in clinical assessments and neuroimaging measures of banks of the STS (bankssts). Generalized linear models were constructed to explore relationships between neuroimaging measures and cognition. aMCI patients in the thick coating group exhibited significantly poorer immediate and delayed recall and slower information processing speed (IPS) (P < 0.05), and decreased functional connectivity (FC) of bilateral bankssts with frontoparietal cortices (P < 0.05, AlphaSim corrected) compared to the thin coating group. It was found notable correlations between cognition encompassing recall and IPS, and FC of bilateral bankssts with frontoparietal cortices (P < 0.05, Bonferroni's correction), as well as interaction effects of group × regional homogeneity (ReHo) of right bankssts on the first immediate recall (P < 0.05, Bonferroni's correction). aMCI patients with thick coating exhibited poor cognitive performance, which might be attributed to decreased FC seeding from bankssts. Our findings strengthen the understanding of brain reorganization of STS via which tongue coating status impacts cognition in patients with aMCI.

EEG decoders track memory dynamics

Encoding- and retrieval-related neural activity jointly determine mnemonic success. We ask whether electroencephalographic activity can reliably predict encoding and retrieval success on individual trials. Each of 98 participants performed a delayed recall task on 576 lists across 24 experimental sessions. Logistic regression classifiers trained on spectral features measured immediately preceding spoken recall of individual words successfully predict whether or not those words belonged to the target list. Classifiers trained on features measured during word encoding also reliably predict whether those words will be subsequently recalled and further predict the temporal and semantic organization of the recalled items. These findings link neural variability predictive of successful memory with item-to-context binding, a key cognitive process thought to underlie episodic memory function.

Recognition memory deficits detected through eye-tracking in well-controlled children with self-limited epilepsy with centrotemporal spikes

OBJECTIVE

Children with self-limited epilepsy characterized by centrotemporal spikes (SeLECTS) exhibit cognitive deficits in memory during the active phase, but there is currently a lack of studies and techniques to assess their memory development after well-controlled seizures. In this study, we employed eye-tracking techniques to investigate visual memory and its association with clinical factors and global intellectual ability, aiming to identify potential risk factors by examining encoding and recognition processes.

METHODS

A total of 26 recruited patients diagnosed with SeLECTS who had been seizure-free for at least 2 years, along with 24 control subjects, underwent Wechsler cognitive assessment and an eye-movement-based memory task while video-electroencephalographic (EEG) data were recorded. Fixation and pupil data related to eye movements were utilized to detect distinct memory processes and subsequently to compare the cognitive performance of patients exhibiting different regression patterns on EEG.

RESULTS

The findings revealed persistent impairments in visual memory among children with SeLECTS after being well controlled, primarily observed in the recognition stage rather than the encoding phase. Furthermore, the age at onset, frequency of seizures, and interictal epileptiform discharges exhibited significant correlations with eye movement data.

SIGNIFICANCE

Children with SeLECTS exhibit persistent recognition memory impairment after being well controlled for the disease. Controlling the frequency of seizures and reducing prolonged epileptiform activity may improve memory cognitive development. The application of the eye-tracking technique may provide novel insights into exploring memory cognition as well as underlying mechanisms associated with pediatric epilepsy.

Semantic associations restore neural encoding mechanisms

Lapses in attention can negatively impact later memory of an experience. Attention and encoding resources are thought to decline as more experiences are encountered in succession, accounting for the primacy effect in which memory is better for items encountered early compared to late in a study list. However, accessing prior knowledge during study can facilitate subsequent memory, suggesting a potential avenue to counteract this decline. Here, we investigated the extent to which semantic associations-shared meaning between experiences-can counteract declines in encoding resources. Our hypothesis is that semantic associations restore neural encoding mechanisms, which in turn improves memory. We recorded scalp electroencephalography (EEG) while male and female human participants performed a delayed free recall task. Half of the items from late in each study list were semantically associated with an item presented earlier in the list. We find that semantic associations improve memory specifically for late list items and selectively modulate the neural signals engaged during the study of late list items. Relative to other recalled items, late list items that are subsequently semantically clustered-recalled consecutively with their semantic associate-elicit increased high-frequency activity and decreased low-frequency activity, a hallmark of successful encoding. Our findings demonstrate that semantic associations restore neural encoding mechanisms and improve later memory. More broadly, these findings suggest that prior knowledge modulates the orientation of attention to influence encoding mechanisms.

Developing a hippocampal neural prosthetic to facilitate human memory encoding and recall of stimulus features and categories

Objective

Here, we demonstrate the first successful use of static neural stimulation patterns for specific information content. These static patterns were derived by a model that was applied to a subject's own hippocampal spatiotemporal neural codes for memory.

Approach

We constructed a new model of processes by which the hippocampus encodes specific memory items via spatiotemporal firing of neural ensembles that underlie the successful encoding of targeted content into short-term memory. A memory decoding model (MDM) of hippocampal CA3 and CA1 neural firing was computed which derives a stimulation pattern for CA1 and CA3 neurons to be applied during the encoding (sample) phase of a delayed match-to-sample (DMS) human short-term memory task.

Main results

MDM electrical stimulation delivered to the CA1 and CA3 locations in the hippocampus during the sample phase of DMS trials facilitated memory of images from the DMS task during a delayed recognition (DR) task that also included control images that were not from the DMS task. Across all subjects, the stimulated trials exhibited significant changes in performance in 22.4% of patient and category combinations. Changes in performance were a combination of both increased memory performance and decreased memory performance, with increases in performance occurring at almost 2 to 1 relative to decreases in performance. Across patients with impaired memory that received bilateral stimulation, significant changes in over 37.9% of patient and category combinations was seen with the changes in memory performance show a ratio of increased to decreased performance of over 4 to 1. Modification of memory performance was dependent on whether memory function was intact or impaired, and if stimulation was applied bilaterally or unilaterally, with nearly all increase in performance seen in subjects with impaired memory receiving bilateral stimulation.

Significance

These results demonstrate that memory encoding in patients with impaired memory function can be facilitated for specific memory content, which offers a stimulation method for a future implantable neural prosthetic to improve human memory.

Functional and anatomical connectivity predict brain stimulation's mnemonic effects

Closed-loop direct brain stimulation is a promising tool for modulating neural activity and behavior. However, it remains unclear how to optimally target stimulation to modulate brain activity in particular brain networks that underlie particular cognitive functions. Here, we test the hypothesis that stimulation's behavioral and physiological effects depend on the stimulation target's anatomical and functional network properties. We delivered closed-loop stimulation as 47 neurosurgical patients studied and recalled word lists. Multivariate classifiers, trained to predict momentary lapses in memory function, triggered the stimulation of the lateral temporal cortex (LTC) during the study phase of the task. We found that LTC stimulation specifically improved memory when delivered to targets near white matter pathways. Memory improvement was largest for targets near white matter that also showed high functional connectivity to the brain's memory network. These targets also reduced low-frequency activity in this network, an established marker of successful memory encoding. These data reveal how anatomical and functional networks mediate stimulation's behavioral and physiological effects, provide further evidence that closed-loop LTC stimulation can improve episodic memory, and suggest a method for optimizing neuromodulation through improved stimulation targeting.

Intracranial Neurofeedback Modulating Neural Activity in the Mesial Temporal Lobe During Memory Encoding: A Pilot Study

Removal of the mesial temporal lobe (MTL) is an established surgical procedure that leads to seizure freedom in patients with intractable MTL epilepsy; however, it carries the potential risk of memory damage. Neurofeedback (NF), which regulates brain function by converting brain activity into perceptible information and providing feedback, has attracted considerable attention in recent years for its potential as a novel complementary treatment for many neurological disorders. However, no research has attempted to artificially reorganize memory functions by applying NF before resective surgery to preserve memory functions. Thus, this study aimed (1) to construct a memory NF system that used intracranial electrodes to feedback neural activity on the language-dominant side of the MTL during memory encoding and (2) to verify whether neural activity and memory function in the MTL change with NF training. Two intractable epilepsy patients with implanted intracranial electrodes underwent at least five sessions of memory NF training to increase the theta power in the MTL. There was an increase in theta power and a decrease in fast beta and gamma powers in one of the patients in the late stage of memory NF sessions. NF signals were not correlated with memory function. Despite its limitations as a pilot study, to our best knowledge, this study is the first to report that intracranial NF may modulate neural activity in the MTL, which is involved in memory encoding. The findings provide important insights into the future development of NF systems for the artificial reorganization of memory functions.

Hippocampal activity predicts contextual misattribution of false memories

Failure of contextual retrieval can lead to false recall, wherein people retrieve an item or experience that occurred in a different context or did not occur at all. Whereas the hippocampus is thought to play a crucial role in memory retrieval, we lack understanding of how the hippocampus supports retrieval of items related to a target context while disregarding related but irrelevant information. Using direct electrical recordings from the human hippocampus, we investigate the neural process underlying contextual misattribution of false memories. In two large datasets, we characterize key physiological differences between correct and false recalls that emerge immediately prior to vocalization. By differentiating between false recalls that share high or low contextual similarity with the target context, we show that low-frequency activity (6 to 18 Hz) in the hippocampus tracks similarity between the current and retrieved context. Applying multivariate decoding methods, we were able to reliably predict the contextual source of the to-be-recalled item. Our findings elucidate one of the hallmark features of episodic memory: our ability to distinguish between memories that were formed on different occasions.

Testing the generalization of neural representations

Multivariate analysis methods are widely used in neuroscience to investigate the presence and structure of neural representations. Representational similarities across time or contexts are often investigated using pattern generalization, e.g. by training and testing multivariate decoders in different contexts, or by comparable pattern-based encoding methods. It is however unclear what conclusions can be validly drawn on the underlying neural representations when significant pattern generalization is found in mass signals such as LFP, EEG, MEG, or fMRI. Using simulations, we show how signal mixing and dependencies between measurements can drive significant pattern generalization even though the true underlying representations are orthogonal. We suggest that, using an accurate estimate of the expected pattern generalization given identical representations, it is nonetheless possible to test meaningful hypotheses about the generalization of neural representations. We offer such an estimate of the expected magnitude of pattern generalization and demonstrate how this measure can be used to assess the similarity and differences of neural representations across time and contexts.

Paving the Way for Memory Enhancement: Development and Examination of a Neurofeedback System Targeting the Medial Temporal Lobe

Neurofeedback (NF) shows promise in enhancing memory, but its application to the medial temporal lobe (MTL) still needs to be studied. Therefore, we aimed to develop an NF system for the memory function of the MTL and examine neural activity changes and memory task score changes through NF training. We created a memory NF system using intracranial electrodes to acquire and visualise the neural activity of the MTL during memory encoding. Twenty trials of a tug-of-war game per session were employed for NF and designed to control neural activity bidirectionally (Up/Down condition). NF training was conducted with three patients with drug-resistant epilepsy, and we observed an increasing difference in NF signal between conditions (Up-Down) as NF training progressed. Similarities and negative correlation tendencies between the transition of neural activity and the transition of memory function were also observed. Our findings demonstrate NF's potential to modulate MTL activity and memory encoding. Future research needs further improvements to the NF system to validate its effects on memory functions. Nonetheless, this study represents a crucial step in understanding NF's application to memory and provides valuable insights into developing more efficient memory enhancement strategies.

Functional and anatomical connectivity predict brain stimulation's mnemonic effects

Closed-loop direct brain stimulation is a promising tool for modulating neural activity and behavior. However, it remains unclear how to optimally target stimulation to modulate brain activity in particular brain networks that underlie particular cognitive functions. Here, we test the hypothesis that stimulation's behavioral and physiological effects depend on the stimulation target's anatomical and functional network properties. We delivered closed-loop stimulation as 47 neurosurgical patients studied and recalled word lists. Multivariate classifiers, trained to predict momentary lapses in memory function, triggered stimulation of the lateral temporal cortex (LTC) during the study phase of the task. We found that LTC stimulation specifically improved memory when delivered to targets near white matter pathways. Memory improvement was largest for targets near white matter that also showed high functional connectivity to the brain's memory network. These targets also reduced low-frequency activity in this network, an established marker of successful memory encoding. These data reveal how anatomical and functional networks mediate stimulation's behavioral and physiological effects, provide further evidence that closed-loop LTC stimulation can improve episodic memory, and suggest a method for optimizing neuromodulation through improved stimulation targeting.

Biomarker-guided neuromodulation aids memory in traumatic brain injury

Traumatic brain injury (TBI) is a leading cause of cognitive disability in adults, often characterized by marked deficits in episodic memory and executive function. Prior studies have found that direct electrical stimulation of the temporal cortex yielded improved memory in epilepsy patients, but it is not clear if these results generalize to patients with a specific history of TBI. Here we asked whether applying closed-loop, direct electrical stimulation to lateral temporal cortex could reliably improve memory in a TBI cohort. Among a larger group of patients undergoing neurosurgical evaluation for refractory epilepsy, we recruited a subset of patients with a history of moderate-to-severe TBI. By analyzing neural data from indwelling electrodes as patients studied and recalled lists of words, we trained personalized machine-learning classifiers to predict momentary fluctuations in mnemonic function in each patient. We subsequently used these classifiers to trigger high-frequency stimulation of the lateral temporal cortex (LTC) at moments when memory was predicted to fail. This strategy yielded a 19% boost in recall performance on stimulated as compared with non-stimulated lists (P = 0.012). These results provide a proof-of-concept for using closed-loop stimulation of the brain in treatment of TBI-related memory impairment.

Neural similarity across task load relates to cognitive reserve and brain maintenance measures on the Letter Sternberg task: a longitudinal study

The aging process is characterized by change across several measures that index cognitive status and brain integrity. In the present study, 54 cognitively-healthy younger and older adults, were analyzed, longitudinally, on a verbal working memory task to investigate the effect of brain maintenance (i.e., cortical thickness) and cognitive reserve (i.e., NART IQ as proxy) factors on a derived measure of neural efficiency. Participants were scanned using fMRI while presented with the Letter Sternberg task, a verbal working memory task consisting of encoding, maintenance and retrieval phases, where cognitive load is manipulated by varying the number of presented items (i.e., between one and six letters). Via correlation analysis, we looked at region-level and whole-brain relationships between load levels within each phase and then computed a global task measure, what we term phase specificity, to analyze how similar neural responses were across load levels within each phase compared to between each phase. We found that longitudinal change in phase specificity was positively related to longitudinal change in cortical thickness, at both the whole-brain and regional level. Additionally, baseline NART IQ was positively related to longitudinal change in phase specificity over time. Furthermore, we found a longitudinal effect of sex on change in phase specificity, such that females displayed higher phase specificity over time. Cross-sectional findings aligned with longitudinal findings, with the notable exception of behavioral performance being positively linked to phase specificity cross-sectionally at baseline. Taken together, our findings suggest that phase specificity positively relates to brain maintenance and reserve factors and should be better investigated as a measure of neural efficiency.

Hotspot of human verbal memory encoding in the left anterior prefrontal cortex

Background

Treating memory and cognitive deficits requires knowledge about anatomical sites and neural activities to be targeted with particular therapies. Emerging technologies for local brain stimulation offer attractive therapeutic options but need to be applied to target specific neural activities, at distinct times, and in specific brain regions that are critical for memory formation.

Methods

The areas that are critical for successful encoding of verbal memory as well as the underlying neural activities were determined directly in the human brain with intracranial electrophysiological recordings in epilepsy patients. We recorded a broad range of spectral activities across the cortex of 135 patients as they memorised word lists for subsequent free recall.

Findings

The greatest differences in the spectral power between encoding subsequently recalled and forgotten words were found in low theta frequency (3–5 Hz) activities of the left anterior prefrontal cortex. This subsequent memory effect was proportionally greater in the lower frequency bands and in the more anterior cortical regions. We found the peak of this memory signal in a distinct part of the prefrontal cortex at the junction between the Broca's area and the frontal pole. The memory effect in this confined area was significantly higher (Tukey–Kramer test, p<0.05) than in other anatomically distinct areas.

Interpretation

Our results suggest a focal hotspot of human verbal memory encoding located in the higher-order processing region of the prefrontal cortex, which presents a prospective target for modulating cognitive functions in the human patients. The memory effect provides an electrophysiological biomarker of low frequency neural activities, at distinct times of memory encoding, and in one hotspot location in the human brain.

Funding

Open-access datasets were originally collected as part of a BRAIN Initiative project called Restoring Active Memory (RAM) funded by the Defence Advanced Research Project Agency (DARPA). CT, ML, MTK and this research were supported from the First Team grant of the Foundation for Polish Science co-financed by the European Union under the European Regional Development Fund.

Decoding Intracranial EEG With Machine Learning: A Systematic Review

Advances in intracranial electroencephalography (iEEG) and neurophysiology have enabled the study of previously inaccessible brain regions with high fidelity temporal and spatial resolution. Studies of iEEG have revealed a rich neural code subserving healthy brain function and which fails in disease states. Machine learning (ML), a form of artificial intelligence, is a modern tool that may be able to better decode complex neural signals and enhance interpretation of these data. To date, a number of publications have applied ML to iEEG, but clinician awareness of these techniques and their relevance to neurosurgery, has been limited. The present work presents a review of existing applications of ML techniques in iEEG data, discusses the relative merits and limitations of the various approaches, and examines potential avenues for clinical translation in neurosurgery. One-hundred-seven articles examining artificial intelligence applications to iEEG were identified from 3 databases. Clinical applications of ML from these articles were categorized into 4 domains: i) seizure analysis, ii) motor tasks, iii) cognitive assessment, and iv) sleep staging. The review revealed that supervised algorithms were most commonly used across studies and often leveraged publicly available timeseries datasets. We conclude with recommendations for future work and potential clinical applications.

Temporal lobe interictal spikes disrupt encoding and retrieval of verbal memory: A subregion analysis

OBJECTIVE

The medial temporal lobe (MTL) encodes and recalls memories and can be a predominant site for interictal spikes (IS) in patients with focal epilepsy. It is unclear whether memory deficits are due to IS in the MTL producing a transient decline. Here, we investigated whether IS in the MTL subregions and lateral temporal cortex impact episodic memory encoding and recall.

METHODS

Seventy-eight participants undergoing presurgical evaluation for medically refractory focal epilepsy with depth electrodes placed in the temporal lobe participated in a verbal free recall task. IS were manually annotated during the pre-encoding, encoding, and recall epochs. We examined the effect of IS on word recall using mixed-effects logistic regression.

RESULTS

IS in the left hippocampus (odds ratio [OR] = .73, 95% confidence interval [CI] = .63-.84, p < .001) and left middle temporal gyrus (OR = .46, 95% CI = .27-.78, p < .05) during word encoding decreased subsequent recall performance. Within the left hippocampus, this effect was specific for area CA1 (OR = .76, 95% CI = .66-.88, p < .01) and dentate gyrus (OR = .74, 95% CI = .62-.89, p < .05). IS in other MTL subregions or inferior and superior temporal gyrus and IS occurring during the prestimulus window did not affect word encoding (p > .05). IS during retrieval in right hippocampal (OR = .22, 95% CI = .08-.63, p = .01) and parahippocampal regions (OR = .24, 95% CI = .07-.8, p < .05) reduced the probability of recalling a word.

SIGNIFICANCE

IS in medial and lateral temporal cortex contribute to transient memory decline during verbal episodic memory.

Dissociable oscillatory theta signatures of memory formation in the developing brain

Understanding complex human brain functions is critically informed by studying such functions during development. Here, we addressed a major gap in models of human memory by leveraging rare direct electrophysiological recordings from children and adolescents. Specifically, memory relies on interactions between the medial temporal lobe (MTL) and prefrontal cortex (PFC), and the maturation of these interactions is posited to play a key role in supporting memory development. To understand the nature of MTL-PFC interactions, we examined subdural recordings from MTL and PFC in 21 neurosurgical patients aged 5.9-20.5 years as they performed an established scene memory task. We determined signatures of memory formation by comparing the study of subsequently recognized to forgotten scenes in single trials. Results establish that MTL and PFC interact via two distinct theta mechanisms, an ∼3-Hz oscillation that supports amplitude coupling and slows down with age and an ∼7-Hz oscillation that supports phase coupling and speeds up with age. Slow and fast theta interactions immediately preceding scene onset further explained age-related differences in recognition performance. Last, with additional diffusion imaging data, we linked both functional mechanisms to the structural maturation of the cingulum tract. Our findings establish system-level dynamics of memory formation and suggest that MTL and PFC interact via increasingly dissociable mechanisms as memory improves across development.

Looking for the neural basis of memory

Memory neuroscientists often measure neural activity during task trials designed to recruit specific memory processes. Behavior is championed as crucial for deciphering brain-memory linkages but is impoverished in typical experiments that rely on summary judgments. We criticize this approach as being blind to the multiple cognitive, neural, and behavioral processes that occur rapidly within a trial to support memory. Instead, time-resolved behaviors such as eye movements occur at the speed of cognition and neural activity. We highlight successes using eye-movement tracking with in vivo electrophysiology to link rapid hippocampal oscillations to encoding and retrieval processes that interact over hundreds of milliseconds. This approach will improve research on the neural basis of memory because it pinpoints discrete moments of brain-behavior-cognition correspondence.

Lateralized Contributions of Medial Prefrontal Cortex Network to Episodic Memory Deficits in Subjects With Amnestic Mild Cognitive Impairment

Both episodic memory and executive function are impaired in amnestic mild cognitive impairment (aMCI) subjects, but it is unclear if these impairments are independent or interactive. The present study aimed to explore the relationship between episodic memory deficits and executive function deficits, and the underlying functional mechanisms in aMCI subjects. Thirty-one aMCI subjects and 27 healthy subjects underwent neuropsychological tests and multimodal magnetic resonance imaging (MRI) scans. Hippocampal networks and medial prefrontal cortex (MPFC) networks were identified based on resting-sate functional MRI (fMRI) data. AMCI subjects displayed lower episodic memory scores and executive function scores than control subjects, and the episodic memory scores were positively correlated with the executive function scores in aMCI subjects. Brain network analyses showed an interaction between the hippocampal networks and the MPFC networks, and the interaction was significantly associated with the episodic memory scores and the executive function scores. Notably, aMCI subjects displayed higher functional connectivity (FC) of the right hippocampal network with the right prefrontal cortex than did control subjects, but this difference disappeared when controlling for the MPFC networks. Furthermore, the effects of the MPFC networks on the hippocampal networks were significantly associated with the episodic memory scores in aMCI subjects. The present findings suggested that the episodic memory deficits in aMCI subjects could be partially underpinned by the modulation of the MPFC networks on the hippocampal networks.

Distinct cortical systems reinstate the content and context of episodic memories

Episodic recall depends upon the reinstatement of cortical activity present during the formation of a memory. Evidence from functional neuroimaging and invasive recordings in humans suggest that reinstatement organizes our memories by time or content, yet the neural systems involved in reinstating these unique types of information remain unclear. Here, combining computational modeling and intracranial recordings from 69 epilepsy patients, we show that two cortical systems uniquely reinstate the semantic content and temporal context of previously studied items during free recall. Examining either the posterior medial or anterior temporal networks, we find that forward encoding models trained on the brain's response to the temporal and semantic attributes of items can predict the serial position and semantic category of unseen items. During memory recall, these models uniquely link reinstatement of temporal context and semantic content to these posterior and anterior networks, respectively. These findings demonstrate how specialized cortical systems enable the human brain to target specific memories.

Highlights From AES2020, a Virtual American Epilepsy Society Experience

Due to COVID-19 a live, in-person meeting was not possible for the American Epilepsy Society in 2020. An alternative, virtual event, the AES2020, was held instead. AES2020 was a great success with 4679 attendees from 70 countries. The educational content was outstanding and spanned the causes, treatments, and outcomes from epileptic encephalopathy to the iatrogenicity of epilepsy interventions to neurocognitive disabilities to the approach to neocortical epilepsies. New gene therapy approaches such as antisense oligonucleotide treatment for Dravet syndrome were introduced and neuromodulation devices were discussed. There were many other topics discussed in special interest groups and investigators' workshops. A highlight was having a Nobel prize winner speak about memory processing. Human intracranial electrophysiology contributes insights into memory processing and complements animal work. In a special COVID symposium, the impact of COVID on patients with epilepsy was reviewed. Telehealth has been expanded rapidly and may be well suited for some parts of epilepsy care. In summary, the epilepsy community was alive and engaged despite being limited to a virtual platform.

Biomarkers of memory variability in traumatic brain injury

Traumatic brain injury is a leading cause of cognitive disability and is often associated with significant impairment in episodic memory. In traumatic brain injury survivors, as in healthy controls, there is marked variability between individuals in memory ability. Using recordings from indwelling electrodes, we characterized and compared the oscillatory biomarkers of mnemonic variability in two cohorts of epilepsy patients: a group with a history of moderate-to-severe traumatic brain injury (n = 37) and a group of controls without traumatic brain injury (n = 111) closely matched for demographics and electrode coverage. Analysis of these recordings demonstrated that increased high-frequency power and decreased theta power across a broad set of brain regions mark periods of successful memory formation in both groups. As features in a logistic-regression classifier, spectral power biomarkers effectively predicted recall probability, with little difference between traumatic brain injury patients and controls. The two groups also displayed similar patterns of theta-frequency connectivity during successful encoding periods. These biomarkers of successful memory, highly conserved between traumatic brain injury patients and controls, could serve as the basis for novel therapies that target disordered memory across diverse forms of neurological disease.

Insights into human cognition from intracranial EEG: A review of audition, memory, internal cognition, and causality

By recording neural activity directly from the human brain, researchers gain unprecedented insight into how neurocognitive processes unfold in real time. We first briefly discuss how intracranial electroencephalography (iEEG) recordings, performed for clinical practice, are used to study human cognition with the spatiotemporal and single-trial precision traditionally limited to non-human animal research. We then delineate how studies using iEEG have informed our understanding of issues fundamental to human cognition: auditory prediction, working and episodic memory, and internal cognition. We also discuss the potential of iEEG to infer causality through the manipulation or 'engineering' of neurocognitive processes via spatiotemporally precise electrical stimulation. We close by highlighting limitations of iEEG, potential of burgeoning techniques to further increase spatiotemporal precision, and implications for future research using intracranial approaches to understand, restore, and enhance human cognition.

A Gaussian Process Model of Human Electrocorticographic Data

We present a model-based method for inferring full-brain neural activity at millimeter-scale spatial resolutions and millisecond-scale temporal resolutions using standard human intracranial recordings. Our approach makes the simplifying assumptions that different people's brains exhibit similar correlational structure, and that activity and correlation patterns vary smoothly over space. One can then ask, for an arbitrary individual's brain: given recordings from a limited set of locations in that individual's brain, along with the observed spatial correlations learned from other people's recordings, how much can be inferred about ongoing activity at other locations throughout that individual's brain? We show that our approach generalizes across people and tasks, thereby providing a person- and task-general means of inferring high spatiotemporal resolution full-brain neural dynamics from standard low-density intracranial recordings.

Invertible generalized synchronization: A putative mechanism for implicit learning in neural systems

Regardless of the marked differences between biological and artificial neural systems, one fundamental similarity is that they are essentially dynamical systems that can learn to imitate other dynamical systems whose governing equations are unknown. The brain is able to learn the dynamic nature of the physical world via experience; analogously, artificial neural systems such as reservoir computing networks (RCNs) can learn the long-term behavior of complex dynamical systems from data. Recent work has shown that the mechanism of such learning in RCNs is invertible generalized synchronization (IGS). Yet, whether IGS is also the mechanism of learning in biological systems remains unclear. To shed light on this question, we draw inspiration from features of the human brain to propose a general and biologically feasible learning framework that utilizes IGS. To evaluate the framework's relevance, we construct several distinct neural network models as instantiations of the proposed framework. Regardless of their particularities, these neural network models can consistently learn to imitate other dynamical processes with a biologically feasible adaptation rule that modulates the strength of synapses. Further, we observe and theoretically explain the spontaneous emergence of four distinct phenomena reminiscent of cognitive functions: (i) learning multiple dynamics; (ii) switching among the imitations of multiple dynamical systems, either spontaneously or driven by external cues; (iii) filling-in missing variables from incomplete observations; and (iv) deciphering superimposed input from different dynamical systems. Collectively, our findings support the notion that biological neural networks can learn the dynamic nature of their environment through the mechanism of IGS.

Theta Oscillations in Human Memory

Theta frequency (4-8 Hz) fluctuations of the local field potential have long been implicated in learning and memory. Human studies of episodic memory, however, have provided mixed evidence for theta's role in successful learning and remembering. Re-evaluating these conflicting findings leads us to conclude that: (i) successful memory is associated both with increased narrow-band theta oscillations and a broad-band tilt of the power spectrum; (ii) theta oscillations specifically support associative memory, whereas the spectral tilt reflects a general index of activation; and (iii) different cognitive contrasts (generalized versus specific to memory), recording techniques (invasive versus noninvasive), and referencing schemes (local versus global) alter the balance between the two phenomena to make one or the other more easily detectable.

Reactivated Spatial Context Guides Episodic Recall

The medial temporal lobe (MTL) is known as the locus of spatial coding and episodic memory, but the interaction between these cognitive domains as well as the extent to which they rely on common neurophysiological mechanisms is poorly understood. Here, we use intracranial electroencephalography and a hybrid spatial-episodic memory task (29 subjects, 15 female) to determine how spatial information is dynamically reactivated in subregions of the human MTL and how this reactivation guides recall of episodic information. Our results implicate theta oscillations across the MTL as a common neurophysiological substrate for spatial coding in navigation and episodic recall. We further show that our index of retrieved spatial context is high in the hippocampus (HC) in an early time window preceding recall. Closer to recall, it decreases in the HC and increases in the parahippocampal gyrus. Finally, we demonstrate that hippocampal theta phase modulates parahippocampal gamma amplitude during retrieval of spatial context, suggesting a role for cross-frequency coupling in coding and transmitting retrieved spatial information.SIGNIFICANCE STATEMENT By recording from the human medial temporal lobe (MTL) while subjects recall items experienced in a virtual environment, we establish a direct relation between the strength of theta activity during memory search and the extent to which memories are organized by their spatial locations. We thereby pinpoint a role for theta oscillations in accessing the "cognitive map" during episodic retrieval and further highlight the dynamic interplay of hippocampus and extrahippocampal MTL in representing retrieved spatial context. Our results provide an important step toward a unified theory of MTL function encompassing its role in spatial navigation and episodic memory.

Voxel-based analysis and multivariate pattern analysis of diffusion tensor imaging study in anti-NMDA receptor encephalitis

PURPOSE

This study aimed to investigate brain white matter (WM) changes and their relationship to cognition in patients with anti-N-methyl-D-aspartate (anti-NMDA) receptor encephalitis. Multivariate pattern analysis (MVPA) was used to explore brain regions that play an important role in classification.

METHODS

Fifteen patients and fifteen controls underwent Montreal Cognitive Assessment (MoCA) and diffusion tensor imaging. Based on fractional anisotropy (FA) and mean diffusivity (MD) for MVPA classification, the weights of each brain region were calculated.

RESULTS

Compared with the controls, the patients showed an FA reduction in right middle temporal gyrus, left middle cerebellar peduncle, right praecuneus, and an MD increase in left medial temporal gyrus and left frontal lobe. The MoCA score for patients was lower than controls, especially in executive function, fluency, delayed recall and visual perception items. The FA value of right praecuneus was positively correlated with total MoCA score and fluency score. The MD of left frontal lobe was negatively correlated with total MoCA score, and MD of the left medial temporal gyrus was positively correlated with delayed recall. The accuracy, sensitivity and specificity of classification based on FA were 70%, 60% and 80%, respectively. Based on MD, they were each 80%. The brain regions with large weights from FA and MD overlap in temporal lobe, cerebellum and hippocampus.

CONCLUSIONS

These results suggest that WM changes are associated with cognitive deficits. MVPA based on FA and MD has good classification ability. Our study may provide new insights into the pathophysiological mechanisms of residual cognitive deficits.

Tonic Resting State Hubness Supports High Gamma Activity Defined Verbal Memory Encoding Network in Epilepsy

High gamma activity (HGA) of verbal-memory encoding using invasive-electroencephalogram has laid the foundation for numerous studies testing the integrity of memory in diseased populations. Yet, the functional connectivity characteristics of networks subserving these memory linkages remains uncertain. By integrating this electrophysiological biomarker of memory encoding from IEEG with resting-state BOLD fluctuations, we estimated the segregation and hubness of HGA-memory regions in drug-resistant epilepsy patients and matched healthy controls. HGA-memory regions express distinctly different hubness compared to neighboring regions in health and in epilepsy, and this hubness was more relevant than segregation in predicting verbal memory encoding. The HGA-memory network comprised regions from both the cognitive control and primary processing networks, validating that effective verbal-memory encoding requires integrating brain functions, and is not dominated by a central cognitive core. Our results demonstrate a tonic intrinsic set of functional connectivity, which provides the necessary conditions for effective, phasic, task-dependent memory encoding.

Comparison of fMRI correlates of successful episodic memory encoding in temporal lobe epilepsy patients and healthy controls

Intra-cranial electroencephalographic brain recordings (iEEG) provide a powerful tool for investigating the neural processes supporting episodic memory encoding and form the basis of experimental therapies aimed at improving memory dysfunction. However, given the invasiveness of iEEG, investigations are constrained to patients with drug-resistant epilepsy for whom such recordings are clinically indicated. Particularly in the case of temporal lobe epilepsy (TLE), neuropathology and the possibility of functional reorganization are potential constraints on the generalizability of intra-cerebral findings and pose challenges to the development of therapies for memory disorders stemming from other etiologies. Here, samples of TLE (N = 16; all of whom had undergone iEEG) and age-matched healthy control (N = 19) participants underwent fMRI as they studied lists of concrete nouns. fMRI BOLDresponses elicited by the study words were segregated according to subsequent performance on tests of delayed free recall and recognition memory. Subsequent memory effects predictive of both successful recall and recognition memory were evident in several neural regions, most prominently in the left inferior frontal gyrus, and did not demonstrate any group differences. Behaviorally, the groups did not differ in overall recall performance or in the strength of temporal contiguity effects. However, group differences in serial position effects and false alarm rates were evident during the free recall and recognition memory tasks, respectively. Despite these behavioral differences, neuropathology associated with temporal lobe epilepsy was apparently insufficient to give rise to detectable differences in the functional neuroanatomy of episodic memory encoding relative to neurologically healthy controls. The findings provide reassurance that iEEG findings derived from experimental paradigms similar to those employed here generalize to the neurotypical population.

Functional control of electrophysiological network architecture using direct neurostimulation in humans

Chronically implantable neurostimulation devices are becoming a clinically viable option for treating patients with neurological disease and psychiatric disorders. Neurostimulation offers the ability to probe and manipulate distributed networks of interacting brain areas in dysfunctional circuits. Here, we use tools from network control theory to examine the dynamic reconfiguration of functionally interacting neuronal ensembles during targeted neurostimulation of cortical and subcortical brain structures. By integrating multimodal intracranial recordings and diffusion-weighted imaging from patients with drug-resistant epilepsy, we test hypothesized structural and functional rules that predict altered patterns of synchronized local field potentials. We demonstrate the ability to predictably reconfigure functional interactions depending on stimulation strength and location. Stimulation of areas with structurally weak connections largely modulates the functional hubness of downstream areas and concurrently propels the brain towards more difficult-to-reach dynamical states. By using focal perturbations to bridge large-scale structure, function, and markers of behavior, our findings suggest that stimulation may be tuned to influence different scales of network interactions driving cognition.

Brain stimulation devices capable of perturbing the physiological state of neural systems are rapidly gaining popularity for their potential to treat neurological and psychiatric disease. A root problem is that underlying dysfunction spans a large-scale network of brain regions, requiring the ability to control the complex interactions between multiple brain areas. Here, we use tools from network control theory to examine the dynamic reconfiguration of functionally interacting neuronal ensembles during targeted neurostimulation of cortical and subcortical brain structures. We demonstrate the ability to predictably reconfigure patterns of interactions between functional brain areas by modulating the strength and location of stimulation. Our findings have high significance for designing stimulation protocols capable of modulating distributed neural circuits in the human brain.

Dynamic Theta Networks in the Human Medial Temporal Lobe Support Episodic Memory

The medial temporal lobe (MTL) is a locus of episodic memory in the human brain. It is comprised of cytologically distinct subregions that, in concert, give rise to successful encoding and retrieval of context-dependent memories. However, the functional connections between these subregions are poorly understood. To determine functional connectivity among MTL subregions, we had 131 subjects fitted with indwelling electrodes perform a verbal memory task and asked how encoding or retrieval correlated with inter-regional synchronization. Using phase-based measures of connectivity, we found that synchronous theta (4-8 Hz) activity underlies successful episodic memory. During encoding, we observed a dynamic pattern of connections converging on the left entorhinal cortex, beginning with the perirhinal cortex and shifting through hippocampal subfields. Retrieval-associated networks demonstrated enhanced involvement of the subiculum and CA1, reflecting a substantial reorganization of the encoding network. We posit that coherent theta activity within the MTL marks periods of successful memory, but distinct patterns of connectivity dissociate key stages of memory processing.

Consistent Gradient of Performance and Decoding of Stimulus Type and Valence From Local and Network Activity

The individual differences approach focuses on the variation of behavioral and neural signatures across subjects. In this context, we searched for intracranial neural markers of performance in three individuals with distinct behavioral patterns (efficient, borderline, and inefficient) in a dual-valence task assessing facial and lexical emotion recognition. First, we performed a preliminary study to replicate well-established evoked responses in relevant brain regions. Then, we examined time series data and network connectivity, combined with multivariate pattern analyses and machine learning, to explore electrophysiological differences in resting-state versus task-related activity across subjects. Next, using the same methodological approach, we assessed the neural decoding of performance for different dimensions of the task. The classification of time series data mirrored the behavioral gradient across subjects for stimulus type but not for valence. However, network-based measures reflected the subjects' hierarchical profiles for both stimulus types and valence. Therefore, this measure serves as a sensitive marker for capturing distributed processes such as emotional valence discrimination, which relies on an extended set of regions. Network measures combined with classification methods may offer useful insights to study single subjects and understand inter-individual performance variability. Promisingly, this approach could eventually be extrapolated to other neuroscientific techniques.

Neural activity reveals interactions between episodic and semantic memory systems during retrieval

Whereas numerous findings support a distinction between episodic and semantic memory, it is now widely acknowledged that these two forms of memory interact during both encoding and retrieval. The precise nature of this interaction, however, remains poorly understood. To examine the role of semantic organization during episodic encoding and retrieval, we recorded intracranial encephalographic signals as 69 neurosurgical patients studied and subsequently recalled categorized and unrelated word lists. Applying multivariate classifiers to neural recordings, we were able to reliably predict encoding success, retrieval success, and temporal and categorical clustering during recall. By assessing how these classifiers generalized across list types, we identified specific retrieval processes that predicted recall of categorized lists and distinguished between recall transitions within and between category clusters. These results particularly implicate retrieval (rather than encoding) processes in the categorical organization of episodic memories. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Lateralized hippocampal oscillations underlie distinct aspects of human spatial memory and navigation

The hippocampus plays a vital role in various aspects of cognition including both memory and spatial navigation. To understand electrophysiologically how the hippocampus supports these processes, we recorded intracranial electroencephalographic activity from 46 neurosurgical patients as they performed a spatial memory task. We measure signals from multiple brain regions, including both left and right hippocampi, and we use spectral analysis to identify oscillatory patterns related to memory encoding and navigation. We show that in the left but not right hippocampus, the amplitude of oscillations in the 1–3-Hz “low theta” band increases when viewing subsequently remembered object–location pairs. In contrast, in the right but not left hippocampus, low-theta activity increases during periods of navigation. The frequencies of these hippocampal signals are slower than task-related signals in the neocortex. These results suggest that the human brain includes multiple lateralized oscillatory networks that support different aspects of cognition.

Theta oscillations are implicated in memory formation. Here, the authors show that low-theta oscillations in the hippocampus are differentially modulated between each hemisphere, with oscillations in the left increasing when successfully learning object–location pairs and in the right during spatial navigation.

Closed-loop stimulation of temporal cortex rescues functional networks and improves memory

Memory failures are frustrating and often the result of ineffective encoding. One approach to improving memory outcomes is through direct modulation of brain activity with electrical stimulation. Previous efforts, however, have reported inconsistent effects when using open-loop stimulation and often target the hippocampus and medial temporal lobes. Here we use a closed-loop system to monitor and decode neural activity from direct brain recordings in humans. We apply targeted stimulation to lateral temporal cortex and report that this stimulation rescues periods of poor memory encoding. This system also improves later recall, revealing that the lateral temporal cortex is a reliable target for memory enhancement. Taken together, our results suggest that such systems may provide a therapeutic approach for treating memory dysfunction.