Neurofeedback helps to reveal a relationship between context reinstatement and memory retrieval

Decoding EEG for optimizing naturalistic memory

BACKGROUND

Spectral features of human electroencephalographic (EEG) recordings during learning predict subsequent recall variability.

NEW METHOD

Capitalizing on these fluctuating neural features, we develop a non-invasive closed-loop (NICL) system for real-time optimization of human learning. Participants play a virtual navigation-and-memory game; recording multi-session data across days allowed us to build participant-specific classification models of recall success. In subsequent closed-loop sessions, our platform manipulated the timing of memory encoding, selectively presenting items during periods of predicted good or poor memory function based on EEG features decoded in real time.

RESULTS

The induced memory effect (the difference between recall rates when presenting items during predicted good vs. poor learning periods) increased with the accuracy of neural decoding.

COMPARISON WITH EXISTING METHODS

This study demonstrates greater-than-chance memory decoding from EEG recordings in a naturalistic virtual navigation task with greater real-world validity than basic word-list recall paradigms. Here we modulate memory by timing stimulus presentation based on noninvasive scalp EEG recordings, whereas prior closed-loop studies for memory improvement involved intracranial recordings and direct electrical stimulation. Other noninvasive studies have investigated the use of neurofeedback or remedial study for memory improvement.

CONCLUSIONS

These findings present a proof-of-concept for using non-invasive closed-loop technology to optimize human learning and memory through principled stimulus timing, but only in those participants for whom classifiers reliably predict out-of-sample memory function.

Decoding context memories for threat in large-scale neural networks

Humans are often tasked with determining the degree to which a given situation poses threat. Salient cues present during prior events help bring online memories for context, which plays an informative role in this process. However, it is relatively unknown whether and how individuals use features of the environment to retrieve context memories for threat, enabling accurate inferences about the current level of danger/threat (i.e. retrieve appropriate memory) when there is a degree of ambiguity surrounding the present context. We leveraged computational neuroscience approaches (i.e. independent component analysis and multivariate pattern analyses) to decode large-scale neural network activity patterns engaged during learning and inferring threat context during a novel functional magnetic resonance imaging task. Here, we report that individuals accurately infer threat contexts under ambiguous conditions through neural reinstatement of large-scale network activity patterns (specifically striatum, salience, and frontoparietal networks) that track the signal value of environmental cues, which, in turn, allows reinstatement of a mental representation, primarily within a ventral visual network, of the previously learned threat context. These results provide novel insight into distinct, but overlapping, neural mechanisms by which individuals may utilize prior learning to effectively make decisions about ambiguous threat-related contexts as they navigate the environment.

Exploring protocol development: Implementing systematic contextual memory to enhance real-time fMRI neurofeedback

Objective

The goal of this study was to explore the development and implementation of a protocol for real-time fMRI neurofeedback (rtfMRI-nf) and to assess the potential for enhancing the selective brain activation using stimuli from Virtual Reality (VR). In this study we focused on two specific brain regions, supplementary motor area (SMA) and right inferior frontal gyrus (rIFG). Publications by other study groups have suggested impaired function in these specific brain regions in patients with the diagnoses Attention Deficit Hyperactivity Disorder (ADHD) and Tourette's Syndrome (TS). This study explored the development of a protocol to investigate if attention and contextual memory may be used to systematically strengthen the procedure of rtfMRI-nf.

Methods

We used open-science software and platforms for rtfMRI-nf and for developing a simulated repetition of the rtfMRI-nf brain training in VR. We conducted seven exploratory tests in which we updated the protocol at each step. During rtfMRI-nf, MRI images are analyzed live while a person is undergoing an MRI scan, and the results are simultaneously shown to the person in the MRI-scanner. By focusing the analysis on specific regions of the brain, this procedure can be used to help the person strengthen conscious control of these regions. The VR simulation of the same experience involved a walk through the hospital toward the MRI scanner where the training sessions were conducted, as well as a subsequent simulated repetition of the MRI training. The VR simulation was a 2D projection of the experience.The seven exploratory tests involved 19 volunteers. Through this exploration, methods for aiming within the brain (e.g. masks/algorithms for coordinate-system control) and calculations for the analyses (e.g. calculations based on connectivity versus activity) were updated by the project team throughout the project. The final procedure involved three initial rounds of rtfMRI-nf for learning brain strategies. Then, the volunteers were provided with VR headsets and given instructions for one week of use. Afterward, a new session with three rounds of rtfMRI-nf was conducted.

Results

Through our exploration of the indirect effect parameters - brain region activity (directed oxygenated blood flow), connectivity (degree of correlated activity in different regions), and neurofeedback score - the volunteers tended to increase activity in the reinforced brain regions through our seven tests. Updates of procedures and analyses were always conducted between pilots, and never within. The VR simulated repetition was tested in pilot 7, but the role of the VR contribution in this setting is unclear due to underpowered testing.

Conclusion

This proof-of-concept protocol implies how rtfMRI-nf may be used to selectively train two brain regions (SMA and rIFG). The method may likely be adapted to train any given region in the brain, but readers are advised to update and adapt the procedure to experimental needs.

INDUCING REPRESENTATIONAL CHANGE IN THE HIPPOCAMPUS THROUGH REAL-TIME NEUROFEEDBACK

When you perceive or remember one thing, other related things come to mind. This competition has consequences for how these items are later perceived, attended, or remembered. Such behavioral consequences result from changes in how much the neural representations of the items overlap, especially in the hippocampus. These changes can reflect increased (integration) or decreased (differentiation) overlap; previous studies have posited that the amount of coactivation between competing representations in cortex determines which will occur: high coactivation leads to hippocampal integration, medium coactivation leads to differentiation, and low coactivation is inert. However, those studies used indirect proxies for coactivation, by manipulating stimulus similarity or task demands. Here we induce coactivation of competing memories in visual cortex more directly using closed-loop neurofeedback from real-time fMRI. While viewing one object, participants were rewarded for implicitly activating the representation of another object as strongly as possible. Across multiple real-time fMRI training sessions, they succeeded in using the neurofeedback to induce coactivation. Compared with untrained objects, this coactivation led to behavioral and neural integration: The trained objects became harder for participants to discriminate in a categorical perception task and harder to decode from patterns of fMRI activity in the hippocampus.

Reward prediction error in learning-related behaviors

Learning is a complex process, during which our opinions and decisions are easily changed due to unexpected information. But the neural mechanism underlying revision and correction during the learning process remains unclear. For decades, prediction error has been regarded as the core of changes to perception in learning, even driving the learning progress. In this article, we reviewed the concept of reward prediction error, and the encoding mechanism of dopaminergic neurons and the related neural circuities. We also discussed the relationship between reward prediction error and learning-related behaviors, including reversal learning. We then demonstrated the evidence of reward prediction error signals in several neurological diseases, including Parkinson's disease and addiction. These observations may help to better understand the regulatory mechanism of reward prediction error in learning-related behaviors.

Targeted neurorehabilitation strategies in post-stroke aphasia

BACKGROUND

Aphasia is a debilitating language impairment, affecting millions of people worldwide. About 40% of stroke survivors develop chronic aphasia, resulting in life-long disability.

OBJECTIVE

This review examines extrinsic and intrinsic neuromodulation techniques, aimed at enhancing the effects of speech and language therapies in stroke survivors with aphasia.

METHODS

We discuss the available evidence supporting the use of transcranial direct current stimulation (tDCS), repetitive transcranial magnetic stimulation, and functional MRI (fMRI) real-time neurofeedback in aphasia rehabilitation.

RESULTS

This review systematically evaluates studies focusing on efficacy and implementation of specialized methods for post-treatment outcome optimization and transfer to functional skills. It considers stimulation target determination and various targeting approaches. The translation of neuromodulation interventions to clinical practice is explored, emphasizing generalization and functional communication. The review also covers real-time fMRI neurofeedback, discussing current evidence for efficacy and essential implementation parameters. Finally, we address future directions for neuromodulation research in aphasia.

CONCLUSIONS

This comprehensive review aims to serve as a resource for a broad audience of researchers and clinicians interested in incorporating neuromodulation for advancing aphasia care.

Enhancing learning and retention with distinctive virtual reality environments and mental context reinstatement

Memory is inherently context-dependent: internal and environmental cues become bound to learnt information, and the later absence of these cues can impair recall. Here, we developed an approach to leverage context-dependence to optimise learning of challenging, interference-prone material. While navigating through desktop virtual reality (VR) contexts, participants learnt 80 foreign words in two phonetically similar languages. Those participants who learnt each language in its own unique context showed reduced interference and improved one-week retention (92%), relative to those who learnt the languages in the same context (76%)-however, this advantage was only apparent if participants subjectively experienced VR-based contexts as "real" environments. A follow-up fMRI experiment confirmed that reinstatement of brain activity patterns associated with the original encoding context during word retrieval was associated with improved recall performance. These findings establish that context-dependence can be harnessed with VR to optimise learning and showcase the important role of mental context reinstatement.

RT-Cloud: A cloud-based software framework to simplify and standardize real-time fMRI

Real-time fMRI (RT-fMRI) neurofeedback has been shown to be effective in treating neuropsychiatric disorders and holds tremendous promise for future breakthroughs, both with regard to basic science and clinical applications. However, the prevalence of its use has been hampered by computing hardware requirements, the complexity of setting up and running an experiment, and a lack of standards that would foster collaboration. To address these issues, we have developed RT-Cloud (https://github.com/brainiak/rt-cloud), a flexible, cloud-based, open-source Python software package for the execution of RT-fMRI experiments. RT-Cloud uses standardized data formats and adaptable processing streams to support and expand open science in RT-fMRI research and applications. Cloud computing is a key enabling technology for advancing RT-fMRI because it eliminates the need for on-premise technical expertise and high-performance computing; this allows installation, configuration, and maintenance to be automated and done remotely. Furthermore, the scalability of cloud computing makes it easier to deploy computationally-demanding multivariate analyses in real time. In this paper, we describe how RT-Cloud has been integrated with open standards, including the Brain Imaging Data Structure (BIDS) standard and the OpenNeuro database, how it has been applied thus far, and our plans for further development and deployment of RT-Cloud in the coming years.

Stronger memory representation after memory reinstatement during retrieval in the human hippocampus

Memory retrieval allows us to reinstate previously encoded information but is also considered to contribute to memory enhancement. Retrieval-induced enhancement may involve processing to strengthen memory traces, but neural processing beyond reinstatement during retrieval remains elusive. Here, we show that hippocampal processing, different from memory reinstatement, exists during retrieval in the human brain. By tracking changes in the response patterns in the selected hippocampal and cortical regions over time during retrieval based on functional MRI, we found that the representation of associative memory in CA3/DG became stronger even after cortical memory reinstatement, while CA1 showed significant memory representation at retrieval onset with the cortical reinstatement, but not afterwards. This tendency was not observed in the condition without active retrieval. Moreover, subsequent long-term memory performance depended on the delayed CA3/DG representation during retrieval. These findings suggest that CA3/DG contributes to neural processing beyond memory reinstatement during retrieval, which may lead to memory enhancement.

Sharpening Working Memory With Real-Time Electrophysiological Brain Signals: Which Neurofeedback Paradigms Work?

Growing evidence supports the idea that the ultimate biofeedback is to reward sensory pleasure (e.g., enhanced visual clarity) in real-time to neural circuits that are associated with a desired performance, such as excellent memory retrieval. Neurofeedback is biofeedback that uses real-time sensory reward to brain activity associated with a certain performance (e.g., accurate and fast recall). Working memory is a key component of human intelligence. The challenges are in our current limited understanding of neurocognitive dysfunctions as well as in technical difficulties for closed-loop feedback in true real-time. Here we review recent advancements of real time neurofeedback to improve memory training in healthy young and older adults. With new advancements in neuromarkers of specific neurophysiological functions, neurofeedback training should be better targeted beyond a single frequency approach to include frequency interactions and event-related potentials. Our review confirms the positive trend that neurofeedback training mostly works to improve memory and cognition to some extent in most studies. Yet, the training typically takes multiple weeks with 2-3 sessions per week. We review various neurofeedback reward strategies and outcome measures. A well-known issue in such training is that some people simply do not respond to neurofeedback. Thus, we also review the literature of individual differences in psychological factors e.g., placebo effects and so-called "BCI illiteracy" (Brain Computer Interface illiteracy). We recommend the use of Neural modulation sensitivity or BCI insensitivity in the neurofeedback literature. Future directions include much needed research in mild cognitive impairment, in non-Alzheimer's dementia populations, and neurofeedback using EEG features during resting and sleep for memory enhancement and as sensitive outcome measures.

Closed-loop neuromodulation for studying spontaneous activity and causality

Having established that spontaneous brain activity follows meaningful coactivation patterns and correlates with behavior, researchers have turned their attention to understanding its function and behavioral significance. We suggest closed-loop neuromodulation as a neural perturbation tool uniquely well suited for this task. Closed-loop neuromodulation has primarily been viewed as an interventionist tool to teach subjects to directly control their own brain activity. We examine an alternative operant conditioning model of closed-loop neuromodulation which, through implicit feedback, can manipulate spontaneous activity at the network level, without violating the spontaneous or endogenous nature of the signal, thereby providing a direct test of network causality.

Real-Time Decoding of Attentional States Using Closed-Loop EEG Neurofeedback

Sustained attention is a cognitive ability to maintain task focus over extended periods of time (Mackworth, 1948; Chun, Golomb, & Turk-Browne, 2011). In this study, scalp electroencephalography (EEG) signals were processed in real time using a 32 dry-electrode system during a sustained visual attention task. An attention training paradigm was implemented, as designed in DeBettencourt, Cohen, Lee, Norman, and Turk-Browne (2015) in which the composition of a sequence of blended images is updated based on the participant's decoded attentional level to a primed image category. It was hypothesized that a single neurofeedback training session would improve sustained attention abilities. Twenty-two participants were trained on a single neurofeedback session with behavioral pretraining and posttraining sessions within three consecutive days. Half of the participants functioned as controls in a double-blinded design and received sham neurofeedback. During the neurofeedback session, attentional states to primed categories were decoded in real time and used to provide a continuous feedback signal customized to each participant in a closed-loop approach. We report a mean classifier decoding error rate of 34.3% (chance = 50%). Within the neurofeedback group, there was a greater level of task-relevant attentional information decoded in the participant's brain before making a correct behavioral response than before an incorrect response. This effect was not visible in the control group (interaction p=7.23e-4), which strongly indicates that we were able to achieve a meaningful measure of subjective attentional state in real time and control participants' behavior during the neurofeedback session. We do not provide conclusive evidence whether the single neurofeedback session per se provided lasting effects in sustained attention abilities. We developed a portable EEG neurofeedback system capable of decoding attentional states and predicting behavioral choices in the attention task at hand. The neurofeedback code framework is Python based and open source, and it allows users to actively engage in the development of neurofeedback tools for scientific and translational use.

Influences on memory for naturalistic visual episodes: sleep, familiarity, and traits differentially affect forms of recall

The memories we form are composed of information that we extract from multifaceted episodes. Static stimuli and paired associations have proven invaluable stimuli for understanding memory, but real-life events feature spatial and temporal dimensions that help form new retrieval paths. We ask how the ability to recall semantic, temporal, and spatial aspects (the "what, when, and where") of naturalistic episodes is affected by three influences-prior familiarity, postencoding sleep, and individual differences-by testing their influence on three forms of recall: cued recall, free recall, and the extent that recalled details are recombined for a novel prompt. Naturalistic videos of events with rare animals were presented to 115 participants, randomly assigned to receive a 12- or 24-h delay with sleep and/or wakefulness. Participants' immediate and delayed recall was tested and coded by its spatial, temporal, and semantic content. We find that prior familiarity with items featured in events improved cued recall, but not free recall, particularly for temporal and spatial details. In contrast, postencoding sleep, relative to wakefulness, improved free recall, but not cued recall, of all forms of content. Finally, individuals with higher trait scores in the Survey of Autobiographical Memory spontaneously incorporated more spatial details during free recall, and more event details (at a trend level) in a novel recombination recall task. These findings show that prior familiarity, postencoding sleep, and memory traits can each enhance a different form of recall. More broadly, this work highlights that recall is heterogeneous in response to different influences on memory.

Nonmonotonic Plasticity: How Memory Retrieval Drives Learning

What are the principles that govern whether neural representations move apart (differentiate) or together (integrate) as a function of learning? According to supervised learning models that are trained to predict outcomes in the world, integration should occur when two stimuli predict the same outcome. Numerous findings support this, but - paradoxically - some recent fMRI studies have found that pairing different stimuli with the same associate causes differentiation, not integration. To explain these and related findings, we argue that supervised learning needs to be supplemented with unsupervised learning that is driven by spreading activation in a U-shaped way, such that inactive memories are not modified, moderate activation of memories causes weakening (leading to differentiation), and higher activation causes strengthening (leading to integration).