Early Visual Cortex Stimulation Modifies Well-Consolidated Perceptual Gains

Convolutional neural networks uncover the dynamics of human visual memory representations over time

The ability to accurately retrieve visual details of past events is a fundamental cognitive function relevant for daily life. While a visual stimulus contains an abundance of information, only some of it is later encoded into long-term memory representations. However, an ongoing challenge has been to isolate memory representations that integrate various visual features and uncover their dynamics over time. To address this question, we leveraged a novel combination of empirical and computational frameworks based on the hierarchal structure of convolutional neural networks and their correspondence to human visual processing. This enabled to reveal the contribution of different levels of visual representations to memory strength and their dynamics over time. Visual memory strength was measured with distractors selected based on their shared similarity to the target memory along low or high layers of the convolutional neural network hierarchy. The results show that visual working memory relies similarly on low and high-level visual representations. However, already after a few minutes and on to the next day, visual memory relies more strongly on high-level visual representations. These findings suggest that visual representations transform from a distributed to a stronger high-level conceptual representation, providing novel insights into the dynamics of visual memory over time.

Distinct Neural Plasticity Enhancing Visual Perception

The developed human brain shows remarkable plasticity following perceptual learning, resulting in improved visual sensitivity. However, such improvements commonly require extensive stimuli exposure. Here we show that efficiently enhancing visual perception with minimal stimuli exposure recruits distinct neural mechanisms relative to standard repetition-based learning. Participants (n = 20, 12 women, 8 men) encoded a visual discrimination task, followed by brief memory reactivations of only five trials each performed on separate days, demonstrating improvements comparable with standard repetition-based learning (n = 20, 12 women, 8 men). Reactivation-induced learning engaged increased bilateral intraparietal sulcus (IPS) activity relative to repetition-based learning. Complementary evidence for differential learning processes was further provided by temporal-parietal resting functional connectivity changes, which correlated with behavioral improvements. The results suggest that efficiently enhancing visual perception with minimal stimuli exposure recruits distinct neural processes, engaging higher-order control and attentional resources while leading to similar perceptual gains. These unique brain mechanisms underlying improved perceptual learning efficiency may have important implications for daily life and in clinical conditions requiring relearning following brain damage.

Learning of the same task subserved by substantially different mechanisms between patients with body dysmorphic disorder and healthy individuals

It has remained unclear whether individuals with psychiatric disorders involving altered visual processing employ similar neuronal mechanisms during perceptual learning of a visual task. We investigated this question by training patients with body dysmorphic disorder, a psychiatric disorder characterized by distressing or impairing preoccupation with nonexistent or slight defects in one's physical appearance, and healthy controls on a visual detection task for human faces with low spatial frequency components. Brain activation during task performance was measured with functional magnetic resonance imaging before the beginning and after the end of behavioral training. Both groups of participants improved performance on the trained task to a similar extent. However, neuronal changes in the fusiform face area were substantially different between groups such that activation for low spatial frequency faces in the right fusiform face area increased after training in body dysmorphic disorder patients but decreased in controls. Moreover, functional connectivity between left and right fusiform face area decreased after training in patients but increased in controls. Our results indicate that neuronal mechanisms involved in perceptual learning of a face detection task differ fundamentally between body dysmorphic disorder patients and controls. Such different neuronal mechanisms in body dysmorphic disorder patients might reflect the brain's adaptations to altered functions imposed by the psychiatric disorder.

Sensory alterations in post-traumatic stress disorder

PTSD is characterized by difficulties in accurately evaluating the threat value of sensory stimuli. While the role of canonical fear and threat neural circuitry in this ability has been well studied, recent lines of evidence suggest a need to include more emphasis on sensory processing in the conceptualization of PTSD symptomology. Specifically, studies have demonstrated a strong association between variability in sensory processing regions and the severity of PTSD symptoms. In this review, we summarize recent findings that underscore the importance of sensory processing in PTSD, in addition to the structural and functional characteristics of associated sensory brain regions. First, we discuss the link between PTSD and various behavioral aspects of sensory processing. This is followed by a discussion of recent findings that link PTSD to variability in the structure of both gray and white matter in sensory brain regions. We then delve into how brain activity (measured with task-based and resting-state functional imaging) in sensory regions informs our understanding of PTSD symptomology.

Learning of the same task subserved by substantially different mechanisms between patients with Body Dysmorphic Disorder and healthy individuals

It is generally believed that learning of a perceptual task involving low-level neuronal mechanisms is similar between individuals. However, it is unclear whether this assumption also applies to individuals with psychiatric disorders that are known to have altered brain activation during visual processing. We investigated this question in patients with body dysmorphic disorder (BDD), a psychiatric disorder characterized by distressing or impairing preoccupation with nonexistent or slight defects in one's physical appearance, and in healthy controls. Participants completed six training sessions on separate days on a visual detection task for human faces with low spatial frequency (LSF) components. Brain activation during task performance was measured with functional magnetic resonance imaging (fMRI) on separate days prior to and after training. The behavioral results showed that both groups of participants improved on the visual detection task to a similar extent through training. Despite this similarity in behavioral improvement, neuronal changes in the Fusiform Face Area (FFA), a core cortical region involved in face processing, with training were substantially different between groups. First, activation in the right FFA for LSF faces relative to High Spatial Frequency (HSF) faces that were used as an untrained control increased after training in BDD patients but decreased in controls. Second, resting state functional connectivity between left and right FFAs decreased after training in BDD patients but increased in controls. Contrary to the assumption that learning of a perceptual task is subserved by the same neuronal mechanisms across individuals, our results indicate that the neuronal mechanisms involved in learning of a face detection task differ fundamentally between patients with BDD and healthy individuals. The involvement of different neuronal mechanisms for learning of even simple perceptual tasks in patients with BDD might reflect the brain's adaptations to altered functions imposed by the psychiatric disorder.

Modulating temporal dynamics of performance across retinotopic locations enhances the generalization of perceptual learning

Human visual perception can be improved through perceptual learning. However, such learning is often specific to stimulus and learning conditions. Here, we explored how temporal dynamics of performance across conditions impact learning generalization. Participants performed a visual task, with the target at retinotopic location A. Then, the target was presented at location B either immediately after location A (same-session performance) or following a 48h consolidation period (different-session performance). Long-term generalization was measured the following week. Following initial training, both groups demonstrated generalization, consistent with previous accounts of fast learning. However, long-term generalization was enhanced in the same-session performance group. Consistently, improvements at locations A and B were correlated only following same-session performance, implying an integrated learning process across locations. The results support a new account of perceptual learning and generalization dynamics, suggesting that the temporal proximity of learning and consolidation of different conditions may integrate correlated learning processes, facilitating generalized learning.

Effects of repetitive transcranial magnetic stimulation and their underlying neural mechanisms evaluated with magnetic resonance imaging-based brain connectivity network analyses

Repetitive transcranial magnetic stimulation (rTMS) is a noninvasive brain modulation and rehabilitation technique used in patients with neuropsychiatric diseases. rTMS can structurally remodel or functionally induce activities of specific cortical regions and has developed to an important therapeutic method in such patients. Magnetic resonance imaging (MRI) provides brain data that can be used as an explanation tool for the neural mechanisms underlying rTMS effects; brain alterations related to different functions or structures may be reflected in changes in the interaction and influence of brain connections within intrinsic specific networks. In this review, we discuss the technical details of rTMS and the biological interpretation of brain networks identified with MRI analyses, comprehensively summarize the neurobiological effects in rTMS-modulated individuals, and elaborate on changes in the brain network in patients with various neuropsychiatric diseases receiving rehabilitation treatment with rTMS. We conclude that brain connectivity network analysis based on MRI can reflect alterations in functional and structural connectivity networks comprising adjacent and separated brain regions related to stimulation sites, thus reflecting the occurrence of intrinsic functional integration and neuroplasticity. Therefore, MRI is a valuable tool for understanding the neural mechanisms of rTMS and practically tailoring treatment plans for patients with neuropsychiatric diseases.

Targeted visual cortex stimulation (TVCS): a novel neuro-navigated repetitive transcranial magnetic stimulation mode for improving cognitive function in bipolar disorder

A more effective and better-tolerated site for repetitive transcranial magnetic stimulation (rTMS) for treating cognitive dysfunction in patients with bipolar disorder (BD) is needed. The primary visual cortex (V1) may represent a suitable site. To investigate the use of the V1, which is functionally linked to the dorsolateral prefrontal cortex (DLPFC) and anterior cingulate cortex (ACC), as a potential site for improving cognitive function in BD. Seed-based functional connectivity (FC) analysis was used to locate targets in the V1 that had significant FC with the DLPFC and ACC. Subjects were randomly assigned to 4 groups, namely, the DLPFC active-sham rTMS (A1), DLPFC sham-active rTMS (A2), ACC active-sham rTMS (B1), and ACC sham-active rTMS groups (B2). The intervention included the rTMS treatment once daily, with five treatments a week for four weeks. The A1 and B1 groups received 10 days of active rTMS treatment followed by 10 days of sham rTMS treatment. The A2 and B2 groups received the opposite. The primary outcomes were changes in the scores of five tests in the THINC-integrated tool (THINC-it) at week 2 (W2) and week 4 (W4). The secondary outcomes were changes in the FC between the DLPFC/ACC and the whole brain at W2 and W4. Of the original 93 patients with BD recruited, 86 were finally included, and 73 finished the trial. Significant interactions between time and intervention type (Active/Sham) were observed in the scores of the accuracy of the Symbol Check in the THINC-it tests at baseline (W0) and W2 in groups B1 and B2 (F = 4.736, p = 0.037) using a repeated-measures analysis of covariance approach. Group B1 scored higher in the accuracy of Symbol Check at W2 compared with W0 (p < 0.001), while the scores of group B2 did not differ significantly between W0 and W2. No significant interactions between time and intervention mode were seen between groups A1 and A2, nor was any within-group significance of FC between DLPFC/ACC and the whole brain observed between baseline (W0) and W2/W4 in any group. One participant in group B1 experienced disease progression after 10 active and 2 sham rTMS sessions. The present study demonstrated that V1, functionally correlated with ACC, is a potentially effective rTMS stimulation target for improving neurocognitive function in BD patients. Further investigation using larger samples is required to confirm the clinical efficacy of TVCS.

Reactivation-induced motor skill modulation does not operate at a rapid micro-timescale level

Abundant evidence shows that consolidated memories are susceptible to modifications following their reactivation. Processes of memory consolidation and reactivation-induced skill modulation have been commonly documented after hours or days. Motivated by studies showing rapid consolidation in early stages of motor skill acquisition, here we asked whether motor skill memories are susceptible to modifications following brief reactivations, even at initial stages of learning. In a set of experiments, we collected crowdsourced online motor sequence data to test whether post-encoding interference and performance enhancement occur following brief reactivations in early stages of learning. Results indicate that memories forming during early learning are not susceptible to interference nor to enhancement within a rapid reactivation-induced time window, relative to control conditions. This set of evidence suggests that reactivation-induced motor skill memory modulation might be dependent on consolidation at the macro-timescale level, requiring hours or days to occur.

Visual Plasticity in Adulthood: Perspectives from Hebbian and Homeostatic Plasticity

The visual system retains profound plastic potential in adulthood. In the current review, we summarize the evidence of preserved plasticity in the adult visual system during visual perceptual learning as well as both monocular and binocular visual deprivation. In each condition, we discuss how such evidence reflects two major cellular mechanisms of plasticity: Hebbian and homeostatic processes. We focus on how these two mechanisms work together to shape plasticity in the visual system. In addition, we discuss how these two mechanisms could be further revealed in future studies investigating cross-modal plasticity in the visual system.

Brief memory reactivations induce learning in the numeric domain

Learning of arithmetic facts such as the multiplication table requires time-consuming, repeated practice. In light of evidence indicating that reactivation of encoded memories can modulate learning and memory processes at the synaptic, system and behavioral levels, we asked whether brief memory reactivations can induce human learning in the numeric domain. Adult participants performed a number-fact retrieval task in which they learned arbitrary numeric facts. Following encoding and a baseline test, 3 passive, brief reactivation sessions of only 40 s each were conducted on separate days. Learning was evaluated in a retest session. Results showed reactivations induced learning, with improved performance at retest relative to baseline test. Furthermore, performance was superior compared to a control group performing test-retest sessions without reactivations, who showed significant memory deterioration. A standard practice group completed active-retrieval sessions on 3 separate days, and showed significant learning gains. Interestingly, while these gains were higher than those of the reactivations group, subjects showing reactivation-induced learning were characterized by superior efficiency relative to standard practice subjects, with higher rate of improvement per practice time. A follow-up long-term retention experiment showed that 30 days following initial practice, weekly brief reactivations reduced forgetting, with participants performing superior to controls undergoing the same initial practice without reactivations. Overall, the results demonstrate that brief passive reactivations induce efficient learning and reduce forgetting within a numerical context. Time-efficient practice in the numeric domain carries implications for enhancement of learning strategies in daily-life settings.

A distinct route for efficient learning and generalization in autism

Visual skill learning is the process of improving responses to surrounding visual stimuli.¹ For individuals with autism spectrum disorders (ASDs), efficient skill learning may be especially valuable due to potential difficulties with sensory processing² and challenges in adjusting flexibly to changing environments.^3,4 Standard skill learning protocols require extensive practice with multiple stimulus repetitions,^5-7 which may be difficult for individuals with ASD and create abnormally specific learning with poor ability to generalize.⁴ Motivated by findings indicating that brief memory reactivations can facilitate skill learning,^8,9 we hypothesized that reactivation learning with few stimulus repetitions will enable efficient learning in individuals with ASD, similar to their learning with standard extensive practice protocols used in previous studies.^4,10,11 We further hypothesized that in contrast to experience-dependent plasticity often resulting in specificity, reactivation-induced learning would enable generalization patterns in ASD. To test our hypotheses, high-functioning adults with ASD underwent brief reactivations of an encoded visual learning task, consisting of only 5 trials each instead of hundreds. Remarkably, individuals with ASD improved their visual discrimination ability in the task substantially, demonstrating successful learning. Furthermore, individuals with ASD generalized learning to an untrained visual location, indicating a unique benefit of reactivation learning mechanisms for ASD individuals. Finally, an additional experiment showed that without memory reactivations ASD subjects did not demonstrate efficient learning and generalization patterns. Taken together, the results provide proof-of-concept evidence supporting a distinct route for efficient visual learning and generalization in ASD, which may be beneficial for skill learning in other sensory and motor domains.

Neuromodulation of Visual Cortex Reduces the Intensity of Intrusive Memories

Aversive events can be reexperienced as involuntary and spontaneous mental images of the event. Given that the vividness of retrieved mental images is coupled with elevated visual activation, we tested whether neuromodulation of the visual cortex would reduce the frequency and negative emotional intensity of intrusive memories. Intrusive memories of a viewed trauma film and their accompanied emotional intensity were recorded throughout 5 days. Functional connectivity, measured with resting-state functional magnetic resonance imaging prior to film viewing, was used as predictive marker for intrusions-related negative emotional intensity. Results indicated that an interaction between the visual network and emotion processing areas predicted intrusions’ emotional intensity. To test the causal influence of early visual cortex activity on intrusions’ emotional intensity, participants’ memory of the film was reactivated by brief reminders 1 day following film viewing, followed by inhibitory 1 Hz repetitive transcranial magnetic stimulation (rTMS) over early visual cortex. Results showed that visual cortex inhibitory stimulation reduced the emotional intensity of later intrusions, while leaving intrusion frequency and explicit visual memory intact. Current findings suggest that early visual areas constitute a central node influencing the emotional intensity of intrusive memories for negative events. Potential neuroscience-driven intervention targets designed to downregulate the emotional intensity of intrusive memories are discussed.

A behavioral training protocol using visual perceptual learning to improve a visual skill

We describe a behavioral training protocol using visual perceptual learning (VPL) to improve visual detection skills in non-experts for subtle mammographic lesions indicative of breast cancer. This protocol can be adapted for the professional training of experts (radiologists) or to improve visual skills for other tasks, such as the detection of targets in photo or video surveillance.

For complete details on the use and execution of this protocol, please refer to Frank et al. (2020a).

•

Behavioral training using VPL induces long-lasting improvements of a visual skill

•

Training should be conducted using detailed feedback about response accuracy

•

Training can be conducted with minimal technical equipment

•

VPL protocol can be used for clinical or other professional training