Feature-Specific Awake Reactivation in Human V1 after Visual Training

Dynamic predictive coding: A model of hierarchical sequence learning and prediction in the neocortex

We introduce dynamic predictive coding, a hierarchical model of spatiotemporal prediction and sequence learning in the neocortex. The model assumes that higher cortical levels modulate the temporal dynamics of lower levels, correcting their predictions of dynamics using prediction errors. As a result, lower levels form representations that encode sequences at shorter timescales (e.g., a single step) while higher levels form representations that encode sequences at longer timescales (e.g., an entire sequence). We tested this model using a two-level neural network, where the top-down modulation creates low-dimensional combinations of a set of learned temporal dynamics to explain input sequences. When trained on natural videos, the lower-level model neurons developed space-time receptive fields similar to those of simple cells in the primary visual cortex while the higher-level responses spanned longer timescales, mimicking temporal response hierarchies in the cortex. Additionally, the network's hierarchical sequence representation exhibited both predictive and postdictive effects resembling those observed in visual motion processing in humans (e.g., in the flash-lag illusion). When coupled with an associative memory emulating the role of the hippocampus, the model allowed episodic memories to be stored and retrieved, supporting cue-triggered recall of an input sequence similar to activity recall in the visual cortex. When extended to three hierarchical levels, the model learned progressively more abstract temporal representations along the hierarchy. Taken together, our results suggest that cortical processing and learning of sequences can be interpreted as dynamic predictive coding based on a hierarchical spatiotemporal generative model of the visual world.

Visual Plasticity in Adulthood: Perspectives from Hebbian and Homeostatic Plasticity

The visual system retains profound plastic potential in adulthood. In the current review, we summarize the evidence of preserved plasticity in the adult visual system during visual perceptual learning as well as both monocular and binocular visual deprivation. In each condition, we discuss how such evidence reflects two major cellular mechanisms of plasticity: Hebbian and homeostatic processes. We focus on how these two mechanisms work together to shape plasticity in the visual system. In addition, we discuss how these two mechanisms could be further revealed in future studies investigating cross-modal plasticity in the visual system.

Repetitive nociceptive stimulation increases spontaneous neural activation similar to nociception-induced activity in mouse insular cortex

Recent noninvasive neuroimaging technology has revealed that spatiotemporal patterns of cortical spontaneous activity observed in chronic pain patients are different from those in healthy subjects, suggesting that the spontaneous cortical activity plays a key role in the induction and/or maintenance of chronic pain. However, the mechanisms of the spontaneously emerging activities supposed to be induced by nociceptive inputs remain to be established. In the present study, we investigated spontaneous cortical activities in sessions before and after electrical stimulation of the periodontal ligament (PDL) by applying wide-field and two-photon calcium imaging to anesthetized GCaMP6s transgenic mice. First, we identified the sequential cortical activation patterns from the primary somatosensory and secondary somatosensory cortices to the insular cortex (IC) by PDL stimulation. We, then found that spontaneous IC activities that exhibited a similar spatiotemporal cortical pattern to evoked activities by PDL stimulation increased in the session after repetitive PDL stimulation. At the single-cell level, repetitive PDL stimulation augmented the synchronous neuronal activity. These results suggest that cortical plasticity induced by the repetitive stimulation leads to the frequent PDL stimulation-evoked-like spontaneous IC activation. This nociception-induced spontaneous activity in IC may be a part of mechanisms that induces chronic pain.

Is the role of sleep in memory consolidation overrated?

Substantial empirical evidence suggests that sleep benefits the consolidation and reorganization of learned information. Consequently, the concept of "sleep-dependent memory consolidation" is now widely accepted by the scientific community, in addition to influencing public perceptions regarding the functions of sleep. There are, however, numerous studies that have presented findings inconsistent with the sleep-memory hypothesis. Here, we challenge the notion of "sleep-dependency" by summarizing evidence for effective memory consolidation independent of sleep. Plasticity mechanisms thought to mediate or facilitate consolidation during sleep (e.g., neuronal replay, reactivation, slow oscillations, neurochemical milieu) also operate during non-sleep states, particularly quiet wakefulness, thus allowing for the stabilization of new memories. We propose that it is not sleep per se, but the engagement of plasticity mechanisms, active during both sleep and (at least some) waking states, that constitutes the critical factor determining memory formation. Thus, rather than playing a "critical" role, sleep falls along a continuum of behavioral states that vary in their effectiveness to support memory consolidation at the neural and behavioral level.

Simple contextual cueing prevents retroactive interference in short-term perceptual training of orientation detection tasks

Perceptual training of multiple tasks suffers from interference between the trained tasks. Here, we conducted five psychophysical experiments with separate groups of participants to investigate the possibility of preventing the interference in short-term perceptual training. We trained the participants to detect two orientations of Gabor stimuli in two adjacent days at the same retinal location and examined the interference of training effects between the two orientations. The results showed significant retroactive interference from the second orientation to the first orientation (Experiment 1 and Experiment 2). Introducing a 6-h interval between the pre-test and training of the second orientation did not eliminate the interference effect, excluding the interpretation of disrupted reconsolidation as the pre-test of the second orientation may reactivate and destabilize the representation of the first orientation (Experiment 3). Finally, the training of the two orientations was accompanied by fixations in two colors, each serving as a contextual cue for one orientation. The results showed that the retroactive interference was not evident if the participants passively perceived contextual cues during the training and test sessions (Experiment 4). Importantly, this facilitation effect could be observed if the contextual cues appeared only during the training, demonstrating the robustness of the effect (Experiment 5). Our findings suggest that the retroactive interference effect in short-term perceptual training of orientation detection tasks was likely the result of higher-level factors such as shared contextual cues embedded in the tasks. The efficiency of multiple perceptual trainings could be facilitated by associating the trained tasks with different contextual cues.

The Impact of Feedback on Perceptual Decision-Making and Metacognition: Reduction in Bias but No Change in Sensitivity

It is widely believed that feedback improves behavior, but the mechanisms behind this improvement remain unclear. Different theories postulate that feedback has either a direct effect on performance through automatic reinforcement mechanisms or only an indirect effect mediated by a deliberate change in strategy. To adjudicate between these competing accounts, we performed two large experiments on human adults (total N = 518); approximately half the participants received trial-by-trial feedback on a perceptual task, whereas the other half did not receive any feedback. We found that feedback had no effect on either perceptual or metacognitive sensitivity even after 7 days of training. On the other hand, feedback significantly affected participants' response strategies by reducing response bias and improving confidence calibration. These results suggest that the beneficial effects of feedback stem from allowing people to adjust their strategies for performing the task and not from direct reinforcement mechanisms, at least in the domain of perception.

Reactivation-induced motor skill learning

Learning motor skills commonly requires repeated execution to achieve gains in performance. Motivated by memory reactivation frameworks predominantly originating from fear-conditioning studies in rodents, which have extended to humans, we asked the following: Could motor skill learning be achieved by brief memory reactivations? To address this question, we had participants encode a motor sequence task in an initial test session, followed by brief task reactivations of only 30 s each, conducted on separate days. Learning was evaluated in a final retest session. The results showed that these brief reactivations induced significant motor skill learning gains. Nevertheless, the efficacy of reactivations was not consistent but determined by the number of consecutive correct sequences tapped during memory reactivations. Highly continuous reactivations resulted in higher learning gains, similar to those induced by full extensive practice, while lower continuity reactivations resulted in minimal learning gains. These results were replicated in a new independent sample of subjects, suggesting that the quality of memory reactivation, reflected by its continuity, regulates the magnitude of learning gains. In addition, the change in noninvasive brain stimulation measurements of corticospinal excitability evoked by transcranial magnetic stimulation over primary motor cortex between pre- and postlearning correlated with retest and transfer performance. These results demonstrate a unique form of rapid motor skill learning and may have far-reaching implications, for example, in accelerating motor rehabilitation following neurological injuries.

Awake suppression after brief exposure to a familiar stimulus

Newly learned information undergoes a process of awake reactivation shortly after the learning offset and we recently demonstrated that this effect can be observed as early as area V1. However, reactivating all experiences can be wasteful and unnecessary, especially for familiar stimuli. Therefore, here we tested whether awake reactivation occurs differentially for new and familiar stimuli. Subjects completed a brief visual task on a stimulus that was either novel or highly familiar due to extensive prior training on it. Replicating our previous results, we found that awake reactivation occurred in V1 for the novel stimulus. On the other hand, brief exposure to the familiar stimulus led to 'awake suppression' such that neural activity patterns immediately after exposure to the familiar stimulus diverged from the patterns associated with that stimulus. Further, awake reactivation was observed selectively in V1, whereas awake suppression had similar strength across areas V1-V3. These results are consistent with the presence of a competition between local awake reactivation and top-down awake suppression, with suppression becoming dominant for familiar stimuli.

Causal Contribution of Awake Post-encoding Processes to Episodic Memory Consolidation

Stable representations of past experience are thought to depend on processes that unfold after events are initially encoded into memory. Post-encoding reactivation and hippocampal-cortical interactions are leading candidate mechanisms thought to support memory retention and stabilization across hippocampal-cortical networks. Although putative consolidation mechanisms have been observed during sleep and periods of awake rest, the direct causal contribution of awake consolidation mechanisms to later behavior is unclear, especially in humans. Moreover, it has been argued that observations of putative consolidation processes are epiphenomenal and not causally important, yet there are few tools to test the functional contribution of these mechanisms in humans. Here, we combined transcranial magnetic stimulation (TMS) and fMRI to test the role of awake consolidation processes by targeting hippocampal interactions with lateral occipital cortex (LOC). We applied theta-burst TMS to LOC (and a control site) to interfere with an extended window (approximately 30-50 min) after memory encoding. Behaviorally, post-encoding TMS to LOC selectively impaired associative memory retention compared to multiple control conditions. In the control TMS condition, we replicated prior reports of post-encoding reactivation and memory-related hippocampal-LOC interactions during periods of awake rest using fMRI. However, post-encoding LOC TMS reduced these processes, such that post-encoding reactivation in LOC and memory-related hippocampal-LOC functional connectivity were no longer present. By targeting and manipulating post-encoding neural processes, these findings highlight the direct contribution of awake time periods to episodic memory consolidation. This combined TMS-fMRI approach provides an opportunity for causal manipulations of human memory consolidation.

Cue-triggered activity replay in human early visual cortex

The recall of learned temporal sequences by a visual cue is an important form of experience-based neural plasticity. Here we observed such reactivation in awake human visual cortex using intracranial recording. After repeated exposure to a moving dot, a flash of the dot was able to trigger neural reactivation in the downstream receptive field along the motion path. This effect was observed only when the cue appeared near the receptive field. The estimated traveling speed was faster compared to the activation induced by the real motion. We suggest a range-limited, time-compressed reactivation as a result of repeated visual exposure in awake human visual cortex.

Post-training TMS abolishes performance improvement and releases future learning from interference

The period immediately after the offset of visual training is thought to be critical for memory consolidation. Nevertheless, we still lack direct evidence for the causal role of this period to perceptual learning of either previously or subsequently trained material. To address these issues, we had human subjects complete two consecutive trainings with different tasks (detecting different Gabor orientations). We applied continuous theta burst stimulation (cTBS) to either the visual cortex or a control site (vertex) immediately after the offset of the first training. In the vertex cTBS condition, subjects showed improvement on the first task but not on the second task, suggesting the presence of anterograde interference. Critically, cTBS to the visual cortex abolished the performance improvement on the first task and released the second training from the anterograde interference. These results provide causal evidence for a role of the immediate post-training period in the consolidation of perceptual learning.

Awake Reactivation of Prior Experiences Consolidates Memories and Biases Cognition

After experiences are encoded into memory, post-encoding reactivation mechanisms have been proposed to mediate long-term memory stabilization and transformation. Spontaneous reactivation of hippocampal representations, together with hippocampal-cortical interactions, are leading candidate mechanisms for promoting systems-level memory strengthening and reorganization. While the replay of spatial representations has been extensively studied in rodents, here we review recent fMRI work that provides evidence for spontaneous reactivation of nonspatial, episodic event representations in the human hippocampus and cortex, as well as for experience-dependent alterations in systems-level hippocampal connectivity. We focus on reactivation during awake post-encoding periods, relationships between reactivation and subsequent behavior, how reactivation is modulated by factors that influence consolidation, and the implications of persistent reactivation for biasing ongoing perception and cognition.