Dynamically changing neuronal activity supporting working memory for predictable and unpredictable durations

Automating licking bias correction in a two-choice delayed match-to-sample task to accelerate learning

Animals often display choice bias, or a preference for one option over the others, which can significantly impede learning new tasks. Delayed match-to-sample (DMS) tasks with two-alternative choices of lickports on the left and right have been widely used to study sensory processing, working memory, and associative memory in head-fixed animals. However, extensive training time, primarily due to the animals' biased licking responses, limits their practical utility. Here, we present the implementation of an automated side bias correction system in an olfactory DMS task, where the lickport positions and the ratio of left- and right-rewarded trials are dynamically adjusted to counterbalance mouse's biased licking responses during training. The correction algorithm moves the preferred lickport farther away from the mouse's mouth and the non-preferred lickport closer, while also increasing the proportion of non-preferred side trials when biased licking occurs. We found that adjusting lickport distances and the proportions of left- versus right-rewarded trials effectively reduces the mouse's side bias. Further analyses reveal that these adjustments also correlate with subsequent improvements in behavioral performance. Our findings suggest that the automated side bias correction system is a valuable tool for enhancing the applicability of behavioral tasks involving two-alternative lickport choices.

Time for Memories

The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.

Multiplexing working memory and time in the trajectories of neural networks

Working memory (WM) and timing are generally considered distinct cognitive functions, but similar neural signatures have been implicated in both. To explore the hypothesis that WM and timing may rely on shared neural mechanisms, we used psychophysical tasks that contained either task-irrelevant timing or WM components. In both cases, the task-irrelevant component influenced performance. We then developed recurrent neural network (RNN) simulations that revealed that cue-specific neural sequences, which multiplexed WM and time, emerged as the dominant regime that captured the behavioural findings. During training, RNN dynamics transitioned from low-dimensional ramps to high-dimensional neural sequences, and depending on task requirements, steady-state or ramping activity was also observed. Analysis of RNN structure revealed that neural sequences relied primarily on inhibitory connections, and could survive the deletion of all excitatory-to-excitatory connections. Our results indicate that in some instances WM is encoded in time-varying neural activity because of the importance of predicting when WM will be used.

Distinct hippocampal-prefrontal neural assemblies coordinate memory encoding, maintenance, and recall

Short-term memory enables incorporation of recent experience into subsequent decision-making. This processing recruits both the prefrontal cortex and hippocampus, where neurons encode task cues, rules, and outcomes. However, precisely which information is carried when, and by which neurons, remains unclear. Using population decoding of activity in rat medial prefrontal cortex (mPFC) and dorsal hippocampal CA1, we confirm that mPFC populations lead in maintaining sample information across delays of an operant non-match to sample task, despite individual neurons firing only transiently. During sample encoding, distinct mPFC subpopulations joined distributed CA1-mPFC cell assemblies hallmarked by 4-5 Hz rhythmic modulation; CA1-mPFC assemblies re-emerged during choice episodes but were not 4-5 Hz modulated. Delay-dependent errors arose when attenuated rhythmic assembly activity heralded collapse of sustained mPFC encoding. Our results map component processes of memory-guided decisions onto heterogeneous CA1-mPFC subpopulations and the dynamics of physiologically distinct, distributed cell assemblies.

Dynamic theta-modulated high frequency oscillations in rat medial prefrontal cortex during spatial working memory task

Interaction of oscillatory rhythms at different frequencies is considered to provide a neuronal mechanism for information processing and transmission. These interactions have been suggested to have a vital role in cognitive functions such as working memory and decision-making. Here, we investigated the medial prefrontal cortex (mPFC), which is known to have a critical role in successful execution of spatial working memory tasks. We recorded local field potential oscillations from mPFC while rats performed a delayed-non-match-to-place (DNMTP) task. In the DNMTP task, the rat needed to decide actively about the pathway based on the information remembered in the first phase of each trial. Our analysis revealed a dynamic phase-amplitude coupling (PAC) between theta and high frequency oscillations (HFOs). This dynamic coupling emerged near the turning point and diminished afterward. Further, theta activity during the delay period, which is thought of as the maintenance phase, in the absence of the coupling, can predict task completion time. We previously reported diminished rat performance in the DNMTP task in response to electromagnetic radiation. Here, we report an increase in the theta rhythm during delay activity besides diminishing the coupling after electromagnetic radiation. These findings suggest that the different roles of the mPFC in working memory could be supported by separate mechanisms: Theta activity during the delay period for information maintenance and theta-HFOs phase-amplitude coupling relating to the decision-making procedure.

Dopamine activates astrocytes in prefrontal cortex via α1-adrenergic receptors

The prefrontal cortex (PFC) is a hub for cognitive control, and dopamine profoundly influences its functions. In other brain regions, astrocytes sense diverse neurotransmitters and neuromodulators and, in turn, orchestrate regulation of neuroactive substances. However, basic physiology of PFC astrocytes, including which neuromodulatory signals they respond to and how they contribute to PFC function, is unclear. Here, we characterize divergent signaling signatures in mouse astrocytes of the PFC and primary sensory cortex, which show differential responsiveness to locomotion. We find that PFC astrocytes express receptors for dopamine but are unresponsive through the Gs/Gi-cAMP pathway. Instead, fast calcium signals in PFC astrocytes are time locked to dopamine release and are mediated by α1-adrenergic receptors both ex vivo and in vivo. Further, we describe dopamine-triggered regulation of extracellular ATP at PFC astrocyte territories. Thus, we identify astrocytes as active players in dopaminergic signaling in the PFC, contributing to PFC function though neuromodulator receptor crosstalk.

Pittolo et al. demonstrate that the neuromodulator dopamine targets astrocytes, a type of brain cell, via receptors specific to another neuromodulator—norepinephrine. This study provides groundwork on how dopamine affects non-neuronal brain cells and suggests that crosstalk between neuromodulatory pathways occurs in vivo, with possible clinical implications.

Cortical feedback loops bind distributed representations of working memory

Working memory—the brain’s ability to internalize information and use it flexibly to guide behaviour—is an essential component of cognition. Although activity related to working memory has been observed in several brain regions^1–3, how neural populations actually represent working memory^4–7 and the mechanisms by which this activity is maintained^8–12 remain unclear^13–15. Here we describe the neural implementation of visual working memory in mice alternating between a delayed non-match-to-sample task and a simple discrimination task that does not require working memory but has identical stimulus, movement and reward statistics. Transient optogenetic inactivations revealed that distributed areas of the neocortex were required selectively for the maintenance of working memory. Population activity in visual area AM and premotor area M2 during the delay period was dominated by orderly low-dimensional dynamics^16,17 that were, however, independent of working memory. Instead, working memory representations were embedded in high-dimensional population activity, present in both cortical areas, persisted throughout the inter-stimulus delay period, and predicted behavioural responses during the working memory task. To test whether the distributed nature of working memory was dependent on reciprocal interactions between cortical regions^18–20, we silenced one cortical area (AM or M2) while recording the feedback it received from the other. Transient inactivation of either area led to the selective disruption of inter-areal communication of working memory. Therefore, reciprocally interconnected cortical areas maintain bound high-dimensional representations of working memory.

Experiments in mice alternating between a visual working memory task and a task that is independent of working memory provide insight into the neural representation of working memory and the distributed nature of its maintenance.

Neural Substrates of Visual Perception and Working Memory: Two Sides of the Same Coin or Two Different Coins?

Visual perception occurs when a set of physical signals emanating from the environment enter the visual system and the brain interprets such signals as a percept. Visual working memory occurs when the brain produces and maintains a mental representation of a percept while the physical signals corresponding to that percept are not available. Early studies in humans and non-human primates demonstrated that lesions of the prefrontal cortex impair performance during visual working memory tasks but not during perceptual tasks. These studies attributed a fundamental role in working memory and a lesser role in visual perception to the prefrontal cortex. Indeed, single cell recording studies have found that neurons in the lateral prefrontal cortex of macaques encode working memory representations via persistent firing, validating the results of lesion studies. However, other studies have reported that neurons in some areas of the parietal and temporal lobe-classically associated with visual perception-similarly encode working memory representations via persistent firing. This prompted a line of enquiry about the role of the prefrontal and other associative cortices in working memory and perception. Here, we review evidence from single neuron studies in macaque monkeys examining working memory representations across different areas of the visual hierarchy and link them to studies examining the role of the same areas in visual perception. We conclude that neurons in early visual areas of both ventral (V1-V2-V4) and dorsal (V1-V3-MT) visual pathways of macaques mainly encode perceptual signals. On the other hand, areas downstream from V4 and MT contain subpopulations of neurons that encode both perceptual and/or working memory signals. Differences in cortical architecture (neuronal types, layer composition, and synaptic density and distribution) may be linked to the differential encoding of perceptual and working memory signals between early visual areas and higher association areas.

Slow manifolds within network dynamics encode working memory efficiently and robustly

Working memory is a cognitive function involving the storage and manipulation of latent information over brief intervals of time, thus making it crucial for context-dependent computation. Here, we use a top-down modeling approach to examine network-level mechanisms of working memory, an enigmatic issue and central topic of study in neuroscience. We optimize thousands of recurrent rate-based neural networks on a working memory task and then perform dynamical systems analysis on the ensuing optimized networks, wherein we find that four distinct dynamical mechanisms can emerge. In particular, we show the prevalence of a mechanism in which memories are encoded along slow stable manifolds in the network state space, leading to a phasic neuronal activation profile during memory periods. In contrast to mechanisms in which memories are directly encoded at stable attractors, these networks naturally forget stimuli over time. Despite this seeming functional disadvantage, they are more efficient in terms of how they leverage their attractor landscape and paradoxically, are considerably more robust to noise. Our results provide new hypotheses regarding how working memory function may be encoded within the dynamics of neural circuits.

Parallel processing of working memory and temporal information by distinct types of cortical projection neurons

It is unclear how different types of cortical projection neurons work together to support diverse cortical functions. We examined the discharge characteristics and inactivation effects of intratelencephalic (IT) and pyramidal tract (PT) neurons-two major types of cortical excitatory neurons that project to cortical and subcortical structures, respectively-in the deep layer of the medial prefrontal cortex in mice performing a delayed response task. We found stronger target-dependent firing of IT than PT neurons during the delay period. We also found the inactivation of IT neurons, but not PT neurons, impairs behavioral performance. In contrast, PT neurons carry more temporal information than IT neurons during the delay period. Our results indicate a division of labor between IT and PT projection neurons in the prefrontal cortex for the maintenance of working memory and for tracking the passage of time, respectively.

Modeling Working Memory in a Spiking Neuron Network Accompanied by Astrocytes

We propose a novel biologically plausible computational model of working memory (WM) implemented by a spiking neuron network (SNN) interacting with a network of astrocytes. The SNN is modeled by synaptically coupled Izhikevich neurons with a non-specific architecture connection topology. Astrocytes generating calcium signals are connected by local gap junction diffusive couplings and interact with neurons via chemicals diffused in the extracellular space. Calcium elevations occur in response to the increased concentration of the neurotransmitter released by spiking neurons when a group of them fire coherently. In turn, gliotransmitters are released by activated astrocytes modulating the strength of the synaptic connections in the corresponding neuronal group. Input information is encoded as two-dimensional patterns of short applied current pulses stimulating neurons. The output is taken from frequencies of transient discharges of corresponding neurons. We show how a set of information patterns with quite significant overlapping areas can be uploaded into the neuron-astrocyte network and stored for several seconds. Information retrieval is organized by the application of a cue pattern representing one from the memory set distorted by noise. We found that successful retrieval with the level of the correlation between the recalled pattern and ideal pattern exceeding 90% is possible for the multi-item WM task. Having analyzed the dynamical mechanism of WM formation, we discovered that astrocytes operating at a time scale of a dozen of seconds can successfully store traces of neuronal activations corresponding to information patterns. In the retrieval stage, the astrocytic network selectively modulates synaptic connections in the SNN leading to successful recall. Information and dynamical characteristics of the proposed WM model agrees with classical concepts and other WM models.

Active maintenance of eligibility trace in rodent prefrontal cortex

Even though persistent neural activity has been proposed as a mechanism for maintaining eligibility trace, direct empirical evidence for active maintenance of eligibility trace has been lacking. We recorded neuronal activity in the medial prefrontal cortex (mPFC) in rats performing a dynamic foraging task in which a choice must be remembered until its outcome on the timescale of seconds for correct credit assignment. We found that mPFC neurons maintain significant choice signals during the time period between action selection and choice outcome. We also found that neural signals for choice, outcome, and action value converge in the mPFC when choice outcome was revealed. Our results indicate that the mPFC maintains choice signals necessary for temporal credit assignment in the form of persistent neural activity in our task. They also suggest that the mPFC might update action value by combining actively maintained eligibility trace with action value and outcome signals.

[Review of cognitive enhancement techniques based on the combination of cognitive training and transcranial direct current stimulation]

Cognitive enhancement refers to the technology of enhancing or expanding the cognitive and emotional abilities of people without psychosis based on relevant knowledge of neurobiology. The common methods of cognitive enhancement include transcranial direct current stimulation (tDCS) and cognitive training (CT). tDCS takes effect quickly, with a short effective time, while CT takes longer to work, requiring several weeks of training, with a longer effective time. In recent years, some researchers have begun to use the method of tDCS combined with CT to regulate the cognitive function. This paper will sort out and summarize this topic from five aspects: perception, attention, working memory, decision-making and other cognitive abilities. Finally, the application prospect and challenges of technology are prospected.

Using rat operant delayed match-to-sample task to identify neural substrates recruited with increased working memory load

The delayed match-to-sample task (DMS) is used to probe working memory (WM) across species. While the involvement of the PFC in this task has been established, limited information exists regarding the recruitment of broader circuitry, especially under the low- versus high-WM load. We sought to address this question by using a variable-delay operant DMS task. Male Sprague-Dawley rats were trained and tested to determine their baseline WM performance across all (0- to 24-sec) delays. Next, rats were tested in a single DMS test with either 0- or 24-sec fixed delay, to assess low-/high-load WM performance. c-Fos mRNA expression was quantified within cortical and subcortical regions and correlated with WM performance. High WM load up-regulated overall c-Fos mRNA expression within the PrL, as well as within a subset of mGlu5+ cells, with load-dependent, local activation of protein kinase C (PKC) as the proposed underlying molecular mechanism. The PrL activity negatively correlated with choice accuracy during high load WM performance. A broader circuitry, including several subcortical regions, was found to be activated under low and/or high load conditions. These findings highlight the role of mGlu5- and/or PKC-dependent signaling within the PrL, and corresponding recruitment of subcortical regions during high-load WM performance.