Stable population coding for working memory coexists with heterogeneous neural dynamics in prefrontal cortex

Orthogonality of sensory and contextual categorical dynamics embedded in a continuum of responses from the second somatosensory cortex

How does the brain simultaneously process signals that bring complementary information, like raw sensory signals and their transformed counterparts, without any disruptive interference? Contemporary research underscores the brain's adeptness in using decorrelated responses to reduce such interference. Both neurophysiological findings and artificial neural networks support the notion of orthogonal representation for signal differentiation and parallel processing. Yet, where, and how raw sensory signals are transformed into more abstract representations remains unclear. Using a temporal pattern discrimination task in trained monkeys, we revealed that the second somatosensory cortex (S2) efficiently segregates faithful and transformed neural responses into orthogonal subspaces. Importantly, S2 population encoding for transformed signals, but not for faithful ones, disappeared during a nondemanding version of this task, which suggests that signal transformation and their decoding from downstream areas are only active on-demand. A mechanistic computation model points to gain modulation as a possible biological mechanism for the observed context-dependent computation. Furthermore, individual neural activities that underlie the orthogonal population representations exhibited a continuum of responses, with no well-determined clusters. These findings advocate that the brain, while employing a continuum of heterogeneous neural responses, splits population signals into orthogonal subspaces in a context-dependent fashion to enhance robustness, performance, and improve coding efficiency.

Shifts in attention drive context-dependent subspace encoding in anterior cingulate cortex in mice during decision making

Attention supports decision making by selecting the features that are relevant for decisions. Selective enhancement of the relevant features and inhibition of distractors has been proposed as potential neural mechanisms driving this selection process. Yet, how attention operates when relevance cannot be directly determined, and the attention signal needs to be internally constructed is less understood. Here we recorded from populations of neurons in the anterior cingulate cortex (ACC) of mice in an attention-shifting task where relevance of stimulus modalities changed across blocks of trials. In contrast with V1 recordings, decoding of the irrelevant modality gradually declined in ACC after an initial transient. Our analytical proof and a recurrent neural network model of the task revealed mutually inhibiting connections that produced context-gated suppression as observed in mice. Using this RNN model we predicted a correlation between contextual modulation of individual neurons and their stimulus drive, which we confirmed in ACC but not in V1.

The computational foundations of dynamic coding in working memory

Working memory (WM) is a fundamental aspect of cognition. WM maintenance is classically thought to rely on stable patterns of neural activities. However, recent evidence shows that neural population activities during WM maintenance undergo dynamic variations before settling into a stable pattern. Although this has been difficult to explain theoretically, neural network models optimized for WM typically also exhibit such dynamics. Here, we examine stable versus dynamic coding in neural data, classical models, and task-optimized networks. We review principled mathematical reasons for why classical models do not, while task-optimized models naturally do exhibit dynamic coding. We suggest an update to our understanding of WM maintenance, in which dynamic coding is a fundamental computational feature rather than an epiphenomenon.

Timescales of learning in prefrontal cortex

The lateral prefrontal cortex (PFC) in humans and other primates is critical for immediate, goal-directed behaviour and working memory, which are classically considered distinct from the cognitive and neural circuits that support long-term learning and memory. Over the past few years, a reconsideration of this textbook perspective has emerged, in that different timescales of memory-guided behaviour are in constant interaction during the pursuit of immediate goals. Here, we will first detail how neural activity related to the shortest timescales of goal-directed behaviour (which requires maintenance of current states and goals in working memory) is sculpted by long-term knowledge and learning - that is, how the past informs present behaviour. Then, we will outline how learning across different timescales (from seconds to years) drives plasticity in the primate lateral PFC, from single neuron firing rates to mesoscale neuroimaging activity patterns. Finally, we will review how, over days and months of learning, dense local and long-range connectivity patterns in PFC facilitate longer-lasting changes in population activity by changing synaptic weights and recruiting additional neural resources to inform future behaviour. Our Review sheds light on how the machinery of plasticity in PFC circuits facilitates the integration of learned experiences across time to best guide adaptive behaviour.

Representation and computation in visual working memory

The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.

Unified control of temporal and spatial scales of sensorimotor behavior through neuromodulation of short-term synaptic plasticity

Neuromodulators have been shown to alter the temporal profile of short-term synaptic plasticity (STP); however, the computational function of this neuromodulation remains unexplored. Here, we propose that the neuromodulation of STP provides a general mechanism to scale neural dynamics and motor outputs in time and space. We trained recurrent neural networks that incorporated STP to produce complex motor trajectories-handwritten digits-with different temporal (speed) and spatial (size) scales. Neuromodulation of STP produced temporal and spatial scaling of the learned dynamics and enhanced temporal or spatial generalization compared to standard training of the synaptic weights in the absence of STP. The model also accounted for the results of two experimental studies involving flexible sensorimotor timing. Neuromodulation of STP provides a unified and biologically plausible mechanism to control the temporal and spatial scales of neural dynamics and sensorimotor behaviors.

When remembering less is more: Unfiltered items are associated with reduced memory fidelity in visual short-term memory

Visual short-term memory (VSTM), the ability to store information no longer visible, is essential for human behavior. VSTM limits vary across the population and are correlated with overall cognitive ability. It has been proposed that low-memory individuals are unable to select only relevant items for storage and that these limitations are greatest when memory demands are high. However, it is unknown whether these effects simply reflect task difficulty and whether they impact the quality of memory representations. Here we varied the number of items presented, or set size, to investigate the effect of memory demands on the performance of visual short-term memory across low- and high-memory groups. Group differences emerged as set size exceeded memory limits, even when task difficulty was controlled. In a change-detection task, the low-memory group performed more poorly when set size exceeded their memory limits. We then predicted that low-memory individuals encoding items beyond measured memory limits would result in the degraded fidelity of memory representations. A continuous report task confirmed that low, but not high, memory individuals demonstrated decreased memory fidelity as set size exceeded measured memory limits. The current study demonstrates that items held in VSTM are stored distinctly across groups and task demands. These results link the ability to maintain high quality representations with overall cognitive ability.

Heterogeneous Forgetting Rates and Greedy Allocation in Slot-Based Memory Networks Promotes Signal Retention

A key question in the neuroscience of memory encoding pertains to the mechanisms by which afferent stimuli are allocated within memory networks. This issue is especially pronounced in the domain of working memory, where capacity is finite. Presumably the brain must embed some "policy" by which to allocate these mnemonic resources in an online manner in order to maximally represent and store afferent information for as long as possible and without interference from subsequent stimuli. Here, we engage this question through a top-down theoretical modeling framework. We formally optimize a gating mechanism that projects afferent stimuli onto a finite number of memory slots within a recurrent network architecture. In the absence of external input, the activity in each slot attenuates over time (i.e., a process of gradual forgetting). It turns out that the optimal gating policy consists of a direct projection from sensory activity to memory slots, alongside an activity-dependent lateral inhibition. Interestingly, allocating resources myopically (greedily with respect to the current stimulus) leads to efficient utilization of slots over time. In other words, later-arriving stimuli are distributed across slots in such a way that the network state is minimally shifted and so prior signals are minimally "overwritten." Further, networks with heterogeneity in the timescales of their forgetting rates retain stimuli better than those that are more homogeneous. Our results suggest how online, recurrent networks working on temporally localized objectives without high-level supervision can nonetheless implement efficient allocation of memory resources over time.

A Multivariate analysis on evoked components of Chinese semantic congruity: an OP-MEG study with EEG

The application of wearable magnetoencephalography using optically-pumped magnetometers has drawn extensive attention in the field of neuroscience. Electroencephalogram system can cover the whole head and reflect the overall activity of a large number of neurons. The efficacy of optically-pumped magnetometer in detecting event-related components can be validated through electroencephalogram results. Multivariate pattern analysis is capable of tracking the evolution of neurocognitive processes over time. In this paper, we adopted a classical Chinese semantic congruity paradigm and separately collected electroencephalogram and optically-pumped magnetometer signals. Then, we verified the consistency of optically-pumped magnetometer and electroencephalogram in detecting N400 using mutual information index. Multivariate pattern analysis revealed the difference in decoding performance of these two modalities, which can be further validated by dynamic/stable coding analysis on the temporal generalization matrix. The results from searchlight analysis provided a neural basis for this dissimilarity at the magnetoencephalography source level and the electroencephalogram sensor level. This study opens a new avenue for investigating the brain's coding patterns using wearable magnetoencephalography and reveals the differences in sensitivity between the two modalities in reflecting neuron representation patterns.

Mystery of the memory engram: History, current knowledge, and unanswered questions

The quest to understand the memory engram has intrigued humans for centuries. Recent technological advances, including genetic labelling, imaging, optogenetic and chemogenetic techniques, have propelled the field of memory research forward. These tools have enabled researchers to create and erase memory components. While these innovative techniques have yielded invaluable insights, they often focus on specific elements of the memory trace. Genetic labelling may rely on a particular immediate early gene as a marker of activity, optogenetics may activate or inhibit one specific type of neuron, and imaging may capture activity snapshots in a given brain region at specific times. Yet, memories are multifaceted, involving diverse arrays of neuronal subpopulations, circuits, and regions that work in concert to create, store, and retrieve information. Consideration of contributions of both excitatory and inhibitory neurons, micro and macro circuits across brain regions, the dynamic nature of active ensembles, and representational drift is crucial for a comprehensive understanding of the complex nature of memory.

Contributions of narrow- and broad-spiking prefrontal and parietal neurons on working memory tasks

Neurons that generate persistent activity in the primate dorsolateral prefrontal and posterior parietal cortex have been shown to be predictive of behavior in working memory tasks, though subtle differences between them have been observed in how information is represented. The role of different neuron types in each of these areas has not been investigated at depth. We thus compared the activity of neurons classified as narrow-spiking, putative interneurons, and broad-spiking, putative pyramidal neurons, recorded from the dorsolateral prefrontal and posterior parietal cortex of male monkeys, to analyze their role in the maintenance of working memory. Our results demonstrate that narrow-spiking neurons are active during a range of tasks and generate persistent activity during the delay period over which stimuli need to be maintained in memory. Furthermore, the activity of narrow-spiking neurons was predictive of the subject's recall no less than that of broad-spiking neurons, which are exclusively projection neurons in the cortex. Our results show that putative interneurons play an active role during the maintenance of working memory and shed light onto the fundamental neural circuits that determine subjects' memories and judgments.

Event-specific and persistent representations for contextual states in orbitofrontal neurons

Flexible and context-dependent behaviors require animals, including humans, to identify their current contextual state for proper rules to apply, especially when information that defines these states is partially observable. Depending on behavioral needs, contextual states usually persist for prolonged periods and across other events, including sensory stimuli, actions, and rewards, highlighting prominent challenges of holding a reliable state representation. The orbitofrontal cortex (OFC) is crucial in behaviors requiring the identification of the current context (e.g., reversal learning); however, how single units in the OFC accomplish this function has not been assessed. Do they maintain such information persistently, in separate populations from those responding phasically to events within a task, or is contextual information dynamic and embedded in these phasic responses? Here, we investigated this question by recording single units from OFC in rats performing a task that required them to identify the current contextual state related to estimated proximity to future reward with distracting olfactory cues. We found that while some OFC neurons encode contextual states, most change their selectivity upon the transition of task events. Nevertheless, despite dynamic activities in single neurons, the neural populations maintain persistent representations regarding current contextual states within particular neural subspaces.

Effective connectivity of working memory performance: a DCM study of MEG data

Visual working memory (WM) engages several nodes of a large-scale network that includes frontal, parietal, and visual regions; however, little is understood about how these regions interact to support WM behavior. In particular, it is unclear whether network dynamics during WM maintenance primarily represent feedforward or feedback connections. This question has important implications for current debates about the relative roles of frontoparietal and visual regions in WM maintenance. In the current study, we investigated the network activity supporting WM using MEG data acquired while healthy subjects performed a multi-item delayed estimation WM task. We used computational modeling of behavior to discriminate correct responses (high accuracy trials) from two different types of incorrect responses (low accuracy and swap trials), and dynamic causal modeling of MEG data to measure effective connectivity. We observed behaviorally dependent changes in effective connectivity in a brain network comprising frontoparietal and early visual areas. In comparison with high accuracy trials, frontoparietal and frontooccipital networks showed disrupted signals depending on type of behavioral error. Low accuracy trials showed disrupted feedback signals during early portions of WM maintenance and disrupted feedforward signals during later portions of maintenance delay, while swap errors showed disrupted feedback signals during the whole delay period. These results support a distributed model of WM that emphasizes the role of visual regions in WM storage and where changes in large scale network configurations can have important consequences for memory-guided behavior.

Top-down generation of low-resolution representations improves visual perception and imagination

Perception or imagination requires top-down signals from high-level cortex to primary visual cortex (V1) to reconstruct or simulate the representations bottom-up stimulated by the seen images. Interestingly, top-down signals in V1 have lower spatial resolution than bottom-up representations. It is unclear why the brain uses low-resolution signals to reconstruct or simulate high-resolution representations. By modeling the top-down pathway of the visual system using the decoder of a variational auto-encoder (VAE), we reveal that low-resolution top-down signals can better reconstruct or simulate the information contained in the sparse activities of V1 simple cells, which facilitates perception and imagination. This advantage of low-resolution generation is related to facilitating high-level cortex to form geometry-respecting representations observed in experiments. Furthermore, we present two findings regarding this phenomenon in the context of AI-generated sketches, a style of drawings made of lines. First, we found that the quality of the generated sketches critically depends on the thickness of the lines in the sketches: thin-line sketches are harder to generate than thick-line sketches. Second, we propose a technique to generate high-quality thin-line sketches: instead of directly using original thin-line sketches, we use blurred sketches to train VAE or GAN (generative adversarial network), and then infer the thin-line sketches from the VAE- or GAN-generated blurred sketches. Collectively, our work suggests that low-resolution top-down generation is a strategy the brain uses to improve visual perception and imagination, which inspires new sketch-generation AI techniques.

Prefrontal projections modulate recurrent circuitry in the insular cortex to support short-term memory

Short-term memory (STM) maintains information during a short delay period. How long-range and local connections interact to support STM encoding remains elusive. Here, we tackle the problem focusing on long-range projections from the medial prefrontal cortex (mPFC) to the anterior agranular insular cortex (aAIC) in head-fixed mice performing an olfactory delayed-response task. Optogenetic and electrophysiological experiments reveal the behavioral importance of the two regions in encoding STM information. Spike-correlogram analysis reveals strong local and cross-region functional coupling (FC) between memory neurons encoding the same information. Optogenetic suppression of mPFC-aAIC projections during the delay period reduces behavioral performance, the proportion of memory neurons, and memory-specific FC within the aAIC, whereas optogenetic excitation enhances all of them. mPFC-aAIC projections also bidirectionally modulate the efficacy of STM-information transfer, measured by the contribution of FC spiking pairs to the memory-coding ability of following neurons. Thus, prefrontal projections modulate insular neurons' functional connectivity and memory-coding ability to support STM.

Ramping Dynamics in the Frontal Cortex Unfold Over Multiple Timescales During Motor Planning

Plans are formulated and refined over the period leading to their execution, ensuring that the appropriate behavior is enacted at just the right time. While existing evidence suggests that memory circuits convey the passage of time through diverse neuronal responses, it remains unclear whether the neural circuits involved in planning behavior exhibit analogous temporal dynamics. Using publicly available data, we analyzed how activity in the frontal motor cortex evolves during motor planning. Individual neurons exhibited diverse ramping activity throughout a delay interval that preceded a planned movement. The collective activity of these neurons was useful for making temporal predictions that became increasingly precise as the movement time approached. This temporal diversity gave rise to a spectrum of encoding patterns, ranging from stable to dynamic representations of the upcoming movement. Our results indicate that neural activity unfolds over multiple timescales during motor planning, suggesting a shared mechanism in the brain for processing temporal information related to both past memories and future plans.

Neuronal Population Encoding of Identity in Primate Prefrontal Cortex

The ventrolateral prefrontal cortex (VLPFC) shows robust activation during the perception of faces and voices. However, little is known about what categorical features of social stimuli drive neural activity in this region. Since perception of identity and expression are critical social functions, we examined whether neural responses to naturalistic stimuli were driven by these two categorical features in the prefrontal cortex. We recorded single neurons in the VLPFC, while two male rhesus macaques (Macaca mulatta) viewed short audiovisual videos of unfamiliar conspecifics making expressions of aggressive, affiliative, and neutral valence. Of the 285 neurons responsive to the audiovisual stimuli, 111 neurons had a main effect (two-way ANOVA) of identity, expression, or their interaction in their stimulus-related firing rates; however, decoding of expression and identity using single-unit firing rates rendered poor accuracy. Interestingly, when decoding from pseudo-populations of recorded neurons, the accuracy for both expression and identity increased with population size, suggesting that the population transmitted information relevant to both variables. Principal components analysis of mean population activity across time revealed that population responses to the same identity followed similar trajectories in the response space, facilitating segregation from other identities. Our results suggest that identity is a critical feature of social stimuli that dictates the structure of population activity in the VLPFC, during the perception of vocalizations and their corresponding facial expressions. These findings enhance our understanding of the role of the VLPFC in social behavior.

Applications of information geometry to spiking neural network activity

The space of possible behaviors that complex biological systems may exhibit is unimaginably vast, and these systems often appear to be stochastic, whether due to variable noisy environmental inputs or intrinsically generated chaos. The brain is a prominent example of a biological system with complex behaviors. The number of possible patterns of spikes emitted by a local brain circuit is combinatorially large, although the brain may not make use of all of them. Understanding which of these possible patterns are actually used by the brain, and how those sets of patterns change as properties of neural circuitry change is a major goal in neuroscience. Recently, tools from information geometry have been used to study embeddings of probabilistic models onto a hierarchy of model manifolds that encode how model outputs change as a function of their parameters, giving a quantitative notion of "distances" between outputs. We apply this method to a network model of excitatory and inhibitory neural populations to understand how the competition between membrane and synaptic response timescales shapes the network's information geometry. The hyperbolic embedding allows us to identify the statistical parameters to which the model behavior is most sensitive, and demonstrate how the ranking of these coordinates changes with the balance of excitation and inhibition in the network.

The neuronal implementation of representational geometry in primate prefrontal cortex

Modern neuroscience has seen the rise of a population-doctrine that represents cognitive variables using geometrical structures in activity space. Representational geometry does not, however, account for how individual neurons implement these representations. Leveraging the principle of sparse coding, we present a framework to dissect representational geometry into biologically interpretable components that retain links to single neurons. Applied to extracellular recordings from the primate prefrontal cortex in a working memory task with interference, the identified components revealed disentangled and sequential memory representations including the recovery of memory content after distraction, signals hidden to conventional analyses. Each component was contributed by small subpopulations of neurons with distinct spiking properties and response dynamics. Modeling showed that such sparse implementations are supported by recurrently connected circuits as in prefrontal cortex. The perspective of neuronal implementation links representational geometries to their cellular constituents, providing mechanistic insights into how neural systems encode and process information.

Static and dynamic coding in distinct cell types during associative learning in the prefrontal cortex

The prefrontal cortex maintains information in memory through static or dynamic population codes depending on task demands, but whether the population coding schemes used are learning-dependent and differ between cell types is currently unknown. We investigate the population coding properties and temporal stability of neurons recorded from male macaques in two mapping tasks during and after stimulus-response associative learning, and then we use a Strategy task with the same stimuli and responses as control. We identify a heterogeneous population coding for stimuli, responses, and novel associations: static for putative pyramidal cells and dynamic for putative interneurons that show the strongest selectivity for all the variables. The population coding of learned associations shows overall the highest stability driven by cell types, with interneurons changing from dynamic to static coding after successful learning. The results support that prefrontal microcircuitry expresses mixed population coding governed by cell types and changes its stability during associative learning.

Decoding working memory information from neurons with and without persistent activity in the primate prefrontal cortex

Persistent activity of neurons in the prefrontal cortex has been thought to represent the information maintained in working memory, though alternative models have challenged this idea. Theories that depend on the dynamic representation of information posit that stimulus information may be maintained by the activity pattern of neurons whose firing rate is not significantly elevated above their baseline during the delay period of working memory tasks. We thus tested the ability of neurons that do and do not generate persistent activity in the prefrontal cortex of monkeys to represent spatial and object information in working memory. Neurons that generated persistent activity represented more information about the stimuli in both spatial and object working memory tasks. The amount of information that could be decoded from neural activity depended on the choice of decoder and parameters used but neurons with persistent activity outperformed non-persistent neurons consistently. Averaged across all neurons and stimuli, the firing rate did not appear clearly elevated above baseline during the maintenance of neural activity particularly for object working memory; however, this grand average masked neurons that generated persistent activity selective for their preferred stimuli, which carried the majority of stimulus information. These results reveal that prefrontal neurons that generate persistent activity maintain information more reliably during working memory.NEW & NOTEWORTHY Competing theories suggest that neurons that generate persistent activity or do not are primarily responsible for the maintenance of information, particularly regarding object working memory. Although the two models have been debated on theoretical terms, direct comparison of empirical results has been lacking. Analysis of neural activity in a large database of prefrontal recordings revealed that neurons that generate persistent activity were primarily responsible for the maintenance of both spatial and object working memory.

Optimal information loading into working memory explains dynamic coding in the prefrontal cortex

Working memory involves the short-term maintenance of information and is critical in many tasks. The neural circuit dynamics underlying working memory remain poorly understood, with different aspects of prefrontal cortical (PFC) responses explained by different putative mechanisms. By mathematical analysis, numerical simulations, and using recordings from monkey PFC, we investigate a critical but hitherto ignored aspect of working memory dynamics: information loading. We find that, contrary to common assumptions, optimal loading of information into working memory involves inputs that are largely orthogonal, rather than similar, to the late delay activities observed during memory maintenance, naturally leading to the widely observed phenomenon of dynamic coding in PFC. Using a theoretically principled metric, we show that PFC exhibits the hallmarks of optimal information loading. We also find that optimal information loading emerges as a general dynamical strategy in task-optimized recurrent neural networks. Our theory unifies previous, seemingly conflicting theories of memory maintenance based on attractor or purely sequential dynamics and reveals a normative principle underlying dynamic coding.

Phantom oscillations in principal component analysis

Principal component analysis (PCA) is a dimensionality reduction method that is known for being simple and easy to interpret. Principal components are often interpreted as low-dimensional patterns in high-dimensional space. However, this simple interpretation fails for timeseries, spatial maps, and other continuous data. In these cases, nonoscillatory data may have oscillatory principal components. Here, we show that two common properties of data cause oscillatory principal components: smoothness and shifts in time or space. These two properties implicate almost all neuroscience data. We show how the oscillations produced by PCA, which we call "phantom oscillations," impact data analysis. We also show that traditional cross-validation does not detect phantom oscillations, so we suggest procedures that do. Our findings are supported by a collection of mathematical proofs. Collectively, our work demonstrates that patterns which emerge from high-dimensional data analysis may not faithfully represent the underlying data.

Functional alterations of the prefrontal circuit underlying cognitive aging in mice

Executive function is susceptible to aging. How aging impacts the circuit-level computations underlying executive function remains unclear. Using calcium imaging and optogenetic manipulation during memory-guided behavior, we show that working-memory coding and the relevant recurrent connectivity in the mouse medial prefrontal cortex (mPFC) are altered as early as middle age. Population activity in the young adult mPFC exhibits dissociable yet overlapping patterns between tactile and auditory modalities, enabling crossmodal memory coding concurrent with modality-dependent coding. In middle age, however, crossmodal coding remarkably diminishes while modality-dependent coding persists, and both types of coding decay in advanced age. Resting-state functional connectivity, especially among memory-coding neurons, decreases already in middle age, suggesting deteriorated recurrent circuits for memory maintenance. Optogenetic inactivation reveals that the middle-aged mPFC exhibits heightened vulnerability to perturbations. These findings elucidate functional alterations of the prefrontal circuit that unfold in middle age and deteriorate further as a hallmark of cognitive aging.

Common Mechanisms of Learning in Motor and Cognitive Systems

Rapid progress in our understanding of the brain's learning mechanisms has been accomplished over the past decade, particularly with conceptual advances, including representing behavior as a dynamical system, large-scale neural population recordings, and new methods of analysis of neuronal populations. However, motor and cognitive systems have been traditionally studied with different methods and paradigms. Recently, some common principles, evident in both behavior and neural activity, that underlie these different types of learning have become to emerge. Here we review results from motor and cognitive learning, relying on different techniques and studying different systems to understand the mechanisms of learning. Movement is intertwined with cognitive operations, and its dynamics reflect cognitive variables. Training, in either motor or cognitive tasks, involves recruitment of previously unresponsive neurons and reorganization of neural activity in a low dimensional manifold. Mapping of new variables in neural activity can be very rapid, instantiating flexible learning of new tasks. Communication between areas is just as critical a part of learning as are patterns of activity within an area emerging with learning. Common principles across systems provide a map for future research.

Shifts in attention drive context-dependent subspace encoding in anterior cingulate cortex during decision making

Attention is a cognitive faculty that selects part of a larger set of percepts, driven by cues such as stimulus saliency, internal goals or priors. The enhancement of the attended representation and inhibition of distractors have been proposed as potential neural mechanisms driving this selection process. Yet, how attention operates when the cue has to be internally constructed from conflicting stimuli, decision rules, and reward contingencies, is less understood. Here we recorded from populations of neurons in the anterior cingulate cortex (ACC), an area implicated in ongoing error monitoring and correction during decision conflicts, in a challenging attention-shifting task. In this task, mice had to attend to the rewarded modality when presented identical auditory and visual stimuli in two contexts without direct external cues. In the ACC, the irrelevant stimulus continuously became less decodable than the relevant stimulus as the trial progressed to the decision point. This contrasted strongly with our previous findings in V1 where both relevant and irrelevant stimuli were equally decodable throughout the trial. Using analytical tools and a recurrent neural network (RNN) model, we found that the linearly independent representation of stimulus modalities in ACC was well suited to context-gated suppression of a stimulus modality. We demonstrated that the feedback structure of lateral connections in the RNN consisted of excitatory interactions between cell ensembles representing the same modality and mutual inhibition between cell ensembles representing distinct stimulus modalities. Using this RNN model showing signatures of context-gated suppression, we predicted that the level of contextual modulation of individual neurons should be correlated with their relative responsiveness to the two stimulus modalities used in the task. We verified this prediction in recordings from ACC neurons but not from recordings from V1 neurons. Therefore, ACC effectively operates on low-dimensional neuronal subspaces to combine stimulus related information with internal cues to drive actions under conflict.

Self-Organization of Nonlinearly Coupled Neural Fluctuations Into Synergistic Population Codes

Neural activity in the brain exhibits correlated fluctuations that may strongly influence the properties of neural population coding. However, how such correlated neural fluctuations may arise from the intrinsic neural circuit dynamics and subsequently affect the computational properties of neural population activity remains poorly understood. The main difficulty lies in resolving the nonlinear coupling between correlated fluctuations with the overall dynamics of the system. In this study, we investigate the emergence of synergistic neural population codes from the intrinsic dynamics of correlated neural fluctuations in a neural circuit model capturing realistic nonlinear noise coupling of spiking neurons. We show that a rich repertoire of spatial correlation patterns naturally emerges in a bump attractor network and further reveals the dynamical regime under which the interplay between differential and noise correlations leads to synergistic codes. Moreover, we find that negative correlations may induce stable bound states between two bumps, a phenomenon previously unobserved in firing rate models. These noise-induced effects of bump attractors lead to a number of computational advantages including enhanced working memory capacity and efficient spatiotemporal multiplexing and can account for a range of cognitive and behavioral phenomena related to working memory. This study offers a dynamical approach to investigating realistic correlated neural fluctuations and insights to their roles in cortical computations.

Individual prefrontal neurons contribute to sensory-to-motor information transformation by rotating reference frames during spatial working memory performance

Performing working memory tasks correctly requires not only the temporary maintenance of information but also the visual-to-motor transformation of information. Although sustained delay-period activity is known to be a mechanism for temporarily maintaining information, the mechanism for information transformation is not well known. An analysis using a population of delay-period activities recorded from prefrontal neurons visualized a gradual change of maintained information from sensory to motor as the delay period progressed. However, the contributions of individual prefrontal neurons to this process are not known. In the present study, we used a version of the delayed-response task, in which monkeys needed to make a saccade 90o clockwise from a visual cue after a 3-s delay, and examined the temporal change in the preferred directions of delay-period activity during the delay period for individual neurons. One group of prefrontal neurons encoded the cue direction by a retinotopic reference frame and either maintained it throughout the delay period or rotated it 90o counterclockwise to adjust visual information to saccade information, whereas other groups of neurons encoded the cue direction by a saccade-based reference frame and rotated it 90o clockwise. The results indicate that visual-to-motor information transformation is achieved by manipulating the reference frame to adjust visual coordinates to motor coordinates.

Neural signatures of natural behavior in socializing macaques

Our understanding of the neurobiology of primate behavior largely derives from artificial tasks in highly-controlled laboratory settings, overlooking most natural behaviors primate brains evolved to produce1. In particular, how primates navigate the multidimensional social relationships that structure daily life and shape survival and reproductive success remains largely unexplored at the single neuron level. Here, we combine ethological analysis with new wireless recording technologies to uncover neural signatures of natural behavior in unrestrained, socially interacting pairs of rhesus macaques within a larger colony. Population decoding of single neuron activity in prefrontal and temporal cortex unveiled robust encoding of 24 species-typical behaviors, which was strongly modulated by the presence and identity of surrounding monkeys. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioral mechanism supporting friendships and alliances, and neural activity maintained a running account of these social investments. When confronted with an aggressive intruder, behavioral and neural population responses reflected empathy and were buffered by the presence of a partner. Surprisingly, neural signatures in prefrontal and temporal cortex were largely indistinguishable and irreducible to visual and motor contingencies. By employing an ethological approach to the study of primate neurobiology, we reveal a highly-distributed neurophysiological record of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

Automated customization of large-scale spiking network models to neuronal population activity

Understanding brain function is facilitated by constructing computational models that accurately reproduce aspects of brain activity. Networks of spiking neurons capture the underlying biophysics of neuronal circuits, yet the dependence of their activity on model parameters is notoriously complex. As a result, heuristic methods have been used to configure spiking network models, which can lead to an inability to discover activity regimes complex enough to match large-scale neuronal recordings. Here we propose an automatic procedure, Spiking Network Optimization using Population Statistics (SNOPS), to customize spiking network models that reproduce the population-wide covariability of large-scale neuronal recordings. We first confirmed that SNOPS accurately recovers simulated neural activity statistics. Then, we applied SNOPS to recordings in macaque visual and prefrontal cortices and discovered previously unknown limitations of spiking network models. Taken together, SNOPS can guide the development of network models and thereby enable deeper insight into how networks of neurons give rise to brain function.

Neural population dynamics of human working memory

The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics.

Single-neuron and population measures of neuronal activity in working memory tasks

Information represented in working memory is reflected in the firing rate of neurons in the prefrontal cortex and brain areas connected to it. In recent years, there has been an increased realization that population measures capture more accurately neural correlates of cognitive functions. We examined how single neuron firing in the prefrontal and posterior parietal cortex of two male monkeys compared with population measures in spatial working memory tasks. Persistent activity was observed in the dorsolateral prefrontal and posterior parietal cortex and firing rate predicted working memory behavior, particularly in the prefrontal cortex. These findings had equivalents in population measures, including trajectories in state space that became less separated in error trials. We additionally observed rotations of stimulus representations in the neuronal state space for different task conditions, which were not obvious in firing rate measures. These results suggest that population measures provide a richer view of how neuronal activity is associated with behavior, largely confirming that persistent activity is the core phenomenon that maintains visual-spatial information in working memory.NEW & NOTEWORTHY Recordings from large numbers of neurons led to a reevaluation of neural correlates of cognitive functions, which traditionally were defined based on responses of single neurons or averages of firing rates. Analysis of neuronal recordings from the dorsolateral prefrontal and posterior parietal cortex revealed that properties of neuronal firing captured in classical studies of persistent activity can account for population representations, though some population characteristics did not have clear correlates in single neuron activity.

Sequential sparse autoencoder for dynamic heading representation in ventral intraparietal area

To navigate in space, it is important to predict headings in real-time from neural responses in the brain to vestibular and visual signals, and the ventral intraparietal area (VIP) is one of the critical brain areas. However, it remains unexplored in the population level how the heading perception is represented in VIP. And there are no commonly used methods suitable for decoding the headings from the population responses in VIP, given the large spatiotemporal dynamics and heterogeneity in the neural responses. Here, responses were recorded from 210 VIP neurons in three rhesus monkeys when they were performing a heading perception task. And by specifically and separately modelling the both dynamics with sparse representation, we built a sequential sparse autoencoder (SSAE) to do the population decoding on the recorded dataset and tried to maximize the decoding performance. The SSAE relies on a three-layer sparse autoencoder to extract temporal and spatial heading features in the dataset via unsupervised learning, and a softmax classifier to decode the headings. Compared with other population decoding methods, the SSAE achieves a leading accuracy of 96.8% ± 2.1%, and shows the advantages of robustness, low storage and computing burden for real-time prediction. Therefore, our SSAE model performs well in learning neurobiologically plausible features comprising dynamic navigational information.

A robust and compact population code for competing sounds in auditory cortex

Cortical circuits encoding sensory information consist of populations of neurons, yet how information aggregates via pooling individual cells remains poorly understood. Such pooling may be particularly important in noisy settings where single-neuron encoding is degraded. One example is the cocktail party problem, with competing sounds from multiple spatial locations. How populations of neurons in auditory cortex code competing sounds have not been previously investigated. Here, we apply a novel information-theoretic approach to estimate information in populations of neurons in mouse auditory cortex about competing sounds from multiple spatial locations, including both summed population (SP) and labeled line (LL) codes. We find that a small subset of neurons is sufficient to nearly maximize mutual information over different spatial configurations, with the labeled line code outperforming the summed population code and approaching information levels attained in the absence of competing stimuli. Finally, information in the labeled line code increases with spatial separation between target and masker, in correspondence with behavioral results on spatial release from masking in humans and animals. Taken together, our results reveal that a compact population of neurons in auditory cortex provides a robust code for competing sounds from different spatial locations.NEW & NOTEWORTHY Little is known about how populations of neurons within cortical circuits encode sensory stimuli in the presence of competing stimuli at other spatial locations. Here, we investigate this problem in auditory cortex using a recently proposed information-theoretic approach. We find a small subset of neurons nearly maximizes information about target sounds in the presence of competing maskers, approaching information levels for isolated stimuli, and provides a noise-robust code for sounds in a complex auditory scene.

Action space restructures visual working memory in prefrontal cortex

Visual working memory enables flexible behavior by decoupling sensory stimuli from behavioral actions. While previous studies have predominantly focused on the storage component of working memory, the role of future actions in shaping working memory remains unknown. To answer this question, we used two working memory tasks that allowed the dissociation of sensory and action components of working memory. We measured behavioral performance and neuronal activity in the macaque prefrontal cortex area, frontal eye fields. We show that the action space reshapes working memory, as evidenced by distinct patterns of memory tuning and attentional orienting between the two tasks. Notably, neuronal activity during the working memory period predicted future behavior and exhibited mixed selectivity in relation to the sensory space but linear selectivity relative to the action space. This linear selectivity was achieved through the rapid transformation from sensory to action space and was subsequently maintained as a stable cross-temporal population activity pattern. Combined, we provide direct physiological evidence of the action-oriented nature of frontal eye field neurons during memory tasks and demonstrate that the anticipation of behavioral outcomes plays a significant role in transforming and maintaining the contents of visual working memory.

Feedforward amplification in recurrent networks underlies paradoxical neural coding

The activity of single neurons encodes behavioral variables, such as sensory stimuli (Hubel & Wiesel 1959) and behavioral choice (Britten et al. 1992; Guo et al. 2014), but their influence on behavior is often mysterious. We estimated the influence of a unit of neural activity on behavioral choice from recordings in anterior lateral motor cortex (ALM) in mice performing a memory-guided movement task (H. K. Inagaki et al. 2018). Choice selectivity grew as it flowed through a sequence of directions in activity space. Early directions carried little selectivity but were predicted to have a large behavioral influence, while late directions carried large selectivity and little behavioral influence. Consequently, estimated behavioral influence was only weakly correlated with choice selectivity; a large proportion of neurons selective for one choice were predicted to influence choice in the opposite direction. These results were consistent with models in which recurrent circuits produce feedforward amplification (Goldman 2009; Ganguli et al. 2008; Murphy & Miller 2009) so that small amplitude signals along early directions are amplified to produce low-dimensional choice selectivity along the late directions, and behavior. Targeted photostimulation experiments (Daie et al. 2021b) revealed that activity along the early directions triggered sequential activity along the later directions and caused predictable behavioral biases. These results demonstrate the existence of an amplifying feedforward dynamical motif in the motor cortex, explain paradoxical responses to perturbation experiments (Chettih & Harvey 2019; Daie et al. 2021b; Russell et al. 2019), and reveal behavioral relevance of small amplitude neural dynamics.

Intracortical brain-computer interfaces in primates: a review and outlook

Brain-computer interfaces (BCI) translate brain signals into artificial output to restore or replace natural central nervous system (CNS) functions. Multiple processes, including sensorimotor integration, decision-making, motor planning, execution, and updating, are involved in any movement. For example, a BCI may be better able to restore naturalistic motor behaviors if it uses signals from multiple brain areas and decodes natural behaviors' cognitive and motor aspects. This review provides an overview of the preliminary information necessary to plan a BCI project focusing on intracortical implants in primates. Since the brain structure and areas of non-human primates (NHP) are similar to humans, exploring the result of NHP studies will eventually benefit human BCI studies. The different types of BCI systems based on the target cortical area, types of signals, and decoding methods will be discussed. In addition, various successful state-of-the-art cases will be reviewed in more detail, focusing on the general algorithm followed in the real-time system. Finally, an outlook for improving the current BCI research studies will be debated.

The dynamics and geometry of choice in premotor cortex

The brain represents sensory variables in the coordinated activity of neural populations, in which tuning curves of single neurons define the geometry of the population code. Whether the same coding principle holds for dynamic cognitive variables remains unknown because internal cognitive processes unfold with a unique time course on single trials observed only in the irregular spiking of heterogeneous neural populations. Here we show the existence of such a population code for the dynamics of choice formation in the primate premotor cortex. We developed an approach to simultaneously infer population dynamics and tuning functions of single neurons to the population state. Applied to spike data recorded during decision-making, our model revealed that populations of neurons encoded the same dynamic variable predicting choices, and heterogeneous firing rates resulted from the diverse tuning of single neurons to this decision variable. The inferred dynamics indicated an attractor mechanism for decision computation. Our results reveal a common geometric principle for neural encoding of sensory and dynamic cognitive variables.

Multiplexing working memory and time in the trajectories of neural networks

Working memory (WM) and timing are generally considered distinct cognitive functions, but similar neural signatures have been implicated in both. To explore the hypothesis that WM and timing may rely on shared neural mechanisms, we used psychophysical tasks that contained either task-irrelevant timing or WM components. In both cases, the task-irrelevant component influenced performance. We then developed recurrent neural network (RNN) simulations that revealed that cue-specific neural sequences, which multiplexed WM and time, emerged as the dominant regime that captured the behavioural findings. During training, RNN dynamics transitioned from low-dimensional ramps to high-dimensional neural sequences, and depending on task requirements, steady-state or ramping activity was also observed. Analysis of RNN structure revealed that neural sequences relied primarily on inhibitory connections, and could survive the deletion of all excitatory-to-excitatory connections. Our results indicate that in some instances WM is encoded in time-varying neural activity because of the importance of predicting when WM will be used.

A Transient High-dimensional Geometry Affords Stable Conjunctive Subspaces for Efficient Action Selection

Flexible action selection requires cognitive control mechanisms capable of mapping the same inputs to diverse output actions depending on goals and contexts. How the brain encodes information to enable this capacity remains one of the longstanding and fundamental problems in cognitive neuroscience. From a neural state-space perspective, solving this problem requires a control representation that can disambiguate similar input neural states, making task-critical dimensions separable depending on the context. Moreover, for action selection to be robust and time-invariant, control representations must be stable in time, thereby enabling efficient readout by downstream processing units. Thus, an ideal control representation should leverage geometry and dynamics that maximize the separability and stability of neural trajectories for task computations. Here, using novel EEG decoding methods, we investigated how the geometry and dynamics of control representations constrain flexible action selection in the human brain. Specifically, we tested the hypothesis that encoding a temporally stable conjunctive subspace that integrates stimulus, response, and context (i.e., rule) information in a high-dimensional geometry achieves the separability and stability needed for context-dependent action selection. Human participants performed a task that requires context-dependent action selection based on pre-instructed rules. Participants were cued to respond immediately at varying intervals following stimulus presentation, which forced responses at different states in neural trajectories. We discovered that in the moments before successful responses, there was a transient expansion of representational dimensionality that separated conjunctive subspaces. Further, we found that the dynamics stabilized in the same time window, and that the timing of entry into this stable and high-dimensional state predicted the quality of response selection on individual trials. These results establish the neural geometry and dynamics the human brain needs for flexible control over behavior.

Oxytocin promotes prefrontal population activity via the PVN-PFC pathway to regulate pain

Neurons in the prefrontal cortex (PFC) can provide top-down regulation of sensory-affective experiences such as pain. Bottom-up modulation of sensory coding in the PFC, however, remains poorly understood. Here, we examined how oxytocin (OT) signaling from the hypothalamus regulates nociceptive coding in the PFC. In vivo time-lapse endoscopic calcium imaging in freely behaving rats showed that OT selectively enhanced population activity in the prelimbic PFC in response to nociceptive inputs. This population response resulted from the reduction of evoked GABAergic inhibition and manifested as elevated functional connectivity involving pain-responsive neurons. Direct inputs from OT-releasing neurons in the paraventricular nucleus (PVN) of the hypothalamus are crucial to maintaining this prefrontal nociceptive response. Activation of the prelimbic PFC by OT or direct optogenetic stimulation of oxytocinergic PVN projections reduced acute and chronic pain. These results suggest that oxytocinergic signaling in the PVN-PFC circuit constitutes a key mechanism to regulate cortical sensory processing.

Bifurcation in space: Emergence of function modularity in the neocortex

How does functional modularity emerge in a multiregional cortex made with repeats of a canonical local circuit architecture? We investigated this question by focusing on neural coding of working memory, a core cognitive function. Here we report a mechanism dubbed "bifurcation in space", and show that its salient signature is spatially localized "critical slowing down" leading to an inverted V-shaped profile of neuronal time constants along the cortical hierarchy during working memory. The phenomenon is confirmed in connectome-based large-scale models of mouse and monkey cortices, offering an experimentally testable prediction to assess whether working memory representation is modular. Many bifurcations in space could explain the emergence of different activity patterns potentially deployed for distinct cognitive functions, This work demonstrates that a distributed mental representation is compatible with functional specificity as a consequence of macroscopic gradients of neurobiological properties across the cortex, suggesting a general principle for understanding brain's modular organization.

A unifying perspective on neural manifolds and circuits for cognition

Two different perspectives have informed efforts to explain the link between the brain and behaviour. One approach seeks to identify neural circuit elements that carry out specific functions, emphasizing connectivity between neurons as a substrate for neural computations. Another approach centres on neural manifolds - low-dimensional representations of behavioural signals in neural population activity - and suggests that neural computations are realized by emergent dynamics. Although manifolds reveal an interpretable structure in heterogeneous neuronal activity, finding the corresponding structure in connectivity remains a challenge. We highlight examples in which establishing the correspondence between low-dimensional activity and connectivity has been possible, unifying the neural manifold and circuit perspectives. This relationship is conspicuous in systems in which the geometry of neural responses mirrors their spatial layout in the brain, such as the fly navigational system. Furthermore, we describe evidence that, in systems in which neural responses are heterogeneous, the circuit comprises interactions between activity patterns on the manifold via low-rank connectivity. We suggest that unifying the manifold and circuit approaches is important if we are to be able to causally test theories about the neural computations that underlie behaviour.

Distinct hippocampal-prefrontal neural assemblies coordinate memory encoding, maintenance, and recall

Short-term memory enables incorporation of recent experience into subsequent decision-making. This processing recruits both the prefrontal cortex and hippocampus, where neurons encode task cues, rules, and outcomes. However, precisely which information is carried when, and by which neurons, remains unclear. Using population decoding of activity in rat medial prefrontal cortex (mPFC) and dorsal hippocampal CA1, we confirm that mPFC populations lead in maintaining sample information across delays of an operant non-match to sample task, despite individual neurons firing only transiently. During sample encoding, distinct mPFC subpopulations joined distributed CA1-mPFC cell assemblies hallmarked by 4-5 Hz rhythmic modulation; CA1-mPFC assemblies re-emerged during choice episodes but were not 4-5 Hz modulated. Delay-dependent errors arose when attenuated rhythmic assembly activity heralded collapse of sustained mPFC encoding. Our results map component processes of memory-guided decisions onto heterogeneous CA1-mPFC subpopulations and the dynamics of physiologically distinct, distributed cell assemblies.

Comparing representations and computations in single neurons versus neural networks

Single-neuron-level explanations have been the gold standard in neuroscience for decades. Recently, however, neural-network-level explanations have become increasingly popular. This increase in popularity is driven by the fact that the analysis of neural networks can solve problems that cannot be addressed by analyzing neurons independently. In this opinion article, I argue that while both frameworks employ the same general logic to link physical and mental phenomena, in many cases the neural network framework provides better explanatory objects to understand representations and computations related to mental phenomena. I discuss what constitutes a mechanistic explanation in neural systems, provide examples, and conclude by highlighting a number of the challenges and considerations associated with the use of analyses of neural networks to study brain function.

Spectrotemporal content of human auditory working memory represented in functional connectivity patterns

Recent research suggests that working memory (WM), the mental sketchpad underlying thinking and communication, is maintained by multiple regions throughout the brain. Whether parts of a stable WM representation could be distributed across these brain regions is, however, an open question. We addressed this question by examining the content-specificity of connectivity-pattern matrices between subparts of cortical regions-of-interest (ROI). These connectivity patterns were calculated from functional MRI obtained during a ripple-sound auditory WM task. Statistical significance was assessed by comparing the decoding results to a null distribution derived from a permutation test considering all comparable two- to four-ROI connectivity patterns. Maintained WM items could be decoded from connectivity patterns across ROIs in frontal, parietal, and superior temporal cortices. All functional connectivity patterns that were specific to maintained sound content extended from early auditory to frontoparietal cortices. Our results demonstrate that WM maintenance is supported by content-specific patterns of functional connectivity across different levels of cortical hierarchy.

Multitask computation through dynamics in recurrent spiking neural networks

In this work, inspired by cognitive neuroscience experiments, we propose recurrent spiking neural networks trained to perform multiple target tasks. These models are designed by considering neurocognitive activity as computational processes through dynamics. Trained by input-output examples, these spiking neural networks are reverse engineered to find the dynamic mechanisms that are fundamental to their performance. We show that considering multitasking and spiking within one system provides insightful ideas on the principles of neural computation.

Foundations of a temporal RL

Recent advances in neuroscience and psychology show that the brain has access to timelines of both the past and the future. Spiking across populations of neurons in many regions of the mammalian brain maintains a robust temporal memory, a neural timeline of the recent past. Behavioral results demonstrate that people can estimate an extended temporal model of the future, suggesting that the neural timeline of the past could extend through the present into the future. This paper presents a mathematical framework for learning and expressing relationships between events in continuous time. We assume that the brain has access to a temporal memory in the form of the real Laplace transform of the recent past. Hebbian associations with a diversity of synaptic time scales are formed between the past and the present that record the temporal relationships between events. Knowing the temporal relationships between the past and the present allows one to predict relationships between the present and the future, thus constructing an extended temporal prediction for the future. Both memory for the past and the predicted future are represented as the real Laplace transform, expressed as the firing rate over populations of neurons indexed by different rate constants s. The diversity of synaptic timescales allows for a temporal record over the much larger time scale of trial history. In this framework, temporal credit assignment can be assessed via a Laplace temporal difference. The Laplace temporal difference compares the future that actually follows a stimulus to the future predicted just before the stimulus was observed. This computational framework makes a number of specific neurophysiological predictions and, taken together, could provide the basis for a future iteration of RL that incorporates temporal memory as a fundamental building block.

Evaluation of betulinic acid effects on pain, memory, anxiety, catalepsy, and oxidative stress in animal model of Parkinson's disease

Parkinson's disease (PD) is known for motor impairments. Betulinic acid (BA) is a natural compound with antioxidant activity. The present study addresses the question of whether BA affects motor and non-motor dysfunctions and molecular changes in the rat model of PD. The right medial forebrain bundle was lesioned by injection of 6-hydroxydopamine in Male Wistar rats (10-12 weeks old, 270-320 g). Animals were divided into Sham, PD, 3 treated groups with BA (0.5, 5, and 10 mg/kg, IP), and a positive control group received L-dopa (20 mg/kg, P.O) for 7 days. rigidity, anxiety, analgesia, and memory were assessed by bar test, open-field, elevated plus-maze (EPM), tail-flick, and shuttle box. Additionally, the malondialdehyde (MDA), Superoxide dismutase (SOD), glutathione peroxidase (GPx) activity, Brain-derived neurotrophic factor (BDNF) and Interleukin 10 (IL10) levels in the whole brain were measured. BA significantly reversed the 6-hydroxydopamine-induced motor and memory complication in the bar test and shuttle box. It modified anxiety-like behavior neither in open-field nor in EPM. It only decreased the time spent in open arms. Moreover, no significant changes were found in the tail-flick between treatment and sham groups. On the other hand, the level of MDA & IL10 were decreased, while the activity of GPx levels of SOD & BDNF in the rats' brains was increased. Our results showed that BA as a free radical scavenger can account for a possible promise as a good therapeutic agent for motor and non-motor complications in PD however further studies may be needed.

Dimensionality reduction of calcium-imaged neuronal population activity

Calcium imaging has been widely adopted for its ability to record from large neuronal populations. To summarize the time course of neural activity, dimensionality reduction methods, which have been applied extensively to population spiking activity, may be particularly useful. However, it is unclear if the dimensionality reduction methods applied to spiking activity are appropriate for calcium imaging. We thus carried out a systematic study of design choices based on standard dimensionality reduction methods. We also developed a method to perform deconvolution and dimensionality reduction simultaneously (Calcium Imaging Linear Dynamical System, CILDS). CILDS most accurately recovered the single-trial, low-dimensional time courses from simulated calcium imaging data. CILDS also outperformed the other methods on calcium imaging recordings from larval zebrafish and mice. More broadly, this study represents a foundation for summarizing calcium imaging recordings of large neuronal populations using dimensionality reduction in diverse experimental settings.