Spatial Rule Learning and Corresponding CA1 Place Cell Reorientation Depend on Local Dopamine Release

Odors in space

As an evolutionarily ancient sense, olfaction is key to learning where to find food, shelter, mates, and important landmarks in an animal's environment. Brain circuitry linking odor and navigation appears to be a well conserved multi-region system among mammals; the anterior olfactory nucleus, piriform cortex, entorhinal cortex, and hippocampus each represent different aspects of olfactory and spatial information. We review recent advances in our understanding of the neural circuits underlying odor-place associations, highlighting key choices of behavioral task design and neural circuit manipulations for investigating learning and memory.

Distinct catecholaminergic pathways projecting to hippocampal CA1 transmit contrasting signals during navigation in familiar and novel environments

Neuromodulatory inputs to the hippocampus play pivotal roles in modulating synaptic plasticity, shaping neuronal activity, and influencing learning and memory. Recently it has been shown that the main sources of catecholamines to the hippocampus, ventral tegmental area (VTA) and locus coeruleus (LC), may have overlapping release of neurotransmitters and effects on the hippocampus. Therefore, to dissect the impacts of both VTA and LC circuits on hippocampal function, a thorough examination of how these pathways might differentially operate during behavior and learning is necessary. We therefore utilized 2-photon microscopy to functionally image the activity of VTA and LC axons within the CA1 region of the dorsal hippocampus in head-fixed male mice navigating linear paths within virtual reality (VR) environments. We found that within familiar environments some VTA axons and the vast majority of LC axons showed a correlation with the animals' running speed. However, as mice approached previously learned rewarded locations, a large majority of VTA axons exhibited a gradual ramping-up of activity, peaking at the reward location. In contrast, LC axons displayed a pre-movement signal predictive of the animal's transition from immobility to movement. Interestingly, a marked divergence emerged following a switch from the familiar to novel VR environments. Many LC axons showed large increases in activity that remained elevated for over a minute, while the previously observed VTA axon ramping-to-reward dynamics disappeared during the same period. In conclusion, these findings highlight distinct roles of VTA and LC catecholaminergic inputs in the dorsal CA1 hippocampal region. These inputs encode unique information, with reward information in VTA inputs and novelty and kinematic information in LC inputs, likely contributing to differential modulation of hippocampal activity during behavior and learning.

A hippocampus-accumbens code guides goal-directed appetitive behavior

The dorsal hippocampus (dHPC) is a key brain region for the expression of spatial memories, such as navigating towards a learned reward location. The nucleus accumbens (NAc) is a prominent projection target of dHPC and implicated in value-based action selection. Yet, the contents of the dHPC→NAc information stream and their acute role in behavior remain largely unknown. Here, we found that optogenetic stimulation of the dHPC→NAc pathway while mice navigated towards a learned reward location was both necessary and sufficient for spatial memory-related appetitive behaviors. To understand the task-relevant coding properties of individual NAc-projecting hippocampal neurons (dHPC→NAc), we used in vivo dual-color two-photon imaging. In contrast to other dHPC neurons, the dHPC→NAc subpopulation contained more place cells, with enriched spatial tuning properties. This subpopulation also showed enhanced coding of non-spatial task-relevant behaviors such as deceleration and appetitive licking. A generalized linear model revealed enhanced conjunctive coding in dHPC→NAc neurons which improved the identification of the reward zone. We propose that dHPC routes specific reward-related spatial and behavioral state information to guide NAc action selection.

Integrated Three-Electrode Dual-Mode Detection Chip for Place Cell Analysis: Dopamine Facilitates the Role of Place Cells in Encoding Spatial Locations of Novel Environments and Rewards

The functioning of place cells requires the involvement of multiple neurotransmitters, with dopamine playing a critical role in hippocampal place cell activity. However, the exact mechanisms through which dopamine influences place cell activity remain largely unknown. Herein, we present the development of the integrated three-electrode dual-mode detection chip (ITDDC), which enables simultaneous recording of the place cell activity and dopamine concentration fluctuation. The working electrode, reference electrode, and counter electrode are all integrated within the ITDDC in electrochemical detection, enabling the real-time in situ monitoring of dopamine concentrations in animals in motion. The reference, working, and counter electrodes are surface-modified using PtNPs and polypyrrole, PtNPs and PEDOT:PSS, and PtNPs, respectively. This modification allows for the detection of dopamine concentrations as low as 20 nM. We conducted dual-mode testing on mice in a novel environment and an environment with food rewards. We found distinct dopamine concentration variations along different paths within a novel environment, implying that different dopamine levels may contribute to spatial memory. Moreover, environmental food rewards elevate dopamine significantly, followed by the intense firing of reward place cells, suggesting a crucial role of dopamine in facilitating the encoding of reward-associated locations in animals. The real-time and in situ recording capabilities of ITDDC offer new opportunities to investigate the interplay between electrophysiology and dopamine during animal exploration and reward-based memory and provide a novel glimpse into the correlation between dopamine levels and place cell activity.

Levodopa suppresses grid-like activity and impairs spatial learning in novel environments in healthy young adults

Accumulated evidence from animal studies suggests a role for the neuromodulator dopamine in memory processes, particularly under conditions of novelty or reward. Our understanding of how dopaminergic modulation impacts spatial representations and spatial memory in humans remains limited. Recent evidence suggests age-specific regulation effects of dopamine pharmacology on activity in the medial temporal lobe, a key region for spatial memory. To which degree this modulation affects spatially patterned medial temporal representations remains unclear. We reanalyzed recent data from a pharmacological dopamine challenge during functional brain imaging combined with a virtual object-location memory paradigm to assess the effect of Levodopa, a dopamine precursor, on grid-like activity in the entorhinal cortex. We found that Levodopa impaired grid cell-like representations in a sample of young adults (n = 55, age = 26-35 years) in a novel environment, accompanied by reduced spatial memory performance. We observed no such impairment when Levodopa was delivered to participants who had prior experience with the task. These results are consistent with a role of dopamine in modulating the encoding of novel spatial experiences. Our results suggest that dopamine signaling may play a larger role in shaping ongoing spatial representations than previously thought.

Flexible coding of time or distance in hippocampal cells

Analysis of neuronal activity in the hippocampus of behaving animals has revealed cells acting as 'Time Cells', which exhibit selective spiking patterns at specific time intervals since a triggering event, and 'Distance Cells', which encode the traversal of specific distances. Other neurons exhibit a combination of these features, alongside place selectivity. This study aims to investigate how the task performed by animals during recording sessions influences the formation of these representations. We analyzed data from a treadmill running study conducted by Kraus et al., 2013, in which rats were trained to run at different velocities. The rats were recorded in two trial contexts: a 'fixed time' condition, where the animal ran on the treadmill for a predetermined duration before proceeding, and a 'fixed distance' condition, where the animal ran a specific distance on the treadmill. Our findings indicate that the type of experimental condition significantly influenced the encoding of hippocampal cells. Specifically, distance-encoding cells dominated in fixed-distance experiments, whereas time-encoding cells dominated in fixed-time experiments. These results underscore the flexible coding capabilities of the hippocampus, which are shaped by over-representation of salient variables associated with reward conditions.

Place cells are nonrandomly clustered by field location in CA1 hippocampus

A challenge in both modern and historic neuroscience has been achieving an understanding of neuron circuits, and determining the computational and organizational principles that underlie these circuits. Deeper understanding of the organization of brain circuits and cell types, including in the hippocampus, is required for advances in behavioral and cognitive neuroscience, as well as for understanding principles governing brain development and evolution. In this manuscript, we pioneer a new method to analyze the spatial clustering of active neurons in the hippocampus. We use calcium imaging and a rewarded navigation task to record from 100 s of place cells in the CA1 of freely moving rats. We then use statistical techniques developed for and in widespread use in geographic mapping studies, global Moran's I, and local Moran's I to demonstrate that cells that code for similar spatial locations tend to form small spatial clusters. We present evidence that this clustering is not the result of artifacts from calcium imaging, and show that these clusters are primarily formed by cells that have place fields around previously rewarded locations. We go on to show that, although cells with similar place fields tend to form clusters, there is no obvious topographic mapping of environmental location onto the hippocampus, such as seen in the visual cortex. Insights into hippocampal organization, as in this study, can elucidate mechanisms underlying motivational behaviors, spatial navigation, and memory formation.

Dopamine Receptor Supports the Potentiation of Intrinsic Excitability and Synaptic LTD in Temporoammonic-CA1 Synapse

Dopaminergic projection to the hippocampus from the ventral tegmental area or locus ceruleus has been considered to play an essential role in the acquisition of novel information. Hence, the dopaminergic modulation of synaptic plasticity in the hippocampus has been widely studied. We examined how the D1 and D2 receptors influenced the mGluR5-mediated synaptic plasticity of the temporoammonic-CA1 synapses and showed that the dopaminergic modulation of the temporoammonic-CA1 synapses was expressed in various ways. Our findings suggest that the dopaminergic system in the hippocampal CA1 region regulates the long-term synaptic plasticity and processing of the novel information.

Experience-dependent changes in hippocampal spatial activity and hippocampal circuit function are disrupted in a rat model of Fragile X Syndrome

BACKGROUND

Fragile X syndrome (FXS) is a common single gene cause of intellectual disability and autism spectrum disorder. Cognitive inflexibility is one of the hallmarks of FXS with affected individuals showing extreme difficulty adapting to novel or complex situations. To explore the neural correlates of this cognitive inflexibility, we used a rat model of FXS (Fmr1^-/y).

METHODS

We recorded from the CA1 in Fmr1^-/y and WT littermates over six 10-min exploration sessions in a novel environment-three sessions per day (ITI 10 min). Our recordings yielded 288 and 246 putative pyramidal cells from 7 WT and 7 Fmr1^-/y rats, respectively.

RESULTS

On the first day of exploration of a novel environment, the firing rate and spatial tuning of CA1 pyramidal neurons was similar between wild-type (WT) and Fmr1^-/y rats. However, while CA1 pyramidal neurons from WT rats showed experience-dependent changes in firing and spatial tuning between the first and second day of exposure to the environment, these changes were decreased or absent in CA1 neurons of Fmr1^-/y rats. These findings were consistent with increased excitability of Fmr1^-/y CA1 neurons in ex vivo hippocampal slices, which correlated with reduced synaptic inputs from the medial entorhinal cortex. Lastly, activity patterns of CA1 pyramidal neurons were dis-coordinated with respect to hippocampal oscillatory activity in Fmr1^-/y rats.

LIMITATIONS

It is still unclear how the observed circuit function abnormalities give rise to behavioural deficits in Fmr1^-/y rats. Future experiments will focus on this connection as well as the contribution of other neuronal cell types in the hippocampal circuit pathophysiology associated with the loss of FMRP. It would also be interesting to see if hippocampal circuit deficits converge with those seen in other rodent models of intellectual disability.

CONCLUSIONS

In conclusion, we found that hippocampal place cells from Fmr1^-/y rats show similar spatial firing properties as those from WT rats but do not show the same experience-dependent increase in spatial specificity or the experience-dependent changes in network coordination. Our findings offer support to a network-level origin of cognitive deficits in FXS.

Neuroprotection in late life attention-deficit/hyperactivity disorder: A review of pharmacotherapy and phenotype across the lifespan

For decades, psychostimulants have been the gold standard pharmaceutical treatment for attention-deficit/hyperactivity disorder (ADHD). In the United States, an astounding 9% of all boys and 4% of girls will be prescribed stimulant drugs at some point during their childhood. Recent meta-analyses have revealed that individuals with ADHD have reduced brain volume loss later in life (>60 y.o.) compared to the normal aging brain, which suggests that either ADHD or its treatment may be neuroprotective. Crucially, these neuroprotective effects were significant in brain regions (e.g., hippocampus, amygdala) where severe volume loss is linked to cognitive impairment and Alzheimer's disease. Historically, the ADHD diagnosis and its pharmacotherapy came about nearly simultaneously, making it difficult to evaluate their effects in isolation. Certain evidence suggests that psychostimulants may normalize structural brain changes typically observed in the ADHD brain. If ADHD itself is neuroprotective, perhaps exercising the brain, then psychostimulants may not be recommended across the lifespan. Alternatively, if stimulant drugs are neuroprotective, then this class of medications may warrant further investigation for their therapeutic effects. Here, we take a bottom-up holistic approach to review the psychopharmacology of ADHD in the context of recent models of attention. We suggest that future studies are greatly needed to better appreciate the interactions amongst an ADHD diagnosis, stimulant treatment across the lifespan, and structure-function alterations in the aging brain.

Flexibility of memory for future-oriented cognition

Memories of daily experiences contain incidental details unique to each experience as well as common latent patterns shared with others. Neural representations focusing on the latter aspect can be reinstated by similar new experiences even though their perceptual features do not match the original experiences perfectly. Such flexible memory use allows for faster learning and better decision-making in novel situations. Here, I review evidence from rodent and primate electrophysiological studies to discuss how memory flexibility is implemented in the spiking activity of neuronal ensembles. These findings uncovered innate and learned coding properties and their potential refinement during sleep that support flexible integration and application of memories for better future adaptation.

Statistical Learning in Vision

Vision and learning have long been considered to be two areas of research linked only distantly. However, recent developments in vision research have changed the conceptual definition of vision from a signal-evaluating process to a goal-oriented interpreting process, and this shift binds learning, together with the resulting internal representations, intimately to vision. In this review, we consider various types of learning (perceptual, statistical, and rule/abstract) associated with vision in the past decades and argue that they represent differently specialized versions of the fundamental learning process, which must be captured in its entirety when applied to complex visual processes. We show why the generalized version of statistical learning can provide the appropriate setup for such a unified treatment of learning in vision, what computational framework best accommodates this kind of statistical learning, and what plausible neural scheme could feasibly implement this framework. Finally, we list the challenges that the field of statistical learning faces in fulfilling the promise of being the right vehicle for advancing our understanding of vision in its entirety. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Navigating for reward

An organism's survival can depend on its ability to recall and navigate to spatial locations associated with rewards, such as food or a home. Accumulating research has revealed that computations of reward and its prediction occur on multiple levels across a complex set of interacting brain regions, including those that support memory and navigation. However, how the brain coordinates the encoding, recall and use of reward information to guide navigation remains incompletely understood. In this Review, we propose that the brain's classical navigation centres - the hippocampus and the entorhinal cortex - are ideally suited to coordinate this larger network by representing both physical and mental space as a series of states. These states may be linked to reward via neuromodulatory inputs to the hippocampus-entorhinal cortex system. Hippocampal outputs can then broadcast sequences of states to the rest of the brain to store reward associations or to facilitate decision-making, potentially engaging additional value signals downstream. This proposal is supported by recent advances in both experimental and theoretical neuroscience. By discussing the neural systems traditionally tied to navigation and reward at their intersection, we aim to offer an integrated framework for understanding navigation to reward as a fundamental feature of many cognitive processes.

Neuroscience: What, where, and how wonderful?

Hippocampal place cells represent spatial locations, but it is unclear how they incorporate associations between locations and specific outcomes. A recent study illuminates this issue by showing that place cells in intermediate hippocampus remap their fields following changes in reward.

Influence of dopamine transmission in the medial prefrontal cortex and dorsal striatum on the emission of 50-kHz ultrasonic vocalizations in rats treated with amphetamine: Effects on drug-stimulated and conditioned calls

Rat ultrasonic vocalizations (USVs) of 50 kHz are increasingly being evaluated as a behavioral marker of the affective properties of drugs. Studies in amphetamine-treated rats have shown that activation of dopamine transmission in the nucleus accumbens (NAc) initiates the emission of 50-kHz USVs, but little is known on how dopamine transmission in other brain regions modulates the effects of drugs on calling behavior. To clarify this issue, we evaluated 50-kHz USV emissions in rats subjected to dopaminergic denervation of either the medial prefrontal cortex (mPFC) or the dorsal striatum (DS) and treated with amphetamine. Rats received amphetamine (1 mg/kg, i.p. × 5) on alternate days in a test cage; 7 days later, they were re-exposed to the test cage, to measure calling behavior that may reflect drug conditioning, and then challenged with amphetamine (1 mg/kg, i.p.). The numbers of total and categorized 50-kHz USVs emitted were evaluated, along with immunofluorescence for Zif-268 in the NAc. Dopamine-denervated and sham-operated rats displayed comparable patterns of calling behavior during amphetamine treatment and after amphetamine challenge. Conversely, rats that were dopamine-denervated in the mPFC, but not DS, emitted low numbers of 50-kHz USVs on test cage re-exposure. Finally, dopamine-denervated rats displayed a less marked increase in Zif-268-positive neurons in the NAc shell after amphetamine challenge, compared with sham-operated rats. These results may be relevant to identify the neuronal circuits that modulate 50-kHz USV emissions in rats treated with amphetamine, as well as the interplay between calling behavior and affective properties of drugs.

Surprise response as a probe for compressed memory states

The limited capacity of recent memory inevitably leads to partial memory of past stimuli. There is also evidence that behavioral and neural responses to novel or rare stimuli are dependent on one’s memory of past stimuli. Thus, these responses may serve as a probe of different individuals’ remembering and forgetting characteristics. Here, we utilize two lossy compression models of stimulus sequences that inherently involve forgetting, which in addition to being a necessity under many conditions, also has theoretical and behavioral advantages. One model is based on a simple stimulus counter and the other on the Information Bottleneck (IB) framework which suggests a more general, theoretically justifiable principle for biological and cognitive phenomena. These models are applied to analyze a novelty-detection event-related potential commonly known as the P300. The trial-by-trial variations of the P300 response, recorded in an auditory oddball paradigm, were subjected to each model to extract two stimulus-compression parameters for each subject: memory length and representation accuracy. These parameters were then utilized to estimate the subjects’ recent memory capacity limit under the task conditions. The results, along with recently published findings on single neurons and the IB model, underscore how a lossy compression framework can be utilized to account for trial-by-trial variability of neural responses at different spatial scales and in different individuals, while at the same time providing estimates of individual memory characteristics at different levels of representation using a theoretically-based parsimonious model.

Surprise responses reflect expectations based on preceding stimuli representations, and hence can be used to infer the characteristics of memory utilized for a task. We suggest a quantitative method for extracting an individual estimate of effective memory capacity dedicated for a task based on the correspondence between a theoretical surprise model and electrophysiological single-trial surprise responses. We demonstrate this method on EEG responses recorded while participants were performing a simple auditory task; we show the correspondence between the theoretical and physiological surprise, and calculate an estimate of the utilized memory. The generality of this framework allows it to be applied to different EEG features that reflect different modes and levels of the processing hierarchy, as well as other physiological measures of surprise responses. Future studies may use this framework to construct a handy diagnostic tool for a quantitative, individualized characterization of memory-related disorders.

Encoding of Reward and Decoding Movement from the Frontal Eye Field during Smooth Pursuit Eye Movements

Expectation of reward potentiates sensorimotor transformations to drive vigorous movements. One of the main challenges in studying reward is to determine how representations of reward interact with the computations that drive behavior. We recorded activity in smooth pursuit neurons in the frontal eye field (FEF) of two male rhesus monkeys while controlling the eye speed by manipulating either reward size or target speed. The neurons encoded the different reward conditions more strongly than the different target speed conditions. This pattern could not be explained by differences in the eye speed, since the eye speed sensitivity of the neurons was also larger for the reward conditions. Pooling the responses by the preferred direction of the neurons attenuated the reward modulation and led to a tighter association between neural activity and behavior. Therefore, a plausible decoder such as the population vector could explain how the FEF both drives behavior and encodes reward beyond behavior.SIGNIFICANCE STATEMENT Motor areas combine sensory and reward information to drive movement. To disambiguate these sources, we manipulated the speed of smooth pursuit eye movements by controlling either the size of the reward or the speed of the visual motion signals. We found that the relationship between activity in frontal eye field and eye kinematics varied: the eye speed sensitivity was larger for the different reward conditions than for the different target speed conditions. Decoders that pooled signals by the preferred direction of the neurons attenuated the reward modulations. These decoders may indicate how reward can be both encoded beyond eye kinematics at the single neuron level and drive movement at the population level.

Cannabinoid disruption of learning mechanisms involved in reward processing

The increasing use of cannabis, its derivatives, and synthetic cannabinoids for medicinal and recreational purposes has led to burgeoning interest in understanding the addictive potential of this class of molecules. It is estimated that ∼10% of marijuana users will eventually show signs of dependence on the drug, and the diagnosis of cannabis use disorder (CUD) is increasing in the United States. The molecule that sustains the use of cannabis is Δ⁹-tetrahydrocannabinol (Δ⁹-THC), and our knowledge of its effects, and those of other cannabinoids on brain function has expanded rapidly in the past two decades. Additionally, the identification of endogenous cannabinoid (endocannabinoid) systems in brain and their roles in physiology and behavior, demonstrate extensive involvement of these lipid signaling molecules in regulating CNS function. Here, we examine roles for endogenous cannabinoids in shaping synaptic activity in cortical and subcortical brain circuits, and we discuss mechanisms in which exogenous cannabinoids, such as Δ⁹-THC, interact with endocannabinoid systems to disrupt neuronal network oscillations. We then explore how perturbation of the interaction of this activity within brain reward circuits may lead to impaired learning. Finally, we propose that disruption of cellular plasticity mechanisms by exogenous cannabinoids in cortical and subcortical circuits may explain the difficulty in establishing viable cannabinoid self-administration models in animals.