Ventral tegmental area and substantia nigra neural correlates of spatial learning

Dopamine Dysregulation in Reward and Autism Spectrum Disorder

Autism spectrum disorder (ASD) is primarily characterized by core deficits in social skills, communication, and cognition and by repetitive stereotyped behaviors. These manifestations are variable between individuals, and ASD pathogenesis is complex, with over a thousand implicated genes, many epigenetic factors, and multiple environmental influences. The mesolimbic dopamine (DA) mediated brain reward system is held to play a key role, but the rapidly expanding literature reveals intricate, nuanced signaling involving a wide array of mesolimbic loci, neurotransmitters and receptor subtypes, and neuronal variants. How altered DA signaling may constitute a downstream convergence of the manifold causal origins of ASD is not well understood. A clear working framework of ASD pathogenesis may help delineate common stages and potential diagnostic and interventional opportunities. Hence, we summarize the known natural history of ASD in the context of emerging data and perspectives to update ASD reward signaling. Then, against this backdrop, we proffer a provisional framework that organizes ASD pathogenesis into successive levels, including (1) genetic and epigenetic changes, (2) disrupted mesolimbic reward signaling pathways, (3) dysregulated neurotransmitter/DA signaling, and finally, (4) altered neurocognitive and social behavior and possible antagonist/agonist based ASD interventions. This subdivision of ASD into a logical progression of potentially addressable parts may help facilitate the rational formulation of diagnostics and targeted treatments.

Cognitive performance in aged rats is associated with differences in distinctive neuronal populations in the ventral tegmental area and altered synaptic plasticity in the hippocampus

Introduction

Deterioration of cognitive functions is commonly associated with aging, although there is wide variation in the onset and manifestation. Albeit heterogeneity in age-related cognitive decline has been studied at the cellular and molecular level, there is poor evidence for electrophysiological correlates. The aim of the current study was to address the electrophysiological basis of heterogeneity of cognitive functions in cognitively Inferior and Superior old (19-20 months) rats in the ventral tegmental area (VTA) and the hippocampus, having Young (12 weeks) rats as a control. The midbrain VTA operates as a hub amidst affective and cognitive facets, processing sensory inputs related to motivated behaviours and hippocampal memory. Increasing evidence shows direct dopaminergic and non-dopaminergic input from the VTA to the hippocampus.

Methods

Aged Superior and Inferior male rats were selected from a cohort of 88 animals based on their performance in a spatial learning and memory task. Using in vivo single-cell recording in the VTA, we examined the electrical activity of different neuronal populations (putative dopaminergic, glutamatergic and GABAergic neurons). In the same animals, basal synaptic transmission and synaptic plasticity were examined in hippocampal slices.

Results

Electrophysiological recordings from the VTA and hippocampus showed alterations associated with aging per se, together with differences specifically linked to the cognitive status of aged animals. In particular, the bursting activity of dopamine neurons was lower, while the firing frequency of glutamatergic neurons was higher in VTA of Inferior old rats. The response to high-frequency stimulation in hippocampal slices also discriminated between Superior and Inferior aged animals.

Discussion

This study provides new insight into electrophysiological information underlying compromised cerebral ageing. Further understanding of brain senescence, possibly related to neurocognitive decline, will help develop new strategies towards the preservation of a high quality of life.

Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

Goal-directed navigation requires learning to accurately estimate location and select optimal actions in each location. Midbrain dopamine neurons are involved in reward value learning and have been linked to reward location learning. They are therefore ideally placed to provide teaching signals for goal-directed navigation. By imaging dopamine neural activity as mice learned to actively navigate a closed-loop virtual reality corridor to obtain reward, we observe phasic and pre-reward ramping dopamine activity, which are modulated by learning stage and task engagement. A Q-learning model incorporating position inference recapitulates our results, displaying prediction errors resembling phasic and ramping dopamine neural activity. The model predicts that ramping is followed by improved task performance, which we confirm in our experimental data, indicating that the dopamine ramp may have a teaching effect. Our results suggest that midbrain dopamine neurons encode phasic and ramping reward prediction error signals to improve goal-directed navigation.

Lateral septum as a nexus for mood, motivation, and movement

The lateral septum (LS) has been implicated in a wide variety of functions, including emotional, motivational, and spatial behavior, and the LS may regulate interactions between the hippocampus and other regions that mediate goal directed behavior. In this review, we suggest that the lateral septum incorporates movement into the evaluation of environmental context with respect to motivation, anxiety, and reward to output an 'integrated movement value signal'. Specifically, hippocampally-derived contextual information may be combined with reinforcement or motivational information in the LS to inform task-relevant decisions. We will discuss how movement is represented in the LS and the literature on the LS's involvement in mood and motivation. We will then connect these results to LS movement-related literature and hypotheses about the role of the lateral septum. We suggest that the LS may communicate a movement-scaled reward signal via changes in place-, movement-, and reward-related firing, and that the LS should be considered a fundamental node of affect and locomotor pathways in the brain.

Learning and the Lifespan: What's Sex Got to Do With It?

Engagement in sexual behavior can impact neurosteroidogenesis, in particular production of the prohormone testosterone (T) and likely its subsequent metabolism to 5α-androstane-3α-17β-Diol (3α-Diol) or aromatization to estradiol (E2). Androgens and their metabolites vary across the lifespan and impact many behaviors, including cognition, anxiety, and sexual behavior. Thus, we hypothesized that mating may alter cognitive performance via androstane neurosteroids in an age- and experience-dependent manner. We first investigated if exposure to mating during memory consolidation could enhance performance in the novel object recognition task (NOR). Male rats were trained in NOR and then immediately exposed to mating-relevant or control stimuli. Following a 4 h inter-trial interval (ITI), male rats were tested for object memory. Male rats that were exposed to a receptive female during the ITI had better performance in NOR. We then investigated if these effects were due to novelty associated with mating. Male rats were exposed to mating-relevant stimuli and identified as sexually responsive (SR) or sexually non-responsive (SNR) based on a median split of engagement in mating with the stimulus female. We found that a brief history (10 min session daily for five consecutive days) of sexual history substantially influenced performance in the NOR task, such that SR males had better performance in the NOR task, but only when presented with the opportunity to mate during the ITI. As T levels substantially decrease with age in male rodents, we investigated whether the effects of long-term sexual experience (10 months) influenced neurosteroids and NOR performance in mid-aged (12 months old) males. Mid-aged SR males maintain neural T; however, they have decreased neural E2 and decreased cognitive performance at 12 months compared to mid-aged SNR rats. In sexually experienced rats, those with better cognitive performance had greater levels of T metabolites (e.g., 3α-Diol in mated SR males, E2 in mid-aged SNR rats). While naïve males that were mated during the ITI had better cognitive performance, T metabolites were decreased compared to controls. These findings suggest that T metabolites, but not the prohormone, may influence learning dependent on sexual proclivity, experience, and proximate opportunity to mate.

Previously rewarding environments enhance incidental memory formation

Declarative memory performance is superior for items that were encoded in temporal proximity to reward delivery or expectancy. How reward-predicting contexts affect subsequent declarative memory formation in those contexts are, however, unknown. Using an ecological experimental setup in the form of a naturalistic driving simulator task, we examined the effect that previously rewarded environments may have on incidental memory formation. After driving in two distinct environments, one of which associated with monetary reward, participants drove again in the environments, which were embedded with unique images on billboards. A recognition test 24 h later demonstrated that incidental memory was superior for items presented in the reward-associated environment. These findings suggest that environmental cues imbued with incentive salience promote memory processes even in the absence of reward.

Curvilinear locus coeruleus functional connectivity trajectories over the adult lifespan: a 7T MRI study

The locus coeruleus (LC) plays a crucial role in modulating several higher order cognitive functions via its widespread projections to the entire brain. We set out to investigate the hypothesis that LC functional connectivity (FC) may fluctuate nonlinearly with age and explored its relation to memory function. To that end, 49 cognitively healthy individuals (19-74 years) underwent ultra high-resolution 7T resting-state functional magnetic resonance imaging and cognitive testing. FC patterns from the LC to regions of the isodendritic core network and cortical regions were examined using region of interest-to-region of interest analyses. Curvilinear patterns with age were observed for FC between the left LC and cortical regions and the nucleus basalis of Meynert. A linear negative association was observed between age and LC-FC and ventral tegmental area. Higher levels of FC between the LC and nucleus basalis of Meynert or ventral tegmental area were associated with lower memory performance from age of 40 years onward. Thus, different LC-FC patterns early in life can signal subtle memory deficits. Furthermore, these results highlight the importance of intact interactions between neurotransmitter systems for optimal cognitive aging.

Visualization of Altered Hippocampal Connectivity in an Animal Model of Alzheimer's Disease

Alzheimer’s disease (AD) is a neurodegenerative disorder characterized by cognitive decline and neurodegeneration in the hippocampus. Despite the pathological importance of the hippocampal degeneration in AD, little topographical evidence exists of impaired hippocampal connectivity in patients with AD. To investigate the anatomical connections of the hippocampus, we injected the neurotracer 1,1′-dioctadecyl-3,3,3′3,3′-tetramethyl-indocarbocyanine perchlorate (DiI) into the hippocampi of 5XFAD mice, which were used as an animal model of AD. In wild-type controls, DiI-containing cells were found in the entorhinal cortex, medial septum, locus coeruleus, dorsal raphe, substantia nigra pars compacta, and olfactory bulb. Hippocampal inputs were decreased in multiple brain regions in the 5XFAD mice compared to wild-type littermate mice. These results are the first to reveal alterations at the cellular level in hippocampal connectivity in the brains of 5XFAD mice. These results suggest that anatomical mapping of hippocampal connectivity will elucidate new pathogenic mechanisms and therapeutic targets for AD treatment.

Effects of dorsal hippocampus catecholamine depletion on paired-associates learning and place learning in rats

Growing evidence suggests that the catecholamine (CA) neurotransmitters dopamine and noradrenaline support hippocampus-mediated learning and memory. However, little is known to date about which forms of hippocampus-mediated spatial learning are modulated by CA signaling in the hippocampus. Therefore, in the current study we examined the effects of 6-hydroxydopamine-induced CA depletion in the dorsal hippocampus on two prominent forms of hippocampus-based spatial learning, that is learning of object-location associations (paired-associates learning) as well as learning and choosing actions based on a representation of the context (place learning). Results show that rats with CA depletion of the dorsal hippocampus were able to learn object-location associations in an automated touch screen paired-associates learning (PAL) task. One possibility to explain this negative result is that object-location learning as tested in the touchscreen PAL task seems to require relatively little hippocampal processing. Results further show that in rats with CA depletion of the dorsal hippocampus the use of a response strategy was facilitated in a T-maze spatial learning task. We suspect that impaired hippocampus CA signaling may attenuate hippocampus-based place learning and favor dorsolateral striatum-based response learning.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

Cre-driven optogenetics in the heterogeneous genetic panorama of the VTA

The selectivity of optogenetics commonly relies on genetic promoters to manipulate specific populations of neurons through the use of Cre-driver lines. All studies performed in the ventral tegmental area (VTA) so far have utilized promoters present in groups of cells that release dopamine (DA), GABA, or glutamate. However, neurons that co-release neurotransmitters and variabilities within groups of neurons that release the same neurotransmitter present challenges when evaluating the results. Further complexity is introduced by ectopic expression patterns often occurring in transgenic Cre-drivers. New perspectives could be unfolded by identifying and selecting different types of promoter for driving the Cre recombinase. Here, we discuss some promising candidates and highlight the advantages or disadvantages of different methods for creating novel transgenic lines.

Heterogeneity of dopamine neuron activity across traits and states

Midbrain dopamine neurons fire irregularly, with interspersed clusters of high-frequency spikes, commonly called 'bursts'. In this review we examine such heterogeneity in activity, and provide insight into how it can participate in psychiatric conditions such as drug addiction. We first describe several techniques used to evaluate dopamine neuron activity, and comment on the different measures that each provides. We next describe the activity of dopamine neurons in 'basal' conditions. Specifically, we discuss how the use of anesthesia and reduced preparations may alter aspects of dopamine cell activity, and how there is heterogeneity across species and regions. We also describe how dopamine cell firing changes throughout the peri-adolescent period and how dopamine neuron activity differs across the population. In the final section, we discuss how dopamine neuron activity changes in response to life events. First, we focus attention on drugs of abuse. Drugs themselves change firing activity through a variety of mechanisms, with effects on firing while drug is present differing from those seen after drug discontinuation. We then review how stimuli that are rewarding, aversive, or salient can evoke changes in firing rate and discharge pattern of dopamine neurons, and provide behavioral relevance of dopamine signaling. Finally, we discuss how stress can modulate dopamine neuron firing and how this may contribute to the role that stressful experiences play in psychiatric disorders such as addiction and depression.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz, Dayan, & Montague, 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo, Lee, & Mizumori, 2013; Puryear, Kim, & Mizumori, 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton, Jo, Clark, Taylor, & Mizumori, 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses.

Effects of prefrontal cortical inactivation on neural activity in the ventral tegmental area

Dopamine (DA) cells have been suggested to signal discrepancies between expected and actual rewards in reinforcement learning. DA cells in the ventral tegmental area (VTA) receive direct projections from the medial prefrontal cortex (mPFC), a structure known to be one of the brain areas that represents expected future rewards. To investigate whether the mPFC contributes to generating reward prediction error signals of DA cells, we recorded VTA cells from rats foraging for different amounts of reward in a spatial working memory task. Our results showed that DA cells initially responded after the acquisition of rewards, but over training, they exhibited phasic responses when rats detected sensory cues originating from the rewards before obtaining them. We also observed two separate groups of non-DA cells activated in expectation of upcoming rewards or during reward consumption. Bilateral injections of muscimol, a GABAA agonist, into the mPFC significantly decreased the non-DA activity that encoded reward expectation. By contrast, the same manipulation of the mPFC elevated DA responses to reward-predicting cues. However, neither DA nor non-DA responses elicited after reward acquisition were affected by mPFC inactivation. These results suggest that the mPFC provides information about expected rewards to the VTA, and its functional loss elevates DA responses to reward-predicting cues by altering expectations about forthcoming rewards.

Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction, and context discrimination

Studies of the neural mechanisms of navigation and context discrimination have generated a powerful heuristic for understanding how neural codes, circuits, and computations contribute to accurate behavior as animals traverse and learn about spatially extended environments. It is assumed that memories are updated as a result of spatial experience. The mechanism, however, for such a process is not clear. Here we suggest that one revealing approach to study this issue is to integrate our knowledge about limbic system mediated navigation and context discrimination with knowledge about how midbrain neural circuitry mediates decision-making. This perspective should lead to new and specific neural theories about how choices that we make during navigation determine what information is ultimately learned and remembered. This same circuitry may be involved when past experiences come to bias future spatial perceptions and response selection. With old age come not only important changes in limbic system operations, but also significant decline in the function of midbrain regions that underlie accurate and efficient decisions. Thus, suboptimal accuracy of spatial context-based decision-making may be, at least in part, responsible for the common observation of spatial memory decline in old age.

NMDA receptor glycine modulatory site in the ventral tegmental area regulates the acquisition, retrieval, and reconsolidation of cocaine reward memory

RATIONALE AND OBJECTIVES

Accumulating clinical and preclinical studies have shown that the memories of the rewarding effects of drugs and their paired cues may contribute to relapse and persistent cocaine use. Glutaminergic actions in the ventral tegmental area (VTA) have been shown to regulate the rewarding effect of drugs and conditioned responses to drug-associated cues, but the role of the VTA in the acquisition, retrieval, and reconsolidation of cocaine cues is not yet known.

METHODS

In the present study, we used 7-chlorothiokynurenic acid (7-CTKA), an N-methyl-D-aspartate (NMDA) receptor glycine modulatory site antagonist with no rewarding effects, to examine the role of the NMDA receptor glycine modulatory site in the acquisition, retrieval, and reconsolidation of cocaine-related reward memory using the conditioned place preference (CPP) paradigm.

RESULTS

Separate groups of Sprague-Dawley rats were trained to acquire cocaine-induced CPP. Vehicle or 7-CTKA was microinjected into the VTA or substantia nigra (SN) (5 μg/μl) at different time points: 10 min before each CPP training session (acquisition), 10 min before the reactivation of CPP (retrieval), and immediately after the reactivation of CPP (reconsolidation). Cocaine-induced CPP was retested 24 h and 1 and 2 weeks after 7-CTKA administration. 7-CTKA microinjected into the VTA, but not SN, significantly impaired the acquisition, retrieval, and reconsolidation of cocaine-induced CPP without affecting cocaine-induced locomotion.

CONCLUSIONS

Our findings suggest that the NMDA receptor glycine modulatory site in the VTA plays a major role in cocaine reward memory, and NMDA receptor glycine site antagonists may be potential pharmacotherapies for the management of relapse.