Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

Lateral preoptic area glutamate neurons relay nociceptive information to the ventral tegmental area

The ventral tegmental area (VTA) has been proposed to play a role in pain, but the brain structures modulating VTA activity in response to nociceptive stimuli remain unclear. Here, we demonstrate that the lateral preoptic area (LPO) glutamate neurons relay nociceptive information to the VTA. These LPO glutamatergic neurons synapsing on VTA neurons respond to nociceptive stimulation and conditioned stimuli predicting nociceptive stimulation and also mediate aversion. In contrast, LPO GABA neurons synapsing in the VTA mediate reward. By ultrastructural quantitative synaptic analysis, ex vivo electrophysiology, and functional neuroanatomy we identify a complex circuitry between LPO glutamatergic and GABAergic neurons and VTA dopaminergic, GABAergic, and glutamatergic neurons. We conclude that LPO glutamatergic neurons play a causal role in the processing of nociceptive stimuli and in relaying information about nociceptive stimuli. The pathway from LPO glutamatergic neurons to the VTA represents an unpredicted interface between peripheral nociceptive information and the limbic system.

Nucleus accumbens dopamine tracks aversive stimulus duration and prediction but not value or prediction error

There is active debate on the role of dopamine in processing aversive stimuli, where inferred roles range from no involvement at all, to signaling an aversive prediction error (APE). Here, we systematically investigate dopamine release in the nucleus accumbens core (NAC), which is closely linked to reward prediction errors, in rats exposed to white noise (WN, a versatile, underutilized, aversive stimulus) and its predictive cues. Both induced a negative dopamine ramp, followed by slow signal recovery upon stimulus cessation. In contrast to reward conditioning, this dopamine signal was unaffected by WN value, context valence, or probabilistic contingencies, and the WN dopamine response shifted only partially toward its predictive cue. However, unpredicted WN provoked slower post-stimulus signal recovery than predicted WN. Despite differing signal qualities, dopamine responses to simultaneous presentation of rewarding and aversive stimuli were additive. Together, our findings demonstrate that instead of an APE, NAC dopamine primarily tracks prediction and duration of aversive events.

Dopaminergic circuits underlying associative aversive learning

Associative aversive learning enables animals to predict and avoid threats and thus is critical for survival and adaptive behavior. Anxiety disorders are characterized with deficits in normal aversive learning mechanisms and hence understanding the neural circuits underlying aversive learning and memory has high clinical relevance. Recent studies have revealed the dopamine system as one of the key modulators of aversive learning. In this review, we highlight recent advances that provide insights into how distinct dopaminergic circuits contribute to aversive learning and memory.

Goofballing of Opioid and Methamphetamine: The Science Behind the Deadly Cocktail

Globally, millions of people suffer from various substance use disorders (SUD), including mono-and polydrug use of opioids and methamphetamine. Brain regions such as the cingulate cortex, infralimbic cortex, dorsal striatum, nucleus accumbens, basolateral and central amygdala have been shown to play important roles in addiction-related behavioral changes. Clinical and pre-clinical studies have characterized these brain regions and their corresponding neurochemical changes in numerous phases of drug dependence such as acute drug use, intoxication, craving, withdrawal, and relapse. At present, many studies have reported the individual effects of opioids and methamphetamine. However, little is known about their combined effects. Co-use of these drugs produces effects greater than either drug alone, where one decreases the side effects of the other, and the combination produces a prolonged intoxication period or a more desirable intoxication effect. An increasing number of studies have associated polydrug abuse with poorer treatment outcomes, drug-related deaths, and more severe psychopathologies. To date, the pharmacological treatment efficacy for polydrug abuse is vague, and still at the experimental stage. This present review discusses the human and animal behavioral, neuroanatomical, and neurochemical changes underlying both morphine and methamphetamine dependence separately, as well as its combination. This narrative review also delineates the recent advances in the pharmacotherapy of mono- and poly drug-use of opioids and methamphetamine at clinical and preclinical stages.

Habenula orphan G-protein coupled receptors in the pathophysiology of fear and anxiety

The phasic emotion, fear, and the tonic emotion, anxiety, have been conventionally inspected in clinical frameworks to epitomize memory acquisition, storage, and retrieval. However, inappropriate expression of learned fear in a safe environment and its resistance to suppression is a cardinal feature of various fear-related disorders. A significant body of literature suggests the involvement of extra-amygdala circuitry in fear disorders. Consistent with this view, the present review underlies incentives for the association between the habenula and fear memory. G protein-coupled receptors (GPCRs) are important to understand the molecular mechanisms central to fear learning due to their neuromodulatory role. The efficacy of a pharmacological strategy aimed at exploiting habenular-GPCR desensitization machinery can serve as a therapeutic target combating the pathophysiology of fear disorders. Originating from this milieu, the conserved nature of orphan GPCRs in the brain, with some having the highest expression in the habenula can lead to recent endeavors in understanding its functionality in fear circuitry.

The Aversion Function of the Limbic Dopaminergic Neurons and Their Roles in Functional Neurological Disorders

The Freudian theory of conversion suggested that the major symptoms of functional neurological disorders (FNDs) are due to internal conflicts at motivation, especially at the sex drive or libido. FND patients might behave properly at rewarding situations, but they do not know how to behave at aversive situations. Sex drive is the major source of dopamine (DA) release in the limbic area; however, the neural mechanism involved in FND is not clear. Dopaminergic (DAergic) neurons have been shown to play a key role in processing motivation-related information. Recently, DAergic neurons are found to be involved in reward-related prediction error, as well as the prediction of aversive information. Therefore, it is suggested that DA might change the rewarding reactions to aversive reactions at internal conflicts of FND. So DAergic neurons in the limbic areas might induce two major motivational functions: reward and aversion at internal conflicts. This article reviewed the recent advances on studies about DAergic neurons involved in aversive stimulus processing at internal conflicts and summarizes several neural pathways, including four limbic system brain regions, which are involved in the processing of aversion. Then the article discussed the vital function of these neural circuits in addictive behavior, depression treatment, and FNDs. In all, this review provided a prospect for future research on the aversion function of limbic system DA neurons and the therapy of FNDs.

Retrorubral field is a hub for diverse threat and aversive outcome signals

Adaptive fear scales to the degree of threat and requires diverse neural signals for threat and aversive outcome. We propose that the retrorubral field (RRF), a midbrain region containing A8 dopamine, is a neural origin of such signals. To reveal these signals, we recorded RRF single-unit activity while male rats discriminated danger, uncertainty, and safety. Many RRF neurons showed firing extremes to danger and safety that framed intermediate firing to uncertainty. The remaining neurons showed unique, threat-selective cue firing patterns. Diversity in firing direction, magnitude, and temporal characteristics led to the detection of at least eight functional neuron types. Neuron types defined with respect to threat showed unique firing patterns following aversive outcome. The result was RRF signals for foot shock receipt, positive prediction error, anti-positive prediction error, persistent safety, and persistent threat. The diversity of threat and aversive outcome signals points to a key role for the RRF in adaptive fear.

Dopamine and Addiction

Addiction is commonly identified with habitual nonmedical self-administration of drugs. It is usually defined by characteristics of intoxication or by characteristics of withdrawal symptoms. Such addictions can also be defined in terms of the brain mechanisms they activate; most addictive drugs cause elevations in extracellular levels of the neurotransmitter dopamine. Animals unable to synthesize or use dopamine lack the conditioned reflexes discussed by Pavlov or the appetitive behavior discussed by Craig; they have only unconditioned consummatory reflexes. Burst discharges (phasic firing) of dopamine-containing neurons are necessary to establish long-term memories associating predictive stimuli with rewards and punishers. Independent discharges of dopamine neurons (tonic or pacemaker firing) determine the motivation to respond to such cues. As a result of habitual intake of addictive drugs, dopamine receptors expressed in the brain are decreased, thereby reducing interest in activities not already stamped in by habitual rewards.

Distinct signals in medial and lateral VTA dopamine neurons modulate fear extinction at different times

Dopamine (DA) neurons are thought to encode reward prediction error (RPE), in addition to other signals, such as salience. While RPE is known to support learning, the role of salience in learning remains less clear. To address this, we recorded and manipulated VTA DA neurons in mice during fear extinction. We applied deep learning to classify mouse freezing behavior, eliminating the need for human scoring. Our fiber photometry recordings showed DA neurons in medial and lateral VTA have distinct activity profiles during fear extinction: medial VTA activity more closely reflected RPE, while lateral VTA activity more closely reflected a salience-like signal. Optogenetic inhibition of DA neurons in either region slowed fear extinction, with the relevant time period for inhibition differing across regions. Our results indicate salience-like signals can have similar downstream consequences to RPE-like signals, although with different temporal dependencies.

The Lateral Preoptic Area: A Novel Regulator of Reward Seeking and Neuronal Activity in the Ventral Tegmental Area

The lateral preoptic area (LPO) is a hypothalamic region whose function has been largely unexplored. Its direct and indirect projections to the ventral tegmental area (VTA) suggest that the LPO could modulate the activity of the VTA and the reward-related behaviors that the VTA underlies. We examined the role of the LPO on reward taking and seeking using operant self-administration of cocaine or sucrose. Rats were trained to self-administer cocaine or sucrose and then subjected to extinction, whereby responding was no longer reinforced. We tested if stimulating the LPO pharmacologically with bicuculline or chemogenetically with Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) modifies self-administration and/or seeking. In another set of experiments, we tested if manipulating the LPO influences cocaine self-administration during and after punishment. To examine the functional connectivity between the LPO and VTA, we used in vivo electrophysiology recordings in anesthetized rats. We tested if stimulating the LPO modifies the activity of GABA and dopamine neurons of the VTA. We found that stimulating the LPO reinstated cocaine and sucrose seeking behavior but had no effect on reward intake. Furthermore, both stimulating and inhibiting the LPO prevented the sustained reduction in cocaine intake seen after punishment. Finally, stimulating the LPO inhibited the activity of VTA GABA neurons while enhancing that of VTA dopamine neurons. These findings indicate that the LPO has the capacity to drive reward seeking, modulate sustained reductions in self-administration following punishment, and regulate the activity of VTA neurons. Taken together, these findings implicate the LPO as a previously overlooked member of the reward circuit.

The power of price compels you: Behavioral economic insights into dopamine-based valuation of rewarding and aversively motivated behavior

The mesocorticolimbic dopamine pathway is generally considered to be a reward pathway. While shortsighted, there is a strong basis for this view of dopamine function. Here, we first describe the role of phasic dopamine release events in reward seeking. We then explain why these release events are being reconsidered as value signals and how we applied behavioral economics to confirm they play a causal role in the valuation of reward. Just because dopamine release can function as a dopamine reward value signal however, does not imply that dopamine is solely a reward molecule. Rather, mesocorticolimbic dopamine appears to mediate many adaptive behaviors, including: reward seeking, avoidance, escape and fear-associated conditioned freezing. While more studies are needed before a consensus is reached on when, where and how dopamine mediates aversively-motivated behavior, its involvement is almost irrefutable. Thus, we next describe the role dopamine plays in these ethologically-relevant defensive behaviors. We conclude by describing our recent behavioral economics results that reveal a causal role for dopamine in the valuation of avoidance.

Financial gain- and loss-related BOLD signals in the human ventral tegmental area and substantia nigra pars compacta

Neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNC) play central roles in reward-related behaviours. Nonhuman animal studies suggest that these neurons also process aversive events. However, our understanding of how the human VTA and SNC responds to such events is limited and has been hindered by the technical challenge of using functional magnetic resonance imaging (fMRI) to investigate a small structure where the signal is particularly vulnerable to physiological noise. Here we show, using methods optimized specifically for the midbrain (including high-resolution imaging, a novel registration protocol, and physiological noise modelling), a BOLD (blood-oxygen-level dependent) signal to both financial gain and loss in the VTA and SNC, along with a response to nil outcomes that are better or worse than expected in the VTA. Taken together, these findings suggest that the human VTA and SNC are involved in the processing of both appetitive and aversive financial outcomes in humans.

Emotional and Motivational Pain Processing: Current State of Knowledge and Perspectives in Translational Research

Pain elicits fear and anxiety and promotes escape, avoidance, and adaptive behaviors that are essential for survival. When pain persists, motivational priority and attention shift to pain-related information. Such a shift often results in impaired functionality, leading to maladaptive pain-related fear and anxiety and escape and avoidance behaviors. Neuroimaging studies in chronic pain patients have established that brain activity, especially in cortical and mesolimbic regions, is different from activity observed during acute pain in control subjects. In this review, we discuss the psychophysiological and neuronal factors that may be associated with the transition to chronic pain. We review information from human studies on neural circuits involved in emotional and motivational pain processing and how these circuits are altered in chronic pain conditions. We then highlight findings from animal research that can increase our understanding of the molecular and cellular mechanisms underlying emotional-motivational pain processing in the brain. Finally, we discuss how translational approaches incorporating results from both human and animal investigations may aid in accelerating the discovery of therapies.

Dorsal tegmental dopamine neurons gate associative learning of fear

Functional neuroanatomy of Pavlovian fear has identified neuronal circuits and synapses associating conditioned stimuli with aversive events. Hebbian plasticity within these networks requires additional reinforcement to store particularly salient experiences into long-term memory. Here, we have identified a circuit reciprocally connecting the ventral periaqueductal grey (vPAG)/dorsal raphe (DR) region and the central amygdala (CE) that gates fear learning. We found that vPAG/DR dopaminergic (vPdRD) neurons encode a positive prediction error in response to unpredicted shocks, and may reshape intra-amygdala connectivity via a dopamine-dependent form of long-term potentiation (LTP). Negative feedback from the CE to vPdRD neurons might limit reinforcement to events that have not been predicted. These findings add a new module to the midbrain DA circuit architecture underlying associative reinforcement learning and identify vPdRD neurons as critical component of Pavlovian fear conditioning. We propose that dysregulation of vPdRD neuronal activity may contribute to fear-related psychiatric disorders.

The dorsal diencephalic conduction system in reward processing: Spotlight on the anatomy and functions of the habenular complex

The dorsal diencephalic conduction system (DDC) is a highly conserved pathway in vertebrates that provides a route for the neural information to flow from forebrain to midbrain structures. It contains the bilaterally paired habenular nuclei along with two fiber tracts, the stria medullaris and the fasciculus retroflexus. The habenula is the principal player in mediating the dialogue between forebrain and midbrain regions, and functional abnormalities in this structure have often been attributed to pathologies like mood disorders and substance use disorder. Following Matsumoto and Hikosaka seminal work on the lateral habenula as a source of negative reward signals, the last decade has witnessed a great surge of interest in the role of the DDC in reward-related processes. However, despite significant progress in research, much work remains to unfold the behavioral functions of this intriguing, yet complex, pathway. This review describes the current state of knowledge on the DDC with respect to its anatomy, connectivity, and functions in reward and aversion processes.

A Transient Dopamine Signal Represents Avoidance Value and Causally Influences the Demand to Avoid

While an extensive literature supports the notion that mesocorticolimbic dopamine plays a role in negative reinforcement, recent evidence suggests that dopamine exclusively encodes the value of positive reinforcement. In the present study, we employed a behavioral economics approach to investigate whether dopamine plays a role in the valuation of negative reinforcement. Using rats as subjects, we first applied fast-scan cyclic voltammetry (FSCV) to determine that dopamine concentration decreases with the number of lever presses required to avoid electrical footshock (i.e., the economic price of avoidance). Analysis of the rate of decay of avoidance demand curves, which depict an inverse relationship between avoidance and increasing price, allows for inference of the worth an animal places on avoidance outcomes. Rapidly decaying demand curves indicate increased price sensitivity, or low worth placed on avoidance outcomes, while slow rates of decay indicate reduced price sensitivity, or greater worth placed on avoidance outcomes. We therefore used optogenetics to assess how inducing dopamine release causally modifies the demand to avoid electrical footshock in an economic setting. Increasing release at an avoidance predictive cue made animals more sensitive to price, consistent with a negative reward prediction error (i.e., the animal perceives they received a worse outcome than expected). Increasing release at avoidance made animals less sensitive to price, consistent with a positive reward prediction error (i.e., the animal perceives they received a better outcome than expected). These data demonstrate that transient dopamine release events represent the value of avoidance outcomes and can predictably modify the demand to avoid.

Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons

Actions motivated by rewards are often associated with risk of punishment. Little is known about the neural representation of punishment risk during reward-seeking behavior. We modeled this circumstance in rats by designing a task where actions were consistently rewarded but probabilistically punished. Spike activity and local field potentials were recorded during task performance simultaneously from VTA and mPFC, two reciprocally connected regions implicated in reward-seeking and aversive behaviors. At the single unit level, we found that ensembles of putative dopamine and non-dopamine VTA neurons and mPFC neurons encode the relationship between action and punishment. At the network level, we found that coherent theta oscillations synchronize VTA and mPFC in a bottom-up direction, effectively phase-modulating the neuronal spike activity in the two regions during punishment-free actions. This synchrony declined as a function of punishment probability, suggesting that during reward-seeking actions, risk of punishment diminishes VTA-driven neural synchrony between the two regions.

Conditioned task-set competition: Neural mechanisms of emotional interference in depression

Depression has been associated with increased response times at the incongruent-, neutral-, and negative-word trials of the classical and emotional Stroop tasks (Epp et al., Clinical Psychology Review, 32, 316-328, 2012). Response-time slowdown effects at incongruent- and negative-word trials of the Stroop tasks were reported to correlate with depressive severity, indicating strong relevance of the effects to the symptomatology. This study proposes a novel integrative computational model of neural mechanisms of both the classical and emotional Stroop effects, drawing on the previous prominent theoretical explanations of performance at the classical Stroop task (Cohen, Dunbar, & McClelland, Psychological Review, 97, 332-361, 1990; Herd, Banich, & O'Reilly, Journal of Cognitive Neuroscience, 18, 22-32, 2006), and in addition suggesting that negative emotional words represent conditioned stimuli for future negative outcomes. The model is shown to explain the classical Stroop effect and the slow (between-trial) emotional Stroop effect with biologically plausible mechanisms, providing an advantage over the previous theoretical accounts (Matthews & Harley, Cognition & Emotion, 10, 561-600, 1996; Wyble, Sharma, & Bowman, Cognition & Emotion, 22, 1019-1051, 2008). Simulation results suggested a candidate mechanism responsible for the pattern of depressive performance at the classical and the emotional Stroop tasks. Hyperactivity of the amygdala, together with increased inhibitory influence of the amygdala over dopaminergic neurotransmission, could be at the origin of the performance deficits.

Manganese-enhanced magnetic resonance imaging depicts brain activity in models of acute and chronic pain: A new window to study experimental spontaneous pain?

Application of functional imaging techniques to animal models is vital to understand pain mechanisms, but is often confounded by the need to limit movement artefacts with anaesthesia, and a focus on evoked responses rather than clinically relevant spontaneous pain and related hyperalgesia. The aim of the present study was to investigate the potential of manganese-enhanced magnetic resonance imaging (MEMRI) to measure neural responses during on-going pain that underpins hyperalgesia in pre-clinical models of nociception. As a proof of concept that MEMRI is sensitive to the neural activity of spontaneous, intermittent behaviour, we studied a separate positive control group undergoing a voluntary running wheel experiment. In the pain models, pain behaviour (weight bearing asymmetry and hindpaw withdrawal thresholds (PWTs)) was measured at baseline and following either intra-articular injection of nerve growth factor (NGF, 10µg/50µl; acute pain model, n=4 rats per group), or the chondrocyte toxin monosodium iodoacetate (MIA, 1mg/50µl; chronic model, n=8 rats per group), or control injection. Separate groups of rats underwent a voluntary wheel running protocol (n=8 rats per group). Rats were administered with paramagnetic ion Mn²⁺ as soluble MnCl₂ over seven days (subcutaneous osmotic pump) to allow cumulative activity-dependent neural accumulation in the models of pain, or over a period of running. T1-weighted MR imaging at 7T was performed under isoflurane anaesthesia using a receive-only rat head coil in combination with a 72mm volume coil for excitation. The pain models resulted in weight bearing asymmetry (NGF: 20.0 ± 5.2%, MIA: 15 ± 3%), and a reduction in PWT in the MIA model (8.3 ± 1.5g) on the final day of assessment before undergoing MR imaging. Voxel-wise and region-based analysis of MEMRI data did not identify group differences in T1 signal. However, MnCl₂ accumulation in the VTA, right Ce amygdala, and left cingulate was negatively correlated with pain responses (greater differences in weight bearing), similarly MnCl₂ accumulation was reduced in the VTA in line with hyperalgesia (lower PWTs), which suggests reduced regional activation as a result of the intensity and duration of pain experienced during the 7 days of MnCl₂ exposure. Motor cortex T1-weighted signal increase was associated with the distance ran in the wheel running study, while no between group difference was seen. Our data suggest that on-going pain related signal changes identified using MEMRI offers a new window to study the neural underpinnings of spontaneous pain in rats.

Midbrain dopaminergic neuron activity across alternating brain states of urethane anaesthetized rat

Midbrain dopaminergic neurons are implicated in the control of motor functions and reward-driven behaviours. The function of this neuronal population is strongly connected with distinct patterns of firing - irregular or bursting, which either maintains basal levels of dopamine (DA) or leads to phasic release, respectively. Heterogeneity of dopaminergic neurons, observed on both structural and functional levels, is also reflected in different responses of DA neurons to changes in global brain states. Preparation of urethane anaesthetized animal is a broadly used model to study brain state dependent activity of neurons. Unfortunately activity of midbrain DA neurons across urethane induced cyclic, spontaneous brain state alternations is poorly described. To fulfil this gap in our knowledge we have performed simultaneous, extracellular recordings of the firing of single putative DA neurons combined with continuous brain state monitoring. We found that during slow wave activity, the firing rate of recorded putative DA neurons was significantly higher compared to firing rates during activated state, both in ventral tegmental area (VTA) and substantia nigra pars compacta (SNc). In the presence of cortical slow waves, putative dopaminergic neurons also intensified bursting activity, but the magnitude of this phenomena differed in respect to the examined region (VTA or SNc). Our results show that activity of DA neurons under urethane anaesthesia is brain-state dependent and emphasize the importance of brain state monitoring during electrophysiological experiments.

Enhanced Sensitivity to Hyperpolarizing Inhibition in Mesoaccumbal Relative to Nigrostriatal Dopamine Neuron Subpopulations

Midbrain dopamine neurons recorded in vivo pause their firing in response to reward omission and aversive stimuli. While the initiation of pauses typically involves synaptic or modulatory input, intrinsic membrane properties may also enhance or limit hyperpolarization, raising the question of how intrinsic conductances shape pauses in dopamine neurons. Using retrograde labeling and electrophysiological techniques combined with computational modeling, we examined the intrinsic conductances that shape pauses evoked by current injections and synaptic stimulation in subpopulations of dopamine neurons grouped according to their axonal projections to the nucleus accumbens or dorsal striatum in mice. Testing across a range of conditions and pulse durations, we found that mesoaccumbal and nigrostriatal neurons differ substantially in rebound properties with mesoaccumbal neurons displaying significantly longer delays to spiking following hyperpolarization. The underlying mechanism involves an inactivating potassium (I_A) current with decay time constants of up to 225 ms, and small-amplitude hyperpolarization-activated currents (I_H), characteristics that were most often observed in mesoaccumbal neurons. Pharmacological block of I_A completely abolished rebound delays and, importantly, shortened synaptically evoked inhibitory pauses, thereby demonstrating the involvement of A-type potassium channels in prolonging pauses evoked by GABAergic inhibition. Therefore, these results show that mesoaccumbal and nigrostriatal neurons display differential responses to hyperpolarizing inhibitory stimuli that favors a higher sensitivity to inhibition in mesoaccumbal neurons. These findings may explain, in part, observations from in vivo experiments that ventral tegmental area neurons tend to exhibit longer aversive pauses relative to SNc neurons.SIGNIFICANCE STATEMENT Our study examines rebound, postburst, and synaptically evoked inhibitory pauses in subpopulations of midbrain dopamine neurons. We show that pauses in dopamine neuron firing, evoked by either stimulation of GABAergic inputs or hyperpolarizing current injections, are enhanced by a subclass of potassium conductances that are recruited at voltages below spike threshold. Importantly, A-type potassium currents recorded in mesoaccumbal neurons displayed substantially slower inactivation kinetics, which, combined with weaker expression of hyperpolarization-activated currents, lengthened hyperpolarization-induced delays in spiking relative to nigrostriatal neurons. These results suggest that input integration differs among dopamine neurons favoring higher sensitivity to inhibition in mesoaccumbal neurons and may partially explain in vivo observations that ventral tegmental area neurons exhibit longer aversive pauses relative to SNc neurons.

Midbrain dopamine neurons signal aversion in a reward-context-dependent manner

Dopamine is thought to regulate learning from appetitive and aversive events. Here we examined how optogenetically-identified dopamine neurons in the lateral ventral tegmental area of mice respond to aversive events in different conditions. In low reward contexts, most dopamine neurons were exclusively inhibited by aversive events, and expectation reduced dopamine neurons’ responses to reward and punishment. When a single odor predicted both reward and punishment, dopamine neurons’ responses to that odor reflected the integrated value of both outcomes. Thus, in low reward contexts, dopamine neurons signal value prediction errors (VPEs) integrating information about both reward and aversion in a common currency. In contrast, in high reward contexts, dopamine neurons acquired a short-latency excitation to aversive events that masked their VPE signaling. Our results demonstrate the importance of considering the contexts to examine the representation in dopamine neurons and uncover different modes of dopamine signaling, each of which may be adaptive for different environments.

DOI:http://dx.doi.org/10.7554/eLife.17328.001

There are many types of learning; one type of learning means that rewards and punishments can shape future behavior. Dopamine is a molecule that allows neurons in the brain to communicate with one another, and it is released in response to unexpected rewards. Most neuroscientists believe that dopamine is important to learn from the reward; however, there are different opinions about whether dopamine is important to learn from punishments or not.

Previous studies that tried to examine how dopamine activities change in response to punishment have reported different results. One of the likely reasons for the controversy is that it was difficult to measure only the activity of dopamine-releasing neurons.

To overcome this issue, Matsumoto et al. used genetically engineered mice in which shining a blue light into their brain would activate their dopamine neurons but not any other neurons. Tiny electrodes were inserted into the brains of these mice, and a blue light was used to confirm that these electrodes were recording from the dopamine-producing neurons. Specifically if the electrode detected an electrical impulse when blue light was beamed into the brain, then the recorded neuron was confirmed to be a dopamine-producing neuron.

Measuring the activities of these dopamine neurons revealed that they were indeed activated by reward but inhibited by punishment. In other words, dopamine neurons indeed can signal punishments as negative and rewards as positive on a single axis. Further experiments showed that, if the mice predicted both a reward and a punishment, the dopamine neurons could integrate information from both to direct learning.

Matsumoto et al. also saw that when mice received rewards too often, their dopamine neurons did not signal punishment correctly. These results suggest that how we feel about punishment may depend on how often we experience rewards.

In addition to learning, dopamine has also been linked to many psychiatric symptoms such as addiction and depression. The next challenge will be to examine how the frequency of rewards changes an animal’s state and responses to punishment in more detail, and how this relates to normal and abnormal behaviors.

DOI:http://dx.doi.org/10.7554/eLife.17328.002

Knockdown of corticotropin-releasing factor 1 receptors in the ventral tegmental area enhances conditioned fear

The neuropeptide corticotropin-releasing factor (CRF) coordinates the physiological and behavioural responses to stress. CRF receptors are highly expressed in the ventral tegmental area (VTA), an important region for motivated behaviour. Therefore, we examined the role of CRF receptor type 1 (CRFR1) in the VTA in conditioned fear, using a viral-mediated RNA interference approach. Following stereotaxic injection of a lentivirus that contained either shCRF-R1 or a control sequence, mice received tone-footshock pairings. Intra-VTA shCRF-R1 did not affect tone-elicited freezing during conditioning. Once conditioned fear was acquired, however, shCRF-R1 mice consistently showed stronger freezing to the tone even after extinction and reinstatement. These results implicate a novel role of VTA CRF-R1 in conditioned fear, and suggest how stress may modulate aversive learning and memory.

Glutamate neurons are intermixed with midbrain dopamine neurons in nonhuman primates and humans

The rodent ventral tegmental area (VTA) and substantia nigra pars compacta (SNC) contain dopamine neurons intermixed with glutamate neurons (expressing vesicular glutamate transporter 2; VGluT2), which play roles in reward and aversion. However, identifying the neuronal compositions of the VTA and SNC in higher mammals has remained challenging. Here, we revealed VGluT2 neurons within the VTA and SNC of nonhuman primates and humans by simultaneous detection of VGluT2 mRNA and tyrosine hydroxylase (TH; for identification of dopamine neurons). We found that several VTA subdivisions share similar cellular compositions in nonhuman primates and humans; their rostral linear nuclei have a high prevalence of VGluT2 neurons lacking TH; their paranigral and parabrachial pigmented nuclei have mostly TH neurons, and their parabrachial pigmented nuclei have dual VGluT2-TH neurons. Within nonhuman primates and humans SNC, the vast majority of neurons are TH neurons but VGluT2 neurons were detected in the pars lateralis subdivision. The demonstration that midbrain dopamine neurons are intermixed with glutamate or glutamate-dopamine neurons from rodents to humans offers new opportunities for translational studies towards analyzing the roles that each of these neurons play in human behavior and in midbrain-associated illnesses such as addiction, depression, schizophrenia, and Parkinson's disease.

Modulation of pain, nociception, and analgesia by the brain reward center

The midbrain dopamine center comprises a key network for reward, salience, motivation, and mood. Evidence from various clinical and preclinical settings points to the midbrain dopamine circuit as an important modulator of pain perception and pain-induced anxiety and depression. This review summarizes recent findings that shed light to the neuroanatomical, electrophysiological and molecular adaptations that chronic pain conditions promote in the mesolimbic dopamine system. Chronic pain states induce changes in neuronal plasticity and functional connectivity in several parts of the brain reward center, including nucleus accumbens, the ventral tegmental area and the prefrontal cortex. Here, we discuss recent findings on the mechanisms involved in the perception of chronic pain, in pain-induced anxiety and depression, as well as in pain-killer addiction vulnerability. Several new studies also show that the mesolimbic dopamine circuit potently modulates responsiveness to opioids and antidepressants used for the treatment of chronic pain. We discuss recent data supporting a role of the brain reward pathway in treatment efficacy and we summarize novel findings on intracellular adaptations in the brain reward circuit under chronic pain states.

Dopamine Rebound-Excitation Theory: Putting Brakes on PTSD

It is not uncommon for humans or animals to experience traumatic events in their lifetimes. However, the majority of individuals are resilient to long-term detrimental changes turning into anxiety and depression, such as post-traumatic stress disorder (PTSD). What underlying neural mechanism accounts for individual variability in stress resilience? Hyperactivity in fear circuits, such as the amygdalar system, is well-known to be the major pathophysiological basis for PTSD, much like a "stuck accelerator." Interestingly, increasing evidence demonstrates that dopamine (DA) - traditionally known for its role in motivation, reward prediction, and addiction - is also crucial in regulating fear learning and anxiety. Yet, how dopaminergic (DAergic) neurons control stress resilience is unclear, especially given that DAergic neurons have multiple subtypes with distinct temporal dynamics. Here, we propose the Rebound-Excitation Theory, which posits that DAergic neurons' rebound-excitation at the termination of fearful experiences serves as an important "brake" by providing intrinsic safety-signals to fear-processing neural circuits in a spatially and temporally controlled manner. We discuss how DAergic neuron rebound-excitation may be regulated by genetics and experiences, and how such physiological properties may be used as a brain-activity biomarker to predict and confer individual resilience to stress and anxiety.

Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors

Correlative studies have strongly linked phasic changes in dopamine activity with reward prediction error signaling. But causal evidence that these brief changes in firing actually serve as error signals to drive associative learning is more tenuous. While there is direct evidence that brief increases can substitute for positive prediction errors, there is no comparable evidence that similarly brief pauses can substitute for negative prediction errors. Lacking such evidence, the effect of increases in firing could reflect novelty or salience, variables also correlated with dopamine activity. Here we provide such evidence, showing in a modified Pavlovian over-expectation task that brief pauses in the firing of dopamine neurons in rat ventral tegmental area at the time of reward are sufficient to mimic the effects of endogenous negative prediction errors. These results support the proposal that brief changes in the firing of dopamine neurons serve as full-fledged bidirectional prediction error signals.

Brain Circuits Encoding Reward from Pain Relief

Relief from pain in humans is rewarding and pleasurable. Primary rewards, or reward-predictive cues, are encoded in brain reward/motivational circuits. While considerable advances have been made in our understanding of reward circuits underlying positive reinforcement, less is known about the circuits underlying the hedonic and reinforcing actions of pain relief. We review findings from electrophysiological, neuroimaging, and behavioral studies supporting the concept that the rewarding effect of pain relief requires opioid signaling in the anterior cingulate cortex (ACC), activation of midbrain dopamine neurons, and the release of dopamine in the nucleus accumbens (NAc). Understanding of circuits that govern the reward of pain relief may allow the discovery of more effective and satisfying therapies for patients with acute or chronic pain.

Computational Classification Approach to Profile Neuron Subtypes from Brain Activity Mapping Data

The analysis of cell type-specific activity patterns during behaviors is important for better understanding of how neural circuits generate cognition, but has not been well explored from in vivo neurophysiological datasets. Here, we describe a computational approach to uncover distinct cell subpopulations from in vivo neural spike datasets. This method, termed “inter-spike-interval classification-analysis” (ISICA), is comprised of four major steps: spike pattern feature-extraction, pre-clustering analysis, clustering classification, and unbiased classification-dimensionality selection. By using two key features of spike dynamic - namely, gamma distribution shape factors and a coefficient of variation of inter-spike interval - we show that this ISICA method provides invariant classification for dopaminergic neurons or CA1 pyramidal cell subtypes regardless of the brain states from which spike data were collected. Moreover, we show that these ISICA-classified neuron subtypes underlie distinct physiological functions. We demonstrate that the uncovered dopaminergic neuron subtypes encoded distinct aspects of fearful experiences such as valence or value, whereas distinct hippocampal CA1 pyramidal cells responded differentially to ketamine-induced anesthesia. This ISICA method should be useful to better data mining of large-scale in vivo neural datasets, leading to novel insights into circuit dynamics associated with cognitions.

Neuronal Reward and Decision Signals: From Theories to Data

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature

Survival is dictated by an organism's fitness in approaching positive stimuli and avoiding harm. While a rich literature outlines a role for mesolimbic dopamine in reward and appetitive behaviors, dopamine's involvement in aversion and avoidance behaviors remains controversial. Debate surrounding dopamine's function in the processing of negative stimuli likely stems from conflicting results reported by single-unit electrophysiological studies. Indeed, a number of studies suggest that midbrain dopaminergic cells are inhibited by the presentation of negative or fearful stimuli, while others report no change, or even an increase, in their activity. These disparate results may be due to population heterogeneity. Recent evidence demonstrates that midbrain dopamine neurons are heterogeneous in their projection targets, responses to environmental stimuli, pharmacology, and influences on motivated behavior. Thus, in order to assemble an accurate account of dopamine function during aversive stimulus experience and related behavior, it is necessary to examine the functional output of dopamine neural activity at mesolimbic terminal regions. This Review presents a growing body of evidence that dopamine release in the nucleus accumbens encodes not only reward, but also aversion. For example, our laboratory recently utilized fast-scan cyclic voltammetry to show that real-time changes in accumbal dopamine release are detected when animals are presented with predictors of aversion and its avoidance. These data, along with other reports, support a considerably more nuanced view of dopamine neuron function, wherein accumbal dopamine release is differentially modulated by positive and negative affective stimuli to promote adaptive behaviors.

Juxtacellular recording and morphological identification of single neurons in freely moving rats

It is well established that neural circuits consist of a great diversity of cell types, but very little is known about how neuronal diversity contributes to cognition and behavior. One approach to addressing this problem is to directly link cellular diversity to neuronal activity recorded in vivo in behaving animals. Here we describe the technical procedures for obtaining juxtacellular recordings from single neurons in trained rats engaged in exploratory behavior. The recorded neurons can be labeled to allow subsequent anatomical identification. In its current format, the protocol can be used for resolving the cellular identity of spatially modulated neurons (i.e., head-direction cells and grid cells), which form the basis of the animal's internal representation of space, but this approach can easily be extended to other unrestrained behaviors. The procedures described here, from the beginning of animal training to the histological processing of brain sections, can be completed in ≈ 3-4 weeks.

Heterogeneity of dopamine neuron activity across traits and states

Midbrain dopamine neurons fire irregularly, with interspersed clusters of high-frequency spikes, commonly called 'bursts'. In this review we examine such heterogeneity in activity, and provide insight into how it can participate in psychiatric conditions such as drug addiction. We first describe several techniques used to evaluate dopamine neuron activity, and comment on the different measures that each provides. We next describe the activity of dopamine neurons in 'basal' conditions. Specifically, we discuss how the use of anesthesia and reduced preparations may alter aspects of dopamine cell activity, and how there is heterogeneity across species and regions. We also describe how dopamine cell firing changes throughout the peri-adolescent period and how dopamine neuron activity differs across the population. In the final section, we discuss how dopamine neuron activity changes in response to life events. First, we focus attention on drugs of abuse. Drugs themselves change firing activity through a variety of mechanisms, with effects on firing while drug is present differing from those seen after drug discontinuation. We then review how stimuli that are rewarding, aversive, or salient can evoke changes in firing rate and discharge pattern of dopamine neurons, and provide behavioral relevance of dopamine signaling. Finally, we discuss how stress can modulate dopamine neuron firing and how this may contribute to the role that stressful experiences play in psychiatric disorders such as addiction and depression.

A comparison of neural responses to appetitive and aversive stimuli in humans and other mammals

Distinguishing potentially harmful or beneficial stimuli is necessary for the self-preservation and well-being of all organisms. This assessment requires the ongoing valuation of environmental stimuli. Despite much work on the processing of aversive- and appetitive-related brain signals, it is not clear to what degree these two processes interact across the brain. To help clarify this issue, this report used a cross-species comparative approach in humans (i.e. meta-analysis of imaging data) and other mammals (i.e. targeted review of functional neuroanatomy in rodents and non-human primates). Human meta-analysis results suggest network components that appear selective for appetitive (e.g. ventromedial prefrontal cortex, ventral tegmental area) or aversive (e.g. cingulate/supplementary motor cortex, periaqueductal grey) processing, or that reflect overlapping (e.g. anterior insula, amygdala) or asymmetrical, i.e. apparently lateralized, activity (e.g. orbitofrontal cortex, ventral striatum). However, a closer look at the known value-related mechanisms from the animal literature suggests that all of these macroanatomical regions are involved in the processing of both appetitive and aversive stimuli. Differential spatiotemporal network dynamics may help explain similarities and differences in appetitive- and aversion-related activity.

Sensory regulation of dopaminergic cell activity: Phenomenology, circuitry and function

Dopaminergic neurons in a range of species are responsive to sensory stimuli. In the anesthetized preparation, responses to non-noxious and noxious sensory stimuli are usually tonic in nature, although long-duration changes in activity have been reported in the awake preparation as well. However, in the awake preparation, short-latency, phasic changes in activity are most common. These phasic responses can occur to unconditioned aversive and non-aversive stimuli, as well as to the stimuli which predict them. In both the anesthetized and awake preparations, not all dopaminergic neurons are responsive to sensory stimuli, however responsive neurons tend to respond to more than a single stimulus modality. Evidence suggests that short-latency sensory information is provided to dopaminergic neurons by relatively primitive subcortical structures - including the midbrain superior colliculus for vision and the mesopontine parabrachial nucleus for pain and possibly gustation. Although short-latency visual information is provided to dopaminergic neurons by the relatively primitive colliculus, dopaminergic neurons can discriminate between complex visual stimuli, an apparent paradox which can be resolved by the recently discovered route of information flow through to dopaminergic neurons from the cerebral cortex, via a relay in the colliculus. Given that projections from the cortex to the colliculus are extensive, such a relay potentially allows the activity of dopaminergic neurons to report the results of complex stimulus processing from widespread areas of the cortex. Furthermore, dopaminergic neurons could acquire their ability to reflect stimulus value by virtue of reward-related modification of sensory processing in the cortex. At the forebrain level, sensory-related changes in the tonic activity of dopaminergic neurons may regulate the impact of the cortex on forebrain structures such as the nucleus accumbens. In contrast, the short latency of the phasic responses to sensory stimuli in dopaminergic neurons, coupled with the activation of these neurons by non-rewarding stimuli, suggests that phasic responses of dopaminergic neurons may provide a signal to the forebrain which indicates that a salient event has occurred (and possibly an estimate of how salient that event is). A stimulus-related salience signal could be used by downstream systems to reinforce behavioral choices.

VTA GABA neurons modulate specific learning behaviors through the control of dopamine and cholinergic systems

The mesolimbic reward system is primarily comprised of the ventral tegmental area (VTA) and the nucleus accumbens (NAc) as well as their afferent and efferent connections. This circuitry is essential for learning about stimuli associated with motivationally-relevant outcomes. Moreover, addictive drugs affect and remodel this system, which may underlie their addictive properties. In addition to dopamine (DA) neurons, the VTA also contains approximately 30% γ-aminobutyric acid (GABA) neurons. The task of signaling both rewarding and aversive events from the VTA to the NAc has mostly been ascribed to DA neurons and the role of GABA neurons has been largely neglected until recently. GABA neurons provide local inhibition of DA neurons and also long-range inhibition of projection regions, including the NAc. Here we review studies using a combination of in vivo and ex vivo electrophysiology, pharmacogenetic and optogenetic manipulations that have characterized the functional neuroanatomy of inhibitory circuits in the mesolimbic system, and describe how GABA neurons of the VTA regulate reward and aversion-related learning. We also discuss pharmacogenetic manipulation of this system with benzodiazepines (BDZs), a class of addictive drugs, which act directly on GABA_A receptors located on GABA neurons of the VTA. The results gathered with each of these approaches suggest that VTA GABA neurons bi-directionally modulate activity of local DA neurons, underlying reward or aversion at the behavioral level. Conversely, long-range GABA projections from the VTA to the NAc selectively target cholinergic interneurons (CINs) to pause their firing and temporarily reduce cholinergic tone in the NAc, which modulates associative learning. Further characterization of inhibitory circuit function within and beyond the VTA is needed in order to fully understand the function of the mesolimbic system under normal and pathological conditions.

Dopaminergic basis of salience dysregulation in psychosis

Disrupted salience processing is proposed as central in linking dysregulated dopamine function with psychotic symptoms. Several strands of evidence are now converging in support of this model. Animal studies show that midbrain dopamine neurons are activated by unexpected salient events. In psychotic patients, neurochemical studies have confirmed subcortical striatal dysregulation of dopaminergic neurotransmission, whereas functional magnetic resonance imaging (fMRI) studies of salience tasks have located alterations in prefrontal and striatal dopaminergic projection fields. At the clinical level, this may account for the altered sense of meaning and significance that predates the onset of psychosis. This review draws these different strands of evidence together in support of an emerging understanding of how dopamine dysregulation may lead to aberrant salience and psychotic symptoms.

Dopamine and extinction: a convergence of theory with fear and reward circuitry

Research on dopamine lies at the intersection of sophisticated theoretical and neurobiological approaches to learning and memory. Dopamine has been shown to be critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in reward-related tasks. A parallel and growing literature indicates that dopamine is involved in fear conditioning and extinction. These studies are consistent with long-standing ideas about appetitive-aversive interactions in learning theory and they speak to the general nature of cellular and molecular processes that underlie behavior. We review the behavioral and neurobiological literature showing a role for dopamine in fear conditioning and extinction. At a cellular level, we review dopamine signaling and receptor pharmacology, cellular and molecular events that follow dopamine receptor activation, and brain systems in which dopamine functions. At a behavioral level, we describe theories of learning and dopamine function that could describe the fundamental rules underlying how dopamine modulates different aspects of learning and memory processes.

Multiphasic temporal dynamics in responses of midbrain dopamine neurons to appetitive and aversive stimuli

The transient response of dopamine neurons has been described as reward prediction error (RPE), with activation or suppression by events that are better or worse than expected, respectively. However, at least a minority of neurons are activated by aversive or high-intensity stimuli, casting doubt on the generality of RPE in describing the dopamine signal. To overcome limitations of previous studies, we studied neuronal responses to a wider variety of high-intensity and aversive stimuli, and we quantified and controlled aversiveness through a choice task in which macaques sacrificed juice to avoid aversive stimuli. Whereas most previous work has portrayed the RPE as a single impulse or "phase," here we demonstrate its multiphasic temporal dynamics. Aversive or high-intensity stimuli evoked a triphasic sequence of activation-suppression-activation extending over a period of 40-700 ms. The initial activation at short latencies (40-120 ms) reflected sensory intensity. The influence of motivational value became dominant between 150 and 250 ms, with activation in the case of appetitive stimuli, and suppression in the case of aversive and neutral stimuli. The previously unreported late activation appeared to be a modest "rebound" after strong suppression. Similarly, strong activation by reward was often followed by suppression. We suggest that these "rebounds" may result from overcompensation by homeostatic mechanisms in some cells. Our results are consistent with a realistic RPE, which evolves over time through a dynamic balance of excitation and inhibition.

Diversity and homogeneity in responses of midbrain dopamine neurons

Dopamine neurons of the ventral midbrain have been found to signal a reward prediction error that can mediate positive reinforcement. Despite the demonstration of modest diversity at the cellular and molecular levels, there has been little analysis of response diversity in behaving animals. Here we examine response diversity in rhesus macaques to appetitive, aversive, and neutral stimuli having relative motivational values that were measured and controlled through a choice task. First, consistent with previous studies, we observed a continuum of response variability and an apparent absence of distinct clusters in scatter plots, suggesting a lack of statistically discrete subpopulations of neurons. Second, we found that a group of "sensitive" neurons tend to be more strongly suppressed by a variety of stimuli and to be more strongly activated by juice. Third, neurons in the "ventral tier" of substantia nigra were found to have greater suppression, and a subset of these had higher baseline firing rates and late "rebound" activation after suppression. These neurons could belong to a previously identified subgroup of dopamine neurons that express high levels of H-type cation channels but lack calbindin. Fourth, neurons further rostral exhibited greater suppression. Fifth, although we observed weak activation of some neurons by aversive stimuli, this was not associated with their aversiveness. In conclusion, we find a diversity of response properties, distributed along a continuum, within what may be a single functional population of neurons signaling reward prediction error.

Aversive stimuli and loss in the mesocorticolimbic dopamine system

There is mounting evidence that the mesolimbic dopamine system carries valuation signals not only for appetitive or gain-related stimuli, with which it is traditionally associated, but also for aversive and loss-related stimuli. Cellular-level studies demonstrate that the neuronal architecture to support aversive stimuli encoding in this system does exist. Both cellular-level and human neuroimaging research suggest the co-existence of appetitive and aversive prediction-error signals within the mesocorticolimbic system. These findings shift the view of the mesocorticolimbic system as a singular pathway for reward to a system with multiple signals across a wide range of domains that drive value-based decision making.