Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear

Aversive stimuli and loss in the mesocorticolimbic dopamine system

There is mounting evidence that the mesolimbic dopamine system carries valuation signals not only for appetitive or gain-related stimuli, with which it is traditionally associated, but also for aversive and loss-related stimuli. Cellular-level studies demonstrate that the neuronal architecture to support aversive stimuli encoding in this system does exist. Both cellular-level and human neuroimaging research suggest the co-existence of appetitive and aversive prediction-error signals within the mesocorticolimbic system. These findings shift the view of the mesocorticolimbic system as a singular pathway for reward to a system with multiple signals across a wide range of domains that drive value-based decision making.

Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell

Although fear directs adaptive behavioral responses, how aversive cues recruit motivational neural circuitry is poorly understood. Specifically, while it is known that dopamine (DA) transmission within the nucleus accumbens (NAc) is imperative for mediating appetitive motivated behaviors, its role in aversive behavior is controversial. It has been proposed that divergent phasic DA transmission following aversive events may correspond to segregated mesolimbic dopamine pathways; however, this prediction has never been tested. Here, we used fast-scan cyclic voltammetry to examine real-time DA transmission within NAc core and shell projection systems in response to a fear-evoking cue. In male Sprague Dawley rats, we first demonstrate that a fear cue results in decreased DA transmission within the NAc core, but increased transmission within the NAc shell. We examined whether these changes in DA transmission could be attributed to modulation of phasic transmission evoked by cue presentation. We found that cue presentation decreased the probability of phasic DA release in the core, while the same cue enhanced the amplitude of release events in the NAc shell. We further characterized the relationship between freezing and both changes in DA as well as local pH. Although we found that both analytes were significantly correlated with freezing in the NAc across the session, changes in DA were not strictly associated with freezing while basic pH shifts in the core more consistently followed behavioral expression. Together, these results provide the first real-time neurochemical evidence that aversive cues differentially modulate distinct DA projection systems.

Updating dopamine reward signals

Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.

Mathematical model of dopamine autoreceptors and uptake inhibitors and their influence on tonic and phasic dopamine signaling

Dopamine (DA) D2-like autoreceptors are an important component of the DA system, but their influence on postsynaptic DA signaling is not well understood. They are, directly or indirectly, involved in drug abuse and in treatment of schizophrenia and attention deficit hyperactive disorder: DA autoreceptors influence the behavioral effect of cocaine and methylphenidate and may be the target of antipsychotic medications such as haloperidol. DA autoreceptors are active at two levels: Somatodendritic autoreceptors mainly influence firing rate of DA neurons, and presynaptic autoreceptors control release of neurotransmitter at axonal terminals. Here we develop a mathematical model that captures the dynamics of this dual autoregulation system. Our model predicts a biphasic autoreceptor response between DA terminals and somatodendritic regions that influences the postsynaptic integration of DAergic firing patterns. We applied our model to study how DA uptake inhibition affects the translation of DA cell firing into activation of postsynaptic DA receptors. While uptake inhibition increased tonic activation of low-affinity postsynaptic receptors, high-affinity state receptors saturated and thus became insensitive to phasic DA signaling. This effect had remarkable regional specificity: While high-affinity DA receptors saturated at low levels of uptake inhibition in nucleus accumbens, they only saturated at higher levels of uptake inhibition in dorsal striatum. Based on high-affinity receptor saturation, the model predicted that removal of autoreceptor control would lead to cocaine hypersensitivity.

Encoding of aversion by dopamine and the nucleus accumbens

Adaptive motivated behavior requires rapid discrimination between beneficial and harmful stimuli. Such discrimination leads to the generation of either an approach or rejection response, as appropriate, and enables organisms to maximize reward and minimize punishment. Classically, the nucleus accumbens (NAc) and the dopamine projection to it are considered an integral part of the brain's reward circuit, i.e., they direct approach and consumption behaviors and underlie positive reinforcement. This reward-centered framing ignores important evidence about the role of this system in encoding aversive events. One reason for bias toward reward is the difficulty in designing experiments in which animals repeatedly experience punishments; another is the challenge in dissociating the response to an aversive stimulus itself from the reward/relief experienced when an aversive stimulus is terminated. Here, we review studies that employ techniques with sufficient time resolution to measure responses in ventral tegmental area and NAc to aversive stimuli as they are delivered. We also present novel findings showing that the same stimulus - intra-oral infusion of sucrose - has differing effects on NAc shell dopamine release depending on the prior experience. Here, for some rats, sucrose was rendered aversive by explicitly pairing it with malaise in a conditioned taste aversion paradigm. Thereafter, sucrose infusions led to a suppression of dopamine with a similar magnitude and time course to intra-oral infusions of a bitter quinine solution. The results are discussed in the context of regional differences in dopamine signaling and the implications of a pause in phasic dopamine release within the NAc shell. Together with our data, the emerging literature suggests an important role for differential phasic dopamine signaling in aversion vs. reward.

The role of dopamine in the context of aversive stimuli with particular reference to acoustically signaled avoidance learning

Learning from punishment is a powerful means for behavioral adaptation with high relevance for various mechanisms of self-protection. Several studies have explored the contribution of released dopamine (DA) or responses of DA neurons on reward seeking using rewards such as food, water, and sex. Phasic DA signals evoked by rewards or conditioned reward predictors are well documented, as are modulations of these signals by such parameters as reward magnitude, probability, and deviation of actually occurring from expected rewards. Less attention has been paid to DA neuron firing and DA release in response to aversive stimuli, and the prediction and avoidance of punishment. In this review, we first focus on DA changes in response to aversive stimuli as measured by microdialysis and voltammetry followed by the change in electrophysiological signatures by aversive stimuli and fearful events. We subsequently focus on the role of DA and effect of DA manipulations on signaled avoidance learning, which consists of learning the significance of a warning cue through Pavlovian associations and the execution of an instrumental avoidance response. We present a coherent framework utilizing the data on microdialysis, voltammetry, electrophysiological recording, electrical brain stimulation, and behavioral analysis. We end by outlining current gaps in the literature and proposing future directions aimed at incorporating technical and conceptual progress to understand the involvement of reward circuit on punishment based decisions.

Ethical concepts and future challenges of neuroimaging: an Islamic perspective

Neuroscience is advancing at a rapid pace, with new technologies and approaches that are creating ethical challenges not easily addressed by current ethical frameworks and guidelines. One fascinating technology is neuroimaging, especially functional Magnetic Resonance Imaging (fMRI). Although still in its infancy, fMRI is breaking new ground in neuroscience, potentially offering increased understanding of brain function. Different populations and faith traditions will likely have different reactions to these new technologies and the ethical challenges they bring with them. Muslims are approximately one-fifth of world population and they have a specific and highly regulated ethical and moral code, which helps them deal with scientific advances and decision making processes in an Islamically ethical manner. From this ethical perspective, in light of the relevant tenets of Islam, neuroimaging poses various challenges. The privacy of spirituality and the thought process, the requirement to put community interest before individual interest, and emphasis on conscious confession in legal situations are Islamic concepts that can pose a challenge for the use of something intrusive such as an fMRI. Muslim moral concepts such as There shall be no harm inflicted or reciprocated in Islam and Necessities overrule prohibitions are some of the criteria that might appropriately be used to guide advancing neuroscience. Neuroscientists should be particularly prudent and well prepared in implementing neuroscience advances that are breaking new scientific and ethical ground. Neuroscientists should also be prepared to assist in setting the ethical frameworks in place in advance of what might be perceived as runaway applications of technology.

Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain

Learning theory and computational accounts suggest that learning depends on errors in outcome prediction as well as changes in processing of or attention to events. These divergent ideas are captured by models, such as Rescorla-Wagner (RW) and temporal difference (TD) learning on the one hand, which emphasize errors as directly driving changes in associative strength, vs. models such as Pearce-Hall (PH) and more recent variants on the other hand, which propose that errors promote changes in associative strength by modulating attention and processing of events. Numerous studies have shown that phasic firing of midbrain dopamine (DA) neurons carries a signed error signal consistent with RW or TD learning theories, and recently we have shown that this signal can be dissociated from attentional correlates in the basolateral amygdala and anterior cingulate. Here we will review these data along with new evidence: (i) implicating habenula and striatal regions in supporting error signaling in midbrain DA neurons; and (ii) suggesting that the central nucleus of the amygdala and prefrontal regions process the amygdalar attentional signal. However, while the neural instantiations of the RW and PH signals are dissociable and complementary, they may be linked. Any linkage would have implications for understanding why one signal dominates learning in some situations and not others, and also for appreciating the potential impact on learning of neuropathological conditions involving altered DA or amygdalar function, such as schizophrenia, addiction or anxiety disorders.

Are you or aren't you? Challenges associated with physiologically identifying dopamine neurons

The dopamine system is involved in motivation, reward and learning, and dysfunction in this system has been implicated in several disorders, including Parkinson's disease (PD) and schizophrenia. Key progress in our understanding of its functions has come from extracellular in vivo electrophysiological recordings from midbrain dopamine neurons. Numerous studies have used a defined set of criteria to identify dopamine neurons electrophysiologically. However, a few recent studies have suggested that a minority population of non-dopamine neurons may not be readily distinguishable from dopamine neurons, raising questions as to the reliability of past findings. We provide an overview of the key findings related to this controversy and assess the criteria used for the electrophysiological identification of dopamine neurons in the substantia nigra pars compacta (SNC) and ventral tegmental area (VTA).

Activation of VTA GABA neurons disrupts reward consumption

The activity of ventral tegmental area (VTA) dopamine (DA) neurons promotes behavioral responses to rewards and environmental stimuli that predict them. VTA GABA inputs synapse directly onto DA neurons and may regulate DA neuronal activity to alter reward-related behaviors; however, the functional consequences of selective activation of VTA GABA neurons remains unknown. Here, we show that in vivo optogenetic activation of VTA GABA neurons disrupts reward consummatory behavior but not conditioned anticipatory behavior in response to reward-predictive cues. In addition, direct activation of VTA GABA projections to the nucleus accumbens (NAc) resulted in detectable GABA release but did not alter reward consumption. Furthermore, optogenetic stimulation of VTA GABA neurons directly suppressed the activity and excitability of neighboring DA neurons as well as the release of DA in the NAc, suggesting that the dynamic interplay between VTA DA and GABA neurons can control the initiation and termination of reward-related behaviors.

Dopamine release in the basal ganglia

Dopamine (DA) is a key transmitter in the basal ganglia, yet DA transmission does not conform to several aspects of the classic synaptic doctrine. Axonal DA release occurs through vesicular exocytosis and is action potential- and Ca²⁺-dependent. However, in addition to axonal release, DA neurons in midbrain exhibit somatodendritic release by an incompletely understood, but apparently exocytotic, mechanism. Even in striatum, axonal release sites are controversial, with evidence for DA varicosities that lack postsynaptic specialization, and largely extrasynaptic DA receptors and transporters. Moreover, DA release is often assumed to reflect a global response to a population of activities in midbrain DA neurons, whether tonic or phasic, with precise timing and specificity of action governed by other basal ganglia circuits. This view has been reinforced by anatomical evidence showing dense axonal DA arbors throughout striatum, and a lattice network formed by DA axons and glutamatergic input from cortex and thalamus. Nonetheless, localized DA transients are seen in vivo using voltammetric methods with high spatial and temporal resolution. Mechanistic studies using similar methods in vitro have revealed local regulation of DA release by other transmitters and modulators, as well as by proteins known to be disrupted in Parkinson's disease and other movement disorders. Notably, the actions of most other striatal transmitters on DA release also do not conform to the synaptic doctrine, with the absence of direct synaptic contacts for glutamate, GABA, and acetylcholine (ACh) on striatal DA axons. Overall, the findings reviewed here indicate that DA signaling in the basal ganglia is sculpted by cooperation between the timing and pattern of DA input and those of local regulatory factors.