Nucleus accumbens shell, but not core, tracks motivational value of salt

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

Chst9 marks a spatially and transcriptionally unique population of Oprm1-expressing neurons in the nucleus accumbens

Opioids produce addictive, analgesic, and euphoric effects via actions at mu opioid receptors (μORs). The μOR is encoded by the Oprm1 gene and is expressed in multiple brain regions that regulate reward and motivation, such as the nucleus accumbens (NAc). Oprm1 expression in NAc medium spiny neurons (MSNs) mediates opioid place preference, seeking, and consumption. However, recent single nucleus RNA sequencing (snRNA-seq) studies have revealed that multiple subpopulations of NAc neurons express Oprm1 mRNA, making it unclear which populations mediate diverse behaviors resulting from μOR activation. Using published snRNA-seq datasets from the rat NAc, we identified a novel population of MSNs that express the highest levels of Oprm1 of any NAc cell type. Here, we show that this population is selectively marked by expression of Chst9, a gene encoding a carbohydrate sulfotransferase. Notably, Chst9+ neurons exhibited more abundant expression of Oprm1 as compared to other cell types, and formed discrete cellular clusters along the medial and ventral borders of the NAc shell subregion. Moreover, CHST9 mRNA was also found to mark specific MSN populations in published human and primate snRNA-seq studies, indicating that this unique population may be conserved across species. Together, these results identify a spatially and transcriptionally distinct NAc neuron population characterized by the expression of Chst9. The abundant expression of Oprm1 in this population and the conservation of these cells across species suggests that they may play a key functional role in opioid response and identify this subpopulation as a target for further investigation.

Chst9 Marks a Spatially and Transcriptionally Unique Population of Oprm1 -Expressing Neurons in the Nucleus Accumbens

Opioids produce addictive, analgesic, and euphoric effects via actions at mu opioid receptors (μORs). The μOR is encoded by the Oprm1 gene and is expressed in multiple brain regions that regulate reward and motivation, such as the nucleus accumbens (NAc). Oprm1 expression in NAc medium spiny neurons (MSNs) mediates opioid place preference, seeking, and consumption. However, recent single nucleus RNA sequencing (snRNA-seq) studies in rodent, primate, and human NAc have revealed that multiple subpopulations of NAc neurons express Oprm1 mRNA, making it unclear which populations mediate diverse behaviors resulting from μOR activation. Using published snRNA-seq datasets from the rat NAc, we identified a novel population of MSNs that express the highest levels of Oprm1 of any NAc cell type. Here, we show that this population is selectively marked by expression of Chst9 , a gene encoding a carbohydrate sulfotransferase. To validate this observation and characterize spatial localization of this population in the rat NAc, we performed multiplexed RNAscope fluorescence in situ hybridization studies to detect expression of Oprm1 and Chst9 mRNA along with well-validated markers of MSNs. Notably, Chst9 + neurons exhibited more abundant expression of Oprm1 as compared to other cell types, and formed discrete cellular clusters along the medial and ventral borders of the NAc shell subregion. Moreover, CHST9 mRNA was also found to mark specific MSN populations in published human and primate snRNA-seq studies, indicating that this unique population may be conserved across species. Together, these results identify a spatially and transcriptionally distinct NAc neuron population characterized by the expression of Chst9 . The abundant expression of Oprm1 in this population and the conservation of these cells across species suggests that they may play a key functional role in opioid response and identify this subpopulation as a target for further investigation.

Homeostatic Reinforcement Theory Accounts for Sodium Appetitive State- and Taste-Dependent Dopamine Responding

Seeking and consuming nutrients is essential to survival and the maintenance of life. Dynamic and volatile environments require that animals learn complex behavioral strategies to obtain the necessary nutritive substances. While this has been classically viewed in terms of homeostatic regulation, recent theoretical work proposed that such strategies result from reinforcement learning processes. This theory proposed that phasic dopamine (DA) signals play a key role in signaling potentially need-fulfilling outcomes. To examine links between homeostatic and reinforcement learning processes, we focus on sodium appetite as sodium depletion triggers state- and taste-dependent changes in behavior and DA signaling evoked by sodium-related stimuli. We find that both the behavior and the dynamics of DA signaling underlying sodium appetite can be accounted for by a homeostatically regulated reinforcement learning framework (HRRL). We first optimized HRRL-based agents to sodium-seeking behavior measured in rodents. Agents successfully reproduced the state and the taste dependence of behavioral responding for sodium as well as for lithium and potassium salts. We then showed that these same agents account for the regulation of DA signals evoked by sodium tastants in a taste- and state-dependent manner. Our models quantitatively describe how DA signals evoked by sodium decrease with satiety and increase with deprivation. Lastly, our HRRL agents assigned equal preference for sodium versus the lithium containing salts, accounting for similar behavioral and neurophysiological observations in rodents. We propose that animals use orosensory signals as predictors of the internal impact of the consumed good and our results pose clear targets for future experiments. In sum, this work suggests that appetite-driven behavior may be driven by reinforcement learning mechanisms that are dynamically tuned by homeostatic need.

Influences of ethanol and temperature on sucrose-evoked response of gustatory neurons in the hamster solitary nucleus

Taste-responsive neurons in the nucleus of the solitary tract (NST), the first gustatory nucleus, often respond to thermal or mechanical stimulation. Alcohol, not a typical taste modality, is a rewarding stimulus. In this study, we aimed to investigate the effects of ethanol (EtOH) and/or temperature as stimuli to the tongue on the activity of taste-responsive neurons in hamster NST. In the first set of experiments, we recorded the activity of 113 gustatory NST neurons in urethane-anesthetized hamsters and evaluated responses to four basic taste stimuli, 25% EtOH, and 40°C and 4°C distilled water (dH₂O). Sixty cells responded to 25% EtOH, with most of them also being sucrose sensitive. The response to 25% EtOH was significantly correlated with the sucrose-evoked response. A significant correlation was also observed between sucrose- and 40°C dH₂O- and between 25% EtOH- and 40°C dH₂O-evoked firings. In a subset of the cells, we evaluated neuronal activities in response to a series of EtOH concentrations, alone and in combination with 32 mM sucrose (EtOH/Suc) at room temperature (RT, 22°C–23°C), 40°C, and 4°C. Neuronal responses to EtOH at RT and 40°C increased as the concentrations increased. The firing rates to EtOH/Suc were greater than those to EtOH or sucrose alone. The responses were enhanced when solutions were applied at 40°C but diminished at 4°C. In summary, EtOH activates most sucrose-responsive NST gustatory cells, and the concomitant presence of sucrose or warm temperatures enhance this response. Our findings may contribute to elucidate the neural mechanisms underlying appetitive alcohol consumption.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Heterogeneous dopamine signals support distinct features of motivated actions: implications for learning and addiction

Despite decades of research, investigations into effective neural and pharmacological therapies for many drugs of abuse, such as cocaine, have produced no FDA-approved approaches. This difficulty derives from the complexity of substance use disorders, which encompass a variety of behavioral, psychological, and neural circuit-based changes that occur as a result of repeated experience with the drug. Dopamine signaling has been demonstrated to play a key role in several aspects of drug abuse—from mediating its reinforcing properties and drug-seeking to triggering relapse—while also mediating a number of important aspects of normal (nondrug related) motivated behaviors and actions. Real-time recording methods such as in vivo voltammetry, electrophysiology, and calcium imaging demonstrate that the signaling properties of dopamine for motivationally relevant stimuli are highly dynamic and spatiotemporally circumscribed within afferent target regions. In this review, we identify the origins and functional consequences of heterogeneous dopamine release in the limbic system, and how these properties are persistently altered in the drug-experienced brain. We propose that these spatiotemporally parallel dopaminergic signals are simultaneously available to the animal, but that these circuits are impaired following prolonged drug experience by disrupting the location and content of dopamine signals in afferent target regions. These findings are discussed in the context of relapse and pathways to discovering new treatments for addiction disorders.

Challenges to Body Fluid Homeostasis Differentially Recruit Phasic Dopamine Signaling in a Taste-Selective Manner

The internal environment of an organism must remain stable to ensure optimal performance and ultimately survival. The generation of motivated behaviors is an adaptive mechanism for defending homeostasis. Although physiological state modulates motivated behaviors, the influence of physiological state on phasic dopamine signaling, an underlying neurobiological substrate of reward-driven behavior, is underexplored. Here, we use sodium depletion and water restriction, manipulations of body fluid homeostasis, to determine the flexibility and specificity of dopamine responses. Changes in dopamine concentration were measured using fast-scan cyclic voltammetry in the nucleus accumbens shell of male rats in response to intraoral infusions of fluids that either satisfied or did not satisfy homeostatic need. Increases in dopamine concentration during intraoral infusions were observed only under conditions of physiological deficit. Furthermore, dopamine increases were selective and limited to those that satisfied the need state of the animal. Thus, dopamine neurons track fluid balance and respond to salt and water stimuli in a state- and taste-dependent manner. Using Fluoro-Gold tracing and immunohistochemistry for c-Fos and Foxp2, a marker of sodium-deprivation responsive neurons, we revealed brainstem populations of neurons that are activated by sodium depletion and project directly to the ventral tegmental area. The identified projections may modulate dopamine neuron excitability and consequently the state-specific dopamine release observed in our experiments. This work illustrates the impact of physiological state on mesolimbic dopamine signaling and a potential circuit by which homeostatic disruptions are communicated to mesolimbic circuitry to drive the selective reinforcement of biologically-required stimuli under conditions of physiological need.SIGNIFICANCE STATEMENT Motivated behaviors arise during physiological need and are highly selective for homeostasis-restoring stimuli. Although phasic dopamine signaling has been shown to contribute to the generation of motivated behaviors, the state and stimulus specificity of phasic dopamine signaling is less clear. These studies use thirst and sodium appetite to show that dopamine neurons dynamically track body fluid homeostasis and respond to water and salt stimuli in a state- and taste-dependent manner. We also identify hindbrain sodium deprivation-responsive neurons that project directly to the ventral tegmental area, where dopamine neuron cell bodies reside. This work demonstrates command of homeostasis over dopamine signaling and proposes a circuit by which physiological need drives motivated behavior by state- and taste-selective recruitment of phasic dopamine signaling.

Orexin neurons couple neural systems mediating fluid balance with motivation-related circuits

During extracellular dehydration, neural systems that sense deficits in body fluid homeostasis operate in tandem with those that mediate motivation and reward in order to promote ingestive behaviors that restore fluid balance. We hypothesized that hypothalamic orexin (Ox) neurons act as an interface to couple brain regions sensing and processing information about body fluid status with central nervous system motivation and reward systems. An initial set of anterograde and retrograde tracing experiments suggested that structures along the lamina terminalis (LT), a region of the forebrain that serves to monitor and integrate information reflecting body fluid balance, project to hypothalamic Ox neurons that, in turn, project to dopamine neurons in the ventral tegmental area (VTA). A second set of experiments determined whether Ox neuron activation is associated with extracellular dehydration and the seeking out and consumption of water and saline. An elevation of Fos-like immunoreactivity in Ox neurons was observed in fluid-depleted rats that were allowed to ingest water and sodium. A final experiment was conducted to determine whether Ox release in the VTA promotes thirst and salt appetite. Bilateral microinjection of the Ox Type I receptor antagonist SB-408124 into the VTA prior to acute extracellular dehydration attenuated fluid intake. Together, these studies support the hypothesis that structures along the LT modulate activity in the VTA through actions of orexinergic neurons that have cell bodies in the hypothalamus. This pathway may function to facilitate sustained consumption of fluids necessary for restoration of fluid balance. (PsycINFO Database Record

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity.SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal is presented with salt-paired cues. The neural circuitry necessary for context-driven salt-seeking behavior is unknown. We used a novel conditioned place preference procedure to show that optogenetic inhibition of the ventral pallidum (VP), a region known for processing reward, impairs context-driven salt seeking and has minimal effects on the consumption of salt itself following sodium depletion. These results highlight the importance of the VP in context-driven reward-seeking behavior.

Physiological state tunes mesolimbic signaling: Lessons from sodium appetite and inspiration from Randall R. Sakai

Sodium deficit poses a life-threatening challenge to body fluid homeostasis and generates a sodium appetite - the behavioral drive to ingest sodium. Dr. Randall R. Sakai greatly contributed to our understanding of the hormonal responses to negative sodium balance and to the central processing of these signals. Reactivity to the taste of sodium solutions and the motivation to seek and consume sodium changes dramatically with body fluid balance. Here, we review studies that collectively suggest that sodium deficit recruits the mesolimbic system to play a role in the behavioral expression of sodium appetite. The recruitment of the mesolimbic system likely contributes to intense sodium seeking and reinforces sodium consumption observed in deficient animals. Some of the hormones that are released in response to sodium deficit act directly on both dopamine and nucleus accumbens elements. Moreover, the taste of sodium in sodium deficient rats evokes a pattern of dopamine and nucleus accumbens activity that is similar to responses to rewarding stimuli. A very different pattern of activity is observed in non-deficient rats. Given the well-characterized endocrine response to sodium deficit and its central action, sodium appetite becomes an ideal model for understanding the role of mesolimbic signaling in reward, reinforcement and the generation of motivated behavior.

Architectural Representation of Valence in the Limbic System

In order to thrive, animals must be able to recognize aversive and appetitive stimuli within the environment and subsequently initiate appropriate behavioral responses. This assignment of positive or negative valence to a stimulus is a key feature of emotional processing, the neural substrates of which have been a topic of study for several decades. Until recently, the result of this work has been the identification of specific brain regions, such as the basolateral amygdala (BLA) and nucleus accumbens (NAc), as important to valence encoding. The advent of modern tools in neuroscience has allowed further dissection of these regions to identify specific populations of neurons signaling the valence of environmental stimuli. In this review, we focus upon recent work examining the mechanisms of valence encoding, and provide a model for the systematic investigation of valence within anatomically-, genetically-, and functionally defined populations of neurons.

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.

Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation

Mesolimbic dopamine (DA) is phasically released during appetitive behaviors, though there is substantive disagreement about the specific purpose of these DA signals. For example, prediction error (PE) models suggest a role of learning, while incentive salience (IS) models argue that the DA signal imbues stimuli with value and thereby stimulates motivated behavior. However, within the nucleus accumbens (NAc) patterns of DA release can strikingly differ between subregions, and as such, it is possible that these patterns differentially contribute to aspects of PE and IS. To assess this, we measured DA release in subregions of the NAc during a behavioral task that spatiotemporally separated sequential goal-directed stimuli. Electrochemical methods were used to measure subsecond NAc dopamine release in the core and shell during a well learned instrumental chain schedule in which rats were trained to press one lever (seeking; SL) to gain access to a second lever (taking; TL) linked with food delivery, and again during extinction. In the core, phasic DA release was greatest following initial SL presentation, but minimal for the subsequent TL and reward events. In contrast, phasic shell DA showed robust release at all task events. Signaling decreased between the beginning and end of sessions in the shell, but not core. During extinction, peak DA release in the core showed a graded decrease for the SL and pauses in release during omitted expected rewards, whereas shell DA release decreased predominantly during the TL. These release dynamics suggest parallel DA signals capable of supporting distinct theories of appetitive behavior.

SIGNIFICANCE STATEMENT

Dopamine signaling in the brain is important for a variety of cognitive functions, such as learning and motivation. Typically, it is assumed that a single dopamine signal is sufficient to support these cognitive functions, though competing theories disagree on how dopamine contributes to reward-based behaviors. Here, we have found that real-time dopamine release within the nucleus accumbens (a primary target of midbrain dopamine neurons) strikingly varies between core and shell subregions. In the core, dopamine dynamics are consistent with learning-based theories (such as reward prediction error) whereas in the shell, dopamine is consistent with motivation-based theories (e.g., incentive salience). These findings demonstrate that dopamine plays multiple and complementary roles based on discrete circuits that help animals optimize rewarding behaviors.

Mapping brain Fos immunoreactivity in response to water deprivation and partial rehydration: Influence of sodium intake

Water deprivation (WD) followed by water intake to satiety, produces satiation of thirst and partial rehydration (PR). Thus, WD-PR is a natural method to differentiate thirst from sodium appetite. WD-PR also produces Fos immunoreactivity (Fos-ir) in interconnected areas of a brain circuit postulated to subserve sodium appetite. In the present work, we evaluated the effect of sodium intake on Fos-ir produced by WD-PR in brain areas operationally defined according to the literature as either facilitatory or inhibitory to sodium intake. Isotonic NaCl was available for ingestion in a sodium appetite test performed immediately after a single episode of WD-PR. Sodium intake decreased Fos-ir in facilitatory areas such as the lamina terminalis (particularly subfornical organ and median preoptic nucleus), central amygdala and hypothalamic parvocellular paraventricular nucleus in the forebrain. Sodium intake also decreased Fos-ir in inhibitory areas such as the area postrema, lateral parabrachial nucleus and nucleus of the solitary tract in the hindbrain. In contrast, sodium intake further increased Fos-ir that was activated by water deprivation in the dorsal raphe nucleus, another inhibitory area localized in the hindbrain. WD-PR increased Fos-ir in the core and shell of the nucleus accumbens. Sodium intake reduced Fos-ir in both parts of the accumbens. In summary, sodium intake following WD-PR reduced Fos-ir in most facilitatory and inhibitory areas, but increased Fos-ir in another inhibitory area. It also reduced Fos-ir in a reward area (accumbens). The results suggest a functional link between sodium intake and the activity of the hindbrain-forebrain circuitry subserving reward and sodium appetite in response to water deprivation.

Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH) and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc) and ventral pallidum (VP), in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (“liking”) and motivational incentive salience (“wanting”) of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating vs. intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including “liking” and “wanting” for food rewards.

Pleasure systems in the brain

Pleasure is mediated by well-developed mesocorticolimbic circuitry and serves adaptive functions. In affective disorders, anhedonia (lack of pleasure) or dysphoria (negative affect) can result from breakdowns of that hedonic system. Human neuroimaging studies indicate that surprisingly similar circuitry is activated by quite diverse pleasures, suggesting a common neural currency shared by all. Wanting for reward is generated by a large and distributed brain system. Liking, or pleasure itself, is generated by a smaller set of hedonic hot spots within limbic circuitry. Those hot spots also can be embedded in broader anatomical patterns of valence organization, such as in a keyboard pattern of nucleus accumbens generators for desire versus dread. In contrast, some of the best known textbook candidates for pleasure generators, including classic pleasure electrodes and the mesolimbic dopamine system, may not generate pleasure after all. These emerging insights into brain pleasure mechanisms may eventually facilitate better treatments for affective disorders.

Descending projections from the nucleus accumbens shell excite activity of taste-responsive neurons in the nucleus of the solitary tract in the hamster

The nucleus of the solitary tract (NST) and the parabrachial nuclei (PbN) are the first and second relays in the rodent central taste pathway. A series of electrophysiological experiments revealed that spontaneous and taste-evoked activities of brain stem gustatory neurons are altered by descending input from multiple forebrain nuclei in the central taste pathway. The nucleus accumbens shell (NAcSh) is a key neural substrate of reward circuitry, but it has not been verified as a classical gustatory nucleus. A recent in vivo electrophysiological study demonstrated that the NAcSh modulates the spontaneous and gustatory activities of hamster pontine taste neurons. In the present study, we investigated whether activation of the NAcSh modulates gustatory responses of the NST neurons. Extracellular single-unit activity was recorded from medullary neurons in urethane-anesthetized hamsters. After taste response was confirmed by delivery of sucrose, NaCl, citric acid, and quinine hydrochloride to the anterior tongue, the NAcSh was stimulated bilaterally with concentric bipolar stimulating electrodes. Stimulation of the ipsilateral and contralateral NAcSh induced firings from 54 and 37 of 90 medullary taste neurons, respectively. Thirty cells were affected bilaterally. No inhibitory responses or antidromic invasion was observed after NAcSh activation. In the subset of taste cells tested, high-frequency electrical stimulation of the NAcSh during taste delivery enhanced taste-evoked neuronal firing. These results demonstrate that two-thirds of the medullary gustatory neurons are under excitatory descending influence from the NAcSh, which is a strong indication of communication between the gustatory pathway and the mesolimbic reward pathway.

The biopsychology of salt hunger and sodium deficiency

Sodium is a necessary dietary macromineral that tended to be sparsely distributed in mankind's environment in the past. Evolutionary selection pressure shaped physiological mechanisms including hormonal systems and neural circuits that serve to promote sodium ingestion. Sodium deficiency triggers the activation of these hormonal systems and neural circuits to engage motivational processes that elicit a craving for salty substances and a state of reward when salty foods are consumed. Sodium deficiency also appears to be associated with aversive psychological states including anhedonia, impaired cognition, and fatigue. Under certain circumstances the psychological processes that promote salt intake can become powerful enough to cause "salt gluttony," or salt intake far in excess of physiological need. The present review discusses three aspects of the biopsychology of salt hunger and sodium deficiency: (1) the psychological processes that promote salt intake during sodium deficiency, (2) the effects of sodium deficiency on mood and cognition, and (3) the sensitization of sodium appetite as a possible cause of salt gluttony.

Conditioned Aversion for a Cocaine-Predictive Cue is Associated with Cocaine Seeking and Taking in Rats

Rats emit aversive taste reactivity (TR) behavior (i.e., gapes) following intraoral delivery of a cocaine-paired taste cue, and greater conditioned aversive TR in well-trained rats predicts greater drug-taking. Here, we used a between-groups design and tracked the development of this conditioned aversive TR behavior on a trial by trial basis in an effort to determine when the change in behavior occurs and at what point individual differences in cue reactivity become predictive of cocaine-seeking and cocaine-taking. The results demonstrate that conditioned aversive TR to a cocaine-predictive flavor cue appears very early in training (i.e., following as few as 1 to 2 taste-drug pairings), stabilizes quickly, and becomes predictive of terminal self-administration within 3 to 4 trials. Indeed, rats exhibiting high conditioned aversive TR to the cocaine-paired cue also exhibited greater goal-directed behavior, were faster to take drug, self-administered more cocaine, and exhibited greater seeking during periods of drug non-availability. High conditioned aversive TR, then, develops quickly and is associated with a greater motivation for drug.

Role of nucleus accumbens in neuropathic pain: linked multi-scale evidence in the rat transitioning to neuropathic pain

Despite recent evidence implicating the nucleus accumbens (NAc) as causally involved in the transition to chronic pain in humans, underlying mechanisms of this involvement remain entirely unknown. Here we elucidate mechanisms of NAc reorganizational properties (longitudinally and cross-sectionally), in an animal model of neuropathic pain (spared nerve injury [SNI]). We observed interrelated changes: (1) In resting-state functional magnetic resonance imaging (fMRI), functional connectivity of the NAc to dorsal striatum and cortex was reduced 28days (but not 5days) after SNI; (2) Contralateral to SNI injury, gene expression of NAc dopamine 1A, 2, and κ-opioid receptors decreased 28days after SNI; (3) In SNI (but not sham), covariance of gene expression was upregulated at 5days and settled to a new state at 28days; and (4) NAc functional connectivity correlated with dopamine receptor gene expression and with tactile allodynia. Moreover, interruption of NAc activity (via lidocaine infusion) reversibly alleviated neuropathic pain in SNI animals. Together, these results demonstrate macroscopic (fMRI) and molecular reorganization of NAc and indicate that NAc neuronal activity is necessary for full expression of neuropathic pain-like behavior.

New insights into the specificity and plasticity of reward and aversion encoding in the mesolimbic system

The mesocorticolimbic system, consisting, at its core, of the ventral tegmental area, the nucleus accumbens, and medial prefrontal cortex, has historically been investigated primarily for its role in positively motivated behaviors and reinforcement learning, and its dysfunction in addiction, schizophrenia, depression, and other mood disorders. Recently, researchers have undertaken a more comprehensive analysis of this system, including its role in not only reward but also punishment, as well as in both positive and negative reinforcement. This focus has been facilitated by new anatomical, physiological, and behavioral approaches to delineate functional circuits underlying behaviors and to determine how this system flexibly encodes and responds to positive and negative states and events, beyond simple associative learning. This review is a summary of topics covered in a mini-symposium at the 2013 Society for Neuroscience annual meeting.

Nucleus accumbens responses differentiate execution and restraint in reward-directed behavior

Our behavior is powerfully driven by environmental cues that signal the availability of rewarding stimuli. We frequently encounter stimuli-a bowl of candy or an alert from our smartphone-that trigger actions to obtain those rewards, even though there may be positive outcomes associated with not acting. The inability to restrain one's action in the presence of reward-associated cues is one type of impulsive behavior and a component of such maladaptive behaviors as overeating, gambling, and substance abuse. The nucleus accumbens (NAc) is ideally situated to integrate multiple cognitive and affective inputs to bias action via outputs through the basal ganglia. NAc neurons have been shown to respond to cues that predict reward availability, goal-directed behaviors aimed at obtaining them, and delivery of the reward itself. As these processes are typically associated, it is difficult to discern whether signals in the NAc are more closely related to processing reward-predictive aspects of goal-directed behavior or selection of behavioral response. To dissociate these possibilities, we recorded the activity of NAc neurons while rats performed a task in which two different cues both informed rats of reward availability but required them to either press a lever (Go) or withhold pressing (NoGo) to obtain the reward. Individual cue-responsive neurons showed either increases or decreases in activity at cue onset. Increases in activity were larger, and decreases smaller, when rats withheld lever pressing, whether correctly for NoGo trials or in error on Go trials. Thus NAc cue responses correlated with action, regardless of cue type or accuracy.

When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine

An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine infusion. Collectively, our findings suggest that cocaine-conditioned cues elicit a cocaine-need state that is aversive, is encoded by a distinct subset of NAc neurons and rapid dopamine signaling, and promotes cocaine-seeking behavior. Finally, we present data showing that experimentally induced abstinence (30 days) exacerbates this natural reward devaluation by cocaine, and this effect is correlated with a greater motivation to lever press during extinction. Dissecting the neural mechanisms underlying these detrimental consequences of addiction is critical since it may lead to novel treatments that ameliorate negative affective states associated with drug use and decrease the drive (craving) for the drug. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Neuroscience of affect: brain mechanisms of pleasure and displeasure

Affective neuroscience aims to understand how affect (pleasure or displeasure) is created by brains. Progress is aided by recognizing that affect has both objective and subjective features. Those dual aspects reflect that affective reactions are generated by neural mechanisms, selected in evolution based on their real (objective) consequences for genetic fitness. We review evidence for neural representation of pleasure in the brain (gained largely from neuroimaging studies), and evidence for the causal generation of pleasure (gained largely from brain manipulation studies). We suggest that representation and causation may actually reflect somewhat separable neuropsychological functions. Representation reaches an apex in limbic regions of prefrontal cortex, especially orbitofrontal cortex, influencing decisions and affective regulation. Causation of core pleasure or 'liking' reactions is much more subcortically weighted, and sometimes surprisingly localized. Pleasure 'liking' is especially generated by restricted hedonic hotspot circuits in nucleus accumbens (NAc) and ventral pallidum. Another example of localized valence generation, beyond hedonic hotspots, is an affective keyboard mechanism in NAc for releasing intense motivations such as either positively valenced desire and/or negatively valenced dread.

Effects of muscimol in the nucleus accumbens shell on salt appetite and sucrose intake: a microstructural study with a comment on the sensitization of salt intake

Previous work has demonstrated that injections of the γ-aminobutyric acidA (GABAA) agonist muscimol into the nucleus accumbens shell (AcbSh) induce pronounced increases in the intake of solid foods and sucrose solutions, but do not potentiate water intake. In order to clarify the range of situations in which inactivation of the AcbSh potentiates ingestive behavior, we examined the effects of muscimol injections on the intake of a 3% NaCl solution in sodium-depleted animals. Although sodium-depleted subjects avidly consumed this solution, muscimol injections had no effect either on the volume consumed or on a variety of microstructural licking parameters. In contrast, in these same animals, muscimol injections significantly increased licking of a 10% sucrose solution. These results suggest that inactivation of the AcbSh may selectively increase the intake of foods, but not that of other homeostatically relevant ingestates. Examination of microstructural parameters suggested that the effect of muscimol on sucrose intake was not mediated by alterations in the "palatability" of the sucrose solution. We also observed that sodium-depleted subjects displayed significantly larger salt intakes after their second experience with sodium depletion than their first, and microstructural analysis in this case indicated that this sensitization effect was produced in a manner consistent with the animals showing increased "hedonic responsiveness" to the salt solution.

Encoding of aversion by dopamine and the nucleus accumbens

Adaptive motivated behavior requires rapid discrimination between beneficial and harmful stimuli. Such discrimination leads to the generation of either an approach or rejection response, as appropriate, and enables organisms to maximize reward and minimize punishment. Classically, the nucleus accumbens (NAc) and the dopamine projection to it are considered an integral part of the brain's reward circuit, i.e., they direct approach and consumption behaviors and underlie positive reinforcement. This reward-centered framing ignores important evidence about the role of this system in encoding aversive events. One reason for bias toward reward is the difficulty in designing experiments in which animals repeatedly experience punishments; another is the challenge in dissociating the response to an aversive stimulus itself from the reward/relief experienced when an aversive stimulus is terminated. Here, we review studies that employ techniques with sufficient time resolution to measure responses in ventral tegmental area and NAc to aversive stimuli as they are delivered. We also present novel findings showing that the same stimulus - intra-oral infusion of sucrose - has differing effects on NAc shell dopamine release depending on the prior experience. Here, for some rats, sucrose was rendered aversive by explicitly pairing it with malaise in a conditioned taste aversion paradigm. Thereafter, sucrose infusions led to a suppression of dopamine with a similar magnitude and time course to intra-oral infusions of a bitter quinine solution. The results are discussed in the context of regional differences in dopamine signaling and the implications of a pause in phasic dopamine release within the NAc shell. Together with our data, the emerging literature suggests an important role for differential phasic dopamine signaling in aversion vs. reward.

Descending projections from the nucleus accumbens shell suppress activity of taste-responsive neurons in the hamster parabrachial nuclei

The parabrachial nuclei (PbN), the second central relay for the gustatory pathway, transfers taste information to various forebrain gustatory nuclei and to the gustatory cortex. The nucleus accumbens is one of the critical neural substrates of the reward system, and the nucleus accumbens shell region (NAcSh) is associated with feeding behavior. Taste-evoked neuronal responses of PbN neurons are modulated by descending projections from the gustatory nuclei in the forebrain. In the present study, we investigated whether taste-responsive neurons in the PbN project to the NAcSh and whether pontine gustatory neurons are subject to modulatory influence from the NAcSh in urethane-anesthetized hamsters. Extracellular single-unit activity was recorded in the PbN, and taste responses were confirmed by the delivery of 32 mM sucrose, NaCl, quinine hydrochloride, and 3.2 mM citric acid to the anterior tongue. The NAcSh was then stimulated (0.5 ms, ≤100 μA) bilaterally using concentric bipolar stimulating electrodes. A total of 98 taste neurons were recorded from the PbN. Eighteen neurons were antidromically invaded from the NAcSh, mostly the ipsilateral NAcSh ( n = 16). Stimulation of the ipsilateral and contralateral NAcSh suppressed the neuronal activity of 88 and 55 neurons, respectively; 52 cells were affected bilaterally. In a subset of pontine neurons tested, electrical stimulation of the NAcSh during taste stimulation also suppressed taste-evoked neuronal firing. These results demonstrated that taste-responsive neurons in the PbN not only project to the NAcSh but also are under substantial descending inhibitory influence from the bilateral NAcSh.

Transitions between sleep and feeding states in rat ventral striatum neurons

Neurons in the nucleus accumbens (NAc) have been shown to participate in several behavioral states, including feeding and sleep. However, it is not known if the same neuron participates in both states and, if so, how similar are the responses. In addition, since the NAc contains several cell types, it is not known if each type participates in the transitions associated with feeding and sleep. Such knowledge is important for understanding the interaction between two different neural networks. For these reasons we recorded ensembles of NAc neurons while individual rats volitionally transitioned between the following states: awake and goal directed, feeding, quiet-awake, and sleeping. We found that during both feeding and sleep states, the same neurons could increase their activity (be activated) or decrease their activity (be inactivated) by feeding and/or during sleep, thus indicating that the vast majority of NAc neurons integrate sleep and feeding signals arising from spatially distinct neural networks. In contrast, a smaller population was modulated by only one of the states. For the majority of neurons in either state, we found that when one population was excited, the other was inhibited, suggesting that they act as a local circuit. Classification of neurons into putative interneurons [fast-spiking interneurons (pFSI) and choline acetyltransferase interneurons (pChAT)] and projection medium spiny neurons (pMSN) showed that all three types are modulated by transitions to and from feeding and sleep states. These results show, for the first time, that in the NAc, those putative inhibitory interneurons respond similarly to pMSN projection neurons and demonstrate interactions between NAc networks involved in sleep and feeding.

Appetitive changes during salt deprivation are paralleled by widespread neuronal adaptations in nucleus accumbens, lateral hypothalamus, and central amygdala

Salt appetite is a goal-directed behavior in which salt-deprived animals ingest high salt concentrations that they otherwise find aversive. Because forebrain areas such as the lateral hypothalamus (LH), central amygdala (CeA), and nucleus accumbens (NAc) are known to play an important role in this behavior, we recorded from these areas while water-deprived (WD) and salt-deprived (SD) rats performed a two-bottle choice test between 0.5 M salt (NaCl) and 0.4 M sucrose. In the SD state, the preference ratio for high molar salt markedly increased. Electrophysiological recordings analyzed with respect to the onset of licking clusters revealed the presence of both excitatory and inhibitory neuronal responses during salt and/or sucrose consumption. In the NAc, putative medium spiny neurons and tonically active neurons exhibited excitatory and inhibitory responses. In all areas, compared with those recorded during the WD state, neurons recorded during the SD state showed an increase in the percentage of salt-evoked excitatory responses and a decrease in the percentage of sucrose-evoked inhibitory responses, suggesting that a subset of the neuronal population in these areas codes for the increased motivational and/or hedonic value of the salt solution. In addition, in the SD state, the firing of excitatory neurons in LH and CeA became more synchronized, indicating a greater functional connectivity between salt-responsive neurons in these areas. We propose that plastic changes in the feeding-related neuronal populations of these forebrain areas arise when changes in metabolic state alter the hedonic and motivational value of a particular taste stimulus.

Comparison of the MK-801-induced appetitive extinction deficit with pressing for reward and associated pERK1/2 staining in prefrontal cortex and nucleus accumbens

Administration of the noncompetitive N-methyl-d-aspartate (NMDA)-receptor antagonist (+)-5-methyl-10,11-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine maleate (MK-801) has been shown to produce extinction deficits on appetitive operant tasks. The present study sought to further explore this by comparing extinction pressing to pressing for the primary reward and examining associated neural correlates to determine if the MK-801 extinction profile resembled the behavioral and neural profile associated with pressing for primary reward. Immunohistochemical labeling of phosphorylated extracellular signal-regulated kinase-1 and -2(pERK1/2) in the prelimbic (PrL) and infralimbic (IL) cortices and nucleus accumbens shell (AcbSh) and core (AcbC) was examined after rewarded or extinction lever pressing conditions. A dose-response curve revealed a within-day extinction deficit following administration of 0.05 mg/kg MK-801. All doses of MK-801 were associated with reduced IL pERK1/2 staining but only the 0.05 mg/kg dose was associated with elevated AcbSh pERK1/2 labeling. Extinction pressing under the influence of MK-801 was elevated compared to that seen during rewarded pressing-whether on MK-801 or saline. Rewarded pressing following saline or MK-801 was associated with elevated pERK1/2 in the PrL with no similar patterns in the MK-801/extinction group. There was more pERK1/2 labeling in the AcbSh of the MK-801 extinction group than any other condition. These data suggest that the MK-801-induced extinction deficit may be due to the combination of an underactive cortical behavioral inhibition system and an overactive AcbSh reward system.