Rapid dopamine dynamics in the accumbens core and shell: learning and action

Phasic Dopamine Transmission Reflects Initiation Vigor and Exerted Effort in an Action- and Region-Specific Manner

Initiating a reward-seeking behavior involves deciding on an action, how fast to initiate the action (initiation vigor), as well as how much effort to exert. These processes are thought to involve the mesolimbic dopamine system. Dopamine levels in the ventral striatum rise before initiating a reliably reinforced behavior. However, it is unknown whether dopamine is similarly involved with unreinforced actions (inactive lever presses, premature food port entries, insufficient number of active lever presses). Furthermore, does the dopamine response when initiating an action reflect specific aspects of motivated behavior, such as initiation vigor and exerted effort? Here, we analyzed voltammetry recordings of dopamine levels in the nucleus accumbens (NAcc) core and shell in rats working for food under a progressive ratio reinforcement schedule. We examined dopamine levels when rats initiated distinct actions (active lever presses, inactive lever presses, food port entries) that were temporally separated from cue- and reward-evoked dopamine release. Active lever pressing bouts were preceded by elevated dopamine release in the NAcc shell, as well as in the NAcc core, although only when rats exhibited high initiation vigor. Dopamine levels were transiently reduced in the NAcc core following an unreinforced food port entry and were unchanged throughout the NAcc when initiating inactive lever presses. The effort exerted and vigor to initiate a bout of active lever presses were signaled by dopamine transmission in the NAcc core, but not in the NAcc shell. These results demonstrate that the dopamine response when initiating a behavior is both region- and action-specific.

SIGNIFICANCE STATEMENT

Exogenous activation of the mesolimbic dopamine system facilitates motivated behavior. However, a direct relationship has not been established between endogenous phasic dopamine transmission and measures of motivation, such as the vigor to initiate an action and the effort exerted in a bout of activity. The present work demonstrates that the dopamine response when initiating an action depends both upon where dopamine is released and what action is performed. Furthermore, dopamine reflects measures of motivated behavior selectively within the nucleus accumbens core.

Nucleus Accumbens AMPA Receptor Trafficking Upregulated by Food Restriction: An Unintended Target for Drugs of Abuse and Forbidden Foods

There is a high rate of comorbidity between eating disorders and substance abuse, and specific evidence that weight-loss dieting can increase risk for binge pathology, rebound excessive weight gain, and initiation and relapse to drug abuse. The present overview discusses basic science findings indicating that chronic food restriction induces dopamine conservation, compensatory upregulation of D-1 dopamine receptor signaling, and synaptic incorporation of calcium-permeable glutamatergic AMPA receptors in nucleus accumbens. Evidence is presented which indicates that these neuroadaptations account for increased incentive effects of food, drugs, and associated environments during food restriction. In addition, these same neuroadaptations underlie upregulation of sucrose- and psychostimulant-induced trafficking of AMPA receptors to the nucleus accumbens postsynaptic density, which may be a mechanistic basis of enduring maladaptive behavior.

Architectural Representation of Valence in the Limbic System

In order to thrive, animals must be able to recognize aversive and appetitive stimuli within the environment and subsequently initiate appropriate behavioral responses. This assignment of positive or negative valence to a stimulus is a key feature of emotional processing, the neural substrates of which have been a topic of study for several decades. Until recently, the result of this work has been the identification of specific brain regions, such as the basolateral amygdala (BLA) and nucleus accumbens (NAc), as important to valence encoding. The advent of modern tools in neuroscience has allowed further dissection of these regions to identify specific populations of neurons signaling the valence of environmental stimuli. In this review, we focus upon recent work examining the mechanisms of valence encoding, and provide a model for the systematic investigation of valence within anatomically-, genetically-, and functionally defined populations of neurons.

Differential Dopamine Regulation of Ca(2+) Signaling and Its Timing Dependence in the Nucleus Accumbens

Dopamine action in the nucleus accumbens (NAc) is thought to drive appetitive behavior and Pavlovian reward learning. However, it remains controversial how dopamine achieves these behavioral effects by regulating medium spiny projection neurons (MSNs) of the NAc, especially on a behaviorally relevant timescale. Metabotropic glutamate receptor (mGluR)-induced Ca(2+) signaling dependent on the Ca(2+)- releasing messenger inositol 1,4,5-triphosphate (IP3) plays a critical role in controlling neuronal excitability and synaptic plasticity. Here, we show that transient dopamine application facilitates mGluR/IP3-induced Ca(2+) signals within a time window of ∼2-10 s in a subpopulation of MSNs in the NAc core. Dopamine facilitation of IP3-induced Ca(2+) signaling is mediated by D1 dopamine receptors. In dopamine-insensitive MSNs, activation of A2A adenosine receptors causes enhancement of IP3-evoked Ca(2+) signals, which is reversed by D2 dopamine receptor activation. These results show that dopamine differentially regulates Ca(2+) signaling on the order of seconds in two distinct MSN subpopulations.

Basal ganglia play a crucial role in decision making

Many studies have suggested that the striatum, located at the interface of the cortico-basal ganglia-thalamic circuit, consists of separate circuits that serve distinct functions It plays an important role in motor planning, value processing, and decision making.

Fischer 344 and Lewis Rat Strains as a Model of Genetic Vulnerability to Drug Addiction

Today it is well acknowledged that both nature and nurture play important roles in the genesis of psychopathologies, including drug addiction. Increasing evidence suggests that genetic factors contribute for at least 40–60% of the variation in liability to drug dependence. Human genetic studies suggest that multiple genes of small effect, rather than single genes, contribute to the genesis of behavioral psychopathologies. Therefore, the use of inbred rat strains might provide a valuable tool to identify differences, linked to genotype, important in liability to addiction and related disorders. In this regard, Lewis and Fischer 344 inbred rats have been proposed as a model of genetic vulnerability to drug addiction, given their innate differences in sensitivity to the reinforcing and rewarding effects of drugs of abuse, as well their different responsiveness to stressful stimuli. This review will provide evidence in support of this model for the study of the genetic influence on addiction vulnerability, with particular emphasis on differences in mesolimbic dopamine (DA) transmission, rewarding and emotional function. It will be highlighted that Lewis and Fischer 344 rats differ not only in several indices of DA transmission and adaptive changes following repeated drug exposure, but also in hypothalamic-pituitary-adrenal (HPA) axis responsiveness, influencing not only the ability of the individual to cope with stressful events, but also interfering with rewarding and motivational processes, given the influence of corticosteroids on dopamine neuron functionality. Further differences between the two strains, as impulsivity or anxiousness, might contribute to their different proneness to addiction, and likely these features might be linked to their different DA neurotransmission plasticity. Although differences in other neurotransmitter systems might deserve further investigation, results from the reviewed studies might open new vistas in understanding aberrant deviations in reward and motivational functions.

Glutamatergic plasticity and alcohol dependence-induced alterations in reward, affect and cognition

INTRODUCTION

Alcohol dependence is characterized by a reduction in reward threshold, development of a negative affective state, and significant cognitive impairments. Dependence-induced glutamatergic neuroadaptations in the neurocircuitry mediating reward, affect and cognitive function are thought to underlie the neural mechanism for these alterations. These changes serve to promote increased craving for alcohol and facilitate the development of maladaptive behaviors that promote relapse to alcohol drinking during periods of abstinence.

OBJECTIVE

To review the extant literature on the effects of chronic alcohol exposure on glutamatergic neurotransmission and its impact on reward, affect and cognition.

RESULTS

Evidence from a diverse set of studies demonstrates significant enhancement of glutamatergic activity following chronic alcohol exposure. In particular, up-regulation of GluN2B-containing NMDA receptor expression and function is a commonly observed phenomenon that likely reflects activity-dependent adaptive homeostatic plasticity. However, this observation as well as other glutamatergic neuroadaptations are often circuit and cell-type specific.

DISCUSSION

Dependence-induced alterations in glutamate signaling contribute to many of the symptoms experienced in addicted individuals and can persist well into abstinence. This suggests that they play an important role in the development of behaviors that increase the probability for relapse. As our understanding of the complexity of the neurocircuitry involved in the addictive process has advanced, it has become increasingly clear that investigations of cell-type and circuit-specific effects are required to gain a more comprehensive understanding of the glutamatergic adaptations and their functional consequences in alcohol addiction.

CONCLUSION

While pharmacological treatments for alcohol dependence and relapse targeting the glutamatergic system have shown great promise in preclinical models, more research is needed to uncover novel, possibly circuit-specific, therapeutic targets that exhibit improved efficacy and reduced side effects.

Nucleus Accumbens Core and Shell Differentially Encode Reward-Associated Cues after Reinforcer Devaluation

Nucleus accumbens (NAc) neurons encode features of stimulus learning and action selection associated with rewards. The NAc is necessary for using information about expected outcome values to guide behavior after reinforcer devaluation. Evidence suggests that core and shell subregions may play dissociable roles in guiding motivated behavior. Here, we recorded neural activity in the NAc core and shell during training and performance of a reinforcer devaluation task. Long-Evans male rats were trained that presses on a lever under an illuminated cue light delivered a flavored sucrose reward. On subsequent test days, each rat was given free access to one of two distinctly flavored foods to consume to satiation and were then immediately tested on the lever pressing task under extinction conditions. Rats decreased pressing on the test day when the reinforcer earned during training was the sated flavor (devalued) compared with the test day when the reinforcer was not the sated flavor (nondevalued), demonstrating evidence of outcome-selective devaluation. Cue-selective encoding during training by NAc core (but not shell) neurons reliably predicted subsequent behavioral performance; that is, the greater the percentage of neurons that responded to the cue, the better the rats suppressed responding after devaluation. In contrast, NAc shell (but not core) neurons significantly decreased cue-selective encoding in the devalued condition compared with the nondevalued condition. These data reveal that NAc core and shell neurons encode information differentially about outcome-specific cues after reinforcer devaluation that are related to behavioral performance and outcome value, respectively.

SIGNIFICANCE STATEMENT

Many neuropsychiatric disorders are marked by impairments in behavioral flexibility. Although the nucleus accumbens (NAc) is required for behavioral flexibility, it is not known how NAc neurons encode this information. Here, we recorded NAc neurons during a training session in which rats learned that a cue predicted a specific reward and during a test session when that reward value was changed. Although encoding in the core during training predicted the ability of rats to change behavior after the reward value was altered, the NAc shell encoded information about the change in reward value during the test session. These findings suggest differential roles of the core and shell in behavioral flexibility.

Cocaine Self-Administration Experience Induces Pathological Phasic Accumbens Dopamine Signals and Abnormal Incentive Behaviors in Drug-Abstinent Rats

Chronic exposure to drugs of abuse is linked to long-lasting alterations in the function of limbic system structures, including the nucleus accumbens (NAc). Although cocaine acts via dopaminergic mechanisms within the NAc, less is known about whether phasic dopamine (DA) signaling in the NAc is altered in animals with cocaine self-administration experience or if these animals learn and interact normally with stimuli in their environment. Here, separate groups of rats self-administered either intravenous cocaine or water to a receptacle (controls), followed by 30 d of enforced abstinence. Next, all rats learned an appetitive Pavlovian discrimination and voltammetric recordings of real-time DA release were taken in either the NAc core or shell of cocaine and control subjects. Cocaine experience differentially impaired DA signaling in the core and shell relative to controls. Although phasic DA signals in the shell were essentially abolished for all stimuli, in the core, DA did not distinguish between cues and was abnormally biased toward reward delivery. Further, cocaine rats were unable to learn higher-order associations and even altered simple conditioned approach behaviors, displaying enhanced preoccupation with cue-associated stimuli (sign-tracking; ST) but diminished time at the food cup awaiting reward delivery (goal-tracking). Critically, whereas control DA signaling correlated with ST behaviors, cocaine experience abolished this relationship. These findings show that cocaine has persistent, differential, and pathological effects on both DA signaling and DA-dependent behaviors and suggest that psychostimulant experience may remodel the very circuits that bias organisms toward repeated relapse.

SIGNIFICANCE STATEMENT

Relapsing to drug abuse despite periods of abstinence and sincere attempts to quit is one of the most pernicious facets of addiction. Unfortunately, little is known about how the dopamine (DA) system functions after periods of drug abstinence, particularly its role in behavior in nondrug situations. Here, rats learned about food-paired stimuli after prolonged abstinence from cocaine self-administration. Using voltammetry, we found that real-time DA signals in cocaine-experienced rats were strikingly altered relative to controls. Further, cocaine-experienced animals found reward-predictive stimuli abnormally salient and spent more time interacting with cues. Therefore, cocaine induces neuroplastic changes in the DA system that biases animals toward salient stimuli (including reward-associated cues), putting addicts at increasing risk to relapse as addiction increases in severity.

Chronic ethanol self-administration in macaques shifts dopamine feedback inhibition to predominantly D2 receptors in nucleus accumbens core

BACKGROUND

Given the high level of homology between nonhuman primates and humans in regard to anatomy, physiology and ethanol drinking patterns, nonhuman primates represent an unparalleled preclinical model for examining the neurobiological basis of ethanol abuse.

METHODS

Here we examined the neurochemical consequences of chronic daily ethanol use using fast-scan cyclic voltammetry in brain slices containing the nucleus accumbens core or dorsolateral caudate taken from male cynomolgus macaques following ethanol drinking.

RESULTS

We found that in both regions the ability of ethanol to decrease dopamine release was unchanged, indicating that ethanol self-administration does not produce tolerance or sensitization to ethanol effects on dopamine release at the dopamine terminal at this time point. We also found that in the nucleus accumbens core, autoregulation of dopamine release was shifted from equal D2 and D3 receptor involvement in control animals to primarily D2 receptor-mediated in drinkers. Specifically, the effect quinpirole, a D2/D3 receptor agonist, on dopamine release was equal across groups; however, dopamine signals were reversed to a greater extent by the selective D3 receptor antagonist SB-277,011A in control animals, indicating a greater contribution of D2 receptors in quinpirole-induced inhibition following ethanol self-administration. In the dorsolateral caudate, the effects of quinpirole and reversal with SB-277,011A was not different between ethanol and control slices.

CONCLUSIONS

This work provides novel insight into the dopaminergic adaptations resulting from chronic ethanol use in nonhuman primates and indicates that alterations in D2/D3 dopamine autoreceptor signaling may be an important neurochemical adaptation to ethanol consumption during early use.

Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens

Substantial evidence suggests that the phasic activity of dopamine neurons represents reinforcement learning’s temporal difference prediction error. However, recent reports of ramp-like increases in dopamine concentration in the striatum when animals are about to act, or are about to reach rewards, appear to pose a challenge to established thinking. This is because the implied activity is persistently predictable by preceding stimuli, and so cannot arise as this sort of prediction error. Here, we explore three possible accounts of such ramping signals: (a) the resolution of uncertainty about the timing of action; (b) the direct influence of dopamine over mechanisms associated with making choices; and (c) a new model of discounted vigour. Collectively, these suggest that dopamine ramps may be explained, with only minor disturbance, by standard theoretical ideas, though urgent questions remain regarding their proximal cause. We suggest experimental approaches to disentangling which of the proposed mechanisms are responsible for dopamine ramps.

Dopamine has long been implicated in reward-motivated behaviour. Theory and experiments suggest that activity of dopamine-containing neurons resembles a temporally-sophisticated prediction error used to learn expectations of future reward. This account would appear to be inconsistent with recent observations of ‘ramps’, i.e., gradual increases in extracellular dopamine concentration prior to the execution of actions or the acquisition of rewards. We explore three different possible explanations of such ramping signals as arising: (a) when subjects experience uncertainty about when actions will be executed; (b) when dopamine itself influences the timecourse of choice; and (c) under a new model in which ‘quasi-tonic’ dopamine signals arise through a form of temporal discounting. We thereby show that dopamine ramps can be integrated with current theories, and also suggest experiments to clarify which mechanisms are involved.

Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation

Mesolimbic dopamine (DA) is phasically released during appetitive behaviors, though there is substantive disagreement about the specific purpose of these DA signals. For example, prediction error (PE) models suggest a role of learning, while incentive salience (IS) models argue that the DA signal imbues stimuli with value and thereby stimulates motivated behavior. However, within the nucleus accumbens (NAc) patterns of DA release can strikingly differ between subregions, and as such, it is possible that these patterns differentially contribute to aspects of PE and IS. To assess this, we measured DA release in subregions of the NAc during a behavioral task that spatiotemporally separated sequential goal-directed stimuli. Electrochemical methods were used to measure subsecond NAc dopamine release in the core and shell during a well learned instrumental chain schedule in which rats were trained to press one lever (seeking; SL) to gain access to a second lever (taking; TL) linked with food delivery, and again during extinction. In the core, phasic DA release was greatest following initial SL presentation, but minimal for the subsequent TL and reward events. In contrast, phasic shell DA showed robust release at all task events. Signaling decreased between the beginning and end of sessions in the shell, but not core. During extinction, peak DA release in the core showed a graded decrease for the SL and pauses in release during omitted expected rewards, whereas shell DA release decreased predominantly during the TL. These release dynamics suggest parallel DA signals capable of supporting distinct theories of appetitive behavior.

SIGNIFICANCE STATEMENT

Dopamine signaling in the brain is important for a variety of cognitive functions, such as learning and motivation. Typically, it is assumed that a single dopamine signal is sufficient to support these cognitive functions, though competing theories disagree on how dopamine contributes to reward-based behaviors. Here, we have found that real-time dopamine release within the nucleus accumbens (a primary target of midbrain dopamine neurons) strikingly varies between core and shell subregions. In the core, dopamine dynamics are consistent with learning-based theories (such as reward prediction error) whereas in the shell, dopamine is consistent with motivation-based theories (e.g., incentive salience). These findings demonstrate that dopamine plays multiple and complementary roles based on discrete circuits that help animals optimize rewarding behaviors.

Social isolation rearing increases dopamine uptake and psychostimulant potency in the striatum

Social isolation rearing (SI) is a model of early life stress that results in neurobiological alterations leading to increased anxiety-like behaviors. These animals also exhibit an increased propensity to administer psychostimulants, such as cocaine; however, the mechanisms governing this increased addiction vulnerability remain to be elucidated. Long-term stressors have been shown to produce important alterations in nucleus accumbens core (NAc) function. The NAc regulates motivated and goal-directed behaviors, and individual differences in NAc function have been shown to be predictive of addiction vulnerability. Rats were reared in group (GH; 4/cage) or SI (1/cage) conditions from weaning (PD 28) into early adulthood (PD 77) and dopamine release was assessed using voltammetry in brain slices containing the NAc and dorsomedial striatum. SI rats exhibited enhanced dopamine release and uptake in both regions compared to GH rats. In regard to psychostimulant effects directly at the dopamine transporter (DAT), methylphenidate and amphetamine, but not cocaine, inhibited uptake more in SI than GH rats. The increased potencies were positively correlated with uptake rates, suggesting that increased potencies of amphetamine-like compounds are due to changes in DAT function. Cocaine's effects on uptake were similar between rearing conditions, however, cocaine enhanced evoked dopamine release greater in SI than GH rats, suggesting that the enhanced cocaine reinforcement in SI animals involves a DAT independent mechanism. Together, the results provide the first evidence that greater psychostimulant effects in SI compared to GH rats are due to effects on dopamine terminals related to uptake dependent and independent mechanisms.

Norepinephrine and dopamine transmission in 2 limbic regions differentially respond to acute noxious stimulation

Central dopamine and norepinephrine regulate behavioral and physiological responses during rewarding and aversive stimuli. Here, we investigated and compared norepinephrine and dopamine transmission in 2 limbic structures, the ventral bed nucleus of the stria terminalis and the nucleus accumbens shell of anesthetized rats, respectively, in response to acute tail pinch, a noxious stimulus. Norepinephrine release in the ventral bed nucleus of the stria terminalis responded monophasically, increasing at the time of the tail pinch and remaining elevated for a period after its cessation. In contrast, dopamine transmission in the nucleus accumbens shell displayed a heterogeneous and time-locked response to tail pinch. For most trials, there was a suppression of extracellular dopamine concentration throughout the duration of the stimuli. At the termination of the stimuli, however, extracellular dopamine either recovered back to or spiked above the initial baseline concentration. These signaling patterns were more clearly observed after administration of selective catecholamine autoreceptor and transporter inhibitors. The results suggest that the opposing responses of these catecholamines can provide integration of noxious inputs to influence behavioral outputs appropriate for survival such as escape or fighting.

The accumbofrontal tract: Diffusion tensor imaging characterization and developmental change from childhood to adulthood

The presence of an anatomical connection between the orbitofrontal cortex and ventral striatum, forming a so-called reward network, is well established across species. This connection has important implications for reward processing and is relevant to a number of neuropsychiatric disorders. Moreover, white matter (WM) is known to continue to mature across adolescence and into early adulthood, and developmental change in the reward network is an important component of models of decision making and risk taking. Despite the importance of this connection, the underlying WM has only recently been characterized in humans histologically, and not yet in-vivo using brain imaging. Here, we implemented diffusion tensor imaging (DTI) in a large cross-sectional sample of 295 healthy individuals ages 8-68 to further characterize the WM of this connection and its development from childhood into adulthood. We demonstrate that the accumbofrontal tract, connecting the orbitofrontal cortex and nucleus accumbens, can be identified using standard DTI sequences. Using Poisson modeling, we show that the accumbofrontal tract undergoes significant change across the lifespan, with males showing a higher and earlier peak compared to females. Moreover, the change occurs in a pattern consistent with developmental models of decision-making. These findings support the hypothesis that developmental differences in WM integrity may be a contributing factor to the observed risk taking that occurs in adolescence. The accumbofrontal tract is not yet included in standard WM atlases, but may be important for inclusion in studies investigating fronto-striatal networks, as well as in investigations of substance abuse and decision making.

Inflammatory Pain Promotes Increased Opioid Self-Administration: Role of Dysregulated Ventral Tegmental Area μ Opioid Receptors

Pain management in opioid abusers engenders ethical and practical difficulties for clinicians, often resulting in pain mismanagement. Although chronic opioid administration may alter pain states, the presence of pain itself may alter the propensity to self-administer opioids, and previous history of drug abuse comorbid with chronic pain promotes higher rates of opioid misuse. Here, we tested the hypothesis that inflammatory pain leads to increased heroin self-administration resulting from altered mu opioid receptor (MOR) regulation of mesolimbic dopamine (DA) transmission. To this end, the complete Freund's adjuvant (CFA) model of inflammation was used to assess the neurochemical and functional changes induced by inflammatory pain on MOR-mediated mesolimbic DA transmission and on rat intravenous heroin self-administration under fixed ratio (FR) and progressive ratio (PR) schedules of reinforcement. In the presence of inflammatory pain, heroin intake under an FR schedule was increased for high, but attenuated for low, heroin doses with concomitant alterations in mesolimbic MOR function suggested by DA microdialysis. Consistent with the reduction in low dose FR heroin self-administration, inflammatory pain reduced motivation for a low dose of heroin, as measured by responding under a PR schedule of reinforcement, an effect dissociable from high heroin dose PR responding. Together, these results identify a connection between inflammatory pain and loss of MOR function in the mesolimbic dopaminergic pathway that increases intake of high doses of heroin. These findings suggest that pain-induced loss of MOR function in the mesolimbic pathway may promote opioid dose escalation and contribute to opioid abuse-associated phenotypes.

SIGNIFICANCE STATEMENT

This study provides critical new insights that show that inflammatory pain alters heroin intake through a desensitization of MORs located within the VTA. These findings expand our knowledge of the interactions between inflammatory pain and opioid abuse liability, and should help to facilitate the development of novel and safer opioid-based strategies for treating chronic pain.

Differential activation of accumbens shell and core dopamine by sucrose reinforcement with nose poking and with lever pressing

In order to investigate the role of modus operandi in the changes of nucleus accumbens (NAc) dopamine (DA) transmission in sucrose reinforcement, extracellular DA was monitored by microdialysis in the NAc shell and core of rats trained on a fixed-ratio 1 schedule to respond for sucrose pellets by nose poking and lever pressing respectively. After training, rats were tested on three different sessions: sucrose reinforcement, extinction and passive sucrose presentation. In rats responding by nose poking dialysate DA increased in the shell but not in the core under reinforced as well as under extinction sessions. In contrast, in rats responding by lever pressing dialysate DA increased both in the accumbens shell and core under reinforced and extinction sessions. Response non-contingent sucrose presentation increased dialysate DA in the shell and core of rats trained to respond for sucrose by nose poking as well as in those trained by lever pressing. In rats trained to respond for sucrose by nose poking on a FR5 schedule dialysate DA also increased selectively in the NAc shell during reinforced responding and in both the shell and core under passive sucrose presentation. These findings, while provide an explanation for the discrepancies existing in the literature over the responsiveness of shell and core DA in rats responding for food, are consistent with the notion that NAc shell and core DA encode different aspects of reinforcement.

Early Life Stress, Nicotinic Acetylcholine Receptors and Alcohol Use Disorders

Stress is a major driving force in alcohol use disorders (AUDs). It influences how much one consumes, craving intensity and whether an abstinent individual will return to harmful alcohol consumption. We are most vulnerable to the effects of stress during early development, and exposure to multiple traumatic early life events dramatically increases the risk for AUDs. However, not everyone exposed to early life stress will develop an AUD. The mechanisms determining whether an individual’s brain adapts and becomes resilient to the effects of stress or succumbs and is unable to cope with stress remain elusive. Emerging evidence suggests that neuroplastic changes in the nucleus accumbens (NAc) following early life stress underlie the development of AUDs. This review discusses the impact of early life stress on NAc structure and function, how these changes affect cholinergic signaling within the mesolimbic reward pathway and the role nicotinic acetylcholine receptors (nAChRs) play in this process. Understanding the neural pathways and mechanism determining stress resilience or susceptibility will improve our ability to identify individuals susceptible to developing AUDs, formulate cognitive interventions to prevent AUDs in susceptible individuals and to elucidate and enhance potential therapeutic targets, such as the nAChRs, for those struggling to overcome an AUD.

Voluntary ethanol intake predicts κ-opioid receptor supersensitivity and regionally distinct dopaminergic adaptations in macaques

The dopaminergic projections from the ventral midbrain to the striatum have long been implicated in mediating motivated behaviors and addiction. Previously it was demonstrated that κ-opioid receptor (KOR) signaling in the striatum plays a critical role in the increased reinforcing efficacy of ethanol following ethanol vapor exposure in rodent models. Although rodents have been used extensively to determine the neurochemical consequences of chronic ethanol exposure, establishing high levels of voluntary drinking in these models has proven difficult. Conversely, nonhuman primates exhibit similar intake and pattern to humans in regard to drinking. Here we examine the effects of chronic voluntary ethanol self-administration on dopamine neurotransmission and the ability of KORs to regulate dopamine release in the dorsolateral caudate (DLC) and nucleus accumbens (NAc) core. Using voltammetry in brain slices from cynomolgus macaques after 6 months of ad libitum ethanol drinking, we found increased KOR sensitivity in both the DLC and NAc. The magnitude of ethanol intake predicted increases in KOR sensitivity in the NAc core, but not the DLC. Additionally, ethanol drinking increased dopamine release and uptake in the NAc, but decreased both of these measures in the DLC. These data suggest that chronic daily drinking may result in regionally distinct disruptions of striatal outputs. In concert with previous reports showing increased KOR regulation of drinking behaviors induced by ethanol exposure, the strong relationship between KOR activity and voluntary ethanol intake observed here gives further support to the hypothesis that KORs may provide a promising pharmacotherapeutic target in the treatment of alcoholism.

Muscarinic regulation of dopamine and glutamate transmission in the nucleus accumbens

Cholinergic transmission in the striatum functions as a key modulator of dopamine (DA) transmission and synaptic plasticity, both of which are required for reward and motor learning. Acetylcholine (ACh) can elicit striatal DA release through activation of nicotinic ACh receptors (nAChRs) on DA axonal projections. However, it remains controversial how muscarinic ACh receptors (mAChRs) modulate striatal DA release, with studies reporting both potentiation and depression of striatal DA transmission by mAChR agonists. This study investigates the mAChR-mediated regulation of release from three types of midbrain neurons that project to striatum: DA, DA/glutamate, and glutamate neurons. We found that M5 mAChRs potentiate DA and glutamate release only from DA and DA/glutamate projections from the midbrain. We also show that M2/M4 mAChRs depress the nAChR-dependent mechanism of DA release in the striatum. These results suggest that M5 receptors on DA neuron terminals enhance DA release, whereas M2/M4 autoreceptors on cholinergic terminals inhibit ACh release and subsequent nAChR-dependent DA release. Our findings clarify the mechanisms of mAChR-dependent modulation of DA and glutamate transmission in the striatum.

Monitoring dopamine transmission in the rat nucleus accumbens shell and core during acquisition of nose-poking for sucrose

On the basis of between subjects monitoring of in vivo dopamine (DA) transmission in the rat nucleus accumbens (NAc) shell and core during response-contingent and non-contingent sucrose feeding we have hypothesized that long term, daily exposure to sucrose feeding results in the acquisition of conditioned/discriminative stimuli capable of activating accumbens shell DA transmission in a non-habituating fashion. In order to verify this hypothesis we have now monitored within the same subject the changes in accumbens shell and core DA during acquisition of fixed ratio 1 (FR1) nose-poking for sucrose pellets. Once full training was obtained, dialysate DA was monitored in the same rat on three different sessions: responding for sucrose, extinction and non-contingent sucrose presentation. Dialysate DA steadily increased in the shell during operant sessions as training progressed but was activated in the core only early and transiently in training (5th session). After full training, reinforced as well as non-reinforced responding for sucrose activated DA selectively in the NAc shell. Non-contingent sucrose feeding activated DA in the shell and in the core. No habituation of shell DA responsiveness was observed under contingent and non-contingent sucrose feeding. These observations are consistent with the hypothesis that learning of FR1 nose-poking for sucrose involves acquisition of conditioned activation of DA transmission in the shell and active suppression in the core and that loss of habituation of shell DA responsiveness is related to change from primary-rewarding to conditioned/discriminative as driving stimuli of DA transmission in this area.

Neuroimaging and neuromodulation approaches to study eating behavior and prevent and treat eating disorders and obesity

Functional, molecular and genetic neuroimaging has highlighted the existence of brain anomalies and neural vulnerability factors related to obesity and eating disorders such as binge eating or anorexia nervosa. In particular, decreased basal metabolism in the prefrontal cortex and striatum as well as dopaminergic alterations have been described in obese subjects, in parallel with increased activation of reward brain areas in response to palatable food cues. Elevated reward region responsivity may trigger food craving and predict future weight gain. This opens the way to prevention studies using functional and molecular neuroimaging to perform early diagnostics and to phenotype subjects at risk by exploring different neurobehavioral dimensions of the food choices and motivation processes. In the first part of this review, advantages and limitations of neuroimaging techniques, such as functional magnetic resonance imaging (fMRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), pharmacogenetic fMRI and functional near-infrared spectroscopy (fNIRS) will be discussed in the context of recent work dealing with eating behavior, with a particular focus on obesity. In the second part of the review, non-invasive strategies to modulate food-related brain processes and functions will be presented. At the leading edge of non-invasive brain-based technologies is real-time fMRI (rtfMRI) neurofeedback, which is a powerful tool to better understand the complexity of human brain-behavior relationships. rtfMRI, alone or when combined with other techniques and tools such as EEG and cognitive therapy, could be used to alter neural plasticity and learned behavior to optimize and/or restore healthy cognition and eating behavior. Other promising non-invasive neuromodulation approaches being explored are repetitive transcranial magnetic stimulation (rTMS) and transcranial direct-current stimulation (tDCS). Converging evidence points at the value of these non-invasive neuromodulation strategies to study basic mechanisms underlying eating behavior and to treat its disorders. Both of these approaches will be compared in light of recent work in this field, while addressing technical and practical questions. The third part of this review will be dedicated to invasive neuromodulation strategies, such as vagus nerve stimulation (VNS) and deep brain stimulation (DBS). In combination with neuroimaging approaches, these techniques are promising experimental tools to unravel the intricate relationships between homeostatic and hedonic brain circuits. Their potential as additional therapeutic tools to combat pharmacorefractory morbid obesity or acute eating disorders will be discussed, in terms of technical challenges, applicability and ethics. In a general discussion, we will put the brain at the core of fundamental research, prevention and therapy in the context of obesity and eating disorders. First, we will discuss the possibility to identify new biological markers of brain functions. Second, we will highlight the potential of neuroimaging and neuromodulation in individualized medicine. Third, we will introduce the ethical questions that are concomitant to the emergence of new neuromodulation therapies.

Nucleus accumbens shell and core dopamine responsiveness to sucrose in rats: role of response contingency and discriminative/conditioned cues

This study investigated by microdialysis the role of response contingency and food-associated cues in the responsiveness of dopamine transmission in the nucleus accumbens shell and core to sucrose feeding. In naive rats, single-trial non-contingent presentation and feeding of sucrose pellets increased dialysate shell dopamine and induced full habituation of dopamine responsiveness to sucrose feeding 24 and 48 h later. In rats trained to respond for sucrose pellets on a fixed ratio 1 (FR1) schedule, dialysate dopamine increased in the shell but not in the core during active responding as well as under extinction in the presence of sucrose cues. In rats yoked to the operant rats, the presentation of sucrose cues also increased dialysate dopamine selectively in the shell. In contrast, non-contingent sucrose presentation and feeding in FR1-trained and in yoked rats increased dialysate dopamine to a similar extent in the shell and core. It is concluded that, whereas non-contingent sucrose feeding activated dopamine transmission in the shell and core, response-contingent feeding activated, without habituation, dopamine transmission selectively in the shell as a result of the action of sucrose conditioned cues. These observations are consistent with a critical role of conditioned cues acquired during training and differential activation of shell vs. core dopamine for response-contingent sucrose feeding.

A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature

Survival is dictated by an organism's fitness in approaching positive stimuli and avoiding harm. While a rich literature outlines a role for mesolimbic dopamine in reward and appetitive behaviors, dopamine's involvement in aversion and avoidance behaviors remains controversial. Debate surrounding dopamine's function in the processing of negative stimuli likely stems from conflicting results reported by single-unit electrophysiological studies. Indeed, a number of studies suggest that midbrain dopaminergic cells are inhibited by the presentation of negative or fearful stimuli, while others report no change, or even an increase, in their activity. These disparate results may be due to population heterogeneity. Recent evidence demonstrates that midbrain dopamine neurons are heterogeneous in their projection targets, responses to environmental stimuli, pharmacology, and influences on motivated behavior. Thus, in order to assemble an accurate account of dopamine function during aversive stimulus experience and related behavior, it is necessary to examine the functional output of dopamine neural activity at mesolimbic terminal regions. This Review presents a growing body of evidence that dopamine release in the nucleus accumbens encodes not only reward, but also aversion. For example, our laboratory recently utilized fast-scan cyclic voltammetry to show that real-time changes in accumbal dopamine release are detected when animals are presented with predictors of aversion and its avoidance. These data, along with other reports, support a considerably more nuanced view of dopamine neuron function, wherein accumbal dopamine release is differentially modulated by positive and negative affective stimuli to promote adaptive behaviors.

A New Perspective on Delusional States - Evidence for Claustrum Involvement

Delusions are a hallmark positive symptom of schizophrenia, although they are also associated with a wide variety of other psychiatric and neurological disorders. The heterogeneity of clinical presentation and underlying disease, along with a lack of experimental animal models, make delusions exceptionally difficult to study in isolation, either in schizophrenia or other diseases. To date, no detailed studies have focused specifically on the neural mechanisms of delusion, although some studies have reported characteristic activation of specific brain areas or networks associated with them. Here, we present a novel hypothesis and extant supporting evidence implicating the claustrum, a relatively poorly understood forebrain nucleus, as a potential common center for delusional states.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n = 8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors.

Habitual alcohol seeking: modeling the transition from casual drinking to addiction

The transition from goal-directed actions to habitual ethanol seeking models the development of addictive behavior that characterizes alcohol use disorders. The progression to habitual ethanol-seeking behavior occurs more rapidly than for natural rewards, suggesting that ethanol may act on habit circuit to drive the loss of behavioral flexibility. This review will highlight recent research that has focused on the formation and expression of habitual ethanol seeking, and the commonalities and distinctions between ethanol and natural reward-seeking habits, with the goal of highlighting important, understudied research areas that we believe will lead toward the development of novel treatment and prevention strategies for uncontrolled drinking.

Gestational stress induces persistent depressive-like behavior and structural modifications within the postpartum nucleus accumbens

Postpartum depression (PPD) is a common complication following childbirth experienced by one in every five new mothers. Pregnancy stress enhances vulnerability to PPD and has also been shown to increase depressive-like behavior in postpartum rats. Thus, gestational stress may be an important translational risk factor that can be used to investigate the neurobiological mechanisms underlying PPD. Here we examined the effects of gestational stress on depressive-like behavior during the early/mid and late postpartum periods and evaluated whether this was accompanied by altered structural plasticity in the nucleus accumbens (NAc), a brain region that has been linked to PPD. We show that early/mid (postpartum day 8) postpartum female rats exhibited more depressive-like behavior in the forced swim test as compared with late postpartum females (postpartum day 22). However, 2 weeks of restraint stress during pregnancy increased depressive-like behavior regardless of postpartum timepoint. In addition, dendritic length, branching and spine density on medium spiny neurons in the NAc shell were diminished in postpartum rats that experienced gestational stress although stress-induced reductions in spine density were evident only in early/mid postpartum females. In the NAc core, structural plasticity was not affected by gestational stress but late postpartum females exhibited lower spine density and reduced dendritic length. Overall, these data not only demonstrate structural changes in the NAc across the postpartum period, they also show that postpartum depressive-like behavior following exposure to gestational stress is associated with compromised structural plasticity in the NAc and thus may provide insight into the neural changes that could contribute to PPD.

Nucleus accumbens core neurons encode value-independent associations necessary for sensory preconditioning

Reinforcement-based learning models predict that the strength of association between cues and outcomes is driven by aspects of outcome value. However, animals routinely make associations between contingent stimuli in the world, even if those associations hold no value to the organism. At the neural level, the nucleus accumbens (NAc) is known to encode associative information, but it is not known whether this encoding is specific for value-based information (consistent with reinforcement-based models) or if the NAc additionally plays a more general role in forming predictive associations, independent of outcome value. To test this, we employed a sensory preconditioning (SPC) task where rats initially (Preconditioning) received either contingent pairings of 2 neutral stimuli (e.g., tone [A] and light [X]; "Paired"), or random noncontingent presentations ("Unpaired"). After cue X was subsequently conditioned with food (First-Order Conditioning), the effect of preconditioning was assessed in Phase 3 (Test) by presentations of cue A alone. Electrophysiological recordings from the NAc core showed significant increases in phasic encoding for the stimuli in the Paired (but not Unpaired) condition as well as during test. Further, these effects were only seen in Paired rats that showed successful behavior during test (Good Learners), but not those who did not (Poor Learners) or Unpaired controls. These findings reveal a role for the NAc in the encoding of associative contingencies independent of value, and suggest that this structure also plays a more general role in forming associations necessary for predictive behavior.

Wheel running alters patterns of uncontrollable stress-induced cfos mRNA expression in rat dorsal striatum direct and indirect pathways: A possible role for plasticity in adenosine receptors

Emerging evidence indicates that adenosine is a major regulator of striatum activity, in part, through the antagonistic modulation of dopaminergic function. Exercise can influence adenosine and dopamine activity, which may subsequently promote plasticity in striatum adenosine and dopamine systems. Such changes could alter activity of medium spiny neurons and impact striatum function. The purpose of this study was twofold. The first was to characterize the effect of long-term wheel running on adenosine 1 (A1R), adenosine 2A (A2AR), dopamine 1 (D1R), and dopamine 2 (D2R) receptor mRNA expression in adult rat dorsal and ventral striatum structures using in situ hybridization. The second was to determine if changes to adenosine and dopamine receptor mRNA from running are associated with altered cfos mRNA induction in dynorphin- (direct pathway) and enkephalin- (indirect pathway) expressing neurons of the dorsal striatum following stress exposure. We report that chronic running, as well as acute uncontrollable stress, reduced A1R and A2AR mRNA levels in the dorsal and ventral striatum. Running also modestly elevated D2R mRNA levels in striatum regions. Finally, stress-induced cfos was potentiated in dynorphin and attenuated in enkephalin expressing neurons of running rats. These data suggest striatum adenosine and dopamine systems are targets for neuroplasticity from exercise, which may contribute to changes in direct and indirect pathway activity. These findings may have implications for striatum mediated motor and cognitive processes, as well as exercise facilitated stress-resistance.

Nucleus accumbens neurons track behavioral preferences and reward outcomes during risky decision making

BACKGROUND

To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

METHODS

Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

RESULTS

At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

CONCLUSIONS

Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

Molecular-level functional magnetic resonance imaging of dopaminergic signaling

We demonstrate a technique for mapping brain activity that combines molecular specificity and spatial coverage using a neurotransmitter sensor detectable by magnetic resonance imaging (MRI). This molecular functional MRI (fMRI) method yielded time-resolved volumetric measurements of dopamine release evoked by reward-related lateral hypothalamic brain stimulation of rats injected with the neurotransmitter sensor. Peak dopamine concentrations and release rates were observed in the anterior nucleus accumbens core. Substantial dopamine transients were also present in more caudal areas. Dopamine-release amplitudes correlated with the rostrocaudal stimulation coordinate, suggesting participation of hypothalamic circuitry in modulating dopamine responses. This work provides a foundation for development and application of quantitative molecular fMRI techniques targeted toward numerous components of neural physiology.

Cocaine self-administration abolishes associative neural encoding in the nucleus accumbens necessary for higher-order learning

BACKGROUND

Cocaine use is often associated with diminished cognitive function, persisting even after abstinence from the drug. Likely targets for these changes are the core and shell of the nucleus accumbens (NAc), which are critical for mediating the rewarding aspects of drugs of abuse as well as supporting associative learning. To understand this deficit, we recorded neural activity in the NAc of rats with a history of cocaine self-administration or control subjects while they learned Pavlovian first- and second-order associations.

METHODS

Rats were trained for 2 weeks to self-administer intravenous cocaine or water. Later, rats learned a first-order Pavlovian discrimination where a conditioned stimulus (CS)+ predicted food, and a control (CS-) did not. Rats then learned a second-order association where, absent any food reinforcement, a novel cued (SOC+) predicted the CS+ and another (SOC-) predicted the CS-. Electrophysiological recordings were taken during performance of these tasks in the NAc core and shell.

RESULTS

Both control subjects and cocaine-experienced rats learned the first-order association, but only control subjects learned the second-order association. Neural recordings indicated that core and shell neurons encoded task-relevant information that correlated with behavioral performance, whereas this type of encoding was abolished in cocaine-experienced rats.

CONCLUSIONS

The NAc core and shell perform complementary roles in supporting normal associative learning, functions that are impaired after cocaine experience. This impoverished encoding of motivational behavior, even after abstinence from the drug, might provide a key mechanism to understand why addiction remains a chronically relapsing disorder despite repeated attempts at sobriety.

Ventral tegmental area α6β2 nicotinic acetylcholine receptors modulate phasic dopamine release in the nucleus accumbens core

RATIONALE

Phasic dopamine (DA) signaling underlies reward learning. Cholinergic and glutamatergic inputs into the ventral tegmental area (VTA) are crucial for modulating burst firing activity and subsequent phasic DA release in the nucleus accumbens (NAc), but the specific VTA nicotinic receptor subtypes that regulate phasic DA release have not been identified.

OBJECTIVE

The goal was to determine the role of VTA N-methyl-D-aspartate receptors (NMDARs) and specific subtypes of nicotinic acetylcholine receptors (nAChRs) in regulating phasic DA release in the NAc core.

METHODS

Fast-scan cyclic voltammetry in anesthetized rats was combined with intra-VTA micro-infusion to evaluate the ability of glutamatergic and cholinergic drugs to modulate stimulated phasic DA release in the NAc core.

RESULTS

VTA NMDAR blockade with AP-5 decreased, while VTA NMDAR activation with NMDA increased NAc peak phasic DA release. Intra-VTA administration of the nonspecific nAChR antagonist mecamylamine produced a persistent decrease in phasic DA release. Infusion of the α6-selective antagonist α-conotoxin MII (α-ctx MII) produced a robust, but transient decrease in phasic DA, whereas infusion of selective doses of either the α4β2-selective antagonist, dihydro-beta-erythroidine, or the α7 antagonist, methyllycaconitine, had no effect. Co-infusion of AP-5 and α-ctx MII produced a similar phasic DA decrease as either drug alone, with no additive effect.

CONCLUSIONS

The results suggest that VTA α6β2 nAChRs, but not α4β2 or α7 nAChRs, regulate phasic DA release in the NAc core and that VTA α6β2 nAChRs and NMDA receptors act at a common site or target to regulate NAc phasic DA signaling.

Effects of ventral striatal lesions on first- and second-order appetitive conditioning

Rats with bilateral lesions of the ventral striatal nucleus accumbens failed to acquire Pavlovian second-order conditioning to auditory stimuli paired with visual stimuli that had previously received first-order pairings with food. This deficit in second-order conditioning was specific to learning driven by incentive properties of the first-order cues, and was observed whether the first-order training had occurred prior to or after lesion surgery. Lesions also produced deficits in the display of conditioned responses to the first-order conditioned stimulus, but only when they were made after first-order training. These results suggest a specific role for the ventral striatum in acquiring and expressing incentive properties of conditioned stimuli through second-order conditioning, as well as a more general role in expressing previously acquired Pavlovian conditioned responses.