Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of GABA-elicited defensive behavior versus eating behavior

GABAA receptors activate fish feeding behaviour via two distinct functional pathways

Benzodiazepines, acting through ionotropic receptors of γ-aminobutyric acid (GABA_A receptors, GABAR), have been shown to modify feeding behaviour and increase appetite in humans and non-human subjects. However, the cellular and molecular mechanisms that underlie connected short-term behavioural fluctuations are still unclear. In the present study, we used Carassius gibelio (Prussian carp) as a model organism to research the impact of scantily explored benzodiazepine phenazepam (PNZ) on feeding behaviour and the related molecular mechanisms of PNZ action at single-cell and single-receptor levels. We found that the feeding activity of C. gibelio is under control of GABARs via two distinct mechanisms: orthosteric (triggered by GABA binding site) and allosteric (triggered by benzodiazepine binding site). PNZ displayed clear stimulatory effects on both mechanisms in a GABA-dependent manner. In addition, orthosteric and allosteric effects were found to be partially competitive, which leads to complex behavioural repercussions of conjoint effects of GABAR ligands.

Neuromodulation for the treatment of eating disorders and obesity

Eating disorders and obesity adversely affect individuals both medically and psychologically, leading to reduced life expectancy and poor quality of life. While there exist a number of treatments for anorexia, morbid obesity and bulimia, many patients do not respond favorably to current behavioral, medical or bariatric surgical management. Neuromodulation has been postulated as a potential treatment for eating disorders and obesity. In particular, deep brain stimulation and transcranial non-invasive brain stimulation have been studied for these indications across a variety of brain targets. Here, we review the neurobiology behind eating and eating disorders as well as the current status of preclinical and clinical neuromodulation trials for eating disorders and obesity.

Abundant collateralization of temporal lobe projections to the accumbens, bed nucleus of stria terminalis, central amygdala and lateral septum

Behavioral flexibility is subserved in part by outputs from the cerebral cortex to telencephalic subcortical structures. In our earlier evaluation of the organization of the cortical-subcortical output system (Reynolds and Zahm, J Neurosci 25:11757-11767, 2005), retrograde double-labeling was evaluated in the prefrontal cortex following tracer injections into pairs of the following subcortical telencephalic structures: caudate-putamen, core and shell of the accumbens (Acb), bed nucleus of stria terminalis (BST) and central nucleus of the amygdala (CeA). The present study was done to assess patterns of retrograde labeling in the temporal lobe after similar paired tracer injections into most of the same telencephalic structures plus the lateral septum (LS). In contrast to the modest double-labeling observed in the prefrontal cortex in the previous study, up to 60-80 % of neurons in the basal and accessory basal amygdaloid nuclei and amygdalopiriform transition area exhibited double-labeling in the present study. The most abundant double-labeling was generated by paired injections into structures affiliated with the extended amygdala, including the CeA, BST and Acb shell. Injections pairing the Acb core with the BST or CeA produced significantly fewer double-labeled neurons. The ventral subiculum exhibited modest amounts of double-labeling associated with paired injections into the Acb, BST, CeA and LS. The results raise the issue of how an extraordinarily collateralized output from the temporal lobe may contribute to behavioral flexibility.

Algorithms for survival: a comparative perspective on emotions

The nature and neural implementation of emotions is the subject of vigorous debate. Here, we use Bayesian decision theory to address key complexities in this field and conceptualize emotions in terms of their relationship to survival-relevant behavioural choices. Decision theory indicates which behaviours are optimal in a given situation; however, the calculations required are radically intractable. We therefore conjecture that the brain uses a range of pre-programmed algorithms that provide approximate solutions. These solutions seem to produce specific behavioural manifestations of emotions and can also be associated with core affective dimensions. We identify principles according to which these algorithms are implemented in the brain and illustrate our approach by considering decision making in the face of proximal threat.

Sex differences in corticotropin releasing factor-evoked behavior and activated networks

Hypersecretion of corticotropin releasing factor (CRF) is linked to the pathophysiology of major depression and post-traumatic stress disorder, disorders that are more common in women than men. Notably, preclinical studies have identified sex differences in CRF receptors that can increase neuronal sensitivity to CRF in female compared to male rodents. These cellular sex differences suggest that CRF may regulate brain circuits and behavior differently in males and females. To test this idea, we first evaluated whether there were sex differences in anxiety-related behaviors induced by the central infusion of CRF. High doses of CRF increased self-grooming more in female than in male rats, and the magnitude of this effect in females was greater when they were in the proestrous phase of their estrous cycle (higher ovarian hormones) compared to the diestrous phase (lower ovarian hormones), which suggests that ovarian hormones potentiate this anxiogenic effect of CRF. Brain regions associated with CRF-evoked self-grooming were identified by correlating a marker of neuronal activation, cFOS, with time spent grooming. In the infralimbic region, which is implicated in regulating anxiety, the correlation for CRF-induced neuronal activation and grooming was positive in proestrous females, but negative for males and diestrous females, indicating that ovarian hormones altered this relationship between neuronal activation and behavior. Because CRF regulates a number of regions that work together to coordinate different aspects of responding to stress, we then examined more broadly whether CRF-activated functional connectivity networks differed between males and cycling females. Interestingly, hormonal status altered correlations for CRF-induced neuronal activation between a variety of brain regions, but the most striking differences were found when comparing proestrous females to males, particularly when comparing neuronal activation between prefrontal cortical and other forebrain regions. These results suggest that ovarian hormones alter the way brain regions work together in response to CRF, which could drive different strategies for coping with stress in males versus females. These sex differences in stress responses could also help explain female vulnerability to psychiatric disorders characterized by CRF hypersecretion.

Orexin in Rostral Hotspot of Nucleus Accumbens Enhances Sucrose 'Liking' and Intake but Scopolamine in Caudal Shell Shifts 'Liking' Toward 'Disgust' and 'Fear'

The nucleus accumbens (NAc) contains a hedonic hotspot in the rostral half of medial shell, where opioid agonist microinjections are known to enhance positive hedonic orofacial reactions to the taste of sucrose ('liking' reactions). Within NAc shell, orexin/hypocretin also has been reported to stimulate food intake and is implicated in reward, whereas blockade of muscarinic acetylcholine receptors by scopolamine suppresses intake and may have anti-reward effects. Here, we show that NAc microinjection of orexin-A in medial shell amplifies the hedonic impact of sucrose taste, but only within the same anatomically rostral site, identical to the opioid hotspot. By comparison, at all sites throughout medial shell, orexin microinjections stimulated 'wanting' to eat, as reflected by increases in intake of palatable sweet chocolates. At NAc shell sites outside the hotspot, orexin selectively enhanced 'wanting' to eat without enhancing sweetness 'liking' reactions. In contrast, microinjections of the antagonist scopolamine at all sites in NAc shell suppressed sucrose 'liking' reactions as well as suppressing intake of palatable food. Conversely, scopolamine increased aversive 'disgust' reactions elicited by bitter quinine at all NAc shell sites. Finally, scopolamine microinjections localized to the caudal half of medial shell additionally generated a fear-related anti-predator reaction of defensive treading and burying directed toward the corners of the transparent chamber. Together, these results confirm a rostral hotspot in NAc medial shell as a unique site for orexin induction of hedonic 'liking' enhancement, similar to opioid enhancement. They also reveal distinct roles for orexin and acetylcholine signals in NAc shell for hedonic reactions and motivated behaviors.

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.

Acute Changes in Striatal Microstructure Predict the Development of Interferon-Alpha Induced Fatigue

BACKGROUND

Interferon-alpha (IFN-α) is a key mediator of antiviral immune responses used clinically for hepatitis C treatment. Though effective, IFN-α induces marked behavioral changes that, when severe, can appear indistinguishable from major depression. Curiously, fatigue and motivational impairment evolve rapidly, suggesting acute engagement of immune-brain communicatory pathways, yet mood impairments typically emerge later, after weeks of treatment. Whether this reflects prolonged modulation of motivational processes underpinning fatigue or separate neurobiological mechanisms is currently unclear.

METHODS

Here, we used quantitative magnetization transfer (qMT) imaging, an advanced microstructural neuroimaging technique sensitive to effects of inflammation, in a prospective study design to measure acute brain changes to IFN-α and relate these to later development of discrete behavioral changes. Twenty-three patients initiating IFN-α treatment for hepatitis C underwent qMT imaging and blood sampling at baseline and 4 hours after their first IFN-α injection. Comprehensive behavioral and psychological assessments were completed at both scanning sessions and at treatment weeks 4, 8, 12, and 24.

RESULTS

IFN-α injection stimulated an acute inflammatory cytokine response and evoked fatigue that peaked between 4 and 12 weeks, preceding mood change by 4 weeks. In the brain, IFN-α induced an acute change in striatal microstructure that additionally predicted development of fatigue but not mood symptoms.

CONCLUSIONS

Our findings highlight qMT as an in vivo biomarker of central effects of peripheral inflammation. We demonstrate exquisite sensitivity of the striatum to IFN-α, implicate striatal perturbation in IFN-α-induced fatigue, and dissociate this from mechanisms underlying IFN-α-induced mood symptoms, providing empirical support for distinct neural substrates mediating actions on motivation and mood.

Low expression of Gria1 and Grin1 glutamate receptors in the nucleus accumbens of Spontaneously Hypertensive Rats (SHR)

The Spontaneously Hypertensive Rat (SHR) strain is a classical animal model for the study of essential hypertension. Recently, our group suggested that this strain could be a useful animal model for schizophrenia, which is a severe mental illness with involvement of glutamatergic system. The aim of this study is to investigate glutamatergic receptors (Gria1 and Grin1) and glycine transporter (Glyt1) gene expression in the prefrontal cortex (PFC) and nucleus accumbens (NAcc) of SHR animals. The effects in gene expression of a chronic treatment with antipsychotic drugs (risperidone, haloperidol and clozapine) were also analyzed. Animals were treated daily for 30 days, and euthanized for brain tissue collection. The expression pattern was evaluated by Real Time Reverse-Transcriptase (RT) PCR technique. In comparison to control rats, SHR animals present a lower expression of both NMDA (Grin1) and AMPA (Gria1) gene receptors in the NAcc. Antipsychotic treatments were not able to change gene expressions in any of the regions evaluated. These findings provide evidence for the role of glutamatergic changes in schizophrenia-like phenotype of the SHR strain.

Of Mice and Men: Natural Kinds of Emotions in the Mammalian Brain? A Response to Panksepp and Izard

For almost 5 decades, the scientific study of emotion has been guided by the assumption that categories such as anger, sadness, and fear cut nature at its joints. Barrett (2006a) provided a comprehensive review of the empirical evidence from the study of emotion in humans and concluded that this assumption has outlived its usefulness. Panksepp and Izard have written lengthy papers (published in this issue) containing complementary but largely nonover lapping criticisms of Barrett (2006a). In our response, we address three of their concerns. First, we discuss the value of correlational versus experimental studies for evaluating the natural-kind model of emotion and refute the claim that the evidence offered in Barrett (2006a) was merely correlational. Second, we take up the issue of whether or not there is evidence for "coherently organized neural circuits for natural kinds of emotions in the mammalian brain and counter the claim that Barrett (2006a) ignored crucial evidence for existence of discrete emotions as natural kinds. Third, we address Panksepp and Izard's misconceptions of an alternative view, the conceptual act model of emotion, that was briefly discussed in Barrett (2006a). Finally, we end the article with some thoughts on how to move the scientific study of emotion beyond the debate over whether or not emotions are natural kinds.

Intermittent-access binge consumption of sweet high-fat liquid does not require opioid or dopamine receptors in the nucleus accumbens

Binge eating disorders are characterized by episodes of intense consumption of high-calorie food. In recently developed animal models of binge eating, rats given intermittent access to such food escalate their consumption over time. Consumption of calorie-dense food is associated with neurochemical changes in the nucleus accumbens, including dopamine release and alterations in dopamine and opioid receptor expression. Therefore, we hypothesized that binge-like consumption on intermittent access schedules is dependent on opioid and/or dopamine neurotransmission in the accumbens. To test this hypothesis, we asked whether injection of dopamine and opioid receptor antagonists into the core and shell of the accumbens reduced consumption of a sweet high-fat liquid in rats with and without a history of intermittent binge access to the liquid. Although injection of a μ opioid agonist increased consumption, none of the antagonists (including μ opioid, δ opioid, κ opioid, D1 dopamine and D2 dopamine receptor antagonists, as well as the broad-spectrum opioid receptor antagonist naltrexone) reduced consumption, and this was the case whether or not the animals had a prior history of intermittent access. These results suggest that consumption of sweet, fatty food does not require opioid or dopamine receptor activation in the accumbens even under intermittent access conditions that resemble human binge episodes.

Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH) and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc) and ventral pallidum (VP), in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (“liking”) and motivational incentive salience (“wanting”) of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating vs. intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including “liking” and “wanting” for food rewards.

Pleasure systems in the brain

Pleasure is mediated by well-developed mesocorticolimbic circuitry and serves adaptive functions. In affective disorders, anhedonia (lack of pleasure) or dysphoria (negative affect) can result from breakdowns of that hedonic system. Human neuroimaging studies indicate that surprisingly similar circuitry is activated by quite diverse pleasures, suggesting a common neural currency shared by all. Wanting for reward is generated by a large and distributed brain system. Liking, or pleasure itself, is generated by a smaller set of hedonic hot spots within limbic circuitry. Those hot spots also can be embedded in broader anatomical patterns of valence organization, such as in a keyboard pattern of nucleus accumbens generators for desire versus dread. In contrast, some of the best known textbook candidates for pleasure generators, including classic pleasure electrodes and the mesolimbic dopamine system, may not generate pleasure after all. These emerging insights into brain pleasure mechanisms may eventually facilitate better treatments for affective disorders.

Intrinsic plasticity: an emerging player in addiction

Exposure to drugs of abuse, such as cocaine, leads to plastic changes in the activity of brain circuits, and a prevailing view is that these changes play a part in drug addiction. Notably, there has been intense focus on drug-induced changes in synaptic excitability and much less attention on intrinsic excitability factors (that is, excitability factors that are remote from the synapse). Accumulating evidence now suggests that intrinsic factors such as K+ channels are not only altered by cocaine but may also contribute to the shaping of the addiction phenotype.

Neuropeptide Y activity in the nucleus accumbens modulates feeding behavior and neuronal activity

BACKGROUND

Neuropeptide Y (NPY) is a hypothalamic neuropeptide that plays a prominent role in feeding and energy homeostasis. Expression of the NPY Y1 receptor (Y1R) is highly concentrated in the nucleus accumbens (Acb), a region important in the regulation of palatable feeding. In this study, we performed a number of experiments to investigate the actions of NPY in the Acb.

METHODS

First, we determined caloric intake and food choice after bilateral administration of NPY in the Acb in rats on a free-choice diet of saturated fat, 30% sucrose solution, and standard chow and whether this was mediated by the Y1R. Second, we measured the effect of intra-Acb NPY on neuronal activity using in vivo electrophysiology. Third, we examined co-localization of Y1R with enkephalin and dynorphin neurons and the effect of NPY on preproenkephalin messenger RNA levels in the striatum using fluorescent and radioactive in situ hybridization. Finally, using retrograde tracing, we examined whether NPY neurons in the arcuate nucleus projected to the Acb.

RESULTS

In rats on the free-choice, high-fat, high-sugar diet, intra-Acb NPY increased intake of fat, but not sugar or chow, and this was mediated by the Y1R. Intra-Acb NPY reduced neuronal firing, as well as preproenkephalin messenger RNA expression in the striatum. Moreover, Acb enkephalin neurons expressed Y1R and arcuate nucleus NPY neurons projected to the Acb.

CONCLUSIONS

NPY reduces neuronal firing in the Acb resulting in increased palatable food intake. Together, our neuroanatomical, pharmacologic, and neuronal activity data support a role and mechanism for intra-Acb NPY-induced fat intake.

Effects of central activation of serotonin 5-HT2A/2C or dopamine D 2/3 receptors on the acute and repeated effects of clozapine in the conditioned avoidance response test

RATIONALE

Acute administration of clozapine (a gold standard of atypical antipsychotics) disrupts avoidance response in rodents, while repeated administration often causes a tolerance effect.

OBJECTIVE

The present study investigated the neuroanatomical basis and receptor mechanisms of acute and repeated effects of clozapine treatment in the conditioned avoidance response test in male Sprague-Dawley rats.

METHODS

2,5-dimethoxy-4-iodo-amphetamine (DOI, a preferential 5-HT2A/2C agonist) or quinpirole (a preferential dopamine D2/3 agonist) was microinjected into the medial prefrontal cortex (mPFC) or nucleus accumbens shell (NAs), and their effects on the acute and long-term avoidance disruptive effect of clozapine were tested.

RESULTS

Intra-mPFC microinjection of quinpirole enhanced the acute avoidance disruptive effect of clozapine (10 mg/kg, sc), while DOI microinjections reduced it marginally. Repeated administration of clozapine (10 mg/kg, sc) daily for 5 days caused a progressive decrease in its inhibition of avoidance responding, indicating tolerance development. Intra-mPFC microinjection of DOI at 25.0 (but not 5.0) μg/side during this period completely abolished the expression of clozapine tolerance. This was indicated by the finding that clozapine-treated rats centrally infused with 25.0 μg/side DOI did not show higher levels of avoidance responses than the vehicle-treated rats in the clozapine challenge test. Microinjection of DOI into the mPFC immediately before the challenge test also decreased the expression of clozapine tolerance.

CONCLUSIONS

Acute behavioral effect of clozapine can be enhanced by activation of the D2/3 receptors in the mPFC. Clozapine tolerance expression relies on the neuroplasticity initiated by its antagonist action against 5-HT2A/2C receptors in the mPFC.

The medial prefrontal cortex is crucial for the maintenance of persistent licking and the expression of incentive contrast

We examined the role of the medial prefrontal cortex (mPFC) in reward processing and the control of consummatory behavior. Rats were trained in an operant licking procedure in which they received alternating access to solutions with relatively high and low levels of sucrose (20 and 4%, w/v). Each level of sucrose was available for fixed intervals of 30 s over 30 min test sessions. Over several days of training, rats came to lick persistently when the high level of sucrose was available and suppressed licking when the low level of sucrose was available. Pharmacological inactivations of the mPFC, specifically the rostral part of the prelimbic area, greatly reduced intake of the higher value fluid and only slightly increased intake of the lower value fluid. In addition, the inactivations altered within-session patterns and microstructural measures of licking. Rats licked equally for the high and low levels of sucrose at the beginning of the test sessions and “relearned” to reduce intake of the low value fluid over the test sessions. Durations of licking bouts (clusters of licks with inter-lick intervals <0.5 s) were reduced for the high value fluid and there were many more brief licking bouts (<1 s) when the low value fluid was available. These effects were verified using an alternative approach (optogenetic silencing using archaerhodopsin) and were distinct from inactivation of the ventral striatum, which simply increased overall intake. Our findings suggest that the mPFC is crucial for the maintenance of persistent licking and the expression of learned feeding strategies.

Direct hypothalamic and indirect trans-pallidal, trans-thalamic, or trans-septal control of accumbens signaling and their roles in food intake

Due in part to the increasing incidence of obesity in developed nations, recent research aims to elucidate neural circuits that motivate humans to overeat. Earlier research has described how the nucleus accumbens shell (AcbSh) motivates organisms to feed by activating neuronal populations in the lateral hypothalamus (LH). However, more recent research suggests that the LH may in turn communicate with the AcbSh, both directly and indirectly, to re-tune the motivation to consume foods with homeostatic and food-related sensory signals. Here, we discuss the functional and anatomical evidence for an LH to AcbSh connection and its role in eating behaviors. The LH appears to modulate Acb activity directly, using neurotransmitters such as hypocretin/orexin or melanin concentrating hormone (MCH). The LH also indirectly regulates AcbSh activity through certain subcortical "relay" regions, such as the lateral septum (LS), ventral pallidum (VP), and paraventricular thalamus, using a variety of neurotransmitters. This review aims to summarize studies on these topics and outline a model by which LH circuits processing energy balance can modulate AcbSh neural activity to regulate feeding behavior.

Excessive disgust caused by brain lesions or temporary inactivations: mapping hotspots of the nucleus accumbens and ventral pallidum

Disgust is a prototypical type of negative affect. In animal models of excessive disgust, only a few brain sites are known in which localized dysfunction (lesions or neural inactivations) can induce intense 'disgust reactions' (e.g. gapes) to a normally pleasant sensation such as sweetness. Here, we aimed to map forebrain candidates more precisely, to identify where either local neuronal damage (excitotoxin lesions) or local pharmacological inactivation (muscimol/baclofen microinjections) caused rats to show excessive sensory disgust reactions to sucrose. Our study compared subregions of the nucleus accumbens shell, ventral pallidum, lateral hypothalamus, and adjacent extended amygdala. The results indicated that the posterior half of the ventral pallidum was the only forebrain site where intense sensory disgust gapes in response to sucrose were induced by both lesions and temporary inactivations (this site was previously identified as a hedonic hotspot for enhancements of sweetness 'liking'). By comparison, for the nucleus accumbens, temporary GABA inactivations in the caudal half of the medial shell also generated sensory disgust, but lesions never did at any site. Furthermore, even inactivations failed to induce disgust in the rostral half of the accumbens shell (which also contains a hedonic hotspot). In other structures, neither lesions nor inactivations induced disgust as long as the posterior ventral pallidum remained spared. We conclude that the posterior ventral pallidum is an especially crucial hotspot for producing excessive sensory disgust by local pharmacological/lesion dysfunction. By comparison, the nucleus accumbens appears to segregate sites for pharmacological disgust induction and hedonic enhancement into separate posterior and rostral halves of the medial shell.

The effects of nucleus accumbens μ-opioid and adenosine 2A receptor stimulation and blockade on instrumental learning

Prior research has shown that glutamate and dopamine receptors in the nucleus accumbens (NAcc) core are critical for the learning of an instrumental response for food reinforcement. It has also been demonstrated that μ-opioid and adenosine A2A receptors within the NAcc impact feeding and motivational processes. In these experiments, we examined the potential roles of NAcc μ-opioid and A2A receptors on instrumental learning and performance. Sprague-Dawley rats were food restricted and trained to lever press following daily intra-accumbens injections of the A2A receptor agonist CGS 21680 (at 0.0, 6.0, or 24.0ng/side), the A2A antagonist pro-drug MSX-3 (at 0.0, 1.0, or 3.0μg/side), the μ-opioid agonist DAMGO (at 0.0, 0.025, or 0.025μg/side), or the opioid receptor antagonist naltrexone (at 0.0, 2.0 or 20.0μg/side). After five days, rats continued training without drug injections until lever pressing rates stabilized, and were then tested with a final drug test to assess potential performance effects. Stimulation, but not inhibition, of NAcc adenosine A2A receptors depressed lever pressing during learning and performance tests, but did not impact lever pressing on non-drug days. Both μ-opioid receptor stimulation and blockade inhibited learning of the lever-press response, though only naltrexone treatment caused impairments in lever-pressing after the task had been learned. The effect of A2A receptor stimulation on learning and performance were consistent with known effects of adenosine on effort-related processes, whereas the pattern of lever presses, magazine approaches, and pellet consumption following opioid receptor manipulations suggested that their effects may have been driven by drug-induced shifts in the incentive value of the sugar reinforcer.

A comparison of neural responses to appetitive and aversive stimuli in humans and other mammals

Distinguishing potentially harmful or beneficial stimuli is necessary for the self-preservation and well-being of all organisms. This assessment requires the ongoing valuation of environmental stimuli. Despite much work on the processing of aversive- and appetitive-related brain signals, it is not clear to what degree these two processes interact across the brain. To help clarify this issue, this report used a cross-species comparative approach in humans (i.e. meta-analysis of imaging data) and other mammals (i.e. targeted review of functional neuroanatomy in rodents and non-human primates). Human meta-analysis results suggest network components that appear selective for appetitive (e.g. ventromedial prefrontal cortex, ventral tegmental area) or aversive (e.g. cingulate/supplementary motor cortex, periaqueductal grey) processing, or that reflect overlapping (e.g. anterior insula, amygdala) or asymmetrical, i.e. apparently lateralized, activity (e.g. orbitofrontal cortex, ventral striatum). However, a closer look at the known value-related mechanisms from the animal literature suggests that all of these macroanatomical regions are involved in the processing of both appetitive and aversive stimuli. Differential spatiotemporal network dynamics may help explain similarities and differences in appetitive- and aversion-related activity.

Relief learning is distinguished from safety learning by the requirement of the nucleus accumbens

Aversive events induce aversive memories (fear learning) and can also establish appetitive memories. This is the case for cues associated with the cessation of an aversive event (relief learning) or occurring in an explicitly unpaired fashion (safety learning). However, the neural basis of relief and safety learning is poorly understood. In particular, it is not clear whether relief learning and safety learning are neuronally distinct. In the present study, we ask whether the nucleus accumbens is required for the acquisition of relief- and/or safety memory. Temporary inactivation of the nucleus accumbens by local injections of the GABA-A receptor agonist muscimol during the learning session abolished relief learning whereas safety learning was not affected. Thus, the requirement for a functional nucleus accumbens distinguishes relief from safety learning, showing that these two forms of learning are neuronally distinct.

The microinjection of a cannabinoid agonist into the accumbens shell induces anxiogenesis in the elevated plus-maze

This study investigated the effect of a cannabinoid agonist injected into the shell region of the nucleus accumbens (nAcb shell) on anxiety-related behaviors. The animals (male Wistar rats) were unilaterally microinjected with either ACEA (arachidonyl-2'-chloroethylamide a CB1 receptor agonist) at doses of 0.005, 0.05 or 0.5 pmol, or vehicle (ethanol 0.04% in saline 0.9%) and submitted to the elevated plus-maze (EPM), a pre-clinical test of anxiety. The data showed that rats microinjected with ACEA (0.05 pmol/0.2 μl) into the nAcb shell exhibited decreased % open arm time and open arm entries in comparison with the control group, which is compatible with an anxiogenic-like effect. To rule out the hypothesis that spread of the drug into the ventricle was responsible for the observed anxiogenic effect, 0.05 pmol ACEA was injected into the lateral ventricle and shown not to alter the responses representative of fear/anxiety and locomotion. The locomotor activity was not changed at the dose of 0.05 pmol ACEA microinjected into the nAcb shell. The present data suggest that activation of cannabinoid receptors in the nAcb shell may modulate fear/anxiety in the EPM.

Rationalizable irrationalities of choice

Although seemingly irrational choice abounds, the rules governing these mis-steps that might provide hints about the factors limiting normative behavior are unclear. We consider three experimental tasks, which probe different aspects of non-normative choice under uncertainty. We argue for systematic statistical, algorithmic, and implementational sources of irrationality, including incomplete evaluation of long-run future utilities, Pavlovian actions, and habits, together with computational and statistical noise and uncertainty. We suggest structural and functional adaptations that minimize their maladaptive effects.

Changes in neural circuitry regulating response-reversal learning and Arc-mediated consolidation of learning in rats with methamphetamine-induced partial monoamine loss

Methamphetamine (METH)-induced neurotoxicity results in long-lasting depletions of monoamines and changes in basal ganglia function. We previously reported that rats with METH-induced neurotoxicity no longer engage dorsomedial striatum during a response-reversal learning task, as their performance is insensitive to acute disruption of dorsomedial striatal function by local infusion of an N-methyl-D-aspartate receptor antagonist or an antisense oligonucleotide against the activity-regulated cytoskeleton-associated (Arc) gene. However, METH-pretreated rats perform the task as well as controls. Therefore, we hypothesized that the neural circuitry involved in the learning had changed in METH-pretreated rats. To test this hypothesis, rats were pretreated with a neurotoxic regimen of METH or with saline. After 3-5 weeks, rats were trained on the reversal-learning task and in situ hybridization for Arc was performed. A significant correlation between Arc expression and performance on the task was found in nucleus accumbens shell of METH-, but not saline-, pretreated rats. Consistent with the idea that the correlation between Arc expression in a brain region and behavioral performance implicates that brain region in the learning, infusion of an antisense oligonucleotide against Arc into the shell impaired consolidation of reversal learning in METH-, but not saline-, pretreated rats. These findings provide novel evidence suggesting that METH-induced neurotoxicity leads to a shift from dorsal to ventral striatal involvement in the reversal-learning task. Such reorganization of neural circuitry underlying learning and memory processes may contribute to impaired cognitive function in individuals with METH-induced neurotoxicity or others with striatal dopamine loss, such as patients with Parkinson's disease.

Fatal attraction: ventral striatum predicts costly choice errors in humans

Animals approach rewards and cues associated with reward, even when this behavior is irrelevant or detrimental to the attainment of these rewards. Motivated by these findings we study the biology of financially-costly approach behavior in humans. Our subjects passively learned to predict the occurrence of erotic rewards. We show that neuronal responses in ventral striatum during this Pavlovian learning task stably predict an individual's general tendency towards financially-costly approach behavior in an active choice task several months later. Our data suggest that approach behavior may prevent some individuals from acting in their own interests.

Mapping brain circuits of reward and motivation: in the footsteps of Ann Kelley

Ann Kelley was a scientific pioneer in reward neuroscience. Her many notable discoveries included demonstrations of accumbens/striatal circuitry roles in eating behavior and in food reward, explorations of limbic interactions with hypothalamic regulatory circuits, and additional interactions of motivation circuits with learning functions. Ann Kelley's accomplishments inspired other researchers to follow in her footsteps, including our own laboratory group. Here we describe results from several lines of our research that sprang in part from earlier findings by Kelley and colleagues. We describe hedonic hotspots for generating intense pleasure 'liking', separate identities of 'wanting' versus 'liking' systems, a novel role for dorsal neostriatum in generating motivation to eat, a limbic keyboard mechanism in nucleus accumbens for generating intense desire versus intense dread, and dynamic limbic transformations of learned memories into motivation. We describe how origins for each of these themes can be traced to fundamental contributions by Ann Kelley.

Differential effects of acute and repeated stress on hippocampus and amygdala inputs to the nucleus accumbens shell

The basolateral amygdala (BLA) and ventral subiculum (vSub) of the hippocampus convey emotion and context information, respectively, to the nucleus accumbens (NAc). Using in vivo extracellular recordings from NAc neurons, we examined how acute and repeated restraint stress alters the plasticity of the vSub and BLA afferent pathways. High-frequency (HFS) and low-frequency (LFS) stimulation was applied to the vSub to assess the impact on NAc responses to vSub and BLA inputs. In addition, iontophoretic application of the dopamine D2-antagonist sulpiride was used to explore the role of dopamine in the NAc in mediating the effects of stress on plasticity. Acute and repeated restraint caused disparate effects on BLA- and vSub-evoked responses in the NAc. Following repeated restraint, but not after acute restraint, HFS of the vSub failed to potentiate the vSub–NAc pathway while instead promoting a long-lasting reduction of the BLA–NAc pathway and these effects were independent of D2-receptor activity. In contrast, LFS to the vSub pathway after acute restraint resulted in potentiation in the vSub–NAc pathway while BLA-evoked responses were unchanged. When sulpiride was applied prior to LFS of the vSub after acute stress, there was a pronounced decrease in vSub-evoked responses similar to control animals. This work provides new insight into the impact of acute and repeated stress on the integration of context and emotion inputs in the NAc. These data support a model of stress whereby the hippocampus is inappropriately activated and dominates the information processing within this circuit via a dopaminergic mechanism after acute bouts of stress.

Cognitive reappraisal of emotion: a meta-analysis of human neuroimaging studies

In recent years, an explosion of neuroimaging studies has examined cognitive reappraisal, an emotion regulation strategy that involves changing the way one thinks about a stimulus in order to change its affective impact. Existing models broadly agree that reappraisal recruits frontal and parietal control regions to modulate emotional responding in the amygdala, but they offer competing visions of how this is accomplished. One view holds that control regions engage ventromedial prefrontal cortex (vmPFC), an area associated with fear extinction, that in turn modulates amygdala responses. An alternative view is that control regions modulate semantic representations in lateral temporal cortex that indirectly influence emotion-related responses in the amygdala. Furthermore, while previous work has emphasized the amygdala, whether reappraisal influences other regions implicated in emotional responding remains unknown. To resolve these questions, we performed a meta-analysis of 48 neuroimaging studies of reappraisal, most involving downregulation of negative affect. Reappraisal consistently 1) activated cognitive control regions and lateral temporal cortex, but not vmPFC, and 2) modulated the bilateral amygdala, but no other brain regions. This suggests that reappraisal involves the use of cognitive control to modulate semantic representations of an emotional stimulus, and these altered representations in turn attenuate activity in the amygdala.

Nucleus accumbens GABAergic inhibition generates intense eating and fear that resists environmental retuning and needs no local dopamine

Intense fearful behavior and/or intense appetitive eating behavior can be generated by localized amino acid inhibitions along a rostrocaudal anatomical gradient within medial shell of nucleus accumbens of the rat. This can be produced by microinjections in medial shell of either the γ-aminobutyric acid (GABA)A agonist muscimol (mimicking intrinsic GABAergic inputs) or the AMPA (α-amino-3-hydroxy-5-methylisoxazole-4-propionic acid) antagonist DNQX (6,7-dinitroquinoxaline-2,3-dione), disrupting corticolimbic glutamate inputs). At rostral sites in medial shell, each drug robustly stimulates appetitive eating and food intake, whereas at more caudal sites the same drugs instead produce increasingly fearful behaviors such as escape, distress vocalizations and defensive treading (an antipredator behavior rodents emit to snakes and scorpions). Previously we showed that intense motivated behaviors generated by glutamate blockade require local endogenous dopamine and can be modulated in valence by environmental ambience. Here we investigated whether GABAergic generation of intense appetitive and fearful motivations similarly depends on local dopamine signals, and whether the valence of motivations generated by GABAergic inhibition can also be retuned by changes in environmental ambience. We report that the answer to both questions is 'no'. Eating and fear generated by GABAergic inhibition of accumbens shell does not need endogenous dopamine. Also, the appetitive/fearful valence generated by GABAergic muscimol microinjections resists environmental retuning and is determined almost purely by rostrocaudal anatomical placement. These results suggest that nucleus accumbens GABAergic release of fear and eating are relatively independent of modulatory dopamine signals, and more anatomically pre-determined in valence balance than release of the same intense behaviors by glutamate disruptions.

Sweetened-fat intake sensitizes gamma-aminobutyric acid-mediated feeding responses elicited from the nucleus accumbens shell

BACKGROUND

There is much interest in exploring whether reward-driven feeding can produce druglike plasticity in the brain. The gamma-aminobutyric acid (GABA) system in the nucleus accumbens (Acb) shell, which modulates hypothalamic feeding systems, is well placed to "usurp" homeostatic control of feeding. Nevertheless, it is unknown whether feeding-induced neuroadaptations occur in this system.

METHODS

Separate groups of ad libitum-maintained rats were exposed to daily bouts of sweetened-fat intake, predator stress, or intra-Acb shell infusions of either d-amphetamine (2 or 10 μg) or the μ-opioid agonist D-[Ala2, N-MePhe4, Gly-ol]-enkephalin (DAMGO, 2.5 μg), then challenged with intra-Acb shell infusion of the GABAA agonist, muscimol (10 ng).

RESULTS

Exposure to sweetened fat robustly sensitized muscimol-induced feeding. Sensitization was present 1 week after cessation of the palatable feeding regimen but had abated by 2 weeks. Rats exposed to sweetened fat did not show an altered feeding response to food deprivation. Repeated intra-Acb shell infusions of DAMGO (2.5 μg) also sensitized intra-Acb shell muscimol-driven feeding. However, neither repeated intra-Acb shell d-amphetamine infusions (2 or 10 μg) nor intermittent exposure to an aversive stimulus (predator stress) altered sensitivity to muscimol.

CONCLUSIONS

Palatable feeding engenders hypersensitivity of Acb shell GABA responses; this effect may involve feeding-induced release of opioid peptides. Heightened arousal, aversive experiences, or increased catecholamine transmission alone are insufficient to produce the effect, and a hunger-induced feeding drive is insufficient to reveal the effect. These findings reveal a novel type of food-induced neuroadaptation within the Acb; possible implications for understanding crossover effects between food reward and drug reward are discussed.

Prefrontal cortex modulates desire and dread generated by nucleus accumbens glutamate disruption

BACKGROUND

Corticolimbic circuits, including direct projections from prefrontal cortex to nucleus accumbens (NAc), permit top-down control of intense motivations generated by subcortical circuits. In rats, localized disruptions of glutamate signaling within medial shell of NAc generate desire or dread, anatomically organized along a rostrocaudal gradient analogous to a limbic keyboard. At rostral locations in shell, these disruptions generate appetitive eating, but at caudal locations the disruptions generate progressively fearful behaviors (distress vocalizations, escape attempts, and antipredator reactions). Here, we asked whether medial prefrontal cortex can modulate intense motivations generated by subcortical NAc disruptions.

METHODS

We used simultaneous microinjections in medial prefrontal cortex regions and in NAc shell to examine whether the desire or dread generated by NAc shell disruptions is modulated by activation/inhibition of three specific regions of prefrontal cortex: medial orbitofrontal cortex, infralimbic cortex (homologous to area 25 or subgenual anterior cingulate in the human), or prelimbic cortex (midventral anterior cingulate).

RESULTS

We found that activation of medial orbitofrontal cortex biased intense bivalent motivation in an appetitive direction by amplifying generation of eating behavior by middle to caudal NAc disruptions, without altering fear. In contrast, activation of infralimbic prefrontal cortex powerfully and generally suppressed both appetitive eating and fearful behaviors generated by NAc shell disruptions.

CONCLUSIONS

These results suggest that corticolimbic projections from discrete prefrontal regions can either bias motivational valence or generally suppress subcortically generated intense motivations of desire or fear.

On lateral septum-like characteristics of outputs from the accumbal hedonic "hotspot" of Peciña and Berridge with commentary on the transitional nature of basal forebrain "boundaries"

Peciña and Berridge (2005; J Neurosci 25:11777-11786) observed that an injection of the μ-opioid receptor agonist DAMGO (D-ala(2) -N-Me-Phe(4) -Glycol(5) -enkephalin) into the rostrodorsal part of the accumbens shell (rdAcbSh) enhances expression of hedonic "liking" responses to the taste of an appetitive sucrose solution. Insofar as the connections of this hedonic "hotspot" were not singled out for special attention in the earlier neuroanatomical literature, we undertook to examine them. We observed that the patterns of inputs and outputs of the rdAcbSh are not qualitatively different from those of the rest of the Acb, except that outputs from the rdAcbSh to the lateral preoptic area and anterior and lateral hypothalamic areas are anomalously robust and overlap extensively with those of the lateral septum. We also detected reciprocal interconnections between the rdAcbSh and lateral septum. Whether and how these connections subserve hedonic impact remains to be learned, but these observations lead us to hypothesize that the rdAcbSh represents a basal forebrain transition area, in the sense that it is invaded by neurons of the lateral septum, or possibly transitional neuronal forms sharing properties of both structures. We note that the proposed transition zone between lateral septum and rdAcbSh would be but one of many in the basal forebrain and conclude by reiterating the longstanding argument that the transitional nature of such boundary areas has functional importance, of which the precise nature will remain elusive until the neurophysiological and neuropharmacological implications of such zones of transition are more generally acknowledged and better addressed.

The nucleus accumbens 5-HTR₄-CART pathway ties anorexia to hyperactivity

In mental diseases, the brain does not systematically adjust motor activity to feeding. Probably, the most outlined example is the association between hyperactivity and anorexia in Anorexia nervosa. The neural underpinnings of this 'paradox', however, are poorly elucidated. Although anorexia and hyperactivity prevail over self-preservation, both symptoms rarely exist independently, suggesting commonalities in neural pathways, most likely in the reward system. We previously discovered an addictive molecular facet of anorexia, involving production, in the nucleus accumbens (NAc), of the same transcripts stimulated in response to cocaine and amphetamine (CART) upon stimulation of the 5-HT(4) receptors (5-HTR(4)) or MDMA (ecstasy). Here, we tested whether this pathway predisposes not only to anorexia but also to hyperactivity. Following food restriction, mice are expected to overeat. However, selecting hyperactive and addiction-related animal models, we observed that mice lacking 5-HTR(1B) self-imposed food restriction after deprivation and still displayed anorexia and hyperactivity after ecstasy. Decryption of the mechanisms showed a gain-of-function of 5-HTR(4) in the absence of 5-HTR(1B), associated with CART surplus in the NAc and not in other brain areas. NAc-5-HTR(4) overexpression upregulated NAc-CART, provoked anorexia and hyperactivity. NAc-5-HTR(4) knockdown or blockade reduced ecstasy-induced hyperactivity. Finally, NAc-CART knockdown suppressed hyperactivity upon stimulation of the NAc-5-HTR(4). Additionally, inactivating NAc-5-HTR(4) suppressed ecstasy's preference, strengthening the rewarding facet of anorexia. In conclusion, the NAc-5-HTR(4)/CART pathway establishes a 'tight-junction' between anorexia and hyperactivity, suggesting the existence of a primary functional unit susceptible to limit overeating associated with resting following homeostasis rules.

Intra-accumbens baclofen, but not muscimol, increases second order instrumental responding for food reward in rats

Stimulation of either GABA_A or GABA_B receptors within the nucleus accumbens shell strongly enhances food intake in rats. However the effects of subtype-selective stimulation of GABA receptors on instrumental responses for food reward are less well characterized. Here we contrast the effects of the GABA_A receptor agonist muscimol and GABA_B receptor agonist baclofen on instrumental responding for food using a second order reinforcement schedule. Bilateral intra-accumbens administration of baclofen (220–440 pmol) stimulated responding but a higher dose (660 pmol) induced stereotyped oral behaviour that interfered with responding. Baclofen (220–660 pmol) also stimulated intake of freely available chow. Muscimol (220–660 pmol) was without effect on responding for food on this schedule but did stimulate intake of freely available chow. Unilateral administration of either baclofen or muscimol (220 pmol) induced similar patterns of c-fos immunoreactivity in several hypothalamic sites but differed in its induction in the central nucleus of the amygdala. We conclude that stimulation of GABA_A or GABA_B receptors in the nucleus accumbens shell of rats produces clearly distinguishable effects on operant responding for food.

Cannabinoid modulation of noradrenergic circuits: implications for psychiatric disorders

The interaction between the endocannabinoid system and catecholaminergic circuits has gained increasing attention as it is recognized that the development of synthetic cannabinoid receptor agonists/antagonists or compounds targeting endocannabinoid synthesis/metabolism may hold some therapeutic potential for the treatment of psychiatric disorders. The noradrenergic system plays a critical role in the modulation of emotional state, primarily related to anxiety, arousal, and stress. Recent evidence suggests that the endocannabinoid system mediates stress responses and emotional homeostasis, in part, by targeting noradrenergic circuits. This review summarizes our current knowledge regarding the anatomical substrates underlying regulation of noradrenergic circuitry by the endocannabinoid system. It then presents biochemical evidence showing an important effect of cannabinoid modulation on adrenergic receptor signaling. Finally, new evidence from behavioral pharmacology studies is provided demonstrating that norepinephrine is a critical determinant of cannabinoid-induced aversion, adding another dimension to how central noradrenergic circuitry is regulated by the cannabinoid system.

The Sturm und Drang of anabolic steroid use: angst, anxiety, and aggression

Anabolic androgenic steroids (AAS) are illicitly administered to enhance athletic performance and body image. Although conferring positive actions on performance, steroid abuse is associated with changes in anxiety and aggression. AAS users are often keenly invested in understanding the biological actions of these drugs. Thus, mechanistic information on AAS actions is important not only for the biomedical community, but also for steroid users. Here we review findings from animal studies on the impact of AAS exposure on neural systems that are crucial for the production of anxiety and aggression, and compare the effects of the different classes of AAS and their potential signaling mechanisms, as well as context-, age- and sex-dependent aspects of their actions.

GABA(A) and dopamine receptors in the nucleus accumbens shell differentially influence performance of a water-reinforced progressive ratio task

Several authors have shown that injections of the GABA(A) agonist muscimol into the medial shell region of the nucleus accumbens (AcbSh) result in large increases in food, but not water, intake. In previous studies we demonstrated that intra-AcbSh injections of either muscimol or of the indirect dopamine agonist amphetamine increase response output on a food-reinforced progressive ratio schedule. In the current experiment we extended these observations by examining the effects of muscimol and amphetamine injections on the performance of a water-reinforced progressive ratio task in mildly deprived animals. We found that muscimol did not affect the number of responses made in the water-reinforced task, even though a marked increase in responding was observed after amphetamine. Muscimol did, however, significantly increase food intake in the same animals. The results suggest that the enhancing effects of intra-AcbSh muscimol differ from those of amphetamine in that they are selective for food-reinforced behaviors.

The role of nucleus accumbens shell GABA receptors on ventral tegmental area intracranial self-stimulation and a potential role for the 5-HT(2C) receptor

Brain γ-aminobutyric acid (GABA) and 5-hydroxytryptamine (5-HT)(2C) receptors are implicated in the neuronal regulation of reward- and aversion-related behaviour. Within the mesocorticolimbic pathways of the brain, relationships between GABA containing neurons and 5-HT(2C) receptor activity may be important in this context. The primary aim of this study was to investigate the role of NAc shell GABA receptors on ventral tegmental area intracranial self-stimulation (ICSS) and to examine the systemic effects of GABAergic ligands in this context. The second aim was to investigate the relationship between GABA receptor- and 5-HT(2C) receptor-related ICSS behaviour, using systemic administration of the selective agonist WAY 161503. Locomotor activity was assessed to compare the potential motor effects of drugs; feeding behaviour and intra-NAc injections of amphetamine (1.0 µg/side) were used as positive controls. When administered systemically the GABA(A) receptor agonist muscimol and antagonist picrotoxin did not selectively change ICSS reward thresholds, although the 5-HT(2C) receptor agonist WAY 161503 (1.0 mg/kg) decreased reward measures. Intra-NAc shell administration of muscimol (225 ng/side) and picrotoxin (125 ng/side), respectively, decreased and increased measures of reward. Intra-NAc shell baclofen (0-225 ng/side; GABA(B) receptor agonist) did not affect any ICSS measures although it increased feeding. Combining picrotoxin and WAY 161503 attenuated the effects of each. These results suggest that a 5-HT(2C) and GABA(A) receptor-mediated neuronal relationship in the NAc shell may be relevant for the regulation of brain reward pathways.

Heterogeneous processing of amygdala and hippocampal inputs in the rostral and caudal subregions of the nucleus accumbens

The nucleus accumbens (NAc) receives converging input from a number of structures proposed to play a role in affective disorders. In particular, the basolateral amygdala (BLA) provides an affective input that overlaps with context-related information derived from the ventral subiculum of the hippocampus (vSub). We examined how stimulation of the BLA is modulated by, and in turn affects, vSub inputs to this region. In-vivo extracellular recordings were performed in the NAc of anaesthetized rats. The effect of high-frequency (theta-burst) stimulation (HFS) of the BLA on both BLA and vSub-evoked responses was tested. In addition, the involvement of dopamine D2 receptors in BLA-induced plasticity in the NAc was examined by pre-treatment with sulpiride (5 mg/kg i.v.). Finally, tetrodotoxin (TTX) was used to inactivate the vSub and the effect on BLA-evoked responses was assessed. We found that HFS of the BLA causes hetereogeneous patterns of plasticity, depression and potentiation, respectively, in the rostral and caudal subregions of the NAc that are disrupted following D2 receptor antagonist treatment. In addition, inactivating the vSub with TTX attenuates the ability of the BLA to drive spike firing in the NAc. Thus, the vSub is required for activation of the NAc by the BLA. These data support a model whereby the amygdala can coordinate reward-seeking and fear-related behaviours via its differential regulation of NAc output. In addition, the hippocampus inappropriately dominates information processing within this circuit, potentially contributing to the overwhelming focus on internal emotional states in disorders such as depression.

Modulation of fear/anxiety responses, but not food intake, following α-adrenoceptor agonist microinjections in the nucleus accumbens shell of free-feeding rats

This study investigated the effect of α-adrenoceptor agonists microinjected into the shell region of the accumbens nucleus (AcbSh) on feeding and anxiety-related behaviors in free-feeding rats. Male Wistar rats with a chronically implanted cannula into the AcbSh were unilaterally microinjected with either clonidine (CLON, α(2)-adrenoceptor agonist) or phenylephrine (PHEN, α(1)-adrenoceptor agonist) at the doses of 6 and 20 nmol and submitted to the elevated plus-maze (EPM), a pre-clinical test of anxiety. Immediately after the EPM test, the animals underwent food intake evaluation for 30 min. The data showed that rats microinjected with CLON (20 nmol/0.2 μl) into the AcbSh exhibited increased %Open arm time, which is compatible with an anxiolytic-like effect. The CLON-induced anxiolysis was corroborated by increased head-dipping and decreased stretched-attend posture, two ethologically derived behaviors which are fear/anxiety-motivated. The animal's locomotor activity was not changed by 20 nmol CLON microinjection into the AcbSh. However, neither dose of PHEN microinjected into the AcbSh was able to alter either the spatial-temporal or ethological variables representative of fear/anxiety and locomotion. Food intake was not altered by any dose of CLON and PHEN microinjected into the AcbSh, but the 20 nmol CLON microinjection induced increased motor activity in the feeding test. The data suggests that noradrenergic projections to the AcbSh may underlie fear/anxiety modulation through α(2)-adrenoceptor in the AcbSh, while feeding behavior was unaffected by noradrenergic modulation in the AcbSh of free-feeding rats. This article is part of a Special Issue entitled 'Anxiety and Depression'.

An imperfect dopaminergic error signal can drive temporal-difference learning

An open problem in the field of computational neuroscience is how to link synaptic plasticity to system-level learning. A promising framework in this context is temporal-difference (TD) learning. Experimental evidence that supports the hypothesis that the mammalian brain performs temporal-difference learning includes the resemblance of the phasic activity of the midbrain dopaminergic neurons to the TD error and the discovery that cortico-striatal synaptic plasticity is modulated by dopamine. However, as the phasic dopaminergic signal does not reproduce all the properties of the theoretical TD error, it is unclear whether it is capable of driving behavior adaptation in complex tasks. Here, we present a spiking temporal-difference learning model based on the actor-critic architecture. The model dynamically generates a dopaminergic signal with realistic firing rates and exploits this signal to modulate the plasticity of synapses as a third factor. The predictions of our proposed plasticity dynamics are in good agreement with experimental results with respect to dopamine, pre- and post-synaptic activity. An analytical mapping from the parameters of our proposed plasticity dynamics to those of the classical discrete-time TD algorithm reveals that the biological constraints of the dopaminergic signal entail a modified TD algorithm with self-adapting learning parameters and an adapting offset. We show that the neuronal network is able to learn a task with sparse positive rewards as fast as the corresponding classical discrete-time TD algorithm. However, the performance of the neuronal network is impaired with respect to the traditional algorithm on a task with both positive and negative rewards and breaks down entirely on a task with purely negative rewards. Our model demonstrates that the asymmetry of a realistic dopaminergic signal enables TD learning when learning is driven by positive rewards but not when driven by negative rewards.

What are the physiological changes that take place in the brain when we solve a problem or learn a new skill? It is commonly assumed that behavior adaptations are realized on the microscopic level by changes in synaptic efficacies. However, this is hard to verify experimentally due to the difficulties of identifying the relevant synapses and monitoring them over long periods during a behavioral task. To address this question computationally, we develop a spiking neuronal network model of actor-critic temporal-difference learning, a variant of reinforcement learning for which neural correlates have already been partially established. The network learns a complex task by means of an internally generated reward signal constrained by recent findings on the dopaminergic system. Our model combines top-down and bottom-up modelling approaches to bridge the gap between synaptic plasticity and system-level learning. It paves the way for further investigations of the dopaminergic system in reward learning in the healthy brain and in pathological conditions such as Parkinson's disease, and can be used as a module in functional models based on brain-scale circuitry.

Chronic loss of melanin-concentrating hormone affects motivational aspects of feeding in the rat

Current epidemic obesity levels apply great medical and financial pressure to the strenuous economy of obesity-prone cultures, and neuropeptides involved in body weight regulation are regarded as attractive targets for a possible treatment of obesity in humans. The lateral hypothalamus and the nucleus accumbens shell (AcbSh) form a hypothalamic-limbic neuropeptide feeding circuit mediated by Melanin-Concentrating Hormone (MCH). MCH promotes feeding behavior via MCH receptor-1 (MCH1R) in the AcbSh, although this relationship has not been fully characterized. Given the AcbSh mediates reinforcing properties of food, we hypothesized that MCH modulates motivational aspects of feeding.

Here we show that chronic loss of the rat MCH-precursor Pmch decreased food intake predominantly via a reduction in meal size during rat development and reduced high-fat food-reinforced operant responding in adult rats. Moreover, acute AcbSh administration of Neuropeptide-GE and Neuropeptide-EI (NEI), both additional neuropeptides derived from Pmch, or chronic intracerebroventricular infusion of NEI, did not affect feeding behavior in adult pmch^+/+ or pmch^−/− rats. However, acute administration of MCH to the AcbSh of adult pmch^−/− rats elevated feeding behavior towards wild type levels. Finally, adult pmch^−/− rats showed increased ex vivo electrically evoked dopamine release and increased limbic dopamine transporter levels, indicating that chronic loss of Pmch in the rat affects the limbic dopamine system.

Our findings support the MCH-MCH1R system as an amplifier of consummatory behavior, confirming this system as a possible target for the treatment of obesity. We propose that MCH-mediated signaling in the AcbSh positively mediates motivational aspects of feeding behavior. Thereby it provides a crucial signal by which hypothalamic neural circuits control energy balance and guide limbic brain areas to enhance motivational or incentive-related aspects of food consumption.

Metabotropic glutamate receptor blockade in nucleus accumbens shell shifts affective valence towards fear and disgust

Glutamatergic inputs to the nucleus accumbens (NAc) modulate both appetitive and fearful motivation. It has been suggested that pathological disturbances of glutamate signaling in NAc contribute to motivation disorders, ranging from excessive desire in drug addiction to paranoia in schizophrenia. Metabotropic glutamate receptors are of special interest, as metabotropic Group II receptor (mglu2/3) agonists have been proposed as potential treatments for both addiction and schizophrenia. Here we tested whether local mglu2/3 receptor blockade in the medial shell of the rat NAc can generate intense distortions of motivation or affect, which might model clinical dysfunction. We found that microinjection of the mglu2/3 antagonist LY341495 at sites throughout medial shell suppressed appetitive motivation to eat and drink. Simultaneously, LY341495 microinjections generated fearful motivation in the form of defensive treading or burying. To assess whether the valence shift extended into a parallel hedonic shift from affective 'liking' to 'disliking' we employed the taste reactivity test, which measures affective orofacial reactions to the sensory pleasure or displeasure of tastes. We found that LY341495 microinjections reduced positive 'liking' reactions to sucrose and enhanced 'disliking' reactions. Overall, mglu2/3 antagonism at most shell sites produced a similar valence shift from positive to negative. This pattern comprised (i) generation of fearful behaviors, and (ii) induction of aversive affective reactions, together with (iii) loss of appetitive ingestion and (iv) loss of 'liking' for rewards. These results are discussed in terms of implications for clinical disorders and the influence of corticolimbic glutamate inputs to NAc in the generation of motivation and affect.

Opponency revisited: competition and cooperation between dopamine and serotonin

Affective valence lies on a spectrum ranging from punishment to reward. The coding of such spectra in the brain almost always involves opponency between pairs of systems or structures. There is ample evidence for the role of dopamine in the appetitive half of this spectrum, but little agreement about the existence, nature, or role of putative aversive opponents such as serotonin. In this review, we consider the structure of opponency in terms of previous biases about the nature of the decision problems that animals face, the conflicts that may thus arise between Pavlovian and instrumental responses, and an additional spectrum joining invigoration to inhibition. We use this analysis to shed light on aspects of the role of serotonin and its interactions with dopamine.