Dissociable effects of disconnecting amygdala central nucleus from the ventral tegmental area or substantia nigra on learned orienting and incentive motivation

The role of the bed nucleus of the stria terminalis in the motivational control of instrumental action

We review recent studies assessing the role of the bed nucleus of the stria terminalis (BNST) in the motivational control of instrumental conditioning. This evidence suggests that the BNST and central nucleus of the amygdala (CeA) form a circuit that modulates the ventral tegmental area (VTA) input to the nucleus accumbens core (NAc core) to control the influence of Pavlovian cues on instrumental performance. In support of these claims, we found that activity in the oval region of BNST was increased by instrumental conditioning, as indexed by phosphorylated ERK activity (Experiment 1), but that this increase was not due to exposure to the instrumental contingency or to the instrumental outcome per se (Experiment 2). Instead, BNST activity was most significantly incremented in a test conducted when the instrumental outcome was anticipated but not delivered, suggesting a role for BNST in the motivational effects of anticipated outcomes on instrumental performance. To test this claim, we examined the effect of NMDA-induced cell body lesions of the BNST on general Pavlovian-to-instrumental transfer (Experiment 3). These lesions had no effect on instrumental performance or on conditioned responding during Pavlovian conditioning to either an excitory conditioned stimulus (CS) or a neutral CS (CS0) but significantly attenuated the excitatory effect of the Pavlovian CS on instrumental performance. These data are consistent with the claim that the BNST mediates the general excitatory influence of Pavlovian cues on instrumental performance and suggest BNST activity may be central to CeA-BNST modulation of a VTA-NAc core circuit in incentive motivation.

Prior chronic alcohol exposure enhances Pavlovian-to-instrumental transfer

Alcohol dependence is associated with aberrant decision-making processes, particularly in the presence of alcohol-related environmental cues. For instance, alcohol cues can trigger alcohol seeking, consumption, and even relapse behavior. Recently, works have suggested that alcohol dependence may induce more general alterations in cued processes that support adaptive behavior, including enhanced cue control of volitional behavior unrelated to alcohol use. Here we examine this hypothesis by combining prior exposure to chronic intermittent ethanol and repeated withdrawal (CIE) procedures with a Pavlovian-to-instrumental transfer (PIT) task in mice. The PIT task entails training a Pavlovian association, separately training an instrumental contingency, and a final test during which the Pavlovian cue and instrumental action are combined for the first time. We first tested two variants of the PIT procedure in ethanol-naïve mice, differing in part in the duration of Pavlovian conditioned cues (short or long). We found in the PIT test that the short cue procedure produced negative transfer, whereas the long cue procedure produced positive transfer. We then used the long cue variant to examine PIT behavior in mice previously exposed to either CIE or air vapor. We found that prior CIE exposure strengthened PIT behavior, with enhanced instrumental responding during presentation of the food-associated cue. We further found that this enhancement in CIE mice persisted even after devaluation of the food outcome. Our findings suggest that ethanol dependence can enhance the influence of reward-predictive cues on ongoing behavior. Greater non-alcohol cue control of behavior may reflect the effect of chronic ethanol exposure on neural circuitry critical for cue-guided behavior in general.

Diverse midbrain dopaminergic neuron subtypes and implications for complex clinical symptoms of Parkinson's disease

Parkinson’s disease (PD), the most common degenerative movement disorder, is clinically manifested with various motor and non-motor symptoms. Degeneration of midbrain substantia nigra pas compacta (SNc) dopaminergic neurons (DANs) is generally attributed to the motor syndrome. The underlying neuronal mechanisms of non-motor syndrome are largely unexplored. Besides SNc, midbrain ventral tegmental area (VTA) DANs also produce and release dopamine and modulate movement, reward, motivation, and memory. Degeneration of VTA DANs also occurs in postmortem brains of PD patients, implying an involvement of VTA DANs in PD-associated non-motor symptoms. However, it remains to be established that there is a distinct segregation of different SNc and VTA DAN subtypes in regulating different motor and non-motor functions, and that different DAN subpopulations are differentially affected by normal ageing or PD. Traditionally, the distinction among different DAN subtypes was mainly based on the location of cell bodies and axon terminals. With the recent advance of single cell RNA sequencing technology, DANs can be readily classified based on unique gene expression profiles. A combination of specific anatomic and molecular markers shows great promise to facilitate the identification of DAN subpopulations corresponding to different behavior modules under normal and disease conditions. In this review, we first summarize the recent progress in characterizing genetically, anatomically, and functionally diverse midbrain DAN subtypes. Then, we provide perspectives on how the preclinical research on the connectivity and functionality of DAN subpopulations improves our current understanding of cell-type and circuit specific mechanisms of the disease, which could be critically informative for designing new mechanistic treatments.

Spontaneous eye blink rate mediates the relationship between sleepiness and impulsivity to negative stimuli

Previous studies have demonstrated that sleep deprivation results in a negativity bias, especially in the context of impaired response inhibition. In the present study we investigated spontaneous eye blink rate (EBR), a correlate of dopamine function, as a mediator of the relationship between subjective sleepiness and impulsivity toward negative stimuli on a Go/NoGo task. Participants rated their sleepiness on a number of measures including the Epworth Sleepiness Scale (ESS), the Karolinska Sleepiness Scale (KSS) and subscales of the Chronic Sleep Reduction Questionnaire (CSRQ). The findings revealed that EBR mediated the relationship between sleepiness as measured by the Karolinska Sleepiness Scale (KSS) and commission errors on negatively valanced stimuli. These findings suggest that reduced inhibition in responding to negative stimuli can be found as a function of subjective sleepiness and that changes in dopamine function may be one contributing factor explaining this relationship.

Incentive motivation: 'wanting' roles of central amygdala circuitry

The central nucleus of amygdala (CeA) mediates positively-valenced reward motivation as well as negatively-valenced fear. Optogenetic or neurochemical stimulation of CeA circuitry can generate intense incentive motivation to pursue and consume a paired natural food, sex, or addictive drug reward, and even create maladaptive 'wanting what hurts' such as attraction to a shock rod. Evidence indicates CeA stimulations selectively amplify incentive motivation ('wanting') but not hedonic impact ('liking') of the same reward. Further, valence flips can occur for CeA contributions to motivational salience. That is, CeA stimulation can promote either incentive motivation or fearful motivation, even in the same individual, depending on situation. These findings may carry implications for understanding CeA roles in neuropsychiatric disorders involving aberrant motivational salience, ranging from addiction to paranoia and anxiety disorders.

The transition to compulsion in addiction

Compulsion is a cardinal symptom of drug addiction (severe substance use disorder). However, compulsion is observed in only a small proportion of individuals who repeatedly seek and use addictive substances. Here, we integrate accounts of the neuropharmacological mechanisms that underlie the transition to compulsion with overarching learning theories, to outline how compulsion develops in addiction. Importantly, we emphasize the conceptual distinctions between compulsive drug-seeking behaviour and compulsive drug-taking behaviour (that is, use). In the latter, an individual cannot stop using a drug despite major negative consequences, possibly reflecting an imbalance in frontostriatal circuits that encode reward and aversion. By contrast, an individual may compulsively seek drugs (that is, persist in seeking drugs despite the negative consequences of doing so) when the neural systems that underlie habitual behaviour dominate goal-directed behavioural systems, and when executive control over this maladaptive behaviour is diminished. This distinction between different aspects of addiction may help to identify its neural substrates and new treatment strategies.

Mapping accumulative whole-brain activities during environmental enrichment with manganese-enhanced magnetic resonance imaging

An enriched environment (EE) provides multi-dimensional stimuli to the brain. EE exposure for days to months induces functional and structural neuroplasticity. In this study, manganese-enhanced magnetic resonance imaging (MEMRI) was used to map the accumulative whole-brain activities associated with a 7-day EE exposure in freely-moving adult male mice, followed by c-Fos immunochemical assessments. Relative to the mice residing in a standard environment (SE), the mice subjected to EE treatment had significantly enhanced regional MEMRI signal intensities in the prefrontal cortex, somatosensory cortices, basal ganglia, amygdala, motor thalamus, lateral hypothalamus, ventral hippocampus and midbrain dopaminergic areas at the end of the 7-day exposure, likely attributing to enhanced Mn²⁺ uptake/transport associated with brain activities at both the regional and macroscale network levels. Some of, but not all, the brain regions in the EE-treated mice showing enhanced MEMRI signal intensity had accompanying increases in c-Fos expression. The EE-treated mice were also found to have significantly increased overall amount of food consumption, decreased body weight gain and upregulated tyrosine hydroxylase (TH) expression in the midbrain dopaminergic areas. Taken together, these results demonstrated that the 7-day EE exposure was associated with elevated cumulative activities in the nigrostriatal, mesolimbic and corticostriatal circuits underpinning reward, motivation, cognition, motor control and appetite regulation. Such accumulative activities might have served as the substrate of EE-related neuroplasticity and the beneficial effects of EE treatment on neurological/psychiatric conditions including drug addiction, Parkinson's disease and eating disorder.

Evidence for incentive salience sensitization as a pathway to alcohol use disorder

The incentive salience sensitization (ISS) theory of addiction holds that addictive behavior stems from the ability of drugs to progressively sensitize the brain circuitry that mediates attribution of incentive salience (IS) to reward-predictive cues and its behavioral manifestations. In this article, we establish the plausibility of ISS as an etiological pathway to alcohol use disorder (AUD). We provide a comprehensive and critical review of evidence for: (1) the ability of alcohol to sensitize the brain circuitry of IS attribution and expression; and (2) attribution of IS to alcohol-predictive cues and its sensitization in humans and non-human animals. We point out gaps in the literature and how these might be addressed. We also highlight how individuals with different alcohol subjective response phenotypes may differ in susceptibility to ISS as a pathway to AUD. Finally, we discuss important implications of this neuropsychological mechanism in AUD for psychological and pharmacological interventions attempting to attenuate alcohol craving and cue reactivity.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Drug Cues, Conditioned Reinforcement, and Drug Seeking: The Sequelae of a Collaborative Venture With Athina Markou

Athina Markou spent a research period in my laboratory, then in the Department of Anatomy in Cambridge University, in 1991 to help us establish a cocaine-seeking procedure. Thus we embarked on developing a second-order schedule of intravenous cocaine reinforcement to investigate the neural basis of the pronounced effects of cocaine-associated conditioned stimuli on cocaine seeking. This brief review summarizes the fundamental aspects of cocaine seeking measured using this approach and the importance of the methodology in enabling us to define the neural mechanisms and circuitry underlying conditioned reinforcement and cocaine, heroin, and alcohol seeking. The shift over time and experience of control over drug seeking from a limbic cortical-ventral striatal circuit underlying goal-directed drug seeking to a dorsal striatal system mediating habitual drug seeking are also summarized. The theoretical implications of these data are discussed, thereby revealing the ways in which the outcomes of a collaboration can endure.

Stimulus preexposure speeds or slows subsequent acquisition of associative learning depending on learning test procedures and response measure

Prior exposure to a conditioned stimulus (CS) typically results in latent inhibition-slower acquisition of associative learning about that stimulus in subsequent training. Here, we found that CS preexposure had different effects on the appetitive conditioning of rats with a sucrose unconditioned stimulus (US) depending on training test procedures, the similarity of preexposure and training procedures, and the choice of response measure. Preexposure to a visual or an auditory stimulus produced facilitation of acquisition of food-cup-directed responding when both of those cues were (separately) paired with sucrose delivery in the training test (Experiments 1 and 3). By contrast, the same preexposure procedure resulted in latent inhibition of food-cup learning if the second stimulus in the test phase was of the same modality as the preexposed stimulus (Experiment 2). In Experiment 3, latent inhibition was enhanced if both phases included a single CS or both phases included both auditory and visual CSs, compared to treatments in which only one CS was presented in one phase but two CSs were presented in the other phase. In Experiment 4, preexposure of an auditory cue slowed subsequent learning about it if the context was salient but enhanced learning if the context was of weaker salience. Finally, a measure of general activity revealed latent inhibition after preexposure in all conditions in all 4 experiments. We discuss the results within several classes of latent inhibition theories, none of which provides a comprehensive account.

Habitual Alcohol Seeking: Neural Bases and Possible Relations to Alcohol Use Disorders

Loss of flexible control over alcohol use may contribute to the development of alcohol use disorders. An increased contribution of response habits to alcohol-related behaviors may help explain this loss of control. Focusing on data from outcome devaluation and Pavlovian-instrumental transfer procedures, we review evidence for loss of goal-directed control over alcohol seeking and consumption drawing from both preclinical findings and clinical data where they exist. Over the course of extended alcohol self-administration and exposure, the performance of alcohol-seeking responses becomes less sensitive to reduction in the value of alcohol and more vulnerable to the influences of alcohol-predictive stimuli. These behavioral changes are accompanied by a shift in the corticostriatal circuits that control responding from circuits centered on the dorsomedial to those centered on the dorsolateral striatum. These changes in behavioral and neural control could help explain failures to abstain from alcohol despite intention to do so. Understanding and ultimately ameliorating these changes will aid development of more effective treatment interventions.

The amygdalo-nigrostriatal network is critical for an optimal temporal performance

The amygdalo-nigrostriatal (ANS) network plays an essential role in enhanced attention to significant events. Interval timing requires attention to temporal cues. We assessed rats having a disconnected ANS network, due to contralateral lesions of the medial central nucleus of the amygdala (CEm) and dopaminergic afferents to the lateral striatum, as compared to controls (sham and ipsilateral lesions of CEm and dopaminergic afferents to LS) in a temporal bisection task. ANS disconnection induced poorer temporal precision and increased response latencies to a short duration. The present results reveal a role of the ANS network in temporal processing.

The antagonism of ghrelin alters the appetitive response to learned cues associated with food

The rapid increase in obesity may be partly mediated by an increase in the exposure to cues for food. Food-paired cues play a role in food procurement and intake under conditions of satiety. The mechanism by which this occurs requires characterization, but may involve ghrelin. This orexigenic peptide alters the response to food-paired conditioned stimuli, and neural responses to food images in reward nuclei. Therefore, we tested whether a ghrelin receptor antagonist alters the influence of food-paired cues on the performance of instrumental responses that earn food and the consumption of food itself using tests of Pavlovian-to-instrumental transfer (PIT) and cue potentiated feeding (CPF), respectively. Food-deprived rats received Pavlovian conditioning where an auditory cue was paired with delivery of sucrose solution followed by instrumental conditioning to lever press for sucrose. Following training, rats were given ad libitum access to chow. On test day, rats were injected with the ghrelin receptor antagonist GHRP-6 [D-Lys3] and then tested for PIT or CPF. Disrupting ghrelin signaling enhanced expression of PIT. In addition, GHRP-6 [D-Lys3] impaired the initiation of feeding behavior in CPF without influencing overall intake of sucrose. Finally, in PIT tested rats, enhanced FOS immunoreactivity was revealed following the antagonist in regions thought to underlie PIT; however, the antagonist had no effect on FOS immunoreactivity in CPF tested rats.

N-methyl-D-aspartate receptors in the ventral tegmental area mediate the excitatory influence of Pavlovian stimuli on instrumental performance

Pavlovian stimuli predictive of food can markedly amplify instrumental responding for food. This effect is termed Pavlovian-instrumental transfer (PIT). The ventral tegmental area (VTA) plays a key role in mediating PIT, however, it is yet unknown whether N-methyl-D-aspartate (NMDA)-type glutamate receptors in the VTA are involved in PIT. Here, we examined the effects of an NMDA-receptor blockade in the VTA on PIT. Immediately prior to PIT testing, rats were subjected to intra-VTA infusions of vehicle or of the NMDA-receptor antagonist 2-amino-5-phosphonopentanoic acid (AP-5) (1, 5 µg/side). In rats that received AP-5 at the lower dose, the PIT effect was intact, i.e. presentation of the Pavlovian stimulus enhanced instrumental responding. By contrast, in rats that received AP-5 at the higher dose, the PIT effect was blocked. The data suggest that NMDA receptors in the VTA mediate the activating effects of Pavlovian stimuli on instrumental responding.

Basolateral and central amygdala differentially recruit and maintain dorsolateral striatum-dependent cocaine-seeking habits

In the development of addiction, drug seeking becomes habitual and controlled by drug-associated cues, and the neural locus of control over behaviour shifts from the ventral to the dorsolateral striatum. The neural mechanisms underlying this functional transition from recreational drug use to drug-seeking habits are unknown. Here we combined functional disconnections and electrophysiological recordings of the amygdalo-striatal networks in rats trained to seek cocaine to demonstrate that functional shifts within the striatum are driven by transitions from the basolateral (BLA) to the central (CeN) amygdala. Thus, while the recruitment of dorsolateral striatum dopamine-dependent control over cocaine seeking is triggered by the BLA, its long-term maintenance depends instead on the CeN. These data demonstrate that limbic cortical areas both tune the function of cognitive territories of the striatum and thereby underpin maladaptive cocaine-seeking habits.

The amygdala and basal forebrain as a pathway for motivationally guided attention

Visual stimuli associated with rewards attract spatial attention. Neurophysiological mechanisms that mediate this process must register both the motivational significance and location of visual stimuli. Recent neurophysiological evidence indicates that the amygdala encodes information about both of these parameters. Furthermore, the firing rate of amygdala neurons predicts the allocation of spatial attention. One neural pathway through which the amygdala might influence attention involves the intimate and bidirectional connections between the amygdala and basal forebrain (BF), a brain area long implicated in attention. Neurons in the rhesus monkey amygdala and BF were therefore recorded simultaneously while subjects performed a detection task in which the stimulus-reward associations of visual stimuli modulated spatial attention. Neurons in BF were spatially selective for reward-predictive stimuli, much like the amygdala. The onset of reward-predictive signals in each brain area suggested different routes of processing for reward-predictive stimuli appearing in the ipsilateral and contralateral fields. Moreover, neurons in the amygdala, but not BF, tracked trial-to-trial fluctuations in spatial attention. These results suggest that the amygdala and BF could play distinct yet inter-related roles in influencing attention elicited by reward-predictive stimuli.

Amygdalo-striatal interaction in the enhancement of stimulus salience in associative learning

Function of the central nucleus of the amygdala (CeA) is critical to 2 aspects of attention in associative learning: the conditioning of orienting responses (ORs) to cues paired with food, and the enhancement of cue salience by the surprising omission of expected events. Such salience enhancements have been found to depend on interactions within a circuit that includes CeA, the substantia nigra pars compacta (SNc), the substantia innominata (SI), and the posterior parietal cortex (PPC). The acquisition and expression of conditioned ORs requires interactions among CeA, SNc, and the dorsal lateral striatum (DLS), but not SI or PPC. Here, we considered whether CeA-DLS interactions are also important in surprise-induced salience enhancements in a serial prediction task. Rats received unilateral lesions of CeA and DLS, either contralaterally, which disrupted interactions between those structures, or ipsilaterally, which produced comparable damage to each structure but permitted interactions between them in 1 hemisphere. Rats with ipsilateral lesions of CeA and DLS showed the salience enhancements normally observed in this task, but rats with contralateral lesions of those structures did not. Thus, convergence of information processing by CeA and DLS is essential for surprise-induced salience enhancements, as well as for conditioned ORs.

Task-dependent spatial selectivity in the primate amygdala

Humans and other animals routinely encounter visual stimuli that indicate whether future reward delivery depends upon the identity or location of a stimulus, or the performance of a particular action. These reinforcement contingencies can influence how much attention is directed toward a stimulus. Neurons in the primate amygdala encode information about the association between visual stimuli and reinforcement as well as about the location of reward-predictive stimuli. Amygdala neural activity also predicts variability in spatial attention. In principle, the spatial properties of amygdala neurons may be present independent of spatial attention allocation. Alternatively, the encoding of spatial information may require attention. We trained monkeys to perform tasks that engaged spatial attention to varying degrees to understand the genesis of spatial processing in the amygdala. During classical conditioning tasks, conditioned stimuli appeared at different locations; amygdala neurons responded selectively to the location of stimuli. These spatial signals diminished rapidly upon stimulus disappearance and were unrelated to selectivity for expected reward. In contrast, spatial selectivity was sustained in time when monkeys performed a delayed saccade task that required sustained spatial attention. This temporally extended spatial signal was correlated with signals encoding reward expectation. Furthermore, variability in firing rates was correlated with variability in spatial attention, as measured by reaction time. These results reveal two types of spatial signals in the amygdala: one that is tied to initial visual responses and a second that reflects coordination between spatial and reinforcement information and that relates to the engagement of spatial attention.

Amygdala neural activity reflects spatial attention towards stimuli promising reward or threatening punishment

Humans and other animals routinely identify and attend to sensory stimuli so as to rapidly acquire rewards or avoid aversive experiences. Emotional arousal, a process mediated by the amygdala, can enhance attention to stimuli in a non-spatial manner. However, amygdala neural activity was recently shown to encode spatial information about reward-predictive stimuli, and to correlate with spatial attention allocation. If representing the motivational significance of sensory stimuli within a spatial framework reflects a general principle of amygdala function, then spatially selective neural responses should also be elicited by sensory stimuli threatening aversive events. Recordings from amygdala neurons were therefore obtained while monkeys directed spatial attention towards stimuli promising reward or threatening punishment. Neural responses encoded spatial information similarly for stimuli associated with both valences of reinforcement, and responses reflected spatial attention allocation. The amygdala therefore may act to enhance spatial attention to sensory stimuli associated with rewarding or aversive experiences.

Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors

When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the lever also display impulsivity and altered attention, as compared to rats showing behavior directed toward the reward delivery location. The current study used a light CS to categorize rats' propensity for cue-directed behavior, and assessed whether individual differences in impulsivity and related behaviors still emerged. During the light-food pairings, some rats displayed enhanced rearing or orienting to the light (Orienters) prior to showing food cup approach behavior, while other rats only showed food cup approach behavior (Nonorienters). Our results showed that Orienters made more impulsive and risky decisions in two different choice tasks, and were quicker to leave a familiar dark environment to enter a novel bright field. Orienters also showed less accurate target detection when a visual distractor was introduced during an attentional challenge. Our current study suggests that light CS-induced rearing/orienting behavior might not necessarily share an identical mechanism with lever CS-approach behavior in predicting impulsivity-related behaviors.

The motivational drive to natural rewards is modulated by prenatal glucocorticoid exposure

Exposure to elevated levels of glucocorticoids (GCs) during neurodevelopment has been identified as a triggering factor for the development of reward-associated disorders in adulthood. Disturbances in the neural networks responsible for the complex processes that assign value to rewards and associated stimuli are critical for disorders such as depression, obsessive–compulsive disorders, obesity and addiction. Essential in the understanding on how cues influence behavior is the Pavlovian–instrumental transfer (PIT), a phenomenon that refers to the capacity of a Pavlovian stimulus that predicts a reward to elicit instrumental responses for that same reward. Here, we demonstrate that in utero exposure to GCs (iuGC) impairs both general and selective versions of the PIT paradigm, suggestive of deficits in motivational drive. The iuGC animals presented impaired neuronal activation pattern upon PIT performance in cortical and limbic regions, as well as morphometric changes and reduced levels of dopamine in prefrontal and orbitofrontal cortices, key regions involved in the integration of Pavlovian and instrumental stimuli. Normalization of dopamine levels rescued this behavior, a process that relied on D2/D3, but not D1, dopamine receptor activation. In summary, iuGC exposure programs the mesocorticolimbic dopaminergic circuitry, leading to a reduction in the attribution of the incentive salience to cues, in a dopamine-D2/D3-dependent manner. Ultimately, these results are important to understand how GCs bias incentive processes, a fact that is particularly relevant for disorders where differential attribution of incentive salience is critical.

An update on the connections of the ventral mesencephalic dopaminergic complex

This review covers the intrinsic organization and afferent and efferent connections of the midbrain dopaminergic complex, comprising the substantia nigra, ventral tegmental area and retrorubral field, which house, respectively, the A9, A10 and A8 groups of nigrostriatal, mesolimbic and mesocortical dopaminergic neurons. In addition, A10dc (dorsal, caudal) and A10rv (rostroventral) extensions into, respectively, the ventrolateral periaqueductal gray and supramammillary nucleus are discussed. Associated intrinsic and extrinsic connections of the midbrain dopaminergic complex that utilize gamma-aminobutyric acid (GABA), glutamate and neuropeptides and various co-expressed combinations of these compounds are considered in conjunction with the dopamine-containing systems. A framework is provided for understanding the organization of massive afferent systems descending and ascending to the midbrain dopaminergic complex from the telencephalon and brainstem, respectively. Within the context of this framework, the basal ganglia direct and indirect output pathways are treated in some detail. Findings from rodent brain are briefly compared with those from primates, including humans. Recent literature is emphasized, including traditional experimental neuroanatomical and modern gene transfer and optogenetic studies. An attempt was made to provide sufficient background and cite a representative sampling of earlier primary papers and reviews so that people new to the field may find this to be a relatively comprehensive treatment of the subject.

Multiple mechanistically distinct modes of endocannabinoid mobilization at central amygdala glutamatergic synapses

The central amygdala (CeA) is a key structure at the limbic-motor interface regulating stress responses and emotional learning. Endocannabinoid (eCB) signaling is heavily implicated in the regulation of stress-response physiology and emotional learning processes; however, the role of eCBs in the modulation of synaptic efficacy in the CeA is not well understood. Here we describe the subcellular localization of CB1 cannabinoid receptors and eCB synthetic machinery at glutamatergic synapses in the CeA and find that CeA neurons exhibit multiple mechanistically and temporally distinct modes of postsynaptic eCB mobilization. These data identify a prominent role for eCBs in the modulation of excitatory drive to CeA neurons and provide insight into the mechanisms by which eCB signaling and exogenous cannabinoids could regulate stress responses and emotional learning.

The contributions of value-based decision-making and attentional bias to alcohol-seeking following devaluation

AIMS

To investigate the mediating role of attentional bias for alcohol cues on alcohol-seeking following devaluation of alcohol.

DESIGN

Between subject.

SETTING

Eye-tracking laboratory at the University of Liverpool.

PARTICIPANTS

Student social drinkers (n = 64).

MEASUREMENTS

An operant choice task in which participants chose between simultaneously presented alcohol and non-alcohol drink rewards, while attentional bias for alcohol and non-alcohol drink cues was inferred from eye movements. Participants then consumed 30 mL of an alcoholic beverage, which was either presented alone (no devaluation: n = 32) or had been adulterated to taste unpleasant (devaluation: n = 32). Choice and attentional bias for the alcohol and non-alcohol drink pictures were then measured again.

FINDINGS

Alcohol devaluation reduced behavioural choice for alcohol (F = 32.64, P < 0.001) and attentional bias for the alcohol pictures indexed by dwell time (F = 22.68, P < 0.001), initial fixation (F = 7.08, P = 0.01) and final fixation (F = 22.44, P < 0.001). Mediation analysis revealed that attentional bias partially mediated the effect of devaluation on alcohol choice; however, the proportion of the variance accounted for by attentional bias is low to moderate (~30%).

CONCLUSIONS

Among student social drinkers, attentional bias is only a partial mediator of alcohol choice following devaluation of alcohol. Value-based decision-making may be a more important determinant of drinking behaviour among student social drinkers than attentional bias.

The Contribution of the Amygdala to Aversive and Appetitive Pavlovian Processes

Pavlovian cues predict the occurrence of motivationally salient outcomes, thus serving as an important trigger of approach and avoidance behavior. The amygdala is a key substrate of Pavlovian conditioning, and the nature of its contribution varies by the motivational valence of unconditioned stimuli. The literature on aversive Pavlovian learning supports a serial-processing model of amygdalar function, while appetitive studies suggest that Pavlovian associations are processed through parallel circuits in the amygdala. It is proposed that serial and parallel forms of information processing can be attributed to differential recruitment of amygdalar nuclei, with emphasis placed on the lateral amygdala.

Addiction: failure of control over maladaptive incentive habits

Drug addiction may be associated with a loss of executive control over maladaptive incentive habits. We hypothesize that these incentive habits result from a pathological coupling of drug-influenced motivational states and a rigid stimulus-response habit system by which drug-associated stimuli through automatic processes elicit and maintain drug seeking. Neurally, incentive habits may depend upon an interaction between the basolateral amygdala and nucleus accumbens core, together with the progressive development of a ventral-to-dorsolateral striatum functional coupling through the recruitment of striato-nigro-striatal dopamine-dependent loop circuitry. Recent evidence suggests that both ventral striatal and central nucleus pathways from the amygdala may be required for the recruitment of DLS-dependent control over habitual behavior.

Role of amygdala central nucleus in feature negative discriminations

Consistent with a popular theory of associative learning, the Pearce-Hall (1980) model, the surprising omission of expected events enhances cue associability (the ease with which a cue may enter into new associations), across a wide variety of behavioral training procedures. Furthermore, previous experiments from this laboratory showed that these enhancements are absent in rats with impaired function of the amygdala central nucleus (CeA). A notable exception to these assertions is found in feature negative (FN) discrimination learning, in which a "target" stimulus is reinforced when it is presented alone but nonreinforced when it is presented in compound with another, "feature" stimulus. According to the Pearce-Hall model, reinforcer omission on compound trials should enhance the associability of the feature relative to control training conditions. However, prior experiments have shown no evidence that CeA lesions affect FN discrimination learning. Here we explored this apparent contradiction by evaluating the hypothesis that the surprising omission of an event confers enhanced associability on a cue only if that cue itself generates the disconfirmed prediction. Thus, in a FN discrimination, the surprising omission of the reinforcer on compound trials would enhance the associability of the target stimulus but not that of the feature. Our data confirmed this hypothesis and showed this enhancement to depend on intact CeA function, as in other procedures. The results are consistent with modern reformulations of both cue and reward processing theories that assign roles for both individual and aggregate error terms in associative learning.

Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior

Motivated behavior exhibits properties that change with experience and partially dissociate among a number of brain structures. Here, we review evidence from rodent experiments demonstrating that multiple brain systems acquire information in parallel and either cooperate or compete for behavioral control. We propose a conceptual model of systems interaction wherein a ventral emotional memory network involving ventral striatum (VS), amygdala, ventral hippocampus, and ventromedial prefrontal cortex triages behavioral responding to stimuli according to their associated affective outcomes. This system engages autonomic and postural responding (avoiding, ignoring, approaching) in accordance with associated stimulus valence (negative, neutral, positive), but does not engage particular operant responses. Rather, this emotional system suppresses or invigorates actions that are selected through competition between goal-directed control involving dorsomedial striatum (DMS) and habitual control involving dorsolateral striatum (DLS). The hippocampus provides contextual specificity to the emotional system, and provides an information rich input to the goal-directed system for navigation and discriminations involving ambiguous contexts, complex sensory configurations, or temporal ordering. The rapid acquisition and high capacity for episodic associations in the emotional system may unburden the more complex goal-directed system and reduce interference in the habit system from processing contingencies of neutral stimuli. Interactions among these systems likely involve inhibitory mechanisms and neuromodulation in the striatum to form a dominant response strategy. Innate traits, training methods, and task demands contribute to the nature of these interactions, which can include incidental learning in non-dominant systems. Addition of these features to reinforcement learning models of decision-making may better align theoretical predictions with behavioral and neural correlates in animals.

Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources

Accumulating evidence indicates integration of dopamine function with metabolic signals, highlighting a potential role for dopamine in energy balance, frequently construed as modulating reward in response to homeostatic state. Though its precise role remains controversial, the reward perspective of dopamine has dominated investigation of motivational disorders, including obesity. In the hypothesis outlined here, we suggest instead that the primary role of dopamine in behavior is to modulate activity to adapt behavioral energy expenditure to the prevailing environmental energy conditions, with the role of dopamine in reward and motivated behaviors derived from its primary role in energy balance. Dopamine has long been known to modulate activity, exemplified by psychostimulants that act via dopamine. More recently, there has been nascent investigation into the role of dopamine in modulating voluntary activity, with some investigators suggesting that dopamine may serve as a final common pathway that couples energy sensing to regulated voluntary energy expenditure. We suggest that interposed between input from both the internal and external world, dopamine modulates behavioral energy expenditure along two axes: a conserve-expend axis that regulates generalized activity and an explore-exploit axes that regulates the degree to which reward value biases the distribution of activity. In this view, increased dopamine does not promote consumption of tasty food. Instead increased dopamine promotes energy expenditure and exploration while decreased dopamine favors energy conservation and exploitation. This hypothesis provides a mechanistic interpretation to an apparent paradox: the well-established role of dopamine in food seeking and the findings that low dopaminergic functions are associated with obesity. Our hypothesis provides an alternative perspective on the role of dopamine in obesity and reinterprets the "reward deficiency hypothesis" as a perceived energy deficit. We propose that dopamine, by facilitating energy expenditure, should be protective against obesity. We suggest the apparent failure of this protective mechanism in Western societies with high prevalence of obesity arises as a consequence of sedentary lifestyles that thwart energy expenditure.

Effects of lesions of the amygdala central nucleus on autoshaped lever pressing

Neutral cues paired with rewards often appear to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues have been reported to modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), serve as conditioned reinforcers in the establishment of new learning, and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the amygdala central nucleus (CeA) on the acquisition of discriminative autoshaped lever-pressing. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose delivery was not contingent on lever pressing, both CeA- and sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Despite their showing little evidence of impairments in autoshaped lever pressing, these same CeA-lesioned rats showed significant deficits in the expression of PIT in a subsequent phase of the experiment. The lack of impaired autoshaping in CeA-lesioned rats contrasts with effects previously reported for conditioned orienting responses (ORs) and for other putative measures of incentive learning including PIT and conditioned approach to visual cues.

Serotonin at the level of the amygdala and orbitofrontal cortex modulates distinct aspects of positive emotion in primates

Impaired top-down regulation of the amygdala, and its modulation by serotonin (5-HT), is strongly implicated in the dysregulation of negative emotion that characterizes a number of affective disorders. However, the contribution of these mechanisms to the regulation of positive emotion is not well understood. This study investigated the role of 5-HT within the amygdala and the orbitofrontal cortex (OFC), on the expression of appetitive Pavlovian conditioned emotional responses and their reversal in a primate, the common marmoset. Its effects were compared to those of the amygdala itself. Having developed conditioned autonomic and behavioural responses to an appetitive cue prior to surgery, marmosets with excitotoxic amygdala lesions failed to display such conditioned autonomic arousal at retention, but still displayed intact cue-directed conditioned behaviours. In contrast, 5,7-DHT infusions into the amygdala, reducing extracellular 5-HT levels, selectively enhanced the expression of appetitive conditioned behaviour at retention. Similar infusions into the OFC, producing marked reductions in post-mortem 5-HT tissue levels, had no overall effect on autonomic or behavioural responses, either at retention or during reversal learning, but caused an uncoupling of these responses, thereby fractionating emotional output. These data demonstrate the critical role of the amygdala in the expression of appetitive autonomic conditioning, and the region-selective contribution of 5-HT in the amygdala and OFC, respectively, to the expression of conditioned behaviour and the overall coordination of the emotional response. They provide insight into the neurochemical mechanisms underlying the regulation of positive emotional responses, advancing our understanding of the neural basis of pathologically dysregulated emotion.

A reliable protocol for the manual segmentation of the human amygdala and its subregions using ultra-high resolution MRI

The measurement of the volume of the human amygdala in vivo has received increasing attention over the past decade, but existing methods face several challenges. First, due to the amorphous appearance of the amygdala and the difficulties in interpreting its boundaries, it is common for protocols to omit sizable sections of the rostral and dorsal regions of the amygdala comprising parts of the basolateral complex (BL) and central nucleus (Ce), respectively. Second, segmentation of the amgydaloid complex into separate subdivisions is challenging due to the resolution of routinely acquired images and the lack of standard protocols. Recent advances in technology have made ultra-high resolution MR images available, and in this study we provide a detailed segmentation protocol for manually tracing the whole amygdala that incorporates a greater portion of the rostral and dorsal sections with techniques illustrated in detail to maximize reproducibility. In addition, we propose a geometrically-based protocol for segmenting the amygdala into four component subregions of interest (sROI), which correspond largely to amygdala subnuclear divisions: the BL sROI, centromedial (CM) sROI, basomedial (BM) sROI, and the amygdaloid cortical (ACo) sROI. We performed an intra- and inter-rater reliability study of our methods in 10 adults (5 young adults and 5 older adults). The results indicate that both protocols can be implemented with a high degree of reliability (the majority of intra-rater and inter-rater correlations were > 0.81). This protocol should aid further research into the alterations in amygdala anatomy, connectivity, and function that accompany normal aging and pathology associated with neuropsychiatric disorders.

Inputs to the midbrain dopaminergic complex in the rat, with emphasis on extended amygdala-recipient sectors

The midbrain dopaminergic neuronal groups A8, A9, A10, and A10dc occupy, respectively, the retrorubral field (RRF), substantia nigra compacta (SNc), ventral tegmental area (VTA), and ventrolateral periaqueductal gray (PAGvl). Collectively, these structures give rise to a mixed dopaminergic and nondopaminergic projection system that essentially permits adaptive behavior. However, knowledge is incomplete regarding how the afferents of these structures are organized. Although the VTA is known to receive numerous afferents from cortex, basal forebrain, and brainstem and the SNc is widely perceived as receiving inputs mainly from the striatum, the afferents of the RRF and PAGvl have yet to be assessed comprehensively. This study was performed to provide an account of those connections and to seek a better understanding of how afferents might contribute to the functional interrelatedness of the VTA, SNc, RRF, and PAGvl. Ventral midbrain structures received injections of retrograde tracer, and the resulting retrogradely labeled structures were targeted with injections of anterogradely transported Phaseolus vulgaris leucoagglutinin. Whereas all injections of retrograde tracer into the VTA, SNc, RRF, or PAGvl produced labeling in many structures extending from the cortex to caudal brainstem, pronounced labeling of structures making up the central division of the extended amygdala occurred following injections that involved the RRF and PAGvl. The anterograde tracing supported this finding, and the combination of retrograde and anterograde labeling data also confirmed reports from other groups indicating that the SNc receives robust input from many of the same structures that innervate the VTA, RRF, and PAGvl.

Modeling appetitive Pavlovian-instrumental interactions in mice

In appetitive Pavlovian associative learning, a stimulus (conditioned stimulus, CS) that has been associated with the delivery of a reinforcing event (unconditioned stimulus, US; e.g., food) can subsequently elicit or modulate goal-directed instrumental behaviors. For example, a Pavlovian CS can serve to reinforce (novel) instrumental behavior (conditioned reinforcement or CRf), or it can energize and potentiate ongoing instrumental responses when presented non-contingently (Pavlovian-instrumental transfer or PIT). Notably, these different effects of a Pavlovian CS on instrumental behavior are mediated by dissociable psychological and neurobiological mechanisms. Given the critical role that Pavlovian-instrumental interactions play in regulating motivated behavior and maladaptive manifestations of motivation such as eating disorders and addictions, understanding the underlying psychological and neurobiological mechanisms will be important. This unit describes behavioral protocols that produce robust and reliable PIT and CRf in mice and that open the door for future studies using transgenic approaches into the molecular mechanisms underlying associative learning and motivation.

Interactions between amygdala central nucleus and the ventral tegmental area in the acquisition of conditioned cue-directed behavior in rats

Rats orient to and approach localizable visual cues paired with food delivery. Previous studies from this laboratory show that the acquisition and expression of these learned cue-directed responses depend on integrity of a system including the central nucleus of the amygdala (CeA), the substantia nigra pars compacta (SNc) and the dorsolateral striatum (DLS). Other investigators have suggested that cue-directed behaviors may also depend on interaction between CeA and the ventral striatum, perhaps via CeA projections to the ventral tegmental area (VTA). In Experiment 1, we examined the effects of unilateral lesions of CeA and/or VTA on rats' acquisition of conditioned responses to visual cues paired with food. Contrary to the results of previous studies that examined interactions of CeA with either SNc or DLS, rats with contralateral disconnection lesions of CeA and VTA were unimpaired in their acquisition of cue-directed responses. By contrast, rats with lesions of both structures in the same hemisphere failed to learn cue-directed responses, but were normal in their acquisition of conditioned responses directed to the food cup. In Experiment 2, we attempted to characterize the influence of VTA on CeA by examining FOS induction in CeA by a visual cue for food in rats with unilateral lesions of VTA. The results suggested an excitatory influence of VTA on CeA in the presence of food cues. Implications of these results for brain circuits involved in learned orienting and incentive motivation are discussed.

Dopamine in motivational control: rewarding, aversive, and alerting

Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but nonrewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and nonreward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior.

The role of dopamine in the dorsomedial striatum in general and outcome-selective Pavlovian-instrumental transfer

Pavlovian stimuli predictive of appetitive outcomes can influence the selection and initiation of instrumental behaviour. For instance, Pavlovian stimuli can act to enhance those actions with which they share an outcome, but not others with which they do not share an outcome, a phenomenon termed outcome-selective Pavlovian-instrumental transfer (PIT). Furthermore, Pavlovian stimuli can invigorate an action by inducing a general appetitive arousal that elevates instrumental responding, a phenomenon termed general PIT. The dorsomedial striatum has been implicated in outcome-selective, but not general PIT. However, the role of dopamine (DA) signals in this subregion in mediating PIT is unknown. Here we examined in rats the effects of a 6-hydroxydopamine-induced DA depletion of the anterior (aDMS) or posterior (pDMS) subregion of the dorsomedial striatum on outcome-selective and general PIT as well as on instrumental performance on a FR-5 schedule (five lever presses earned one pellet). Results demonstrate that aDMS and pDMS DA depletions compromised the rate of responding on a FR-5 schedule, suggesting that DA signals in the dorsomedial striatum are necessary to maintain high rates of instrumental responding. By contrast, aDMS and pDMS DA depletions did not affect general PIT, suggesting that DA signals in the dorsomedial striatum do not mediate general activating effects of reward-predictive stimuli to invigorate instrumental responding. Furthermore, aDMS DA depletions did not impair outcome-selective PIT, while pDMS DA depletions had no or only minor effects. Thus, DA signals in the DMS may not be involved in mediating the specific cueing effects of reward-predictive stimuli.

Disruptive effect of amphetamines on Pavlovian to instrumental transfer

Reward-seeking behavior can be powerfully modulated by exposure to a conditioned stimulus (CS) that was previously associated with that reward. This can be demonstrated in a Pavlovian to instrumental transfer (PIT) task where presentation of a CS (e.g., tone and light) previously paired with a rewarding unconditioned stimulus (US; e.g., food) leads to increases in a behavioral response, such as a lever press, that was also paired with the same US. The transfer effect can be enhanced in rats by exposing them repeatedly to amphetamine after they have undergone Pavlovian conditioning and instrumental training. However, it is not clear if amphetamine injections given immediately after Pavlovian conditioning, which are predicted to enhance memory consolidation for the CS-US association, would also enhance the transfer effect. We tested this hypothesis by giving male, Sprague-Dawley rats i.p. injections of saline or drug (0.5, 1.0, or 3.0 mg/kg amphetamine or methamphetamine) immediately following Pavlovian conditioning sessions. We found that amphetamine, but not methamphetamine, enhanced Pavlovian approach behavior. During a subsequent PIT test done under extinction conditions, we found that rats given either drug, particularly at the highest dose, exhibited deficits in PIT relative to saline-treated controls. These results suggest that treatment with amphetamines after Pavlovian conditioning sessions, when memory consolidation of the CS-US association is hypothesized to occur, inhibits the ability of the CS to subsequently elicit reward-seeking behavior.

Pavlovian to instrumental transfer: a neurobehavioural perspective

Pavlovian-to-instrumental transfer (PIT) is a key concept in developing our understanding of cue-controlled behaviours. Here we have reviewed the literature on behavioural and neurobiological factors that influence PIT. Meta-analyses of the data for individual groups in PIT studies revealed that PIT is related to both the order and amounts of instrumental and Pavlovian training, and that it is critically determined by competition between instrumental and Pavlovian responses. We directly addressed the role of response competition in PIT in two experiments which showed that extensive Pavlovian conditioning produced more Pavlovian magazine visits and weaker PIT than moderate Pavlovian conditioning (Experiment 1); and that PIT lost after extensive Pavlovian conditioning was restored by Pavlovian extinction training (Experiment 2). These findings confirm that response competition is indeed an important determinant of PIT. This has significant implications for lesion and inactivation studies that assess the neurobiological substrates of PIT, as well as attempts to demonstrate PIT in the drug self-administration paradigm where the effect is yet to be reliably shown.

Posterior dorsomedial striatum is critical for both selective instrumental and Pavlovian reward learning

The dorsal striatum (DS) has been implicated in instrumental learning but its role in the acquisition of stimulus-driven behaviour is not clear. To explore the contribution of the DS to both response-outcome (R-O) and stimulus-outcome (S-O) associative learning, we pharmacologically inactivated subregions (dorsolateral, anterior dorsomedial and posterior dorsomedial) of the DS during acquisition sessions in which subjects acquired two unique, novel R-O pairs or two unique, novel S-O pairs. To test whether specific R-O or S-O associations were learned under inactivation, rats were tested following selective-satiety devaluation of one outcome under drug-free conditions. In the instrumental task, control rats and rats with dorsolateral striatum (DLS) inactivation during learning responded less on the lever that had earned the devalued outcome than on the alternative lever at test, indicating that the DLS is not critical for the formation of R-O associations. In contrast, rats with inactivation of the medial DS (DMS) (either anterior or posterior) during learning responded indiscriminately, suggesting failure to acquire the novel R-O associations. In the Pavlovian task, both controls and rats with anterior DMS inactivation during learning responded less in the presence of the stimulus predicting the devalued outcome, whereas rats with DLS or posterior DMS inactivation during learning responded equally to the stimuli, indicating that they had not acquired the novel S-O associations. These data confirm that the DLS and anterior region DMS mediate different aspects of reward-related learning, and suggest that the posterior DMS may mediate a function common to both forms of learning (R-O and S-O). Finally, we demonstrate that both S-O and R-O associations are required for selective Pavlovian-instrumental transfer.

Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action

Recent behavioral studies in both humans and rodents have found evidence that performance in decision-making tasks depends on two different learning processes; one encoding the relationship between actions and their consequences and a second involving the formation of stimulus-response associations. These learning processes are thought to govern goal-directed and habitual actions, respectively, and have been found to depend on homologous corticostriatal networks in these species. Thus, recent research using comparable behavioral tasks in both humans and rats has implicated homologous regions of cortex (medial prefrontal cortex/medial orbital cortex in humans and prelimbic cortex in rats) and of dorsal striatum (anterior caudate in humans and dorsomedial striatum in rats) in goal-directed action and in the control of habitual actions (posterior lateral putamen in humans and dorsolateral striatum in rats). These learning processes have been argued to be antagonistic or competing because their control over performance appears to be all or none. Nevertheless, evidence has started to accumulate suggesting that they may at times compete and at others cooperate in the selection and subsequent evaluation of actions necessary for normal choice performance. It appears likely that cooperation or competition between these sources of action control depends not only on local interactions in dorsal striatum but also on the cortico-basal ganglia network within which the striatum is embedded and that mediates the integration of learning with basic motivational and emotional processes. The neural basis of the integration of learning and motivation in choice and decision-making is still controversial and we review some recent hypotheses relating to this issue.

Assessing the role of the growth hormone secretagogue receptor in motivational learning and food intake

The orexigenic neuropeptide ghrelin is an endogeneous ligand for the growth hormone secretagogue receptor (GHS-R). This orexigen is expressed in both the periphery and in the central system, including portions of mesolimbic dopaminergic circuitry that play a role in affective behaviors. Here we examined pharmacological antagonism of GHS-R in motivational incentive learning, as reflected in Pavlovian-to-instrumental transfer (PIT). Furthermore, it is currently unclear whether the previous effects of ghrelin on food intake are mediated by pre- and/or postingestive influences on ingestive behavior. Thus, the authors also conducted detailed analyses of the temporal dynamics of sucrose licking. Mice received low (50 nmol), moderate (100 nmol), and high (200 nmol) intraperitoneal injections of the GHS-R antagonist GHRP-6 [D-Lys3] prior to subsequent transfer and sucrose consumption tests. Low and moderate doses led to an augmentation of PIT, while high dose injections led to generalized performance deficits. In addition, moderate and high doses of the antagonist resulted in reductions in sucrose intake by reducing palatability of the sucrose. These results suggest dissociable functions of GHS-R in its influence over motivational learning and ingestive behavior.

Why do delusions persist?

Delusions are bizarre and distressing beliefs that characterize certain mental illnesses. They arise without clear reasons and are remarkably persistent. Recent models of delusions, drawing on a neuroscientific understanding of learning, focus on how delusions might emerge from abnormal experience. We believe that these models can be extended to help us understand why delusions persist. We consider prediction error, the mismatch between expectancy and experience, to be central. Surprising events demand a change in our expectancies. This involves making what we have learned labile, updating and binding the memory anew: a process of memory reconsolidation. We argue that, under the influence of excessive prediction error, delusional beliefs are repeatedly reconsolidated, strengthening them so that they persist, apparently impervious to contradiction.

Which cue to "want?" Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue

The central nucleus of the amygdala (CeA) helps translate learning into motivation, and here, we show that opioid stimulation of CeA magnifies and focuses learned incentive salience onto a specific reward cue (pavlovian conditioned stimulus, or CS). This motivation enhancement makes that cue more attractive, noticeable, and liable to elicit appetitive and consummatory behaviors. To reveal the focusing of incentive salience, we exploited individual differences in an autoshaping paradigm in which a rat prefers to approach, nibble, and sniff one of two reward-associated stimuli (its prepotent stimulus). The individually prepotent cue is either a predictive CS+ that signals reward (8 s metal lever insertion) or instead the metal cup that delivers sucrose pellets (the reward source). Results indicated that CeA opioid activation by microinjection of the mu agonist DAMGO (0.1 microg) selectively and reversibly enhanced the attractiveness of whichever reward CS was that rat's prepotent cue. CeA DAMGO microinjections made rats more vigorously approach their particular prepotent CS and to energetically sniff and nibble it in a nearly frenzied consummatory manner. Only the prepotent cue was enhanced as an incentive target, and alternative cues were not enhanced. Conversely, inactivation of CeA by muscimol microinjection (0.25 microg) suppressed approach, nibbles, and sniffs of the prepotent CS. Confirming modulation of incentive salience, unconditioned food intake was similarly increased by DAMGO microinjection and decreased by muscimol in CeA. We conclude that opioid neurotransmission in CeA helps determine which environmental stimuli become most "wanted," and how "wanted" they become. This may powerfully guide reward-seeking behavior.

The integrative function of the basal ganglia in instrumental conditioning

Recent research in instrumental conditioning has focused on the striatum, particularly the role of the dorsal striatum in the learning processes that contribute to instrumental performance in rats. This research has found evidence of what appear to be parallel, functionally and anatomically distinct circuits involving dorsomedial striatum (DMS) and dorsolateral striatum (DLS) that contribute to two independent instrumental learning processes. Evidence suggests that the formation of the critical action-outcome associations mediating goal-directed action are localized to the dorsomedial striatum, whereas the sensorimotor connections that control the performance of habitual actions are localized to the dorsolateral striatum. In addition to the dorsal striatum, these learning processes appear to engage distinct cortico-striatal networks and to be embedded in a complex of converging and partially segregated loops that constitute the cortico-striatal thalamo-cortical feedback circuit. As the entry point for the basal ganglia, cortical circuits involving the dorsal striatum are clearly in a position to control a variety of motor functions but, as recent studies of various neurodegenerative disorders have made clear, they are also involved in a number of cognitive and executive functions including action selection, planning, and decision-making.

The role of attentional bias in mediating human drug-seeking behaviour

RATIONALE

The attentional bias for drug cues is believed to be a causal cognitive process mediating human drug seeking and relapse.

OBJECTIVES, METHODS AND RESULTS

To test this claim, we trained smokers on a tobacco conditioning procedure in which the conditioned stimulus (or S+) acquired parallel control of an attentional bias (measured with an eye tracker), tobacco expectancy and instrumental tobacco-seeking behaviour. Although this correlation between measures may be regarded as consistent with the claim that the attentional bias for the S+ mediated tobacco seeking, when a secondary task was added in the test phase, the attentional bias for the S+ was abolished, yet the control of tobacco expectancy and tobacco seeking remained intact.

CONCLUSIONS

This dissociation suggests that the attentional bias for drug cues is not necessary for the control that drug cues exert over drug-seeking behaviour. The question raised by these data is what function does the attentional bias serve if it does not mediate drug seeking?

Midbrain dopamine neurons: projection target determines action potential duration and dopamine D(2) receptor inhibition

Broad action potentials (APs) and dopamine (DA) D(2) receptor (D(2)R)-mediated inhibition are widely used to identify midbrain DA neurons. However, when these measures are taken alone they do not predict DA content in ventral tegmental area (VTA) neurons. In fact, some VTA neuronal properties correlate better with projection target than neurotransmitter content. Here we report that amygdala (AMYG)-projecting VTA DA neurons have brief APs and lack D(2)R agonist (quinpirole; 1 microM) autoinhibition. However, they are hyperpolarized by both the GABA(B) agonist baclofen (1 microM) and the kappa-opioid receptor agonist U69593 [(+)-(5alpha,7alpha,8beta)-N-methyl-N-[7-(1-pyrrolidinyl)-1-oxaspiro[4.5]dec-8-yl]benzeneacetamide; 1 microM]. Furthermore, we show that accurate prediction of DA content in VTA neurons is possible when the projection target is known: in both nucleus accumbens- and AMYG-projecting neural populations, AP durations are significantly longer in DA than non-DA neurons. Among prefrontal cortex-projecting neurons, quinpirole sensitivity, but not AP duration, is a predictor of DA content. Therefore, in the VTA, AP duration and inhibition by D(2)R agonists may be valid markers of DA content in neurons of known projection target.