Predictive reward signal of dopamine neurons

Dissociation in conditioned dopamine release in the nucleus accumbens core and shell in response to cocaine cues and during cocaine-seeking behavior in rats

The dopaminergic innervation of the nucleus accumbens is generally agreed to mediate the primary reinforcing and locomotor effects of psychostimulants, but there is less consensus on conditioned dopamine (DA) release during drug-seeking behavior. We investigated the neurochemical correlates of drug-seeking behavior under the control of a drug-associated cue [a light conditioned stimulus (CS+)] and to noncontingent presentations of the CS+ in the core and shell subregions of the nucleus accumbens. Rats self-administered cocaine under a continuous reinforcement schedule in which a response on one of two identical levers led to an intravenous cocaine infusion (0.25 mg/infusion) and a 20 sec light CS+. Response requirements for cocaine and the CS+ were then progressively increased until stable responding was established under a second-order schedule of reinforcement. During microdialysis, rats were presented noncontingently with a set of 10 sec CS+ and neutral tone stimuli (CS-) before and after a 90 min period during which they responded for cocaine under a second-order schedule. Results showed the following: (1) nucleus accumbens DA increased in both the core and shell during intravenous cocaine self-administration; (2) noncontingent presentations of a cocaine-associated CS+ led to increased DA release selectively in the nucleus accumbens core; and (3) extracellular DA levels were unaltered in both core and shell during a protracted period of drug-seeking behavior under the control of the same cocaine-associated cue. These results indicate that the mesolimbic dopamine system is activated after exposure to drug-associated stimuli under specific conditions.

Memory systems in the brain

The operation of different brain systems involved in different types of memory is described. One is a system in the primate orbitofrontal cortex and amygdala involved in representing rewards and punishers, and in learning stimulus-reinforcer associations. This system is involved in emotion and motivation. A second system in the temporal cortical visual areas is involved in learning invariant representations of objects. A third system in the hippocampus is implicated in episodic memory and in spatial function. Fourth, brain systems in the frontal and temporal cortices involved in short term memory are described. The approach taken provides insight into the neuronal operations that take place in each of these brain systems, and has the aim of leading to quantitative biologically plausible neuronal network models of how each of these memory systems actually operates.

Increased dopamine release in the human amygdala during performance of cognitive tasks

Accumulating data support a critical involvement of dopamine in the modulation of neuronal activity related to cognitive processing. The amygdala is a major target of midbrain dopaminergic neurons and is implicated in learning and memory processes, particularly those involving associations between novel stimuli and reward. We used intracerebral microdialysis to directly sample extracellular dopamine in the human amygdala during the performance of cognitive tasks. The initial transition from rest to either a working memory or a reading task was accompanied by significant increases in extracellular dopamine concentration of similar magnitude. During a sustained word paired-associates learning protocol, increase in dopamine release in the amygdala related to learning performance. These data provide evidence for sustained activation of the human mesolimbic dopaminergic system during performance of cognitive tasks.

Personality traits in young patients with Parkinson's disease

OBJECTIVES

It has been hypothesized that the dopaminergic deficit of older patients with Parkinson's disease (PD) is associated with a reduction in the dopamine-dependent personality trait "novelty seeking". It is unknown whether this may also be found in younger patients with PD whose dopaminergic deficit is considered to be purely motor.

MATERIAL AND METHODS

We interviewed 122 patients below 51 years of age and 122 age- and sex-matched healthy controls with regard to clinical and sociodemographic data. Both groups had to fill out the Tridimensional Personality Questionnaire (TPQ) of Cloninger. Neuropsychological testing of formal intelligence and depression was also applied.

RESULTS

"Novelty seeking" was not different between both groups. Patients were more often depressed than controls, explaining their difference in "harm avoidance" on the TPQ. "Persistence", a sub-scale of the third TPQ dimension "reward dependence", was significantly higher in patients. Neither sex, nor age, nor educational status were correlated with one of the three personality traits.

CONCLUSIONS

The higher rate of depression explains our finding of more "harm avoidance" among young PD patients. According to a literature review the choice and performance of controls is crucial whether personality traits in PD patients may be assessed as abnormal.

Context dependency in the globus pallidus internal segment during targeted arm movements

Extracellular discharges from single neurons in the internal segment of the globus pallidus (GPi) were recorded and analyzed for rate changes associated with visually guided forearm rotations to four different targets. We sought to examine how GPi neurons contribute to movement preparation and execution. Unit discharge from 108 GPi neurons recorded in 35 electrode penetrations was aligned to the time of various behavioral events, including the onset of cued and return movements. In total, 39 of 108 GPi neurons (36%) were task-modulated, demonstrating statistically significant changes in discharge rate at various times between the presentation of visual cues and movement generation. Most often, strong modulation in discharge rate occurred selectively during either the cued (n = 32) or return (n = 2) phases of the task, although a few neurons (n = 5) were well-modulated during both movement phases. Of the 34 neurons that were modulated exclusively during cued or return movements, 50% (n = 17) were modulated similarly in association with movements to any target. The remaining 17 neurons exhibited considerable diversity in their discharge properties associated with movements to each target. Cued phases of behavior were always rewarded if executed correctly, whereas return phases were never rewarded. Overall, these data reveal that many GPi neurons discharged in a context-dependent manner, being modulated during cued, rewarded movements, but not during similar self-paced, unrewarded movements. When considered in the light of other observations, the context-dependence we have observed seems likely to be influenced by the animal's expectation of reward.

Novelty-evoked elevations of nucleus accumbens dopamine: dependence on impulse flow from the ventral subiculum and glutamatergic neurotransmission in the ventral tegmental area

In vivo microdialysis in freely moving rats was used to monitor novelty-evoked elevations in extracellular dopamine in the nucleus accumbens septi (NAS) and to examine the role of the ventral subiculum of the hippocampus and glutamatergic transmission in the ventral tegmental area (VTA) on these elevations. Exposure to novel stimuli evoked investigatory activity and increased nucleus accumbens dopamine. Unilateral injections of the sodium channel blocker tetrodotoxin (0.16 ng/0.5 microL) into the ventral subiculum ipsilateral to the dialysed NAS abolished novelty-evoked elevations in dopamine. Injections of tetrodotoxin into the contralateral VS did not prevent novelty-evoked elevations in nucleus accumbens dopamine. Unilateral perfusion (via microdialysis) of the ionotropic glutamate receptor antagonists kynurenic acid (1 mM) into the ipsilateral but not the contralateral VTA blocked novelty-evoked elevations in nucleus accumbens dopamine. Neither unilateral injections of tetrodotoxin nor unilateral perfusion of kynurenic acid disrupted investigatory behaviour. These data indicate that phasic elevations in nucleus accumbens dopamine evoked by exposure to unconditioned novel stimuli are dependent on impulse flow from the hippocampus and glutamatergic transmission in the VTA.

Neurons in the thalamic CM-Pf complex supply striatal neurons with information about behaviorally significant sensory events

The projection from the thalamic centre médian-parafascicular (CM-Pf) complex to the caudate nucleus and putamen forms a massive striatal input system in primates. We examined the activity of 118 neurons in the CM and 62 neurons in the Pf nuclei of the thalamus and 310 tonically active neurons (TANs) in the striatum in awake behaving macaque monkeys and analyzed the effects of pharmacologic inactivation of the CM-Pf on the sensory responsiveness of the striatal TANs. A large proportion of CM and Pf neurons responded to visual (53%) and/or auditory beep (61%) or click (91%) stimuli presented in behavioral tasks, and many responded to unexpected auditory, visual, or somatosensory stimuli presented outside the task context. The neurons fell into two classes: those having short-latency facilitatory responses (SLF neurons, predominantly in the Pf) and those having long-latency facilitatory responses (LLF neurons, predominantly in the CM). Responses of both types of neuron appeared regardless of whether or not the sensory stimuli were associated with reward. These response characteristics of CM-Pf neurons sharply contrasted with those of TANs in the striatum, which under the same conditions responded preferentially to stimuli associated with reward. Many CM-Pf neurons responded to alerting stimuli such as unexpected handclaps and noises only for the first few times that they occurred; after that, the identical stimuli gradually became ineffective in evoking responses. Habituation of sensory responses was particularly common for the LLF neurons. Inactivation of neuronal activity in the CM and Pf by local infusion of the GABA(A) receptor agonist, muscimol, almost completely abolished the pause and rebound facilitatory responses of TANs in the striatum. Such injections also diminished behavioral responses to stimuli associated with reward. We suggest that neurons in the CM and Pf supply striatal neurons with information about behaviorally significant sensory events that can activate conditional responses of striatal neurons in combination with dopamine-mediated nigrostriatal inputs having motivational value.

Affect regulation, brain development, and behavioral/emotional health in adolescence

This paper addresses the importance of affect regulation (AR) in relation to a broad range of behavioral and emotional health problems that emerge during adolescence. AR is defined as the adaptive modulation of emotional experience to serve a goal or purpose. This conceptualization of AR emphasizes the use of cognitive skills to guide, inhibit, or modify emotion and behavior, including the expression of emotional responses, in learned, strategic ways-skills that ultimately underpin adult levels of social maturity and the ability to show "responsible" behavior across a range of emotional situations. Neurobehavioral systems that subserve these AR skills include areas of the inferior and orbital prefrontal cortex (PFC), with rich interconnections to several limbic structures and other cortical areas, including the dorsolateral PFC. Adolescence represents an important developmental period in the functional maturation of adult AR skills; it is also a critical time in the development of clinical disorders of AR (eg, rates of depression increase dramatically and gender differences in depression emerge). Maturational changes in AR that occur during adolescence-particularly with respect to the role of emotions influencing responsible decision making-are also relevant to understanding key aspects of the developmental pathways of some behavioral health problems, such as alcohol use and nicotine dependence. A strong case is made for developmental research in affective neuroscience aimed at this important maturational period, particularly the kind of transdisciplinary research leading toward mechanistic understanding of the development of adolescent-onset disorders. Improving understanding in these areas could ultimately lead to the development of early interventions in targeted high-risk populations, and has enormous clinical and social policy relevance.

Cellular and synaptic adaptations mediating opioid dependence

Although opioids are highly effective for the treatment of pain, they are also known to be intensely addictive. There has been a massive research investment in the development of opioid analgesics, resulting in a plethora of compounds with varying affinity and efficacy at all the known opioid receptor subtypes. Although compounds of extremely high potency have been produced, the problem of tolerance to and dependence on these agonists persists. This review centers on the adaptive changes in cellular and synaptic function induced by chronic morphine treatment. The initial steps of opioid action are mediated through the activation of G protein-linked receptors. As is true for all G protein-linked receptors, opioid receptors activate and regulate multiple second messenger pathways associated with effector coupling, receptor trafficking, and nuclear signaling. These events are critical for understanding the early events leading to nonassociative tolerance and dependence. Equally important are associative and network changes that affect neurons that do not have opioid receptors but that are indirectly altered by opioid-sensitive cells. Finally, opioids and other drugs of abuse have some common cellular and anatomical pathways. The characterization of common pathways affected by different drugs, particularly after repeated treatment, is important in the understanding of drug abuse.

Multiple reward signals in the brain

The fundamental biological importance of rewards has created an increasing interest in the neuronal processing of reward information. The suggestion that the mechanisms underlying drug addiction might involve natural reward systems has also stimulated interest. This article focuses on recent neurophysiological studies in primates that have revealed that neurons in a limited number of brain structures carry specific signals about past and future rewards. This research provides the first step towards an understanding of how rewards influence behaviour before they are received and how the brain might use reward information to control learning and goal-directed behaviour.

Impairment in a discrimination reversal task after D1 receptor blockade in the pigeon "prefrontal cortex"

Dopamine (DA) is known to modulate cognitive functions of the prefrontal cortex (PFC) of mammals, especially via D1 receptor mechanisms. Like the PFC, the neostriatum caudolaterale (NCL) of birds is characterized by dopaminergic input, and NLC and PFC lesions cause similar deficits. The significance of DA in a color discrimination reversal was assessed by evaluating the effects of bilateral infusions of the D1 receptor antagonist SCH 23390 into the NCL of pigeons (Columba livia). Reversal deficits were qualitatively similar to those in mammals. At a low dose, perseveration occurred predominantly to the incorrect stimulus. Higher doses caused additional spatial perseveration. The data demonstrate, for the first time, that D1 receptor mechanisms in the NCL of pigeons contribute substantially to its function in cognitive processes. Thus, the avian NCL and mammalian PFC could represent functionally equivalent neural networks under control of the DA system.

Complementary roles of basal ganglia and cerebellum in learning and motor control

The classical notion that the basal ganglia and the cerebellum are dedicated to motor control has been challenged by the accumulation of evidence revealing their involvement in non-motor, cognitive functions. From a computational viewpoint, it has been suggested that the cerebellum, the basal ganglia, and the cerebral cortex are specialized for different types of learning: namely, supervised learning, reinforcement learning and unsupervised learning, respectively. This idea of learning-oriented specialization is helpful in understanding the complementary roles of the basal ganglia and the cerebellum in motor control and cognitive functions.

Increased glutamate-stimulated norepinephrine release from prefrontal cortex slices of spontaneously hypertensive rats

Spontaneously hypertensive rats (SHR) have behavioral characteristics (hyperactivity, impulsiveness, poorly sustained attention) similar to the behavioral disturbances of children with attention-deficit hyperactivity disorder (ADHD). We have previously shown that dopaminergic and noradrenergic systems are disturbed in the prefrontal cortex of SHR compared to their normotensive Wistar-Kyoto (WKY) control rats. It was of interest to determine whether the underlying neural circuits that use glutamate as a neurotransmitter function normally in the prefrontal cortex of SHR. An in vitro superfusion technique was used to demonstrate that glutamate caused a concentration-dependent stimulation of [3H]norepinephrine release from rat prefrontal cortex slices. Glutamate (100 microM and 1 mM) caused significantly greater release of norepinephrine from prefrontal cortex slices of SHR than from control slices. The effect of glutamate was not mediated by NMDA receptors, since NMDA (10 and 100 microM) did not exert any effect on norepinephrine release and MK-801 (10 microM) did not antagonize the effect of 100 microM glutamate. These results demonstrate that glutamate stimulates norepinephrine release from rat prefrontal cortex slices and that this increase is enhanced in SHR. The results are consistent with the suggestion that the noradrenergic system is overactive in prefrontal cortex of SHR, the animal model for ADHD.

Tracking the hemodynamic responses to reward and punishment in the striatum

Research suggests that the basal ganglia complex is a major component of the neural circuitry that mediates reward-related processing. However, human studies have not yet characterized the response of the basal ganglia to an isolated reward, as has been done in animals. We developed an event-related functional magnetic resonance imaging paradigm to identify brain areas that are activated after presentation of a reward. Subjects guessed whether the value of a card was higher or lower than the number 5, with monetary rewards as an incentive for correct guesses. They received reward, punishment, or neutral feedback on different trials. Regions in the dorsal and ventral striatum were activated by the paradigm, showing differential responses to reward and punishment. Activation was sustained following a reward feedback, but decreased below baseline following a punishment feedback.

Haloperidol challenge during copulation prevents subsequent increase in male sexual motivation

Male rats manifest an increase in sexual motivation following sexual experience. The current experiment was devised to investigate the role of dopamine in this process by assessing whether sexual behavior occurring in the presence of the dopamine receptor antagonist, haloperidol, would continue to alter the subjects' subsequent sexual motivation. Four groups of male Long-Evans rats (total N=34) traversed an operant runway once per day for one of two goalbox targets: a nonestrous or estrous female. Following establishment of baseline run times (10 trials), all males received one ejaculation with a receptive female in a separate testing environment. Subjects were pretreated with vehicle or one of three doses of haloperidol (0.05, 0.075, 0.10 mg/kg) 45 min prior to being paired with the receptive female. All subjects successfully achieved ejaculation under these conditions. Subjects were then re-tested within the runway for their motivation to approach the two types of female targets (10 trials). Vehicle-treated subjects expressed the expected increase in sexual motivation following sexual experience, while haloperidol treatment dose-dependently attenuated this effect. Subjects that received the highest haloperidol dose subsequently manifested increased run times and intra-runway "retreat" behaviors, suggesting that female cues may have become associated with an aversive sexual experience. These results are consistent with the view that dopamine systems play a role in the rewarding or reinforcing consequences of male sexual behavior.

Drugs in development for social anxiety disorder: more to social anxiety than meets the SSRI

Individuals with social phobia (SP) fear and avoid a wide variety of social and performance situations in which they are exposed to unfamiliar persons or to possible scrutiny by others. The lifetime prevalence of SP is estimated to be as high as 13%. It is frequently co-morbid with and usually precedes the onset of other psychiatric illnesses and is associated with significant occupational and social impairment, including academic and vocational underachievement. Fortunately, there are effective treatments for this common and debilitating condition. There is currently considerable evidence for the efficacy of pharmacotherapy and especially the monoamine oxidase inhibitors (MAOIs) and selective serotonin re-uptake inhibitors (SSRIs) in the treatment of this disorder. However, SSRIs are generally preferred as the first-line treatment of choice due to the advantages of SSRIs over MAOIs in terms of safety and tolerability. Despite encouraging results, current treatments most often produce partial symptomatic improvement, rather than high end-state functioning. While current first line treatments for social phobia target the serotonergic system, it is important to remember that different social fears are likely to have different developmental roots and may be based on quite different neurobiological systems. In this article we provide a review of current pharmacotherapeutic options for SP, current knowledge of the neurobiology of SP, and a review of new and promising directions in pharmacological research. It is increasingly clear that serotonin (5-HT) is unlikely to be the whole story in SP and that other brain chemical systems, especially the dopaminergic, noradrenaline-corticotropin releasing hormone and gamma-aminobutyric acid (GABA) dependent systems, most probably have an important role to play in a substantial percentage of cases. A number of new and novel agents, including the substance P antagonists, GABA agonists and CRF antagonists show considerable promise in the treatment of SP. However, in order to enhance the understanding of the neurobiology and treatment response of SP, we need to develop more sophisticated theory-driven typologies of SP.

Dopamine-receptor stimulation: biobehavioral and biochemical consequences

The MPTP monkey is a well-characterized animal model of parkinsonism and provides an exceptional tool for the study of dyskinesias induced by dopamine-like agents. Several such agents have been tested during the past 15 years, and it has been found that the duration of action of these compounds is the most reliable variable with which to predict their dyskinesiogenic profile. It is proposed that L-dopa-induced dyskinesias represent a form of pathological learning caused by chronic pulsatile (nonphysiological) stimulation of dopamine receptors, which activates a cascade of molecular and biochemical events. These events include defective regulation of Fos proteins that belong to the deltaFosB family, increased expression of neuropeptides, and defective GABA- and glutamate-mediated neurotransmission in the output structures of the basal ganglia.

The prefrontal cortex and cognitive control

One of the enduring mysteries of brain function concerns the process of cognitive control. How does complex and seemingly willful behaviour emerge from interactions between millions of neurons? This has long been suspected to depend on the prefrontal cortex--the neocortex at the anterior end of the brain--but now we are beginning to uncover its neural basis. Nearly all intended behaviour is learned and so depends on a cognitive system that can acquire and implement the 'rules of the game' needed to achieve a given goal in a given situation. Studies indicate that the prefrontal cortex is central in this process. It provides an infrastructure for synthesizing a diverse range of information that lays the foundation for the complex forms of behaviour observed in primates.

Neuronal coding of prediction errors

Associative learning enables animals to anticipate the occurrence of important outcomes. Learning occurs when the actual outcome differs from the predicted outcome, resulting in a prediction error. Neurons in several brain structures appear to code prediction errors in relation to rewards, punishments, external stimuli, and behavioral reactions. In one form, dopamine neurons, norepinephrine neurons, and nucleus basalis neurons broadcast prediction errors as global reinforcement or teaching signals to large postsynaptic structures. In other cases, error signals are coded by selected neurons in the cerebellum, superior colliculus, frontal eye fields, parietal cortex, striatum, and visual system, where they influence specific subgroups of neurons. Prediction errors can be used in postsynaptic structures for the immediate selection of behavior or for synaptic changes underlying behavioral learning. The coding of prediction errors may represent a basic mode of brain function that may also contribute to the processing of sensory information and the short-term control of behavior.

The central nucleus of the amygdala projection to dopamine subpopulations in primates

The dopamine system plays a major role in responses to potentially rewarding stimuli. An important input to the dopamine neurons is derived from the central nucleus of the amygdala. The central nucleus is a complex structure consisting of several subdivisions with distinct histochemical, morphologic, and connectional features. The central nucleus subdivisions are therefore likely to have specific inputs to the dopamine neurons. The midbrain dopamine cells are divided into dorsal and ventral subpopulations. We determined the organization of inputs from the central nucleus subdivisions to the dopamine subpopulations in monkeys. The dorsal tier neurons receive relatively greater central nucleus input compared to the ventral tier. Within the ventral tier, the central nucleus projects to the densocellular region, but not the cell columns. Furthermore, the midbrain subpopulations receive a differential projection from specific central nucleus subterritories. The medial subdivision of the central nucleus has the greatest input to the dopamine system, and projects throughout the dorsal tier and densocellular regions. This indicates that the medial subdivision influences not only the ventral striatum but also more dorsal striatal areas, through its inputs to these dopamine subpopulations. In contrast, the capsular subdivision of the lateral central nucleus and the amygdalostriatal area project preferentially to the dorsal tier, which selectively modulates the ventral striatum and cortex. The central core of the lateral central nucleus is unique in its restricted projection to the lateral substantia nigra in the region of the nigrotectal pathway. Taken as a whole, the central nucleus-nigral pathway provides a route for affectively significant stimuli to modulate the DA system, influencing the initiation of behavioral responses.

The pharmacology of latent inhibition as an animal model of schizophrenia

The nature of the primary symptoms of schizophrenia and our lack of knowledge of its underlying cause both contribute to the difficulty of generating convincing animal models of schizophrenia. A more recent approach to investigating the biological basis of schizophrenia has been to use information processing models of the disease to link psychotic phenomena to their neural basis. Schizophrenics are impaired in a number of experimental cognitive tasks that support this approach, including sensory gating tasks and models of selective attention such as latent inhibition (LI). LI refers to a process in which noncontingent presentation of a stimulus attenuates its ability to enter into subsequent associations, and it has received much attention because it is widely considered to relate to the cognitive abnormalities that characterise acute schizophrenia. Several claims have been made for LI having face and construct validity for schizophrenia. In this review of the pharmacological studies carried out with LI we examine its claim to predictive validity and the role of methodological considerations in drug effects. The data reviewed demonstrate that facilitation of low levels of LI is strongly related to demonstrated antipsychotic activity in man and all major antipsychotic drugs, both typical and atypical, have been shown to potentiate LI using a variety of protocols. Very few compounds without antipsychotic activity are active in this model. In contrast, disruption of LI occurs with a wide range of drugs and the relationship with psychotomimetic potential is less clear. Although reversal of disrupted LI has also been used as a model for antipsychotic acticity, mostly using amphetamine-induced disruption, insufficient studies have been carried out to evaluate its claim to predictive validity. However, like facilitation, it is sensitive to both typical and atypical antipsychotic agents. The data we have reviewed here demonstrate that facilitation of LI and, perhaps to a lesser extent, reversal of disrupted LI fulfil the criteria for predictive validity.

Computational models of the basal ganglia

Computer simulation studies and mathematical analysis of models of the basal ganglia are being used increasingly to explore theories of basal ganglia function. We review the implications of these new models for a general understanding of basal ganglia function in normal as well as in diseased brains. The focus is on their functional similarities rather than on the details of mathematical methodologies and simulation techniques. Most of the models suggest a vital role for the basal ganglia in learning. Although this interest in learning is partly driven by experimental results associating the acute firing of dopamine cells with reward prediction in monkeys, some of the models have preceded the electrophysiological results. Another common theme of the models is selection. In this case, the striatum is seen as detecting and selecting cortical contexts for access to basal ganglia output. Although the behavioral consequences of this selection are hard to define, the models provide frameworks within which to explore these ideas empirically. This provides a means of refining our understanding of basal ganglia function and to consider dysfunction within the new logical frameworks.

NMDA, but not dopamine D(2), receptors in the rat nucleus accumbens areinvolved in guidance of instrumental behavior by stimuli predicting reward magnitude

Expectancy of future reward is an important factor guiding the speed of instrumental behavior. The present study sought to explore whether signals transmitted via the NMDA subtype of glutamate receptors and via dopamine D(2) receptors in the nucleus accumbens (NAc) are critical for the determination of reaction times (RTs) of instrumental responses by the expectancy of future reward. A simple RT task for rats demanding conditioned lever release was used in which the upcoming reward magnitude (5 or 1 pellet) was signaled in advance by discriminative stimuli. In trained rats, RTs of conditioned responses with expectancy of a high reward magnitude were found to be significantly shorter. The shortening of RTs by stimuli predictive of high reward to be obtained was dose-dependently impaired by bilateral intra-NAc infusion of the competitive NMDA antagonist dl-2-amino-5-phosphonovaleric acid (APV) (1, 2, or 10 microg in 0.5 microl/side), but not by infusion of the preferential dopamine D(2) antagonist haloperidol (5 and 12.5 microg in 0.5 microl/side) or by infusion of vehicle (0.5 microl/side). In conclusion, the data reveal that in well trained animals stimulation of intra-NAc NMDA, but not of dopamine D(2), receptors, is critically involved in guiding the speed of instrumental responses according to stimuli predictive of the upcoming reward magnitude.

Organization of somatic motor inputs from the frontal lobe to the pedunculopontine tegmental nucleus in the macaque monkey

To reveal the somatotopy of the pedunculopontine tegmental nucleus that functions as a brainstem motor center, we examined the distribution patterns of corticotegmental inputs from the somatic motor areas of the frontal lobe in the macaque monkey. Based on the somatotopical map prepared by intracortical microstimulation, injections of the anterograde tracers, biotinylated dextran amine and wheat germ agglutinin-conjugated horseradish peroxidase, were made into the following motor-related areas: the primary motor cortex, the supplementary and presupplementary motor areas, the dorsal and ventral divisions of the premotor cortex, and the frontal eye field. Data obtained from the present experiments were as follows: (i) Corticotegmental inputs from orofacial, forelimb, and hindlimb representations of the primary motor cortex tended to be arranged orderly from medial to lateral in the pedunculopontine tegmental nucleus. However, the distribution areas of these inputs considerably overlapped; (ii) The major input zones from distal representations of the forelimb and hindlimb regions of the primary motor cortex were located medial to those from their proximal representations, although there was a substantial overlap between the distribution areas of distal versus proximal limb inputs; (iii) The main terminal zones from the forelimb regions of the primary motor cortex, the supplementary and presupplementary motor areas, and the dorsal and ventral divisions of the premotor cortex appeared to overlap largely in the mediolaterally middle aspect of the pedunculopontine tegmental nucleus; and (iv) Corticotegmental input from the frontal eye field was scattered over the pedunculopontine tegmental nucleus.Thus, the present results indicate that the pedunculopontine tegmental nucleus is likely to receive partly separate but essentially convergent cortical inputs not only from multiple motor-related areas representing the same body part, but also from multiple regions representing diverse body parts. This suggests that somatotopical representations are intermingled rather than segregated in the pedunculopontine tegmental nucleus.

Modulation of long-term depression by dopamine in the mesolimbic system

Long-lasting adaptations in the mesolimbic dopamine (DA) system in response to drugs of abuse likely mediate many of the behavioral changes that underlie addiction. Recent work suggests that long-term changes in synaptic strength at excitatory synapses in the two major components of this system, the nucleus accumbens (NAc) and ventral tegmental area, may be particularly important for the development of drug-induced sensitization, a process that may contribute to addiction, as well as for normal response-reinforcement learning. Using whole-cell patch-clamp recording techniques from in vitro slice preparations, we have examined the existence and basic mechanisms of long-term depression (LTD) at excitatory synapses on both GABAergic medium spiny neurons in the NAc and dopaminergic neurons in the midbrain. We find that both sets of synapses express LTD but that their basic triggering mechanisms differ. Furthermore, DA blocks the induction of LTD in the midbrain via activation of D2-like receptors but has minimal effects on LTD in the NAc. The existence of LTD in mesolimbic structures and its modulation by DA represent mechanisms that may contribute to the modifications of neural circuitry that mediate reward-related learning as well as the development of addiction.

Amphetamine blocks long-term synaptic depression in the ventral tegmental area

The mesolimbic dopamine system is essential for reward-seeking behavior, and drugs of abuse are thought to usurp the normal functioning of this pathway. A growing body of evidence suggests that glutamatergic synapses on dopamine neurons in the ventral tegmental area (VTA) are modified during exposure to addictive drugs, producing sensitization, a progressive augmentation in the rewarding properties of psychostimulant drugs with repeated exposure. We have tested the hypothesis that psychostimulant exposure interferes with the synaptic plasticity of glutamatergic inputs to the VTA. We find that excitatory synapses onto VTA dopamine neurons exhibit long-term depression (LTD) in response to low-frequency stimulation and modest depolarization. LTD in the VTA is NMDA receptor-independent but is dependent on intracellular Ca(2+) and can be induced by driving Ca(2+) into the dopamine neuron. Brief exposure to amphetamine entirely blocks LTD at glutamatergic synapses in the VTA, by releasing endogenous dopamine that acts at D2 dopamine receptors. The block of LTD is selective, because amphetamine has no effect on hippocampal LTD. The LTD we have discovered in the VTA is likely to be an important component of excitatory control of the reward pathway; amphetamine will inhibit LTD, removing this normal brake on the glutamatergic drive to dopamine neurons. This effect of amphetamine represents an important mechanism by which normal function of the brain reward system may be impaired during substance abuse.

The neurobiology of social phobia: from pharmacotherapy to brain imaging

Social phobia is a common psychiatric disorder that is often associated with significant psychiatric comorbidity and disability. There is currently considerable evidence for the efficacy of pharmacotherapy, especially the selective serotonin reuptake inhibitors, in the treatment of this disorder. In addition, researchers have recently begun to explore the underlying neurobiology of social phobia with results that will likely have important implications for future treatments. This article provides a review of the results to date of controlled medication trials. A review of chemical and neuroendocrine challenges, neurotransmitter functioning, and neuroimaging studies in social phobia is provided, followed by a discussion of the implications of these findings for future treatment and research.

Role of the basal ganglia in the control of purposive saccadic eye movements

In addition to their well-known role in skeletal movements, the basal ganglia control saccadic eye movements (saccades) by means of their connection to the superior colliculus (SC). The SC receives convergent inputs from cerebral cortical areas and the basal ganglia. To make a saccade to an object purposefully, appropriate signals must be selected out of the cortical inputs, in which the basal ganglia play a crucial role. This is done by the sustained inhibitory input from the substantia nigra pars reticulata (SNr) to the SC. This inhibition can be removed by another inhibition from the caudate nucleus (CD) to the SNr, which results in a disinhibition of the SC. The basal ganglia have another mechanism, involving the external segment of the globus pallidus and the subthalamic nucleus, with which the SNr-SC inhibition can further be enhanced. The sensorimotor signals carried by the basal ganglia neurons are strongly modulated depending on the behavioral context, which reflects working memory, expectation, and attention. Expectation of reward is a critical determinant in that the saccade that has been rewarded is facilitated subsequently. The interaction between cortical and dopaminergic inputs to CD neurons may underlie the behavioral adaptation toward purposeful saccades.

Dopamine release in the rat globus pallidus characterised by in vivo microdialysis

Brain microdialysis has been used to examine the in vivo effects of potassium and calcium on dopamine release in the dorsal globus pallidus (GP) of rats. Furthermore, the effects of food presentation and consumption on dopamine release in the GP were investigated. Basal dopamine levels in the GP were below the detection limit, therefore nomifensine (30 microM) was added to the perfused artificial cerebrospinal fluid (aCSF). A prominent increase of dopamine release to 370% was observed after perfusion with elevated potassium (100 mM), while perfusion with calcium-free aCSF produced a significant decrease of dopamine efflux to 36% of control levels. Furthermore, presentation and consumption of food resulted in a rapid increase of extracellular dopamine to 130%. The present experiments demonstrate that in the GP extracellular dopamine can be measured by in vivo brain microdialysis. The data suggest that the dopamine release in the GP can be stimulated by a depolarising agent and involves a partially calcium-dependent release mechanism. The data further suggest that dopamine in basal ganglia structures downstream the striatum as the GP is involved in signalling of important stimuli in the environment, e.g. food.

Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus "natural" (water and food) reward

Electrophysiological recording procedures were used to examine nucleus accumbens (Acb) cell firing in rats trained to press a lever on a multiple schedule [ fixed ratio (FR)1, FR1] for either two "natural" reinforcers (food and water), or a natural reinforcer and intravenous self-administration of cocaine. Of 180 cells recorded during water and food reinforcement (n = 13 rats), 77 neurons were classified as phasically active, exhibiting one of three well-defined types of patterned discharges relative to the reinforced-response (Carelli and Deadwyler, 1994). Of the 77 phasic cells, the majority (68%) showed similar types of patterned discharges across the two natural reinforcer conditions. In contrast, of 127 neurons recorded during water and cocaine reinforcement (n = 8 rats), only 5 of 60 phasically active cells (8%) exhibited similar types of patterned discharges relative to water- and cocaine-reinforced responding. The remaining 55 phasic cells (92%) displayed patterned discharges relative to the cocaine-reinforced response (n = 26 cells), or relative to the water-reinforced response (n = 29 cells), but not both. For some rats (n = 3), food was substituted for water in the task. Again, the majority of phasic neurons (13 of 14 cells, 93%) exhibited nonoverlapping firing patterns across the drug and natural reinforcer conditions. These findings indicate that in the well-trained animal, cocaine activates a neural circuit in the Acb that is largely separate from the circuit that processes information about food and water reward.

Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events

While it has previously been assumed that mesolimbic dopamine neurons carry a reward signal, recent data from single-unit, microdialysis and voltammetry studies suggest that these neurons respond to a large category of salient and arousing events, including appetitive, aversive, high intensity, and novel stimuli. Elevations in dopamine release within mesolimbic, mesocortical and nigrostriatal target sites coincide with arousal, and the increase in dopamine activity within target sites modulates a number of behavioral functions. However, because dopamine neurons respond to a category of salient events that extend beyond that of reward stimuli, dopamine levels are not likely to code for the reward value of encountered events. The paper (i) examines evidence showing that dopamine neurons respond to salient and arousing change in environmental conditions, regardless of the motivational valence of that change, and (ii) asks how this might shape our thinking about the role of dopamine systems in goal-directed behavior.

The adolescent brain and age-related behavioral manifestations

To successfully negotiate the developmental transition between youth and adulthood, adolescents must maneuver this often stressful period while acquiring skills necessary for independence. Certain behavioral features, including age-related increases in social behavior and risk-taking/novelty-seeking, are common among adolescents of diverse mammalian species and may aid in this process. Reduced positive incentive values from stimuli may lead adolescents to pursue new appetitive reinforcers through drug use and other risk-taking behaviors, with their relative insensitivity to drugs supporting comparatively greater per occasion use. Pubertal increases in gonadal hormones are a hallmark of adolescence, although there is little evidence for a simple association of these hormones with behavioral change during adolescence. Prominent developmental transformations are seen in prefrontal cortex and limbic brain regions of adolescents across a variety of species, alterations that include an apparent shift in the balance between mesocortical and mesolimbic dopamine systems. Developmental changes in these stressor-sensitive regions, which are critical for attributing incentive salience to drugs and other stimuli, likely contribute to the unique characteristics of adolescence.

Understanding the neural control of ingestive behaviors: helping to separate cause from effect with dehydration-associated anorexia

Eating and drinking are motivated behaviors that are made up of coordinated sets of neuroendocrine, autonomic, and behavioral motor events. Although the spinal cord, hindbrain, and hypothalamus contain the motor neurons and circuitry sufficient to maintain the reflex parts of these motor events, inputs from the telencephalon are required to furnish the behavioral components with a motivated (goal-directed) character. Each of these motor events derives from the complex interaction of a variety of sensory inputs with groups of neural networks whose components are distributed throughout the brain and collectively support motor expression and coordination. At a first approximation based on a variety of data, these networks can be divided into three groups: networks that stimulate, those that inhibit, and those that disinhibit motor functions. A fourth contributor is the circadian timing signal that originates in the hypothalamic suprachiasmatic nucleus and provides the temporal anchor for the expression of all behaviors. This article discusses the nature of these networks using neuroanatomical (tract-tracing and neuropeptide in situ hybridization), endocrine, and behavioral evidence from a variety of experimental models. A persistent problem when studying the control of food intake from a neural systems perspective has been the difficulty in separating those neuronal changes that result in hunger from those that are as a consequence of eating. To address this problem, dehydration-associated anorexia is presented as a particularly useful experimental model because it can be used to distinguish between neural mechanisms underlying anorexia and those changes that occur as a consequence of anorexia. The article concludes by highlighting the potential role of neuropeptidergic action in the operation of these networks, using forebrain neuropeptidergic innervation of the parabrachial nucleus as an example.

Impact of self-administered cocaine and cocaine cues on extracellular dopamine in mesolimbic and sensorimotor striatum in rhesus monkeys

Studies were conducted to determine the impact of self-administered cocaine on extracellular striatal dopamine in four rhesus monkeys. The extent to which external cue conditioning contributed to the effects of cocaine and whether there is activation of striatal dopaminergic neurotransmission during drug-seeking behavior was also examined. Microdialysis measurements were made at 2 min intervals in sensorimotor (dorsolateral) and mesolimbic (central and ventromedial) striatum. A fixed-ratio schedule of reinforcement was used, with cocaine availability signaled by a visual cue. Studies examined the effects of cocaine or cocaine cues against a drug-free baseline. Large (fivefold to eightfold) increases in extracellular dopamine after a self-administered infusion of 0.5 mg/kg cocaine were quite rapid and matched the time course of reported subjective effects in human laboratory studies. To determine if conditioning to external cues contributed to the cocaine-induced increases, saline was substituted for cocaine in the infusion, leaving all other visual and auditory stimuli unchanged. No increase in extracellular dopamine in either sensorimotor or mesolimbic striatal subdivisions was observed. Extracellular dopamine during extended periods of drug-seeking behavior triggered by a visual cue was determined in both central and ventromedial striatum. This procedure also did not result in any measurable changes in extracellular dopamine. These studies demonstrate rapid and pronounced pharmacological actions of self-administered cocaine. No apparent conditioned component of those actions was associated with external environmental cues, suggesting that cues that trigger drug-seeking behavior in nonhuman primates do not cause conditioned increases in mesolimbic striatal dopamine.

Differential amygdala responses to winning and losing: a functional magnetic resonance imaging study in humans

The amygdala has been shown to respond to many distinct types of affective stimuli, including reward and punishment feedback in animals. In humans, winning and losing situations can be considered as reward and punishment experiences, respectively. In this study, we used functional magnetic resonance imaging (fMRI) to measure regional brain activity when human subjects were given feedback on their performance during a simple response time task in a fictitious competitive tournament. Lexical stimuli were used to convey positive 'win' or negative 'lose' feedback. The frequency of positive and negative trials was parametrically varied by the experimenters independently from the subjects' actual performance and unbeknownst to them. The results showed that the parametric increase of winning was associated with left amygdala activation whereas the parametric increase of losing was associated with right amygdala activation. These findings provide functional evidence that the human amygdala differentially responds to changes in magnitude of positive or negative reinforcement conveyed by lexical stimuli.

Dopamine and synaptic plasticity in the neostriatum

After the unilateral destruction of the dopamine input to the neostriatum there are enduring changes in rat behaviour. These have been ascribed to the loss of dopamine and the animals are often referred to as 'hemiparkinsonian'. In the denervated neostriatum, we have shown that not only are the tyrosine hydroxylase positive boutons missing, but also the medium sized densely spiny output cells have fewer spines. Spines usually have asymmetric synapses on their heads. In a recent stereological study we were able to show that there is a loss of approximately 20% of asymmetric synapses in the lesioned neostriatum by 1 mo after the lesion. Current experiments are trying to establish the specificity of this loss. So far we have evidence suggesting that there is no obvious preferential loss of synapses from either D1 or D2 receptor immunostained dendrites in the neostriatum with damaged dopamine innervation. These experiments suggest that dopamine is somehow necessary for the maintenance of corticostriatal synapses in the neostriatum. In a different series of experiments slices of cortex and neostriatum were maintained in vitro in such a way as to preserve at least some of the corticostriatal connections. In this preparation we have been able to show that cortical stimulation results in robust excitatory postsynaptic potentials (EPSPs) recorded from inside striatal neurons. Using stimulation protocols derived from the experiments on hippocampal synaptic plasticity we have shown that the usual consequence of trains of high frequency stimulation of the cortex is the depression of the size of EPSPs in the striatal cell. In agreement with similar experiments by others, the effect seems to be influenced by NMDA receptors since the unblocking of these receptors with low Mg++ concentrations in the perfusate uncovers a potentiation of the EPSPs after trains of stimulation. Dopamine applied in the perfusion fluid round the slices has no effect but pulsatile application of dopamine, close to the striatal cell being recorded from, and in temporal association with the cortical trains, leads to a similar LTP like effect. The reduction of K+ channel conductance in the bath with TEA also has the effect of making cortical trains induce potentiation of corticostriatal transmission. TEA applied only to the cell being recorded from has no similar effect; the cortical stimulation again depresses the EPSP amplitude, so the site of action of TEA may well be presynaptic to the striatal cell. The morphological and physiological experiments may not necessarily be related but it is tempting to suggest that dopamine protects some corticostriatal synapses by potentiating them but that in the absence of dopamine others simply disconnect and are no longer detectable on electron microscopy.

Contextual modulation of substantia nigra pars reticulata neurons

Neurons in the substantia nigra pars reticulata (SNr) are known to encode saccadic eye movements within some, but not all, behavioral contexts. However, the precise contextual factors that effect the modulations of nigral activity are still uncertain. To further examine the effect of behavioral context on the SNr, we recorded the activity of 72 neurons while monkeys made saccades during a delayed saccade task and during periods of free viewing. We quantified and compared the movement fields of each neuron for saccades made under three different conditions: 1) spontaneous saccades, which shifted gaze during periods of free viewing when no stimuli were presented and no reinforcements were delivered; 2) fixational saccades, which brought gaze into alignment with a fixation target at the start of a delayed saccade trial, were necessary for trial completion, but were not directly followed by reinforcement; and 3) terminal saccades, which brought gaze into alignment with a visual target at the end of a delayed saccade trial and were directly followed by reinforcement. For three of the four SNr neuron classes, saccade-related modulations were only present before terminal saccades. For the fourth class, discrete pausers, saccade-related modulations were substantially larger for terminal saccades than for fixational saccades, and modulations were absent for spontaneous saccades. These results and other recent work on the basal ganglia suggest that some saccade-related signals in the SNr may be influenced by the reinforcement associated with a particular saccadic eye movement.

Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex

This study investigated how neuronal activity in orbitofrontal cortex related to the expectation of reward changed while monkeys repeatedly learned to associate new instruction pictures with known behavioral reactions and reinforcers. In a delayed go-nogo task with several trial types, an initial picture instructed the animal to execute or withhold a reaching movement and to expect a liquid reward or a conditioned auditory reinforcer. When novel instruction pictures were presented, animals learned according to a trial-and-error strategy. After experience with a large number of novel pictures, learning occurred in a few trials, and correct performance usually exceeded 70% in the first 60-90 trials. About 150 task-related neurons in orbitofrontal cortex were studied in both familiar and learning conditions and showed two major forms of changes during learning. Quantitative changes of responses to the initial instruction were seen as appearance of new responses, increase of existing responses, or decrease or complete disappearance of responses. The changes usually outlasted initial learning trials and persisted during subsequent consolidation. They often modified the trial selectivities of activations. Increases might reflect the increased attention during learning and induce neuronal changes underlying the behavioral adaptations. Decreases might be related to the unreliable reward-predicting value of frequently changing learning instructions. The second form of changes reflected the adaptation of reward expectations during learning. In initial learning trials, animals reacted as if they expected liquid reward in every trial type, although only two of the three trial types were rewarded with liquid. In close correspondence, neuronal activations related to the expectation of reward occurred initially in every trial type. The behavioral indices for reward expectation and their neuronal correlates adapted in parallel during the course of learning and became restricted to rewarded trials. In conclusion, these data support the notion that neurons in orbitofrontal cortex code reward information in a flexible and adaptive manner during behavioral changes after novel stimuli.

Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules

Anatomic and behavioral evidence shows that TE and perirhinal cortices are two directly connected but distinct inferior temporal areas. Despite this distinctness, physiological properties of neurons in these two areas generally have been similar with neurons in both areas showing selectivity for complex visual patterns and showing response modulations related to behavioral context in the sequential delayed match-to-sample (DMS) trials, attention, and stimulus familiarity. Here we identify physiological differences in the neuronal activity of these two areas. We recorded single neurons from area TE and perirhinal cortex while the monkeys performed a simple behavioral task using randomly interleaved visually cued reward schedules of one, two, or three DMS trials. The monkeys used the cue's relation to the reward schedule (indicated by the brightness) to adjust their behavioral performance. They performed most quickly and most accurately in trials in which reward was immediately forthcoming and progressively less well as more intermediate trials remained. Thus the monkeys appeared more motivated as they progressed through the trial schedule. Neurons in both TE and perirhinal cortex responded to both the visual cues related to the reward schedules and the stimulus patterns used in the DMS trials. As expected, neurons in both areas showed response selectivity to the DMS patterns, and significant, but small, modulations related to the behavioral context in the DMS trial. However, TE and perirhinal neurons showed strikingly different response properties. The latency distribution of perirhinal responses was centered 66 ms later than the distribution of TE responses, a larger difference than the 10-15 ms usually found in sequentially connected visual cortical areas. In TE, cue-related responses were related to the cue's brightness. In perirhinal cortex, cue-related responses were related to the trial schedules independently of the cue's brightness. For example, some perirhinal neurons responded in the first trial of any reward schedule including the one trial schedule, whereas other neurons failed to respond in the first trial but respond in the last trial of any schedule. The majority of perirhinal neurons had more complicated relations to the schedule. The cue-related activity of TE neurons is interpreted most parsimoniously as a response to the stimulus brightness, whereas the cue-related activity of perirhinal neurons is interpreted most parsimoniously as carrying associative information about the animal's progress through the reward schedule. Perirhinal cortex may be part of a system gauging the relation between work schedules and rewards.

Selective inhibition by adenosine of mGluR IPSPs in dopamine neurons after cocaine treatment

With repeated exposure to psychostimulants such as cocaine and amphetamine, long-lasting changes occur in the mesolimbic dopamine system that are thought to underlie continued drug-seeking and relapse. One consequence of repeated cocaine treatment is an increase in extracellular adenosine in the ventral tegmental area (VTA), which results in tonic inhibition of synaptic input to dopamine neurons. The synapse specificity of this increased adenosine tone was examined on glutamate- and GABA-mediated responses using the selective A1 receptor antagonist 1, 3-dipropyl-8-cyclopentylxanthine (DPCPX). The slow, metabotropic glutamate receptor (mGluR)-mediated inhibitory postsynaptic potential (IPSP) was enhanced by DPCPX only in slices from psychostimulant-treated animals. Under resting conditions, DPCPX was without effect on fast excitatory postsynaptic currents (EPSCs) in slices from saline- or cocaine-treated animals. However, in the presence of amphetamine, DPCPX did augment fast EPSCs in slices from cocaine-treated rats. Although DPCPX increased GABA(B) IPSPs, the magnitude of the increase was not altered by cocaine pretreatment, even in the presence of amphetamine. This suggests that the elevated adenosine tone induced by cocaine treatment acts preferentially on glutamate terminals. Furthermore, the inhibition of the mGluR IPSP by endogenous adenosine may result in more effective burst firing mediated by glutamate afferents in cocaine-treated rats, a phenomenon known to enhance dopamine release.

Chemical stimulation of the ventral hippocampus elevates nucleus accumbens dopamine by activating dopaminergic neurons of the ventral tegmental area

Dual-probe microdialysis (with HPLC and electrochemical detection) in freely moving rats and single-unit recording in anesthetized rats were used to study the extent to which impulse flow through the ventral tegmental area (VTA) contributes to elevations in nucleus accumbens (NAS) dopamine (DA) evoked by stimulation of the ventral subiculum (VS). During perfusion of artificial extracellular fluid into the VTA, injections of 0.74 microgram of the excitatory amino acid NMDA into the VS elevated accumbens DA to >150% of basal values. During intra-VTA perfusion of either 1 microM tetrodotoxin (which blocks impulse flow) or 1 mM kynurenic acid (which blocks excitatory glutamate receptors), injections of NMDA into the VS failed to elevate accumbens DA. Thus, increased impulse flow through VTA DA neurons, mediated by excitatory glutamate inputs to this region, appears critical for VS stimulation to elevate NAS DA. Increased impulse flow through VTA DA neurons was confirmed using single-unit recording in anesthetized rats. Intra-VS NMDA injections increased the firing rates of 45% (14 of 31), decreased the firing rates of 13% (4 of 31), and had no effect on 42% (13 of 31) of VTA DA neurons. Increases in firing rates were evident within 15 min of NMDA injections, a time at which VS NMDA injections elevate accumbens DA in awake animals. The results of the present experiments identify the VTA as a critical site through which outputs from the VS modulate NAS dopaminergic neurotransmission.

Fos protein expression and cocaine-seeking behavior in rats after exposure to a cocaine self-administration environment

To examine neuronal activation associated with incentive motivation for cocaine, cocaine-seeking behavior (operant responding without cocaine reinforcement) and Fos expression were examined in rats exposed to saline and cocaine priming injections and/or a self-administration environment. Rats were first trained to self-administer cocaine or received yoked saline administration ("control"). They then received 21 daily exposures to either the self-administration environment ("extinction") or a different environment ("no extinction") without cocaine available. Extinction training, used to decrease incentive motivation for cocaine elicited by the self-administration environment, decreased cocaine-seeking behavior elicited by both the environment and the cocaine priming injection. Exposure to the self-administration environment enhanced Fos expression in the no extinction group relative to control and extinction groups in the anterior cingulate, basolateral amygdala, hippocampal CA1 region, dentate gyrus, nucleus accumbens shell and core, and central gray area, regardless of whether or not priming injections were given. The priming injections enhanced Fos expression in the ventral tegmental area, caudate putamen, substantia nigra pars reticulata, entorhinal cortex, central amygdala, lateral amygdala, arcuate nucleus, and central gray area, regardless of group. Thus, these changes likely reflect an unconditioned effect from either cocaine or injection stress. The priming injections also enhanced Fos expression in the anterior cingulate, but only in cocaine-experienced groups, suggesting that this enhancement reflects an experience-dependent motivational effect of the priming injections. The results suggest that different neural circuits may be involved in the incentive motivational effects of cocaine-paired environmental stimuli versus priming injections and that the anterior cingulate may be part of a common pathway for both.