Firing modes of midbrain dopamine cells in the freely moving rat

Dealing with the devil in the detail - some thoughts about the next model of the basal ganglia

Any simplified description of a brain system that survives 20 years is bound to have some problems. Twenty years of research should have added details that were not known when the now classical description of the basal ganglia circuitry was new. Some examples of such new information about the parts of the original model include: All of these details make it difficult to cling to the model as it was presented, but which of the new information will support a new synthesis? Do we have a coherent replacement for those powerfully heuristic ideas put forward by Albin Young and Penny in 1989? Perhaps in the quantitative anatomical detail there is a plan that may support a new theory. If all of the cortex is not accessible to every striatal cell. If dopamine influences many spines rather than the one it contacts. If we stop looking for a mechanical control system for movement in the basal ganglia and begin to investigate the predictive properties of 'reinforcement learning'. Then maybe a new functional model will emerge that is less tied to anatomical and physiological simplification, but perhaps will still allow us to engineer therapeutic strategies to help patients with movement disorders.

Striatal muscarinic receptors promote activity dependence of dopamine transmission via distinct receptor subtypes on cholinergic interneurons in ventral versus dorsal striatum

Striatal dopamine (DA) and acetylcholine (ACh) regulate motivated behaviors and striatal plasticity. Interactions between these neurotransmitters may be important, through synchronous changes in parent neuron activities and reciprocal presynaptic regulation of release. How DA signaling is regulated by striatal muscarinic receptors (mAChRs) is unresolved; contradictory reports indicate suppression or facilitation, implicating several mAChR subtypes on various neurons. We investigated whether mAChR regulation of DA signaling varies with presynaptic activity and identified the mAChRs responsible in sensorimotor- versus limbic-associated striatum. We detected DA in real time at carbon fiber microelectrodes in mouse striatal slices. Broad-spectrum mAChR agonists [oxotremorine-M, APET (arecaidine propargyl ester tosylate)] decreased DA release evoked by low-frequency stimuli (1-10 Hz, four pulses) but increased the sensitivity of DA release to presynaptic activity, even enhancing release by high frequencies (e.g., >25 Hz for four pulses). These bidirectional effects depended on ACh input to striatal nicotinic receptors (nAChRs) on DA axons but not GABA or glutamate input. In caudate-putamen (CPu), knock-out of M(2)- or M(4)-mAChRs (not M(5)) prevented mAChR control of DA, indicating that M(2)- and M(4)-mAChRs are required. In nucleus accumbens (NAc) core or shell, mAChR function was prevented in M(4)-knock-outs, but not M(2)- or M(5)-knock-outs. These data indicate that striatal mAChRs, by inhibiting ACh release from cholinergic interneurons and thus modifying nAChR activity, offer variable control of DA release probability that promotes how DA release reflects activation of dopaminergic axons. Furthermore, different coupling of striatal M(2)/M(4)-mAChRs to the control of DA release in CPu versus NAc suggests targets to influence DA/ACh function differentially between striatal domains.

Neural bases for addictive properties of benzodiazepines

Benzodiazepines are widely used in clinics and for recreational purposes, but will lead to addiction in vulnerable individuals. Addictive drugs increase the levels of dopamine and also trigger long-lasting synaptic adaptations in the mesolimbic reward system that ultimately may induce the pathological behaviour. The neural basis for the addictive nature of benzodiazepines, however, remains elusive. Here we show that benzodiazepines increase firing of dopamine neurons of the ventral tegmental area through the positive modulation of GABA(A) (gamma-aminobutyric acid type A) receptors in nearby interneurons. Such disinhibition, which relies on alpha1-containing GABA(A) receptors expressed in these cells, triggers drug-evoked synaptic plasticity in excitatory afferents onto dopamine neurons and underlies drug reinforcement. Taken together, our data provide evidence that benzodiazepines share defining pharmacological features of addictive drugs through cell-type-specific expression of alpha1-containing GABA(A) receptors in the ventral tegmental area. The data also indicate that subunit-selective benzodiazepines sparing alpha1 may be devoid of addiction liability.

An intrinsic neuronal oscillator underlies dopaminergic neuron bursting

Dopaminergic neurons of the ventral midbrain fire high-frequency bursts when animals are presented with unexpected rewards, or stimuli that predict reward. To identify the afferents that can initiate bursting and establish therapeutic strategies for diseases affected by altered bursting, a mechanistic understanding of bursting is essential. Our results show that bursting is initiated by a specific interaction between the voltage sensitivity of NMDA receptors and voltage-gated ion channels that results in the activation of an intrinsic, action potential-independent, high-frequency membrane potential oscillation. We further show that the NMDA receptor is uniquely suited for this because of the rapid kinetics and voltage dependence imparted to it by Mg(2+) ion block and unblock. This mechanism explains the discrete nature of bursting in dopaminergic cells and demonstrates how synaptic signals may be reshaped by local intrinsic properties of a neuron before influencing action potential generation.

Cav1.3 channel voltage dependence, not Ca2+ selectivity, drives pacemaker activity and amplifies bursts in nigral dopamine neurons

Ca(v)1.3 (alpha 1D) L-type Ca(2+) channels have been implicated in substantia nigra (SN) dopamine (DA) neuron pacemaking and vulnerability to Parkinson's disease. These effects may arise from the depolarizing current and cytoplasmic Ca(2+) elevation produced by Ca(v)1.3 channels at subthreshold membrane potentials. However, the assumption that the Ca(2+) selectivity of Ca(v)1.3 channels is essential has not been tested. In this study the properties of SN DA neuron L-type Ca(2+) channels responsible for driving pacemaker activity in juvenile rat brain slices were probed by replacing native channels blocked with the dihydropyridine nimodipine with virtual channels generated by dynamic clamp. Surprisingly, virtual L-type channels that mimic native and recombinant Ca(v)1.3 channels supported pacemaker activity even though dynamic clamp currents are not carried by Ca(2+). This effect is specific because pacemaker activity could not be restored by tonic current injection, virtual nonselective leak channels or virtual NMDA receptors, which share with L-type channels a negative slope conductance region in their current-voltage (I-V) curve. Altering virtual channels showed that the production of pacemaker activity depended on the characteristic voltage dependence of DA neuron L-type channels, while activation kinetics and reversal potential were not critical parameters. Virtual L-type channels also supported slow oscillatory potentials and enhanced firing rate during evoked bursts. Thus, Ca(v)1.3 channel voltage dependence, rather than Ca(2+) selectivity, drives pacemaker activity and amplifies bursts in SN DA neurons.

Cellular mechanisms underlying burst firing in substantia nigra dopamine neurons

Burst firing of substantia nigra dopamine (SN DA) neurons is believed to represent an important teaching signal that instructs synaptic plasticity and associative learning. However, the mechanisms through which synaptic excitation overcomes the limiting effects of somatic Ca(2+)-dependent K(+) current to generate burst firing are controversial. Modeling studies suggest that synaptic excitation sufficiently amplifies oscillatory dendritic Ca(2+) and Na(+) channel currents to lead to the initiation of high-frequency firing in SN DA neuron dendrites. To test this model, visually guided compartment-specific patch-clamp recording and ion channel manipulation were applied to rodent SN DA neurons in vitro. As suggested previously, the axon of SN DA neurons was typically found to originate from a large-diameter dendrite that was proximal to the soma. However, in contrast to the predictions of the model, (1) somatic current injection generated firing that was similar in frequency and form to burst firing in vivo, (2) the efficacy of glutamatergic excitation was inversely related to the distance of excitation from the axon, (3) pharmacological blockade or genetic deletion of Ca(2+) channels did not prevent high-frequency firing, (4) action potential bursts were invariably detected first at sites that were proximal to the axon, and (5) pharmacological blockade of Na(+) channels in the vicinity of the axon/soma but not dendritic excitation impaired burst firing. Together, these data suggest that SN DA neurons integrate their synaptic input in a more conventional manner than was hypothesized previously.

Dopamine signaling in the nucleus accumbens of animals self-administering drugs of abuse

Abuse of psychoactive substances can lead to drug addiction. In animals, addiction is best modeled by drug self-administration paradigms. It has been proposed that the crucial common denominator for the development of drug addiction is the ability of drugs of abuse to increase extracellular concentrations of dopamine in the nucleus accumbens (NAcc). Studies using in vivo microdialysis and chronoamperometry in the behaving animal have demonstrated that drugs of abuse increase tonic dopamine concentrations in the NAcc. However, it is known that dopamine neurons respond to reward-related stimuli on a subsecond timescale. Thus, it is necessary to collect neurochemical information with this level of temporal resolution, as achieved with in vivo fast-scan cyclic voltammetry (FSCV), to fully understand the role of phasic dopamine release in normal behavior and drug addiction. We review studies that investigated the effects of drugs of abuse on NAcc dopamine levels in freely moving animals using in vivo microdialysis, chronoamperometry, and FSCV. After a brief introduction of dopamine signal transduction and anatomy and a section on current theories on the role of dopamine in natural goal-directed behavior, a discussion of techniques for the in vivo assessment of extracellular dopamine in behaving animals is presented. Then, we review studies using these techniques to investigate changes in phasic and tonic dopamine signaling in the NAcc during (1) response-dependent and -independent administration of abused drugs, (2) the presentation of drug-conditioned stimuli and operant behavior in self-administration paradigms, (3) drug withdrawal, and (4) cue-induced reinstatement of drug seeking. These results are then integrated with current ideas on the role of dopamine in addiction with an emphasis on a model illustrating phasic and tonic NAcc dopamine signaling during different stages of drug addiction. This model predicts that phasic dopamine release in response to drug-related stimuli will be enhanced over stimuli associated with natural reinforcers, which may result in aberrant goal-directed behaviors contributing to drug addiction.

Ethanol action on dopaminergic neurons in the ventral tegmental area: interaction with intrinsic ion channels and neurotransmitter inputs

The dopaminergic system originating in the midbrain ventral tegmental area (VTA) has been extensively studied over the past decades as a critical neural substrate involved in the development of alcoholism and addiction to other drugs of abuse. Accumulating evidence indicates that ethanol modulates the functional output of this system by directly affecting the firing activity of VTA dopamine neurons, whereas withdrawal from chronic ethanol exposure leads to a reduction in the functional output of these neurons. This chapter will provide an update on the mechanistic investigations of the acute ethanol action on dopamine neuron activity and the neuroadaptations/plasticities in the VTA produced by previous ethanol experience.

Route of nicotine administration influences in vivo dopamine neuron activity: habituation, needle injection, and cannula infusion

Mesolimbic dopamine (DA) systems play a critical role in tobacco addiction driven by nicotine. Nicotine activates midbrain DA neurons and, consequently, elevates DA concentrations in targets, especially in the nucleus accumbens (NAc) of the ventral striatum. The route of drug administration influences the impact of addictive drugs. Here, we examine whether the nature of the administration alters DA neuron activity and DA concentrations in the NAc. Using unhabituated naïve freely moving rats, microdialysis measurements showed that nicotine administered via needle injection caused greater DA release in the NAc than the same dose administered via an implanted chronic cannula. After habituation to the needle injections, however, there was no significant difference in DA signaling between the needle and cannula routes of administration. Consistent with these microdialysis results after habituation, our in vivo tetrode unit recordings showed no significant difference in midbrain DA neuron activity in response to nicotine delivered by needle or cannula as long as predictive cues were avoided

Metabolic hormones, dopamine circuits, and feeding

Recent evidence has emerged demonstrating that metabolic hormones such as ghrelin and leptin can act on ventral tegmental area (VTA) midbrain dopamine neurons to influence feeding. The VTA is the origin of mesolimbic dopamine neurons that project to the nucleus accumbens (NAc) to influence behavior. While blockade of dopamine via systemic antagonists or targeted gene delete can impair food intake, local NAc dopamine manipulations have little effect on food intake. Notably, non-dopaminergic manipulations in the VTA and NAc produce more consistent effects on feeding and food choice. More recent genetic evidence supports a role for the substantia nigra-striatal dopamine pathways in food intake, while the VTA-NAc circuit is more likely involved in higher-order aspects of food acquisition, such as motivation and cue associations. This rich and complex literature should be considered in models of how peripheral hormones influence feeding behavior via action on the midbrain circuits.

Dysregulation of intracellular dopamine stores revealed in the R6/2 mouse striatum

Huntington's disease (HD) is a fatal, neurodegenerative movement disorder characterized by preferential and extensive striatal degeneration. Here, we used fast-scan cyclic voltammetry to study the mobilization and efflux of reserve pool dopamine (DA) in striatal brain slices from HD model R6/2 mice. When applying stimulus trains of 120 pulses, evoked DA release in wild-type (WT) slices was greater than that in R6/2 slices at the higher frequencies (50 and 60 Hz). To quantify cytosolic and reserve pool DA levels, amphetamine-induced DA efflux was measured after pre-treatment with either tetrabenazine or alpha-methyl-p-tyrosine. Slices from 12-week-old R6/2 mice released less DA than slices from WT mice, while no difference was noted in slices from 6-week old mice. The vesicular release of reserve pool DA, mobilized by treatment with cocaine, was shorter lived in R6/2 slices compared with WT slices even though peak DA release was the same. Moreover, the number of DA reserve pool vesicles in R6/2 mice was less than half of that in WT. Therefore, our data suggest that the same number of DA molecules are present in each reserve pool vesicle in WT and R6/2 mice and that these vesicles are readily mobilized in both genotypes; however, R6/2 mice have fewer DA reserve pool vesicles available for mobilization.

How conditioned stimuli acquire the ability to activate VTA dopamine cells: a proposed neurobiological component of reward-related learning

The ability to learn about conditioned stimuli (CS) associated with rewards is a crucial adaptive mechanism. Activity in the mesocorticolimbic dopamine (DA) system, as well as in the ventral tegmental area (VTA), is correlated with responding to and learning about CSs. The mechanism by which VTA neurons become activated by signals associated with conditioned stimuli is not fully understood. Our model suggests that NMDA receptor stimulation in the VTA allows originally weak glutamate signals carrying information about environmental stimuli, coincident with strong excitation correlated with primary rewards, to be strengthened and thereby acquire the ability to activate VTA neurons in themselves, producing approach. Furthermore, once synaptic strengthening occurs, the model suggests that NMDA receptor stimulation in VTA is not necessary for the expression of reward-related learning. In this review we survey evidence that VTA cells respond to cues associated with primary rewards, that this responding is acquired, and that the VTA possesses the attributes to function as a site of integration of signals of primary and conditioned stimuli.

Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats

Drug seeking is significantly regulated by drug-associated cues and associative learning between environmental cues and cocaine reward is mediated by dopamine transmission within the nucleus accumbens (NAc). However, dopamine transmission during early acquisition of a cue-cocaine association has never been assessed because of the technical difficulties associated with resolving cue-evoked and cocaine-evoked dopamine release within the same conditioning trial. Here, we used fast-scan cyclic voltammetry to measure sub-second fluctuations in dopamine concentration within the NAc core and shell during the initial acquisition of a cue-cocaine Pavlovian association. Within the NAc core, cue-evoked dopamine release developed during conditioning. However, within the NAc shell, the predictive cue appeared to cause an unconditioned decrease in dopamine concentration. The pharmacological effects of cocaine also differed between sub-regions, as cocaine increased phasic dopamine release events within the NAc shell but not the core. Thus, real-time measurements not only revealed the initial development of a conditioned neurochemical response but also demonstrated differential phasic dopamine transmission patterns across NAc sub-regions during the acquisition of a cue-cocaine association.

Nicotinic acetylcholine receptors and the ascending dopamine pathways

Nicotinic acetylcholine receptors (nAChRs) are widely expressed in midbrain dopamine neurons that project to dorsal striatum, nucleus accumbens and prefrontal cortex. Thus nAChRs can influence the functions of these three pathways, notably motor control, 'reward' and executive function, respectively. Diverse subtypes of nAChRs have been identified on dopamine cell bodies and terminals as well as on neighbouring afferents and interneurons. Here we review the molecular and cellular mechanisms through which nAChRs exert their influence on these pathways in rodents.

Endogenous calcium buffering capacity of substantia nigral dopamine neurons

Dopamine (DA)-containing cells from the substantia nigra pars compacta (SNc) play a major role in the initiation of movement. Loss of these cells results in Parkinson's disease (PD). Changes in intracellular calcium ion concentration ([Ca(2+)](i)) elicit several events in DA cells, including spike afterhyperpolarizations (AHPs) and subthreshold oscillations underlying autonomous firing. Continuous Ca(2+) load due to Ca(2+)-dependent rhythmicity has been proposed to cause the death of DA cells in PD and normal aging. Because of the physiological and pathophysiological importance of [Ca(2+)](i) in DA cells, we characterized their intrinsic Ca(2+)-buffering capacity (K(S)) in brain slices. We introduced a fluorescent Ca(2+)-sensitive exogenous buffer (200 microM fura-2) and cells were tracked from break-in until steady state by stimulating with a single action potential (AP) every 30 s and measuring the Ca(2+) transient from the proximal dendrite. DA neurons filled exponentially with a tau of about 5-6 min. [Ca(2+)](i) was assumed to equilibrate between the endogenous Ca(2+) buffer and the exogenous Ca(2+) indicator buffer. Intrinsic buffering was estimated by extrapolating from the linear relationships between the amplitude or time constant of the Ca(2+) transients versus [fura-2]. Extrapolated Ca(2+)-transients in the absence of fura-2 had mean peak amplitudes of 293.7 +/- 65.3 nM and tau = 124 +/- 13 ms (postnatal day 13 [P13] to P17 animals). Intrinsic buffering increased with age in DA neurons. For cells from animals P13-P17, K(S) was estimated to be about 110 (n = 20). In older animals (P25-P32), the estimate was about 179 (n = 10). These relatively low values may reflect the need for rapid Ca(2+) signaling, e.g., to allow activation of sK channels, which shape autonomous oscillations and burst firing. Low intrinsic buffering may also make DA cells vulnerable to Ca(2+)-dependent pathology.

Homeostatic mechanisms in dopamine synthesis and release: a mathematical model

BACKGROUND

Dopamine is a catecholamine that is used as a neurotransmitter both in the periphery and in the central nervous system. Dysfunction in various dopaminergic systems is known to be associated with various disorders, including schizophrenia, Parkinson's disease, and Tourette's syndrome. Furthermore, microdialysis studies have shown that addictive drugs increase extracellular dopamine and brain imaging has shown a correlation between euphoria and psycho-stimulant-induced increases in extracellular dopamine 1. These consequences of dopamine dysfunction indicate the importance of maintaining dopamine functionality through homeostatic mechanisms that have been attributed to the delicate balance between synthesis, storage, release, metabolism, and reuptake.

METHODS

We construct a mathematical model of dopamine synthesis, release, and reuptake and use it to study homeostasis in single dopaminergic neuron terminals. We investigate the substrate inhibition of tyrosine hydroxylase by tyrosine, the consequences of the rapid uptake of extracellular dopamine by the dopamine transporters, and the effects of the autoreceoptors on dopaminergic function. The main focus is to understand the regulation and control of synthesis and release and to explicate and interpret experimental findings.

RESULTS

We show that the substrate inhibition of tyrosine hydroxylase by tyrosine stabilizes cytosolic and vesicular dopamine against changes in tyrosine availability due to meals. We find that the autoreceptors dampen the fluctuations in extracellular dopamine caused by changes in tyrosine hydroxylase expression and changes in the rate of firing. We show that short bursts of action potentials create significant dopamine signals against the background of tonic firing. We explain the observed time courses of extracellular dopamine responses to stimulation in wild type mice and mice that have genetically altered dopamine transporter densities and the observed half-lives of extracellular dopamine under various treatment protocols.

CONCLUSION

Dopaminergic systems must respond robustly to important biological signals such as bursts, while at the same time maintaining homeostasis in the face of normal biological fluctuations in inputs, expression levels, and firing rates. This is accomplished through the cooperative effect of many different homeostatic mechanisms including special properties of tyrosine hydroxylase, the dopamine transporters, and the dopamine autoreceptors.

Tonic autoinhibition contributes to the heterogeneity of evoked dopamine release in the rat striatum

Electrically evoked dopamine release as measured by voltammetry in the rat striatum is heterogeneous in both amplitude and temporal profile. Previous studies have attributed this heterogeneity to variations in the density of dopamine (DA) terminals at the recording site. We reach the alternate conclusion that the heterogeneity of evoked DA release derives from variations in the extent to which DA terminals are autoinhibited. We demonstrate that low-amplitude, slow evoked DA responses occur even though recording electrodes are close to DA terminals. Moreover, the D(2) agonist and antagonist, quinpirole and raclopride, respectively, affect the slow responses in a manner consistent with the known functions of pre-synaptic D(2) autoreceptors. Recording sites that exhibit autoinhibited responses are prevalent in the dorsal striatum. Autoinhibition preceded electrical stimulation, which is consistent with our prior reports that the striatum contains a tonic pool of extracellular DA at basal concentrations that exceed the affinity of D(2) receptors. We conclude that the striatum contains DA terminals operating on multiple time courses, determined at least in part by the local variation in autoinhibition. Thus, we provide direct, real-time observations of the functional consequence of tonic and phasic DAergic signaling in vivo.

Controls of tonic and phasic dopamine transmission in the dorsal and ventral striatum

Dopamine (DA) release varies within subregions and local environments of the striatum, suggesting that controls intrinsic and extrinsic to the DA fibers and terminals regulate release. While applying fast-scan cyclic voltammetry and using tonic and phasic stimulus trains, we investigated the regulation of DA release in the dorsolateral to ventral striatum. The ratio of phasic-to-tonic-evoked DA signals varied with the average ongoing firing frequency, and the ratio was generally higher in the nucleus accumbens (NAc) compared with the dorsolateral striatum. At the normal average firing frequency, burst stimulation produces a larger increase in the DA response in the NAc than the dorsolateral striatum. This finding was comparable whether the DA measurements were made using in vitro brain slices or were recorded in vivo from freely moving rodents. Blockade of the dopamine transporters and dopamine D(2) receptors particularly enhanced the tonic DA signals. Conversely, blockade of nicotinic acetylcholine receptors (nAChRs) containing the beta(2) subunit (beta(2)(*)) predominantly suppressed tonic DA signals. The suppression of tonic DA release increased the contrast between phasic and tonic DA signals, and that made the frequency-dependent DA dynamics between the dorsolateral striatum and NAc more similar. The results indicate that intrinsic differences in the DA fibers that innervate specific regions of the striatum combine with (at least) DA transporters, DA receptors, and nAChRs to regulate the frequency dependence of DA release. A combination of mechanisms provides specific local control of DA release that underlies pathway-specific information associated with motor and reward-related functions.

Neurobiology of ADHD

Attention-deficit hyperactivity disorder (ADHD) is a prevalent and debilitating disorder diagnosed on the basis of persistent and developmentally-inappropriate levels of overactivity, inattention and impulsivity. The etiology and pathophysiology of ADHD is incompletely understood. There is evidence of a genetic basis for ADHD but it is likely to involve many genes of small individual effect. Differences in the dimensions of the frontal lobes, caudate nucleus, and cerebellar vermis have been demonstrated. Neuropsychological testing has revealed a number of well documented differences between children with and without ADHD. These occur in two main domains: executive function and motivation although neither of these is specific to ADHD. In view of the recent advances in the neurobiology of reinforcement, we concentrate in this review on altered reinforcement mechanisms. Among the motivational differences, many pieces of evidence indicate that an altered response to reinforcement may play a central role in the symptoms of ADHD. In particular, sensitivity to delay of reinforcement appears to be a reliable finding. We review neurobiological mechanisms of reinforcement and discuss how these may be altered in ADHD, with particular focus on the neurotransmitter dopamine and its actions at the cellular and systems level. We describe how dopamine cell firing activity is normally associated with reinforcing events, and transfers to earlier time-points in the behavioural sequence as reinforcement becomes more predictable. We discuss how a failure of this transfer may give rise to many symptoms of ADHD, and propose that methylphenidate might act to compensate for the proposed dopamine transfer deficit.

Disparity between tonic and phasic ethanol-induced dopamine increases in the nucleus accumbens of rats

BACKGROUND

Dopamine concentrations in the nucleus accumbens fluctuate on phasic (subsecond) and tonic (over minutes) timescales in awake rats. Acute ethanol increases tonic concentrations of dopamine, but its effect on subsecond dopamine transients has not been fully explored.

METHODS

We measured tonic and phasic dopamine fluctuations in the nucleus accumbens of rats in response to ethanol (within-subject cumulative dosing, 0.125 to 2 g/kg, i.v.).

RESULTS

Microdialysis samples yielded significant tonic increases in dopamine concentrations at 1 to 2 g/kg ethanol in each rat, while repeated saline infusions had no effect. When monitored with fast scan cyclic voltammetry, ethanol increased the frequency of dopamine transients in 6 of 16 recording sites, in contrast to the uniform effect of ethanol as measured with microdialysis. In the remaining 10 recording sites that were unresponsive to ethanol, dopamine transients either decreased in frequency or were unaffected by cumulative ethanol infusions, patterns also observed during repeated saline infusions. The responsiveness of particular recording sites to ethanol was not correlated with either core versus shell placement of the electrodes or the basal rate of dopamine transients. Importantly, the phasic response pattern to a single dose of ethanol at a particular site was qualitatively reproduced when a second dose of ethanol was administered, suggesting that the variable between-site effects reflected specific pharmacology at that recording site.

CONCLUSIONS

These data demonstrate that the relatively uniform dopamine concentrations obtained with microdialysis can mask a dramatic heterogeneity of phasic dopamine release within the accumbens.

The dopaminergic basis of human behaviors: A review of molecular imaging studies

This systematic review describes human molecular imaging studies which have investigated alterations in extracellular DA levels during performance of behavioral tasks. Whilst heterogeneity in experimental methods limits meta-analysis, we describe the advantages and limitations of different methodological approaches. Interpretation of experimental results may be limited by regional cerebral blood flow (rCBF) changes, head movement and choice of control conditions. We revisit our original study of striatal DA release during video-game playing [Koepp, M.J., Gunn, R.N., Lawrence, A.D., Cunningham, V.J., Dagher, A., Jones, T., Brooks, D.J., Bench, C.J., Grasby, P.M., 1998. Evidence for striatal dopamine release during a video game. Nature 393, 266-268] to illustrate the potentially confounding influences of head movement and alterations in rCBF. Changes in [(11)C]raclopride binding may be detected in extrastriatal as well as striatal brain regions-however we review evidence which suggests that extrastriatal changes may not be clearly interpreted in terms of DA release. Whilst several investigations have detected increases in striatal extracellular DA concentrations during task components such as motor learning and execution, reward-related processes, stress and cognitive performance, the presence of potentially biasing factors should be carefully considered (and, where possible, accounted for) when designing and interpreting future studies.

Burst-timing-dependent plasticity of NMDA receptor-mediated transmission in midbrain dopamine neurons

Bursts of spikes triggered by sensory stimuli in midbrain dopamine neurons evoke phasic release of dopamine in target brain areas, driving reward-based reinforcement learning and goal-directed behavior. NMDA-type glutamate receptors (NMDARs) play a critical role in the generation of these bursts. Here we report LTP of NMDAR-mediated excitatory transmission onto dopamine neurons in the substantia nigra. Induction of LTP requires burst-evoked Ca2+ signals amplified by preceding metabotropic neurotransmitter inputs in addition to the activation of NMDARs themselves. PKA activity gates LTP induction by regulating the magnitude of Ca2+ signal amplification. This form of plasticity is associative, input specific, reversible, and depends on the relative timing of synaptic input and postsynaptic bursting in a manner analogous to the timing rule for cue-reward learning paradigms in behaving animals. NMDAR plasticity might thus represent a potential neural substrate for conditioned dopamine neuron burst responses to environmental stimuli acquired during reward-based learning.

Dopamine signaling differences in the nucleus accumbens and dorsal striatum exploited by nicotine

The dorsal striatum and the nucleus accumbens (NAc) shell of the ventral striatum have similar cellular components and are both richly innervated by dopamine neurons. Despite similarities that extend throughout the striatum, only the NAc shell has a conspicuous increase in basal dopamine upon the initial administration of psychostimulant drugs such as nicotine. As measured by microdialysis, the elevated dopamine in the NAc shell is considered an identifying functional characteristic of addictive drugs. To examine this general functional difference between nicotine's action on the dorsolateral striatum and NAc shell, we directly monitored dopamine release in rat striatal slices using fast-scan cyclic voltammetry. In addition, we separately monitored the in vivo unit firing activity of putative midbrain dopamine neurons from freely moving rats using chronic multiple tetrodes. Nicotine administration increased the firing frequency of dopamine neurons and specifically increased the number and the length of phasic burst firing. The frequency dependence for dopamine release in the dorsolateral striatum and NAc shell is fundamentally different, enabling mainly the NAc shell to capitalize on the nicotine-induced phasic burst firing by dopamine neurons. Although nicotine decreased low-frequency (tonic) dopamine release in both areas, the increased ratio of phasic bursts relative to tonic firing caused by nicotine boosted the basal dopamine concentration predominantly in the NAc shell. By favoring release from bursts while depressing release from tonic signals, nicotine spreads the range of dopamine signaling and effectively increases the signal-to-noise relationship along dopamine afferents.

Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli

Midbrain dopamine neurons play central roles in reward processing. It is widely assumed that all dopamine neurons encode the same information. Some evidence, however, suggests functional differences between subgroups of dopamine neurons, particularly with respect to processing nonrewarding, aversive stimuli. To directly test this possibility, we recorded from and juxtacellularly labeled individual ventral tegmental area (VTA) dopamine neurons in anesthetized rats so that we could link precise anatomical position and neurochemical identity with coding for noxious stimuli. Here, we show that dopamine neurons in the dorsal VTA are inhibited by noxious footshocks, consistent with their role in reward processing. In contrast, we find that dopamine neurons in the ventral VTA are phasically excited by footshocks. This observation can explain a number of previously confusing findings that suggested a role for dopamine in processing both rewarding and aversive events. Taken together, our results indicate that there are 2 functionally and anatomically distinct VTA dopamine systems.

Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats

While reward-dependent facilitation of phasic dopamine signaling is well documented at both the cell bodies and terminals, little is known regarding fast dopamine transmission under aversive conditions. Exposure to aggressive confrontation is extremely aversive and stressful for many species including rats. The present study used fast-scan cyclic voltammetry and multiunit recording to determine if aggressive encounters and subsequent social defeat affect burst firing of ventral tegmental area (VTA) dopamine neurons and accumbal dopamine transients in defeated rats. Significant increases in the frequency of transient dopamine release were observed during interactions with an aggressive rat but not with a familiar cage mate. In agreement with voltammetric results, significant increases in burst frequency were detected in the VTA dopamine firing patterns during an aggressive confrontation; however, the number of spikes per burst remained unchanged. We found that neurons with lower burst rates under home cage conditions did not switch from nonbursting to bursting types, while neurons with higher burst levels showed amplified increases in bursting. This study demonstrates for the first time that aggressive confrontations in defeated rats are associated with increases in phasic dopamine transmission in the mesolimbic pathway.

Activity of neurochemically heterogeneous dopaminergic neurons in the substantia nigra during spontaneous and driven changes in brain state

Dopaminergic neurons of the substantia nigra (SN) and ventral tegmental area (VTA) are collectively implicated in motor- and reward-related behaviors. However, dopaminergic SN and VTA neurons differ on several functional levels, and dopaminergic SN neurons themselves vary in their intrinsic electrical properties, neurochemical characteristics and connections. This heterogeneity is not only important for normal function; calbindin (CB) expression by some dopaminergic SN neurons has been linked with their increased survival in Parkinson's disease. To test whether the activity of CB-negative and CB-positive dopaminergic SN neurons differs during distinct spontaneous and driven brain states, we recorded single units in anesthetized rats before, during and after aversive somatosensory stimuli. Recorded neurons were juxtacellularly labeled, confirmed to be dopaminergic, and tested for CB immunoreactivity. During cortical slow-wave activity, the firing of most dopaminergic neurons was slow and regular/irregular and unrelated to cortical slow oscillations. During spontaneous cortical activation, dopaminergic SN neurons fired in a more regular manner, with fewer bursts, but did not change their firing rate. Regardless of brain state, CB-negative dopaminergic neurons fired significantly faster than CB-positive dopaminergic neurons. This difference in firing rate was not mirrored by different firing patterns. Most CB-negative and CB-positive dopaminergic neurons did not respond to the aversive stimuli; of those that did respond, most were inhibited. We conclude that CB-negative and CB-positive dopaminergic neurons exhibit different activities in vivo. Furthermore, the firing of dopaminergic SN neurons is brain state-dependent, and, unlike dopaminergic VTA neurons, they are not commonly recruited or inhibited by aversive stimuli.

Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area

Dopamine concentrations fluctuate on a subsecond time scale in the nucleus accumbens (NAc) of awake rats. These transients occur in resting animals, are more frequent following administration of drugs of abuse, and become time-locked to cues predicting reward. Despite their importance in various behaviors, the origin of these signals has not been demonstrated. Here we show that dopamine transients are evoked by neural activity in the ventral tegmental area (VTA), a brain region containing dopaminergic cell bodies. The frequency of naturally occurring dopamine transients in a resting, awake animal was reduced by a local VTA microinfusion of either lidocaine or (+/-)2-amino,5-phosphopentanoic acid (AP-5), an NMDA receptor antagonist that attenuates phasic firing. When dopamine increases were pharmacologically evoked by noncontingent administration of cocaine, intra-VTA infusion of lidocaine or AP-5 significantly diminished this effect. Dopamine transients acquired in response to a cue during intracranial self-stimulation were also attenuated by intra-VTA microinfusion of AP-5, and this was accompanied by an increase in latency to lever press. The results from these three distinct experiments directly demonstrate, for the first time, how neuronal firing of dopamine neurons originating in the VTA translates into synaptic overflow in a key terminal region, the NAc shell.

Properties of distinct ventral tegmental area synapses activated via pedunculopontine or ventral tegmental area stimulation in vitro

Anatomical studies indicate that synaptic inputs from many cortical and subcortical structures converge on neurons of the ventral tegmental area (VTA). Although in vitro electrophysiological studies have examined synaptic inputs to dopamine (DA) and non-DA neurons in the VTA, they have largely relied upon local electrical stimulation to activate these synapses. This provides little information regarding the distinct properties of synapses originating from different brain areas. Using whole-cell recordings in parasagittal rat brain slices that preserved subcortical axons from the pedunculopontine nucleus (PPN) to the VTA, we compared these synapses with those activated by intra-VTA stimulation. PPN-evoked currents demonstrated longer latencies than intra-VTA-evoked currents, and both VTA and PPN responses were mediated by GABA(A) and AMPA receptors. However, unlike VTA-evoked currents, PPN currents were exclusively mediated by glutamate in 25-40% of the VTA neurons. Consistent with a cholinergic projection from the PPN to the VTA, nicotinic acetylcholine receptors (nAChR) were activated by endogenous acetylcholine released during PPN, but not VTA, stimulation. This was seen as a reduction of PPN-evoked, and not VTA-evoked, synaptic currents by the alpha7-nAChR antagonist methyllycaconitine (MLA) and the agonist nicotine. The beta2-nAChR subunit antagonist dihydro-beta-erythroidine had no effect on VTA- or PPN-evoked synaptic currents. The effects of MLA on PPN-evoked currents were unchanged by the GABA(A) receptor blocker picrotoxin, indicating that alpha7-nAChRs presynaptically modulated glutamate and not GABA release. These differences in physiological and pharmacological properties demonstrate that ascending PPN and presumed descending inputs to VTA utilize distinct mechanisms to differentially modulate neuronal activity and encode cortical and subcortical information.

Electrophysiological characteristics of dopamine neurons: a 35-year update

This chapter consists of four sections. The first section provides a general description of the electrophysiological characteristics of dopamine (DA) neurons in both the substantia nigra and ventral tegmental area. Emphasis is placed on the differences between DA and neighboring non-DA neurons. The second section discusses the ionic mechanisms underlying the generation of action potential in DA cells. Evidence is provided to suggest that these mechanisms differ not only between DA and non-DA neurons but also between DA cells located in different areas, with different projection sites and at different developmental stages. Some of the differences may play a critical role in the vulnerability of a DA neuron to cell death. The third section describes the firing patterns of DA cells. Data are presented to show that the current "80/160 ms" criteria for burst identification need to be revised and that the burst firing, originally described by Bunney et al., can be described as slow oscillations in firing rate. In the ventral tegmental area, the slow oscillations are, at least partially, derived from the prefrontal cortex and part of prefrontal information is transferred to DA cells indirectly through inhibitory neurons. The final section focuses on the feedback regulation of DA cells. New evidence suggests that DA autoreceptors are coupled to multiple effectors, and both D1 and D2-like receptors are involved in long-loop feedback control of DA neurons. Because of the presence of multiple feedback and nonfeedback pathways, the effect of a drug on a DA neuron can be far more complex than an inhibition or excitation. A better understanding of the intrinsic properties of DA neurons and their regulation by afferent input will, in time, help to point to the way to more effective and safer treatments for disorders including schizophrenia, drug addiction, and Parkinson's disease.

Age-dependent changes in dopaminergic neuron firing patterns in substantia nigra pars compacta

Dopaminergic neurons in the substantia nigra pars compacta modulate complex motor control. Nigral dopaminergic neurons exhibit three different firing patterns in vivo: a pacemaker mode, a random mode, and a burst mode. These firing patterns are closely related to motor control. However, the changes in the proportion of the firing patterns with respect to age have not been fully established. To clarify the age-dependent changes in the proportion of dopaminergic firing patterns, we used single unit extracellular recordings in male F344/N rats. We observed that, with age, the distribution of the spikes fired by dopaminergic neurons shifts from pacemaker to random mode, and then from random to burst mode. These results suggest that the age-dependent changes in the proportion of nigral dopaminergic firing patterns may have an effect on motor function.

Dopamine neuron responses depend exponentially on pacemaker interval

Midbrain dopamine neuron activity results from the integration of the responses to metabo- and ionotropic receptors with the postsynaptic excitability of these intrinsic pacemakers. Interestingly, intrinsic pacemaker rate varies greatly between individual dopamine neurons and is subject to short- and long-term regulation. Here responses of substantia nigra dopamine neurons to defined dynamic-clamp stimuli were measured to quantify the impact of cell-to-cell variation in intrinsic pacemaker rate. Then this approach was repeated in single dopamine neurons in which pacemaker rate was altered by activation of muscarinic receptors or current injection. These experiments revealed a dramatic exponential dependence on pacemaker interval for the responses to voltage-gated A-type K+ channels, voltage-independent cation channels and ionotropic synapses. Likewise, responses to native metabotropic (GABAb and mGluR1) inhibitory synapses depended steeply on pacemaker interval. These results show that observed variations in dopamine neuron pacemaker rate are functionally significant because they produce a >10-fold difference in responses to diverse stimuli. Both the magnitude and the mathematical form of the relationship between pacemaker interval and responses were not previously anticipated.

Synaptic plasticity in the basal ganglia

Activity-dependent synaptic plasticity occurs in several parts of the basal ganglia. Increasing evidence supports the hypothesis that activity-dependent plasticity underlies the acquisition, maintenance, and extinction of certain types of learning in the basal ganglia. This review focuses on synaptic plasticity in the corticostriatal pathway. As in other systems, both long-term potentiation and long-term depression have been described, and intracellular calcium signalling plays an important role in the induction of plasticity. However, intracellular calcium levels do not appear to be the dominating control factor. Dopamine, via intracellular signalling cascades, also plays a crucial role in determining the magnitude and direction of plasticity, and in modulating the requirements for induction. Endocannabinoids also play an important role in mediating presynaptic expression of synaptic depression. Recent studies have highlighted spike-timing dependent plasticity phenomena, which also involve dopamine and endocannabinoid signalling. Despite significant progress in recent years, many important questions remain unanswered, especially in relation to long-term potentiation. Of particular interest is the question of how to link the molecular and cellular mechanisms of synaptic plasticity to learning operations at the systems level, which are expressed behaviourally as reinforcement-related learning.

Midbrain dopamine neurons: projection target determines action potential duration and dopamine D(2) receptor inhibition

Broad action potentials (APs) and dopamine (DA) D(2) receptor (D(2)R)-mediated inhibition are widely used to identify midbrain DA neurons. However, when these measures are taken alone they do not predict DA content in ventral tegmental area (VTA) neurons. In fact, some VTA neuronal properties correlate better with projection target than neurotransmitter content. Here we report that amygdala (AMYG)-projecting VTA DA neurons have brief APs and lack D(2)R agonist (quinpirole; 1 microM) autoinhibition. However, they are hyperpolarized by both the GABA(B) agonist baclofen (1 microM) and the kappa-opioid receptor agonist U69593 [(+)-(5alpha,7alpha,8beta)-N-methyl-N-[7-(1-pyrrolidinyl)-1-oxaspiro[4.5]dec-8-yl]benzeneacetamide; 1 microM]. Furthermore, we show that accurate prediction of DA content in VTA neurons is possible when the projection target is known: in both nucleus accumbens- and AMYG-projecting neural populations, AP durations are significantly longer in DA than non-DA neurons. Among prefrontal cortex-projecting neurons, quinpirole sensitivity, but not AP duration, is a predictor of DA content. Therefore, in the VTA, AP duration and inhibition by D(2)R agonists may be valid markers of DA content in neurons of known projection target.

NMDA receptor antagonism in the ventral tegmental area impairs acquisition of reward-related learning

Mechanisms underlying reward-related learning presumably involve neural plasticity integrating signals representing unconditioned and conditioned stimuli in regions mediating reward. The ventral tegmental area (VTA) receives such signals and shows synaptic plasticity which is NMDA receptor-dependent. To test the hypothesis that NMDA receptor stimulation in the VTA is necessary for the acquisition of food-reinforced appetitive learning, Long-Evans male rats were prepared with bilateral VTA cannulae and tested in operant chambers with the opportunity to lever press for food for 10 sessions. Animals received microinjections of AP-5 or vehicle immediately before sessions 1-4 and 10. AP-5 impaired acquisition of lever pressing during sessions 1-4 (but not when injected dorsal to the VTA). All groups increased lever pressing across sessions 5-9. On session 10, lever pressing was not affected regardless of treatment. In separate experiments, AP-5 failed to reduce free feeding, food reward or motor activity, suggesting that impairment in acquisition was not due to reduced food motivation or activity. NMDA transmission in the VTA thus appears to be necessary for the acquisition, but not expression, of reward-related learning.

Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model

Extinction of behavior enables adaptation to a changing world and is crucial for recovery from disorders such as phobias and drug addiction. However, the brain mechanisms underlying behavioral extinction remain poorly understood. Midbrain dopamine (DA) neurons appear to play a central role in most acquisition processes of appetitive conditioning. Here, we show that the responses of putative DA neurons to conditioned reward predicting cues also dynamically encode two classical features of extinction: decrement in amplitude of previously learned excitatory responses and rebound of responding on subsequent retesting (spontaneous recovery). Crucially, this encoding involves development of inhibitory responses in the DA neurons, reflecting new, extinction-specific learning in the brain. We explored the implications of this finding by adding such inhibitory inputs to a standard temporal difference model of DA cell activity. We found that combining extinction-triggered plasticity of these inputs with a time-dependent spontaneous decay of weights, equivalent to a forgetting process as described in classical behavioral extinction literature, enabled the model to simulate several classical features of extinction. A key requirement to achieving spontaneous recovery was differential rates of spontaneous decay for weights representing original conditioning and for subsequent extinction learning. A testable prediction of the model is thus that differential decay properties exist within the wider circuits regulating DA cell activity. These findings are consistent with the hypothesis that extinction processes at both cellular and behavioral levels involve a dynamic interaction between new (inhibitory) learning, forgetting, and unlearning.

Reinforcement learning: the good, the bad and the ugly

Reinforcement learning provides both qualitative and quantitative frameworks for understanding and modeling adaptive decision-making in the face of rewards and punishments. Here we review the latest dispatches from the forefront of this field, and map out some of the territories where lie monsters.

Alpha6-containing nicotinic acetylcholine receptors dominate the nicotine control of dopamine neurotransmission in nucleus accumbens

Modulation of striatal dopamine (DA) neurotransmission plays a fundamental role in the reinforcing and ultimately addictive effects of nicotine. Nicotine, by desensitizing beta2 subunit-containing (beta2*) nicotinic acetylcholine receptors (nAChRs) on striatal DA axons, significantly enhances how DA is released by reward-related burst activity compared to nonreward-related tonic activity. This action provides a synaptic mechanism for nicotine to facilitate the DA-dependent reinforcement. The subfamily of beta2*-nAChRs responsible for these potent synaptic effects could offer a molecular target for therapeutic strategies in nicotine addiction. We explored the role of alpha6beta2*-nAChRs in the nucleus accumbens (NAc) and caudate-putamen (CPu) by observing action potential-dependent DA release from synapses in real-time using fast-scan cyclic voltammetry at carbon-fiber microelectrodes in mouse striatal slices. The alpha6-specific antagonist alpha-conotoxin-MII suppressed DA release evoked by single and low-frequency action potentials and concurrently enhanced release by high-frequency bursts in a manner similar to the beta2*-selective antagonist dihydro-beta-erythroidine (DHbetaE) in NAc, but less so in CPu. The greater role for alpha6*-nAChRs in NAc was not due to any confounding regional difference in ACh tone since elevated ACh levels (after the acetylcholinesterase inhibitor ambenonium) had similar outcomes in NAc and CPu. Rather, there appear to be underlying differences in nAChR subtype function in NAc and CPu. In summary, we reveal that alpha6beta2*-nAChRs dominate the effects of nicotine on DA release in NAc, whereas in CPu their role is minor alongside other beta2*-nAChRs (eg alpha4*), These data offer new insights to suggest striatal alpha6*-nAChRs as a molecular target for a therapeutic strategy for nicotine addiction.

Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD

This review considers the hypothesis that changes in dopamine signalling might account for altered sensitivity to positive reinforcement in children with ADHD. The existing evidence regarding dopamine cell activity in relation to positive reinforcement is reviewed. We focus on the anticipatory firing of dopamine cells brought about by a transfer of dopamine cell responses to cues that precede reinforcers. It is proposed that in children with ADHD there is diminished anticipatory dopamine cell firing, which we call the dopamine transfer deficit (DTD). The DTD theory leads to specific and testable predictions for human and animal research. The extent to which DTD explains symptoms of ADHD and effects of pharmacological interventions is discussed. We conclude by considering the neural changes underlying the etiology of DTD.

Dynamic Changes in the Cortex-Basal Ganglia Network After Dopamine Depletion in the Rat

It is well established that parkinsonian syndrome is associated with alterations in the temporal pattern of neuronal activity and local field potentials in the basal ganglia (BG). An increase in synchronized oscillations has been observed in different BG nuclei in parkinsonian patients and animal models of this disease. However, the mechanisms underlying this phenomenon remain unclear. This study investigates the functional connectivity in the cortex-BG network of a rodent model of Parkinson's disease. Single neurons and local field potentials were simultaneously recorded in the motor cortex, the striatum, and the substantia nigra pars reticulata (SNr) of freely moving rats, and high-voltage spindles (HVSs) were used to compare signal transmission before and after dopaminergic depletion. It is shown that dopaminergic lesion results in a significant enhancement of oscillatory synchronization in the BG: the coherence between pairs of structures increased significantly and the percentage of oscillatory auto- and cross-correlograms. HVS episodes were also more numerous and longer. These changes were associated with a shortening of the latency of SNr response to cortical activation, from 40.5 ± 4.8 to 10.2 ± 1.07 ms. This result suggests that, in normal conditions, SNr neurons are likely to be driven by late inputs from the indirect pathway; however, after the lesion, their shorter latency also indicates an overactivation of the hyperdirect pathway. This study confirms that neuronal signal transmission is altered in the BG after dopamine depletion but also provides qualitative evidence for these changes at the cellular level.

The neuronal nicotinic acetylcholine receptors alpha 4* and alpha 6* differentially modulate dopamine release in mouse striatal slices

Striatal dopamine (DA) plays a major role in the regulation of motor coordination and in the processing of salient information. We used voltammetry to monitor DA-release evoked by electrical stimulation in striatal slices, where interneurons continuously release acetylcholine. Use of the alpha6-selective antagonist alpha-conotoxin MII[E11A] and alpha4 knockout mice enabled identification of two populations of DA-ergic fibers. The first population had a low action potential threshold, and action potential-evoked DA-release from these fibers was modulated by alpha6. The second population had a higher action potential threshold, and only alpha4(non-alpha6) modulated action potential-evoked DA-release. Striatal DA-ergic neurons fire in both tonic and phasic patterns. When stimuli were applied in a train to mimic phasic firing, more DA-release was observed in alpha4 knockout versus wild-type mice. Furthermore, block of alpha4(non-alpha6), but not of alpha6, increased DA release evoked by a train. These results indicate that there are different classes of striatal DA-ergic fibers that express different subtypes of nicotinic receptors.

A Modeling Study Suggesting a Possible Pharmacological Target to Mitigate the Effects of Ethanol on Reward-Related Dopaminergic Signaling

Midbrain dopaminergic neurons are involved in several critical brain functions controlling goal-directed behaviors, reinforcing/reward processes, and motivation. Their dysfunctions alter dopamine release and contribute to a vast range of neural disorders, from Parkinson's disease to schizophrenia and addictive behaviors. These neurons have thus been a natural target of pharmacological treatments trying to ameliorate the consequences of several neuropathologies. From this point of view, a clear experimental link has been recently established between the increase in the pacemaker frequency of dopaminergic neurons in vitro after acute ethanol application and a particular ionic current ( Ih). The functional consequences in vivo, however, are not clear and they are very difficult to explore experimentally. Here we use a realistic computational model of dopaminergic neurons in vivo to suggest that ethanol, through its effects on Ih, modifies the temporal structure of the spiking activity. The model predicts that the dopamine level may increase much more during bursting than during pacemaking activity, especially in those brain regions with a slow dopamine clearance rate. The results suggest that a selective pharmacological remedy could thus be devised against the rewarding effects of ethanol that are postulated to mediate alcohol abuse and addiction, targeting the specific HCN genes expressed in dopaminergic neurons.

Novel neurons in ventral tegmental area fire selectively during the active phase of the diurnal cycle

The ventral tegmental area (VTA) contains dopamine (DA) and gamma-aminobutyric acid (GABA) neurons involved in motivation and behavioral state. These phenomena are also influenced by circadian factors. The goal of our studies was to examine the impulse activity of neurochemically identified VTA neurons during dark (active) vs light (rest) phases of the circadian cycle. Using extracellular single-unit recordings with juxtacellular labeling in anesthetized rats, we found multiple neuronal subpopulations including 'novel neurons' that selectively fired during the dark phase. These novel neurons were electrophysiologically categorized into two groups, 'novel wide-spike' and 'novel thin-spike' neurons. Characterization of novel wide-spike neurons found they were consistently non-dopaminergic and non-GABAergic [tyrosine hydroxylase (TH)(-), glutamic acid decarboxylase (GAD)(-)]. However, they were inhibited by the D2 agonist quinpirole, an effect that could be reversed by the D2 antagonist eticlopride. Physiologically, they were fast firing (mean = 18.9 +/- 1.2 spikes/s), low bursting neurons (median = 6.2 +/- 3.0% of spikes in bursts) with spike durations > or = 2.0 ms, but slightly shorter than TH(+) neurons. They were also consistently non-responsive to footpad stimulation. The novel thin-spike neurons were neurochemically heterogeneous, and were located more ventrally than thin-spike neurons found during the light phase. These findings reveal previously unknown populations of VTA neurons whose activities are sensitive to diurnal phase, and whose functions may be in the temporal regulation of arousal and motivational processes.

Presynaptic nicotinic receptors: a dynamic and diverse cholinergic filter of striatal dopamine neurotransmission

The effects of nicotine on dopamine transmission from mesostriatal dopamine neurons are central to its reinforcing properties. Only recently however, has the influence of presynaptic nicotinic receptors (nAChRs) on dopaminergic axon terminals within striatum begun to be understood. Here, rather than simply enhancing (or inhibiting) dopamine release, nAChRs perform the role of a presynaptic filter, whose influence on dopamine release probability depends on presynaptic activity in dopaminergic as well as cholinergic neurons. Both mesostriatal dopaminergic neurons and striatal cholinergic interneurons play key roles in motivational and sensorimotor processing by the basal ganglia. Moreover, it appears that the striatal influence of dopamine and ACh cannot be fully appreciated without an understanding of their reciprocal interactions. We will review the powerful filtering by nAChRs of striatal dopamine release and discuss its dependence on activity in dopaminergic and cholinergic neurons. We will also review how nicotine, acting via nAChR desensitization, promotes the sensitivity of dopamine synapses to activity. This filtering action might provide a mechanism through which nicotine promotes how burst activity in dopamine neurons facilitates goal-directed behaviour and reinforcement processing. More generally, it indicates that we should not restrict our view of presynaptic nAChRs to simply enhancing neurotransmitter release. We will also summarize current understanding of the forms and functions of the diverse nAChRs purported to exist on dopaminergic axons. A greater understanding of nAChR form and function is imperative to guide the design of ligands with subtype-selective efficacy for improved therapeutic interventions in nicotine addiction as well as Parkinson's disease.

Presynaptic opioid and nicotinic receptor modulation of dopamine overflow in the nucleus accumbens

Behaviorally relevant stimuli prompt midbrain dopamine (DA) neurons to switch from tonic to burst firing patterns. Similar shifts to burst activity are thought to contribute to the addictive effects of opiates and nicotine. The nucleus accumbens DA overflow produced by these drugs is a key element in their pathological effects. Using electrochemical techniques in brain slices, we explored the effects of opioids on single-spike and burst stimuli-evoked DA overflow in the dorsal and ventral striatum. In specific subregions of the nucleus accumbens, mu-opioids inhibit DA overflow elicited with single-spike stimuli while leaving that produced by burst stimuli unaffected. This is similar to published effects of nicotinic receptor blockade or desensitization, and is mediated by opioid receptor-induced inhibition of cholinergic interneurons. Whereas delta-opioids have similar effects, kappa-opioids inhibit evoked DA overflow throughout the striatum in a manner that is not overcome with high-frequency stimuli. These observations reveal remarkable mechanistic overlap between the effects of nicotine and opiates within the dopamine reward pathway.

Dopamine modulates temporal dynamics of feedforward inhibition in rat prefrontal cortex in vivo

Midbrain dopamine (DA) neurons project to pyramidal cells and interneurons of the prefrontal cortex (PFC). At the microcircuit level, interneurons gate inputs to a network and regulate/pattern its outputs. Whereas several in vitro studies have examined the role of DA on PFC interneurons, few in vivo data are available. In this study, we show that DA influences the timing of interneuron firing. In particular, DA had a reductive influence on interneuron spontaneous firing, which in the context of the excitatory response of interneurons to hippocampal electrical stimulation, lead to a temporal focalization of the interneuron response. This suggests that the reductive influence of DA on interneuron excitability is responsible for filtering out weak excitatory inputs. The increase in the temporal precision of interneuron firing is a mechanism by which DA can modulate the temporal dynamics of feedforward inhibition in PFC circuits and can thereby influence cognitive information processing.

Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective

The mesolimbic dopaminergic (ML-DA) system has been recognized for its central role in motivated behaviors, various types of reward, and, more recently, in cognitive processes. Functional theories have emphasized DA's involvement in the orchestration of goal-directed behaviors and in the promotion and reinforcement of learning. The affective neuroethological perspective presented here views the ML-DA system in terms of its ability to activate an instinctual emotional appetitive state (SEEKING) evolved to induce organisms to search for all varieties of life-supporting stimuli and to avoid harms. A description of the anatomical framework in which the ML system is embedded is followed by the argument that the SEEKING disposition emerges through functional integration of ventral basal ganglia (BG) into thalamocortical activities. Filtering cortical and limbic input that spreads into BG, DA transmission promotes the "release" of neural activity patterns that induce active SEEKING behaviors when expressed at the motor level. Reverberation of these patterns constitutes a neurodynamic process for the inclusion of cognitive and perceptual representations within the extended networks of the SEEKING urge. In this way, the SEEKING disposition influences attention, incentive salience, associative learning, and anticipatory predictions. In our view, the rewarding properties of drugs of abuse are, in part, caused by the activation of the SEEKING disposition, ranging from appetitive drive to persistent craving depending on the intensity of the affect. The implications of such a view for understanding addiction are considered, with particular emphasis on factors predisposing individuals to develop compulsive drug seeking behaviors.

What is reinforced by phasic dopamine signals?

The basal ganglia have been associated with processes of reinforcement learning. A strong line of supporting evidence comes from the recording of dopamine (DA) neurones in behaving monkeys. Unpredicted, biologically salient events, including rewards cause a stereotypic short-latency (70-100 ms), short-duration (100-200 ms) burst of DA activity - the phasic response. This response is widely considered to represent reward prediction errors used as teaching signals in appetitive learning to promote actions that will maximise future reward acquisition. For DA signalling to perform this function, sensory processing afferent to DA neurones should discriminate unpredicted reward-related events. However, the comparative response latencies of DA neurones and orienting gaze-shifts indicate that phasic DA responses are triggered by pre-attentive sensory processing. Consequently, in circumstances where biologically salient events are both spatially and temporally unpredictable, it is unlikely their identity will be known at the time of DA signalling. The limited quality of afferent sensory processing and the precise timing of phasic DA signals, suggests that they may play a less direct role in 'Law of Effect' appetitive learning. Rather, the 'time-stamp' nature of the phasic response, in conjunction with the other signals likely to be present in the basal ganglia at the time of phasic DA input, suggests it may reinforce the discovery of unpredicted sensory events for which the organism is responsible. Furthermore, DA-promoted repetition of preceding actions/movements should enable the system to converge on those aspects of context and behavioural output that lead to the discovery of novel actions.