Striatal low-threshold spiking interneurons locally gate dopamine

What Role Does Striatal Dopamine Play in Goal-directed Action?

Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Local regulation of striatal dopamine: A diversity of circuit mechanisms for a diversity of behavioral functions?

Striatal dopamine governs a wide range of behavioral functions, yet local dopamine concentrations can be dissociated from somatic activity. Here, we discuss how dopamine's diverse roles in behavior may be driven by local circuit mechanisms shaping dopamine release. We first look at historical and recent work demonstrating that striatal circuits interact with dopaminergic terminals to either initiate the release of dopamine or modulate the release of dopamine initiated by spiking in midbrain dopamine neurons, with particular attention to GABAergic and cholinergic local circuit mechanisms. Then we discuss some of the first in vivo studies of acetylcholine-dopamine interactions in striatum and broadly discuss necessary future work in understanding the roles of midbrain versus striatal dopamine regulation.

GABA co-released from striatal dopamine axons dampens phasic dopamine release through autoregulatory GABAA receptors

Striatal dopamine axons co-release dopamine and gamma-aminobutyric acid (GABA), using GABA provided by uptake via GABA transporter-1 (GAT1). Functions of GABA co-release are poorly understood. We asked whether co-released GABA autoinhibits dopamine release via axonal GABA type A receptors (GABAARs), complementing established inhibition by dopamine acting at axonal D2 autoreceptors. We show that dopamine axons express α3-GABAAR subunits in mouse striatum. Enhanced dopamine release evoked by single-pulse optical stimulation in striatal slices with GABAAR antagonism confirms that an endogenous GABA tone limits dopamine release. Strikingly, an additional inhibitory component is seen when multiple pulses are used to mimic phasic axonal activity, revealing the role of GABAAR-mediated autoinhibition of dopamine release. This autoregulation is lost in conditional GAT1-knockout mice lacking GABA co-release. Given the faster kinetics of ionotropic GABAARs than G-protein-coupled D2 autoreceptors, our data reveal a mechanism whereby co-released GABA acts as a first responder to dampen phasic-to-tonic dopamine signaling.

Striatal dopamine integrates cost, benefit, and motivation

Striatal dopamine (DA) release has long been linked to reward processing, but it remains controversial whether DA release reflects costs or benefits and how these signals vary with motivation. Here, we measure DA release in the nucleus accumbens (NAc) and dorsolateral striatum (DLS) while independently varying costs and benefits and apply behavioral economic principles to determine a mouse's level of motivation. We reveal that DA release in both structures incorporates both reward magnitude and sunk cost. Surprisingly, motivation was inversely correlated with reward-evoked DA release. Furthermore, optogenetically evoked DA release was also heavily dependent on sunk cost. Our results reconcile previous disparate findings by demonstrating that striatal DA release simultaneously encodes cost, benefit, and motivation but in distinct manners over different timescales. Future work will be necessary to determine whether the reduction in phasic DA release in highly motivated animals is due to changes in tonic DA levels.

Acetylcholine waves and dopamine release in the striatum

Striatal dopamine encodes reward, with recent work showing that dopamine release occurs in spatiotemporal waves. However, the mechanism of dopamine waves is unknown. Here we report that acetylcholine release in mouse striatum also exhibits wave activity, and that the spatial scale of striatal dopamine release is extended by nicotinic acetylcholine receptors. Based on these findings, and on our demonstration that single cholinergic interneurons can induce dopamine release, we hypothesized that the local reciprocal interaction between cholinergic interneurons and dopamine axons suffices to drive endogenous traveling waves. We show that the morphological and physiological properties of cholinergic interneuron - dopamine axon interactions can be modeled as a reaction-diffusion system that gives rise to traveling waves. Analytically-tractable versions of the model show that the structure and the nature of propagation of acetylcholine and dopamine traveling waves depend on their coupling, and that traveling waves can give rise to empirically observed correlations between these signals. Thus, our study provides evidence for striatal acetylcholine waves in vivo, and proposes a testable theoretical framework that predicts that the observed dopamine and acetylcholine waves are strongly coupled phenomena.

Characterization and mu opioid receptor sensitivity of neuropeptide Y interneurons in the mouse nucleus accumbens

Inhibitory interneurons represent less than 5% of neurons within the nucleus accumbens, but are critical for proper microcircuit function within this brain region. In the dorsal striatum, neuropeptide Y is expressed by two interneuron subtypes (low-threshold spiking interneurons and neurogliaform interneurons) that exhibit mu opioid receptor sensitivity in other brain regions. However, few studies have assessed the molecular and physiological properties of neuropeptide Y interneurons within the nucleus accumbens. We used a transgenic reporter mouse to identify and characterize neuropeptide Y interneurons in acute nucleus accumbens brain slices. Nearly all cells exhibited electrophysiological properties of low-threshold spiking interneurons, with almost no neurogliaform interneurons observed among neuropeptide Y interneurons. We corroborated this pattern using fluorescent in situ hybridization, and also identified a high level of mu opioid receptor expression by low-threshold spiking interneurons, which led us to examine the functional consequences of mu opioid receptor activation in these cells using electrophysiology. Mu opioid receptor activation caused a reduction in the rate of spontaneous action potentials in low-threshold spiking interneurons, as well as a decrease in optogenetically-evoked GABA release onto medium spiny neurons. The latter effect was more robust in female versus male mice, and when the postsynaptic medium spiny neuron expressed the Drd1 dopamine receptor. This work is the first to examine the physiological properties of neuropeptide Y interneurons in the nucleus accumbens, and show they may be an important target for mu opioid receptor modulation by endogenous and exogenous opioids.

Connectivity of the corticostriatal and thalamostriatal systems in normal and parkinsonian states: An update

The striatum receives abundant glutamatergic afferents from the cortex and thalamus. These inputs play a major role in the functions of the striatal neurons in normal conditions, and are significantly altered in pathological states, such as Parkinson's disease. This review summarizes the current knowledge of the connectivity of the corticostriatal and thalamostriatal pathways, with emphasis on the most recent advances in the field. We also discuss novel findings regarding structural changes in cortico- and thalamostriatal connections that occur in these connections as a consequence of striatal loss of dopamine in parkinsonism.

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors

Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.^1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,^1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.