Activity Patterns in the Neuropil of Striatal Cholinergic Interneurons in Freely Moving Mice Represent Their Collective Spiking Dynamics

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Striatal Neurons Are Recruited Dynamically into Collective Representations of Self-Initiated and Learned Actions in Freely Moving Mice

Striatal spiny projection neurons are hyperpolarized-at-rest (HaR) and driven to action potential threshold by a small number of powerful inputs-an input-output configuration that is detrimental to response reliability. Because the striatum is important for habitual behaviors and goal-directed learning, we conducted a microendoscopic imaging in freely moving mice that express a genetically encoded Ca2+ indicator sparsely in striatal HaR neurons to evaluate their response reliability during self-initiated movements and operant conditioning. The sparse expression was critical for longitudinal studies of response reliability, and for studying correlations among HaR neurons while minimizing spurious correlations arising from contamination by the background signal. We found that HaR neurons are recruited dynamically into action representation, with distinct neuronal subsets being engaged in a moment-by-moment fashion. While individual neurons respond with little reliability, the population response remained stable across days. Moreover, we found evidence for the temporal coupling between neuronal subsets during conditioned (but not innate) behaviors.

Acetylcholine waves and dopamine release in the striatum

Striatal dopamine encodes reward, with recent work showing that dopamine release occurs in spatiotemporal waves. However, the mechanism of dopamine waves is unknown. Here we report that acetylcholine release in mouse striatum also exhibits wave activity, and that the spatial scale of striatal dopamine release is extended by nicotinic acetylcholine receptors. Based on these findings, and on our demonstration that single cholinergic interneurons can induce dopamine release, we hypothesized that the local reciprocal interaction between cholinergic interneurons and dopamine axons suffices to drive endogenous traveling waves. We show that the morphological and physiological properties of cholinergic interneuron - dopamine axon interactions can be modeled as a reaction-diffusion system that gives rise to traveling waves. Analytically-tractable versions of the model show that the structure and the nature of propagation of acetylcholine and dopamine traveling waves depend on their coupling, and that traveling waves can give rise to empirically observed correlations between these signals. Thus, our study provides evidence for striatal acetylcholine waves in vivo, and proposes a testable theoretical framework that predicts that the observed dopamine and acetylcholine waves are strongly coupled phenomena.

Accumbens cholinergic interneurons dynamically promote dopamine release and enable motivation

Motivation to work for potential rewards is critically dependent on dopamine (DA) in the nucleus accumbens (NAc). DA release from NAc axons can be controlled by at least two distinct mechanisms: (1) action potentials propagating from DA cell bodies in the ventral tegmental area (VTA), and (2) activation of β2* nicotinic receptors by local cholinergic interneurons (CINs). How CIN activity contributes to NAc DA dynamics in behaving animals is not well understood. We monitored DA release in the NAc Core of awake, unrestrained rats using the DA sensor RdLight1, while simultaneously monitoring or manipulating CIN activity at the same location. CIN stimulation rapidly evoked DA release, and in contrast to slice preparations, this DA release showed no indication of short-term depression or receptor desensitization. The sound of unexpected food delivery evoked a brief joint increase in CIN population activity and DA release, with a second joint increase as rats approached the food. In an operant task, we observed fast ramps in CIN activity during approach behaviors, either to start the trial or to collect rewards. These CIN ramps co-occurred with DA release ramps, without corresponding changes in the firing of lateral VTA DA neurons. Finally, we examined the effects of blocking CIN influence over DA release through local NAc infusion of DHβE, a selective antagonist of β2* nicotinic receptors. DHβE dose-dependently interfered with motivated approach decisions, mimicking the effects of a DA antagonist. Our results support a key influence of CINs over motivated behavior via the local regulation of DA release.

Fiber photometry in striatum reflects primarily nonsomatic changes in calcium

Fiber photometry enables recording of population neuronal calcium dynamics in awake mice. While the popularity of fiber photometry has grown in recent years, it remains unclear whether photometry reflects changes in action potential firing (that is, 'spiking') or other changes in neuronal calcium. In microscope-based calcium imaging, optical and analytical approaches can help differentiate somatic from neuropil calcium. However, these approaches cannot be readily applied to fiber photometry. As such, it remains unclear whether the fiber photometry signal reflects changes in somatic calcium, changes in nonsomatic calcium or a combination of the two. Here, using simultaneous in vivo extracellular electrophysiology and fiber photometry, along with in vivo endoscopic one-photon and two-photon calcium imaging, we determined that the striatal fiber photometry does not reflect spiking-related changes in calcium and instead primarily reflects nonsomatic changes in calcium.

Non-uniform distribution of dendritic nonlinearities differentially engages thalamostriatal and corticostriatal inputs onto cholinergic interneurons

The tonic activity of striatal cholinergic interneurons (CINs) is modified differentially by their afferent inputs. Although their unitary synaptic currents are identical, in most CINs cortical inputs onto distal dendrites only weakly entrain them, whereas proximal thalamic inputs trigger abrupt pauses in discharge in response to salient external stimuli. To test whether the dendritic expression of the active conductances that drive autonomous discharge contribute to the CINs’ capacity to dissociate cortical from thalamic inputs, we used an optogenetics-based method to quantify dendritic excitability in mouse CINs. We found that the persistent sodium (NaP) current gave rise to dendritic boosting, and that the hyperpolarization-activated cyclic nucleotide-gated (HCN) current gave rise to a subhertz membrane resonance. This resonance may underlie our novel finding of an association between CIN pauses and internally-generated slow wave events in sleeping non-human primates. Moreover, our method indicated that dendritic NaP and HCN currents were preferentially expressed in proximal dendrites. We validated the non-uniform distribution of NaP currents: pharmacologically; with two-photon imaging of dendritic back-propagating action potentials; and by demonstrating boosting of thalamic, but not cortical, inputs by NaP currents. Thus, the localization of active dendritic conductances in CIN dendrites mirrors the spatial distribution of afferent terminals and may promote their differential responses to thalamic vs. cortical inputs.

Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment

Significant evidence supports the view that dopamine shapes learning by encoding reward prediction errors. However, it is unknown whether striatal targets receive tailored dopamine dynamics based on regional functional specialization. Here, we report wave-like spatiotemporal activity patterns in dopamine axons and release across the dorsal striatum. These waves switch between activational motifs and organize dopamine transients into localized clusters within functionally related striatal subregions. Notably, wave trajectories were tailored to task demands, propagating from dorsomedial to dorsolateral striatum when rewards are contingent on animal behavior and in the opponent direction when rewards are independent of behavioral responses. We propose a computational architecture in which striatal dopamine waves are sculpted by inference about agency and provide a mechanism to direct credit assignment to specialized striatal subregions. Supporting model predictions, dorsomedial dopamine activity during reward-pursuit signaled the extent of instrumental control and interacted with reward waves to predict future behavioral adjustments.

In vivo microstimulation with cathodic and anodic asymmetric waveforms modulates spatiotemporal calcium dynamics in cortical neuropil and pyramidal neurons of male mice

Electrical stimulation has been critical in the development of an understanding of brain function and disease. Despite its widespread use and obvious clinical potential, the mechanisms governing stimulation in the cortex remain largely unexplored in the context of pulse parameters. Modeling studies have suggested that modulation of stimulation pulse waveform may be able to control the probability of neuronal activation to selectively stimulate either cell bodies or passing fibers depending on the leading polarity. Thus, asymmetric waveforms with equal charge per phase (i.e., increasing the leading phase duration and proportionately decreasing the amplitude) may be able to activate a more spatially localized or distributed population of neurons if the leading phase is cathodic or anodic, respectively. Here, we use two-photon and mesoscale calcium imaging of GCaMP6s expressed in excitatory pyramidal neurons of male mice to investigate the role of pulse polarity and waveform asymmetry on the spatiotemporal properties of direct neuronal activation with 10-Hz electrical stimulation. We demonstrate that increasing cathodic asymmetry effectively reduces neuronal activation and results in a more spatially localized subpopulation of activated neurons without sacrificing the density of activated neurons around the electrode. Conversely, increasing anodic asymmetry increases the spatial spread of activation and highly resembles spatiotemporal calcium activity induced by conventional symmetric cathodic stimulation. These results suggest that stimulation polarity and asymmetry can be used to modulate the spatiotemporal dynamics of neuronal activity thus increasing the effective parameter space of electrical stimulation to restore sensation and study circuit dynamics.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease

Striatal cholinergic interneurons (CINs) are the main source of acetylcholine in the striatum and are believed to play an important role in basal ganglia physiology and pathophysiology. The role of CINs in striatal function is known mostly from extracellular recordings of tonically active striatal neurons in monkeys, which are believed to correspond to CINs. Because these neurons transiently respond to motivationally cues with brief pauses, flanked by bursts of increased activity, they are classically viewed as key players in reward-related learning. However, CIN modulatory function within the striatal network has been mainly inferred from the action of acetylcholine agonists/antagonists or through CIN activation. These manipulations are far from recapitulating CIN activity in response to behaviorally-relevant stimuli. New technical tools such as optogenetics allow researchers to specifically manipulate this sparse neuronal population and to mimic their typical pause response. For example, it is now possible to investigate how short inhibition of CIN activity shapes striatal properties. Here, we review the most recent literature and show how these new techniques have brought considerable insights into the functional role of CINs in normal and pathological states, raising several interesting and novel questions. To continue moving forward, it is crucial to determine in detail CIN activity changes during behavior, particularly in rodents. We will also discuss how computational approaches combined with optogenetics will contribute to further our understanding of the CIN role in striatal circuits.

Dopamine-glutamate neuron projections to the nucleus accumbens medial shell and behavioral switching

Dopamine (DA) neuron projections to the striatum are functionally heterogeneous with diverse behavioral roles. We focus here on DA neuron projections to the nucleus accumbens (NAc) medial Shell, their distinct anatomical and functional connections, and discuss their role in motivated behavior. We first review rodent studies showing that a subpopulation of DA neurons in the medial ventral tegmental area (VTA) project to the NAc medial Shell. Using a combinatorial strategy, we show that the majority of DA neurons projecting to the NAc Shell express vesicular glutamate transporter 2 (VGLUT2) making them capable of glutamate co-transmission (DA-GLU neurons). In the NAc dorsal medial Shell, all of the DA neuron terminals arise from DA-GLU neurons, while in the lateral NAc Shell, DA neuron terminals arise from both DA-GLU neurons and DA-only neurons, without VGLUT2. DA-GLU neurons make excitatory connections to the three major cells types, spiny projection neurons, fast-spiking interneuron and cholinergic interneurons (ChIs). The strongest DA-GLU neuron excitatory connections are to ChIs. Photostimulation of DA-GLU neuron terminals in the slice drives ChIs to burst fire. Finally, we review studies that address specially the behavioral function of this subpopulation of DA neurons in extinction learning and latent inhibition. Taking into account findings from anatomical and functional connectome studies, we propose that DA-GLU neuron connections to ChIs in the medial Shell play a crucial role in switching behavioral responses under circumstances of altered cue-reinforcer contingencies.

Coordination of rapid cholinergic and dopaminergic signaling in striatum during spontaneous movement

Interplay between dopaminergic and cholinergic neuromodulation in the striatum is crucial for movement control, with prominent models proposing pro-kinetic and anti-kinetic effects of dopamine and acetylcholine release, respectively. However, the natural, movement-related signals of striatum cholinergic neurons and their relationship to simultaneous variations in dopamine signaling are unknown. Here, functional optical recordings in mice were used to establish rapid cholinergic signals in dorsal striatum during spontaneous movements. Bursts across the cholinergic population occurred at transitions between movement states and were marked by widespread network synchronization which diminished during sustained locomotion. Simultaneous cholinergic and dopaminergic recordings revealed distinct but coordinated sub-second signals, suggesting a new model where cholinergic population synchrony signals rapid changes in movement states while dopamine signals the drive to enact or sustain those states.