Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

The catecholamine neuromodulators dopamine and norepinephrine are implicated in motor function, motivation, and cognition. Although roles for striatal dopamine in these aspects of behavior are well established, the specific roles for cortical catecholamines in regulating striatal dopamine dynamics and behavior are less clear. We recently showed that elevating cortical dopamine but not norepinephrine suppresses hyperactivity in dopamine transporter knockout (DAT-KO) mice, which have elevated striatal dopamine levels. In contrast, norepinephrine transporter knockout (NET-KO) mice have a phenotype distinct from DAT-KO mice, as they show elevated extracellular cortical catecholamines but reduced baseline striatal dopamine levels. Here we evaluated the consequences of altered catecholamine levels in NET-KO mice on cognitive flexibility and striatal dopamine dynamics. In a probabilistic reversal learning task, NET-KO mice showed enhanced reversal learning, which was consistent with larger phasic dopamine transients (dLight) in the dorsomedial striatum (DMS) during reward delivery and reward omission, compared to WT controls. Selective depletion of dorsal medial prefrontal cortex (mPFC) norepinephrine in WT mice did not alter performance on the reversal learning task but reduced nestlet shredding. Surprisingly, NET-KO mice did not show altered breakpoints in a progressive ratio task, suggesting intact food motivation. Collectively, these studies show novel roles of cortical catecholamines in the regulation of tonic and phasic striatal dopamine dynamics and cognitive flexibility, updating our current views on dopamine regulation and informing future therapeutic strategies to counter multiple psychiatric disorders.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.

A novel behavioral paradigm using mice to study predictive postural control

Postural control circuitry performs the essential function of maintaining balance and body position in response to perturbations that are either self-generated (e.g. reaching to pick up an object) or externally delivered (e.g. being pushed by another person). Human studies have shown that anticipation of predictable postural disturbances can modulate such responses. This indicates that postural control could involve higher-level neural structures associated with predictive functions, rather than being purely reactive. However, the underlying neural circuitry remains largely unknown. To enable studies of predictive postural control circuits, we developed a novel task for mice. In this task, modeled after human studies, a dynamic platform generated reproducible translational perturbations. While mice stood bipedally atop a perch to receive water rewards, they experienced backward translations that were either unpredictable or preceded by an auditory cue. To validate the task, we investigated the effect of the auditory cue on postural responses to perturbations across multiple days in three mice. These preliminary results serve to validate a new postural control model, opening the door to the types of neural recordings and circuit manipulations that are currently possible only in mice.

Natural phasic inhibition of dopamine neurons signals cognitive rigidity

When animals unexpectedly fail, their dopamine neurons undergo phasic inhibition that canonically drives extinction learning-a cognitive-flexibility mechanism for discarding outdated strategies. However, the existing evidence equates natural and artificial phasic inhibition, despite their spatiotemporal differences. Addressing this gap, we targeted a GABAA-receptor antagonist precisely to dopamine neurons, yielding three unexpected findings. First, this intervention blocked natural phasic inhibition selectively, leaving tonic activity unaffected. Second, blocking natural phasic inhibition accelerated extinction learning-opposite to canonical mechanisms. Third, our approach selectively benefitted perseverative mice, restoring rapid extinction without affecting new reward learning. Our findings reveal that extinction learning is rapid by default and slowed by natural phasic inhibition-challenging foundational learning theories, while delineating a synaptic mechanism and therapeutic target for cognitive rigidity.

Effects of psychedelic, DOI, on nucleus accumbens dopamine signaling to predictable rewards and cues in rats

Psychedelics produce lasting therapeutic responses in neuropsychiatric diseases suggesting they may disrupt entrenched associations and catalyze learning. Here, we examine psychedelic 5-HT2A/2C agonist, DOI, effects on dopamine signaling in the nucleus accumbens (NAc) core, a region extensively linked to reward learning, motivation, and drug-seeking. We measure phasic dopamine transients following acute DOI administration in rats during well learned Pavlovian tasks in which sequential cues predict rewards. We find that DOI (0.0-1.2 mg/kg, i.p.) increases dopamine signals, photometrically measured using GRABDA optical sensor, to rewards and proximal reward cues, but not to the distal cues that predict these events. We determine that the elevated dopamine produced by DOI to reward cues occurs independently of DOI-induced changes in reward value. The increased dopamine associated with predictable reward cues and rewards supports DOI-induced increases in prediction error signaling. These findings lay a foundation for developing psychedelic strategies aimed at engaging error-driven learning mechanisms to disrupt entrenched associations or produce new associations.

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

Cognitive representations of intracranial self-stimulation of midbrain dopamine neurons depend on stimulation frequency

Dopamine neurons in the ventral tegmental area support intracranial self-stimulation (ICSS), yet the cognitive representations underlying this phenomenon remain unclear. Here, 20-Hz stimulation of dopamine neurons, which approximates a physiologically relevant prediction error, was not sufficient to support ICSS beyond a continuously reinforced schedule and did not endow cues with a general or specific value. However, 50-Hz stimulation of dopamine neurons was sufficient to drive robust ICSS and was represented as a specific reward to motivate behavior. The frequency dependence of this effect is due to the rate (not the number) of action potentials produced by dopamine neurons, which differently modulates dopamine release downstream.

Dietary protein restriction diminishes sucrose reward and reduces sucrose-evoked mesolimbic dopamine signaling

Objective

A growing literature suggests manipulating dietary protein status decreases sweet consumption in rodents and in humans. Underlying neurocircuit mechanisms have not yet been determined, but previous work points towards hedonic rather than homeostatic pathways. Here we hypothesized that a history of protein restriction reduces sucrose seeking by altering mesolimbic dopamine signaling.

Methods

We tested this hypothesis using established behavioral tests of palatability and motivation, including the 'palatability contrast' and conditioned place preference (CPP) tests. We used modern optical sensors for measuring real-time nucleus accumbens (NAc) dopamine dynamics during sucrose consumption, via fiber photometry, in male C57/Bl6J mice maintained on low-protein high-carbohydrate (LPHC) or control (CON) diet for ∼5 weeks.

Results

A history of protein restriction decreased the consumption of a sucrose 'dessert' in sated mice by ∼50% compared to controls [T-test, p< 0.05]. The dopamine release in NAc during sucrose consumption was reduced, also by ∼50%, in LPHC-fed mice compared to CON [T-test, p< 0.01]. Furthermore, LPHC-feeding blocked the sucrose-conditioned place preference we observed in CON-fed mice [paired T-test, p< 0.05], indicating reduced motivation. This was accompanied by a 33% decrease in neuronal activation of the NAc core, as measured by c-Fos immunolabeling from brains collected directly after the CPP test.

Conclusions

Despite ongoing efforts to promote healthier dietary habits, adherence to recommendations aimed at reducing the intake of added sugars and processed sweets remains challenging. This study highlights chronic dietary protein restriction as a nutritional intervention that suppresses the motivation for sucrose intake, via blunted sucrose-evoke dopamine release in NAc.

Multifunctional microelectronic fibers enable wireless modulation of gut and brain neural circuits

Progress in understanding brain-viscera interoceptive signaling is hindered by a dearth of implantable devices suitable for probing both brain and peripheral organ neurophysiology during behavior. Here we describe multifunctional neural interfaces that combine the scalability and mechanical versatility of thermally drawn polymer-based fibers with the sophistication of microelectronic chips for organs as diverse as the brain and the gut. Our approach uses meters-long continuous fibers that can integrate light sources, electrodes, thermal sensors and microfluidic channels in a miniature footprint. Paired with custom-fabricated control modules, the fibers wirelessly deliver light for optogenetics and transfer data for physiological recording. We validate this technology by modulating the mesolimbic reward pathway in the mouse brain. We then apply the fibers in the anatomically challenging intestinal lumen and demonstrate wireless control of sensory epithelial cells that guide feeding behaviors. Finally, we show that optogenetic stimulation of vagal afferents from the intestinal lumen is sufficient to evoke a reward phenotype in untethered mice.

Myelin plasticity in the ventral tegmental area is required for opioid reward

All drugs of abuse induce long-lasting changes in synaptic transmission and neural circuit function that underlie substance-use disorders1,2. Another recently appreciated mechanism of neural circuit plasticity is mediated through activity-regulated changes in myelin that can tune circuit function and influence cognitive behaviour3-7. Here we explore the role of myelin plasticity in dopaminergic circuitry and reward learning. We demonstrate that dopaminergic neuronal activity-regulated myelin plasticity is a key modulator of dopaminergic circuit function and opioid reward. Oligodendroglial lineage cells respond to dopaminergic neuronal activity evoked by optogenetic stimulation of dopaminergic neurons, optogenetic inhibition of GABAergic neurons, or administration of morphine. These oligodendroglial changes are evident selectively within the ventral tegmental area but not along the axonal projections in the medial forebrain bundle nor within the target nucleus accumbens. Genetic blockade of oligodendrogenesis dampens dopamine release dynamics in nucleus accumbens and impairs behavioural conditioning to morphine. Taken together, these findings underscore a critical role for oligodendrogenesis in reward learning and identify dopaminergic neuronal activity-regulated myelin plasticity as an important circuit modification that is required for opioid reward.

Distinct µ-opioid ensembles trigger positive and negative fentanyl reinforcement

Fentanyl is a powerful painkiller that elicits euphoria and positive reinforcement1. Fentanyl also leads to dependence, defined by the aversive withdrawal syndrome, which fuels negative reinforcement2,3 (that is, individuals retake the drug to avoid withdrawal). Positive and negative reinforcement maintain opioid consumption, which leads to addiction in one-fourth of users, the largest fraction for all addictive drugs4. Among the opioid receptors, µ-opioid receptors have a key role5, yet the induction loci of circuit adaptations that eventually lead to addiction remain unknown. Here we injected mice with fentanyl to acutely inhibit γ-aminobutyric acid-expressing neurons in the ventral tegmental area (VTA), causing disinhibition of dopamine neurons, which eventually increased dopamine in the nucleus accumbens. Knockdown of µ-opioid receptors in VTA abolished dopamine transients and positive reinforcement, but withdrawal remained unchanged. We identified neurons expressing µ-opioid receptors in the central amygdala (CeA) whose activity was enhanced during withdrawal. Knockdown of µ-opioid receptors in CeA eliminated aversive symptoms, suggesting that they mediate negative reinforcement. Thus, optogenetic stimulation caused place aversion, and mice readily learned to press a lever to pause optogenetic stimulation of CeA neurons that express µ-opioid receptors. Our study parses the neuronal populations that trigger positive and negative reinforcement in VTA and CeA, respectively. We lay out the circuit organization to develop interventions for reducing fentanyl addiction and facilitating rehabilitation.

Neuromelanin levels in individuals with substance use disorders: A systematic review and meta-analysis

Dopamine's role in addiction has been extensively studied, revealing disruptions in its functioning throughout all addiction stages. Neuromelanin in the substantia nigra (SN) may reflect dopamine auto-oxidation, and can be quantified using neuromelaninsensitive magnetic resonance imaging (neuromelanin-MRI) in a non-invasive manner.In this pre-registered systematic review, we assess the current body of evidence related to neuromelanin levels in substance use disorders, using both post-mortem and MRI examinations. The systematic search identified 10 relevant articles, primarily focusing on the substantia nigra. An early-stage meta-analysis (n = 6) revealed varied observations ranging from standardized mean differences of -3.55 to +0.62, with a pooled estimate of -0.44 (95 % CI = -1.52, 0.65), but there was insufficient power to detect differences in neuromelanin content among individuals with substance use disorders. Our gap analysis highlights the lack of sufficient replication studies, with existing studies lacking the power to detect a true difference, and a complete lack of neuromelanin studies on certain substances of clinical interest. We provide recommendations for future studies of dopaminergic neurobiology in addictions and related psychiatric comorbidities.

The antipsychotic agent sulpiride microinjected into the ventral pallidum restores positive symptom-like habituation disturbance in MAM-E17 schizophrenia model rats

Dysfunction of subcortical D2-like dopamine receptors (D2Rs) can lead to positive symptoms of schizophrenia, and their analog, the increased locomotor activity in schizophrenia model MAM-E17 rats. The ventral pallidum (VP) is a limbic structure containing D2Rs. The D2R antagonist sulpiride is a widespread antipsychotic drug, which can alleviate positive symptoms in human patients. However, it is still not known how sulpiride can influence positive symptoms via VP D2Rs. We hypothesize that the microinjection of sulpiride into the VP can normalize hyperactivity in MAM-E17 rats. In addition, recently, we showed that the microinjection of sulpirid into the VP induces place preference in neurotypical rats. Thus, we aimed to test whether intra-VP sulpiride can also have a rewarding effect in MAM-E17 rats. Therefore, open field-based conditioned place preference (CPP) test was applied in neurotypical (SAL-E17) and MAM-E17 schizophrenia model rats to test locomotor activity and the potential locomotor-reducing and rewarding effects of sulpiride. Sulpiride was microinjected bilaterally in three different doses into the VP, and the controls received only vehicle. The results of the present study demonstrated that the increased locomotor activity of the MAM-E17 rats was caused by habituation disturbance. Accordingly, larger doses of sulpiride in the VP reduce the positive symptom-analog habituation disturbance of the MAM-E17 animals. Furthermore, we showed that the largest dose of sulpiride administered into the VP induced CPP in the SAL-E17 animals but not in the MAM-E17 animals. These findings revealed that VP D2Rs play an important role in the formation of positive symptom-like habituation disturbances in MAM-E17 rats.

Optimized Fabrication of Carbon-Fiber Microbiosensors for Codetection of Glucose and Dopamine in Brain Tissue

Dopamine (DA) signaling is critically important in striatal function, and this metabolically demanding process is fueled largely by glucose. However, DA and glucose are typically studied independently and, as such, the precise relationship between DA release and glucose availability remains unclear. Fast-scan cyclic voltammetry (FSCV) is commonly coupled with carbon-fiber microelectrodes to study DA transients. These microelectrodes can be modified with glucose oxidase (GOx) to generate microbiosensors capable of simultaneously quantifying real-time and physiologically relevant fluctuations of glucose, a nonelectrochemically active substrate, and DA, which is readily oxidized and reduced at the electrode surface. A chitosan hydrogel can be electrodeposited to entrap the oxidase enzyme on the sensor surface for stable, sensitive, and selective codetection of glucose and DA using FSCV. This strategy can also be used to entrap lactate oxidase on the carbon-fiber surface for codetection of lactate and DA. However, these custom probes are individually fabricated by hand, and performance is variable. This study characterizes the physical nature of the hydrogel and its effects on the acquired electrochemical data in the detection of glucose (2.6 mM) and DA (1 μM). The results demonstrate that the electrodeposition of the hydrogel membrane is improved using a linear potential sweep rather than a direct step to the target potential. Electrochemical impedance spectroscopy data relate information on the physical nature of the electrode/solution interface to the electrochemical performance of bare and enzyme-modified carbon-fiber microelectrodes. The electrodeposition waveform and scan rate were characterized for optimal membrane formation and performance. Finally, codetection of both DA/glucose and DA/lactate was demonstrated in intact rat striatum using probes fabricated according to the optimized protocol. Overall, this work improves the reliable fabrication of carbon-fiber microbiosensors for codetection of DA and important energetic substrates that are locally delivered to the recording site to meet metabolic demand.

A dopamine mechanism for reward maximization

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task

The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward ('incentive compatibility'). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals' bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.

An unbiased method to partition diverse neuronal responses into functional ensembles reveals interpretable population dynamics during innate social behavior

In neuroscience, understanding how single-neuron firing contributes to distributed neural ensembles is crucial. Traditional methods of analysis have been limited to descriptions of whole population activity, or, when analyzing individual neurons, criteria for response categorization varied significantly across experiments. Current methods lack scalability for large datasets, fail to capture temporal changes and rely on parametric assumptions. There's a need for a robust, scalable, and non-parametric functional clustering approach to capture interpretable dynamics. To address this challenge, we developed a model-based, statistical framework for unsupervised clustering of multiple time series datasets that exhibit nonlinear dynamics into an a-priori-unknown number of parameterized ensembles called Functional Encoding Units (FEUs). FEU outperforms existing techniques in accuracy and benchmark scores. Here, we apply this FEU formalism to single-unit recordings collected during social behaviors in rodents and primates and demonstrate its hypothesis-generating and testing capacities. This novel pipeline serves as an analytic bridge, translating neural ensemble codes across model systems.

Acetylcholine demixes heterogeneous dopamine signals for learning and moving

Midbrain dopamine neurons promote reinforcement learning and movement vigor. A major outstanding question is how dopamine-recipient neurons in the striatum parse these heterogeneous signals. Here we characterized dopamine and acetylcholine release in the dorsomedial striatum (DMS) of rats performing a decision-making task. We found that dopamine acted as a reward prediction error (RPE), modulating behavior and DMS spiking on subsequent trials when coincident with pauses in cholinergic release. In contrast, at task events that elicited coincident bursts of acetylcholine and dopamine, dopamine preceded contralateral movements and predicted movement vigor without inducing plastic changes in DMS firing rates. Our findings provide a circuit-level mechanism by which cholinergic modulation allows the same dopamine signals to be used for either movement or learning depending on instantaneous behavioral context.

NAPE-PLD in the ventral tegmental area regulates reward events, feeding and energy homeostasis

The N-acyl phosphatidylethanolamine-specific phospholipase D (NAPE-PLD) catalyzes the production of N-acylethanolamines (NAEs), a family of endogenous bioactive lipids, which are involved in various biological processes ranging from neuronal functions to energy homeostasis and feeding behaviors. Reward-dependent behaviors depend on dopamine (DA) transmission between the ventral tegmental area (VTA) and the nucleus accumbens (NAc), which conveys reward-values and scales reinforced behaviors. However, whether and how NAPE-PLD may contribute to the regulation of feeding and reward-dependent behaviors has not yet been investigated. This biological question is of paramount importance since NAEs are altered in obesity and metabolic disorders. Here, we show that transcriptomic meta-analysis highlights a potential role for NAPE-PLD within the VTA→NAc circuit. Using brain-specific invalidation approaches, we report that the integrity of NAPE-PLD is required for the proper homeostasis of NAEs within the midbrain VTA and it affects food-reward behaviors. Moreover, region-specific knock-down of NAPE-PLD in the VTA enhanced food-reward seeking and reinforced behaviors, which were associated with increased in vivo DA release dynamics in response to both food- and non-food-related rewards together with heightened tropism towards food consumption. Furthermore, midbrain knock-down of NAPE-PLD, which increased energy expenditure and adapted nutrient partitioning, elicited a relative protection against high-fat diet-mediated body fat gain and obesity-associated metabolic features. In conclusion, these findings reveal a new key role of VTA NAPE-PLD in shaping DA-dependent events, feeding behaviors and energy homeostasis, thus providing new insights on the regulation of body metabolism.

Mesolimbic dopamine encodes reward prediction errors independent of learning rates

Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented in synaptic weights in the striatum, and updated by dopamine-dependent plasticity, suggesting that dopamine release might reflect the product of the learning rate and RPE. Here, we leveraged the fact that animals learn faster in volatile environments to characterize dopamine encoding of learning rates. We trained rats on a task with semi-observable states offering different rewards, and rats adjusted how quickly they initiated trials across states using RPEs. Computational modeling and behavioral analyses showed that learning rates were higher following state transitions, and scaled with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the nucleus accumbens encoded RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.

Stimulation of VTA dopamine inputs to LH upregulates orexin neuronal activity in a DRD2-dependent manner

Dopamine and orexins (hypocretins) play important roles in regulating reward-seeking behaviors. It is known that hypothalamic orexinergic neurons project to dopamine neurons in the ventral tegmental area (VTA), where they can stimulate dopaminergic neuronal activity. Although there are reciprocal connections between dopaminergic and orexinergic systems, whether and how dopamine regulates the activity of orexin neurons is currently not known. Here we implemented an opto-Pavlovian task in which mice learn to associate a sensory cue with optogenetic dopamine neuron stimulation to investigate the relationship between dopamine release and orexin neuron activity in the lateral hypothalamus (LH). We found that dopamine release can be evoked in LH upon optogenetic stimulation of VTA dopamine neurons and is also naturally evoked by cue presentation after opto-Pavlovian learning. Furthermore, orexin neuron activity could also be upregulated by local stimulation of dopaminergic terminals in the LH in a way that is partially dependent on dopamine D2 receptors (DRD2). Our results reveal previously unknown orexinergic coding of reward expectation and unveil an orexin-regulatory axis mediated by local dopamine inputs in the LH.

Pharmacological Inhibition of the Nucleus Accumbens Increases Dyadic Social Interaction in Macaques

The nucleus accumbens (NAc) is a central component of the brain circuitry that mediates motivated behavior, including reward processing. Since the rewarding properties of social stimuli have a vital role in guiding behavior (both in humans and nonhuman animals), the NAc is likely to contribute to the brain circuitry controlling social behavior. In rodents, prior studies have found that focal pharmacological inhibition of NAc and/or elevation of dopamine in NAc increases social interactions. However, the role of the NAc in social behavior in nonhuman primates remains unknown. We measured the social behavior of eight dyads of male macaques following (1) pharmacological inhibition of the NAc using the GABAA agonist muscimol and (2) focal application of quinpirole, an agonist at the D2 family of dopamine receptors. Transient inhibition of the NAc with muscimol increased social behavior when drug was infused in submissive, but not dominant partners of the dyad. Focal application of quinpirole was without effect on social behavior when infused into the NAc of either dominant or submissive subjects. Our data demonstrate that the NAc contributes to social interactions in nonhuman primates.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Memory-specific encoding activities of the ventral tegmental area dopamine and GABA neurons

Although the midbrain dopamine (DA) system plays a crucial role in higher cognitive functions, including updating and maintaining short-term memory, the encoding properties of the somatic spiking activity of ventral tegmental area (VTA) DA neurons for short-term memory computations have not yet been identified. Here, we probed and analyzed the activity of optogenetically identified DA and GABA neurons while mice engaged in short-term memory-dependent behavior in a T-maze task. Single-neuron analysis revealed that significant subpopulations of DA and GABA neurons responded differently between left and right trials in the memory delay. With a series of control behavioral tasks and regression analysis tools, we show that firing rate differences are linked to short-term memory-dependent decisions and cannot be explained by reward-related processes, motivated behavior, or motor-related activities. This evidence provides novel insights into the mnemonic encoding activities of midbrain DA and GABA neurons.

PI4KIIIβ-Mediated Phosphoinositides Metabolism Regulates Function of the VTA Dopaminergic Neurons and Depression-Like Behavior

Phosphoinositides, including phosphatidylinositol-4,5-bisphosphate (PIP2), play a crucial role in controlling key cellular functions such as membrane and vesicle trafficking, ion channel, and transporter activity. Phosphatidylinositol 4-kinases (PI4K) are essential enzymes in regulating the turnover of phosphoinositides. However, the functional role of PI4Ks and mediated phosphoinositide metabolism in the central nervous system has not been fully revealed. In this study, we demonstrated that PI4KIIIβ, one of the four members of PI4Ks, is an important regulator of VTA dopaminergic neuronal activity and related depression-like behavior of mice by controlling phosphoinositide turnover. Our findings provide new insights into possible mechanisms and potential drug targets for neuropsychiatric diseases, including depression. Both sexes were studied in basic behavior tests, but only male mice could be used in the social defeat depression model.

Channelrhodopsin-2 Oligomerization in Cell Membrane Revealed by Photo-Activated Localization Microscopy

Microbial rhodopsins are retinal membrane proteins that found a broad application in optogenetics. The oligomeric state of rhodopsins is important for their functionality and stability. Of particular interest is the oligomeric state in the cellular native membrane environment. Fluorescence microscopy provides powerful tools to determine the oligomeric state of membrane proteins directly in cells. Among these methods is quantitative photoactivated localization microscopy (qPALM) allowing the investigation of molecular organization at the level of single protein clusters. Here, we apply qPALM to investigate the oligomeric state of the first and most used optogenetic tool Channelrhodopsin-2 (ChR2) in the plasma membrane of eukaryotic cells. ChR2 appeared predominantly as a dimer in the cell membrane and did not form higher oligomers. The disulfide bonds between Cys34 and Cys36 of adjacent ChR2 monomers were not required for dimer formation and mutations disrupting these bonds resulted in only partial monomerization of ChR2. The monomeric fraction increased when the total concentration of mutant ChR2 in the membrane was low. The dissociation constant was estimated for this partially monomerized mutant ChR2 as 2.2±0.9 proteins/μm2 . Our findings are important for understanding the mechanistic basis of ChR2 activity as well as for improving existing and developing future optogenetic tools.

Janus microparticles-based targeted and spatially-controlled piezoelectric neural stimulation via low-intensity focused ultrasound

Electrical stimulation is a fundamental tool in studying neural circuits, treating neurological diseases, and advancing regenerative medicine. Injectable, free-standing piezoelectric particle systems have emerged as non-genetic and wireless alternatives for electrode-based tethered stimulation systems. However, achieving cell-specific and high-frequency piezoelectric neural stimulation remains challenging due to high-intensity thresholds, non-specific diffusion, and internalization of particles. Here, we develop cell-sized 20 μm-diameter silica-based piezoelectric magnetic Janus microparticles (PEMPs), enabling clinically-relevant high-frequency neural stimulation of primary neurons under low-intensity focused ultrasound. Owing to its functionally anisotropic design, half of the PEMP acts as a piezoelectric electrode via conjugated barium titanate nanoparticles to induce electrical stimulation, while the nickel-gold nanofilm-coated magnetic half provides spatial and orientational control on neural stimulation via external uniform rotating magnetic fields. Furthermore, surface functionalization with targeting antibodies enables cell-specific binding/targeting and stimulation of dopaminergic neurons. Taking advantage of such functionalities, the PEMP design offers unique features towards wireless neural stimulation for minimally invasive treatment of neurological diseases.

Synaptotagmin-7 Counteracts Short-Term Depression during Phasic Dopamine Release

Dopamine neurons switch from tonic pacemaker activity to high-frequency bursts in response to salient stimuli. These bursts lead to superlinear increases in dopamine release, and the degree of this increase is highly dependent on firing frequency. The superlinearity and frequency dependence of dopamine release implicate short-term plasticity processes. The presynaptic Ca2+-sensor synaptotagmin-7 (SYT7) has suitable properties to mediate such short-term plasticity and has been implicated in regulating dopamine release from somatodendritic compartments. Here, we use a genetically encoded dopamine sensor and whole-cell electrophysiology in Syt7 KO mice to determine how SYT7 contributes to both axonal and somatodendritic dopamine release. We find that SYT7 mediates a hidden component of facilitation of release from dopamine terminals that can be unmasked by lowering initial release probability or by predepressing synapses with low-frequency stimulation. Depletion of SYT7 increased short-term depression and reduced release during stimulations that mimic in vivo firing. Recordings of D2-mediated inhibitory postsynaptic currents in the substantia nigra pars compacta (SNc) confirmed a similar role for SYT7 in somatodendritic release. Our results indicate that SYT7 drives short-term facilitation of dopamine release, which may explain the frequency dependence of dopamine signaling seen in vivo.

Somatodendritic organization of pacemaker activity in midbrain dopamine neurons

The slow and regular pacemaking activity of midbrain dopamine (DA) neurons requires proper spatial organization of the excitable elements between the soma and dendritic compartments, but the somatodendritic organization is not clear. Here, we show that the dynamic interaction between the soma and multiple proximal dendritic compartments (PDCs) generates the slow pacemaking activity in DA neurons. In multipolar DA neurons, spontaneous action potentials (sAPs) consistently originate from the axon-bearing dendrite. However, when the axon initial segment was disabled, sAPs emerge randomly from various primary PDCs, indicating that multiple PDCs drive pacemaking. Ca2+ measurements and local stimulation/perturbation experiments suggest that the soma serves as a stably-oscillating inertial compartment, while multiple PDCs exhibit stochastic fluctuations and high excitability. Despite the stochastic and excitable nature of PDCs, their activities are balanced by the large centrally-connected inertial soma, resulting in the slow synchronized pacemaking rhythm. Furthermore, our electrophysiological experiments indicate that the soma and PDCs, with distinct characteristics, play different roles in glutamate- induced burst-pause firing patterns. Excitable PDCs mediate excitatory burst responses to glutamate, while the large inertial soma determines inhibitory pause responses to glutamate. Therefore, we could conclude that this somatodendritic organization serves as a common foundation for both pacemaker activity and evoked firing patterns in midbrain DA neurons.

Dynamic behaviour restructuring mediates dopamine-dependent credit assignment

Animals exhibit a diverse behavioural repertoire when exploring new environments and can learn which actions or action sequences produce positive outcomes. Dopamine release after encountering a reward is critical for reinforcing reward-producing actions1-3. However, it has been challenging to understand how credit is assigned to the exact action that produced the dopamine release during continuous behaviour. Here we investigated this problem in mice using a self-stimulation paradigm in which specific spontaneous movements triggered optogenetic stimulation of dopaminergic neurons. Dopamine self-stimulation rapidly and dynamically changes the structure of the entire behavioural repertoire. Initial stimulations reinforced not only the stimulation-producing target action, but also actions similar to the target action and actions that occurred a few seconds before stimulation. Repeated pairings led to a gradual refinement of the behavioural repertoire to home in on the target action. Reinforcement of action sequences revealed further temporal dependencies of refinement. Action pairs spontaneously separated by long time intervals promoted a stepwise credit assignment, with early refinement of actions most proximal to stimulation and subsequent refinement of more distal actions. Thus, a retrospective reinforcement mechanism promotes not only reinforcement, but also gradual refinement of the entire behavioural repertoire to assign credit to specific actions and action sequences that lead to dopamine release.

Prediction error in dopamine neurons during associative learning

Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine's computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are central in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self-stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-Cre rats. We find that while VTA dopamine neuron activation in the absence of explicit external cues is sufficient to maintain robust self-stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Downstream network transformations dissociate neural activity from causal functional contributions

Neuroscientists rely on distributed spatio-temporal patterns of neural activity to understand how neural units contribute to cognitive functions and behavior. However, the extent to which neural activity reliably indicates a unit's causal contribution to the behavior is not well understood. To address this issue, we provide a systematic multi-site perturbation framework that captures time-varying causal contributions of elements to a collectively produced outcome. Applying our framework to intuitive toy examples and artificial neural networks revealed that recorded activity patterns of neural elements may not be generally informative of their causal contribution due to activity transformations within a network. Overall, our findings emphasize the limitations of inferring causal mechanisms from neural activities and offer a rigorous lesioning framework for elucidating causal neural contributions.

Neuroscience of reward: Paradoxical roles for corticotrophin-releasing factor

The brain has long been known to control stress and reward through complex and interconnected circuitry. A new study now reveals a group of hypothalamic neurons that paradoxically mediate both reward and aversion.

Targeting mitochondrial dynamics of morphine-responsive dopaminergic neurons ameliorates opiate withdrawal

Converging studies demonstrate the dysfunction of the dopaminergic neurons following chronic opioid administration. However, the therapeutic strategies targeting opioid-responsive dopaminergic ensembles that contribute to the development of opioid withdrawal remain to be elucidated. Here, we used the neuronal activity-dependent Tet-Off system to label dopaminergic ensembles in response to initial morphine exposure (Mor-Ens) in the ventral tegmental area (VTA). Fiber optic photometry recording and transcriptome analysis revealed downregulated spontaneous activity and dysregulated mitochondrial respiratory, ultrastructure, and oxidoreductase signal pathways after chronic morphine administration in these dopaminergic ensembles. Mitochondrial fragmentation and the decreased mitochondrial fusion gene mitofusin 1 (Mfn1) were found in these ensembles after prolonged opioid withdrawal. Restoration of Mfn1 in the dopaminergic Mor-Ens attenuated excessive oxidative stress and the development of opioid withdrawal. Administration of Mdivi-1, a mitochondrial fission inhibitor, ameliorated the mitochondrial fragmentation and maladaptation of the neuronal plasticity in these Mor-Ens, accompanied by attenuated development of opioid withdrawal after chronic morphine administration, without affecting the analgesic effect of morphine. These findings highlighted the plastic architecture of mitochondria as a potential therapeutic target for opioid analgesic-induced substance use disorders.

Coordinating brain-distributed network activities in memory resistant to extinction

Certain memories resist extinction to continue invigorating maladaptive actions. The robustness of these memories could depend on their widely distributed implementation across populations of neurons in multiple brain regions. However, how dispersed neuronal activities are collectively organized to underpin a persistent memory-guided behavior remains unknown. To investigate this, we simultaneously monitored the prefrontal cortex, nucleus accumbens, amygdala, hippocampus, and ventral tegmental area (VTA) of the mouse brain from initial recall to post-extinction renewal of a memory involving cocaine experience. We uncover a higher-order pattern of short-lived beta-frequency (15-25 Hz) activities that are transiently coordinated across these networks during memory retrieval. The output of a divergent pathway from upstream VTA glutamatergic neurons, paced by a slower (4-Hz) oscillation, actuates this multi-network beta-band coactivation; its closed-loop phase-informed suppression prevents renewal of cocaine-biased behavior. Binding brain-distributed neural activities in this temporally structured manner may constitute an organizational principle of robust memory expression.

Magnetoelectric Nanodiscs Enable Wireless Transgene-Free Neuromodulation

Deep-brain stimulation (DBS) with implanted electrodes revolutionized treatment of movement disorders and empowered neuroscience studies. Identifying less invasive alternatives to DBS may further extend its clinical and research applications. Nanomaterial-mediated transduction of magnetic fields into electric potentials offers an alternative to invasive DBS. Here, we synthesize magnetoelectric nanodiscs (MENDs) with a core-double shell Fe3O4-CoFe2O4-BaTiO3 architecture with efficient magnetoelectric coupling. We find robust responses to magnetic field stimulation in neurons decorated with MENDs at a density of 1 μg/mm2 despite individual-particle potentials below the neuronal excitation threshold. We propose a model for repetitive subthreshold depolarization, which combined with cable theory, corroborates our findings in vitro and informs magnetoelectric stimulation in vivo. MENDs injected into the ventral tegmental area of genetically intact mice at concentrations of 1 mg/mL enable remote control of reward behavior, setting the stage for mechanistic optimization of magnetoelectric neuromodulation and inspiring its future applications in fundamental and translational neuroscience.

Drug-induced change in transmitter identity is a shared mechanism generating cognitive deficits

Cognitive deficits are a long-lasting consequence of drug use, yet the convergent mechanism by which classes of drugs with different pharmacological properties cause similar deficits is unclear. We find that both phencyclidine and methamphetamine, despite differing in their targets in the brain, cause the same glutamatergic neurons in the medial prefrontal cortex to gain a GABAergic phenotype and decrease their expression of the vesicular glutamate transporter. Suppressing the drug-induced gain of GABA with RNA-interference prevents the appearance of memory deficits. Stimulation of dopaminergic neurons in the ventral tegmental area is necessary and sufficient to produce this gain of GABA. Drug-induced prefrontal hyperactivity drives this change in transmitter identity. Returning prefrontal activity to baseline, chemogenetically or with clozapine, reverses the change in transmitter phenotype and rescues the associated memory deficits. The results reveal a shared and reversible mechanism that regulates the appearance of cognitive deficits upon exposure to different drugs.

Stress relief as a natural resilience mechanism against depression-like behaviors

Relief, the appetitive state after the termination of aversive stimuli, is evolutionarily conserved. Understanding the behavioral role of this well-conserved phenomenon and its underlying neurobiological mechanisms are open and important questions. Here, we discover that the magnitude of relief from physical stress strongly correlates with individual resilience to depression-like behaviors in chronic stressed mice. Notably, blocking stress relief causes vulnerability to depression-like behaviors, whereas natural rewards supplied shortly after stress promotes resilience. Stress relief is mediated by reward-related mesolimbic dopamine neurons, which show minute-long, persistent activation after stress termination. Circuitry-wise, activation or inhibition of circuits downstream of the ventral tegmental area during the transient relief period bi-directionally regulates depression resilience. These results reveal an evolutionary function of stress relief in depression resilience and identify the neural substrate mediating this effect. Importantly, our data suggest a behavioral strategy of augmenting positive valence of stress relief with natural rewards to prevent depression.

Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility

Behavioural flexibility is key to survival in a dynamic environmentWhile flexible, goal-directed behaviours are initially dependent on dorsomedial striatum, they become dependent on lateral striatum as behaviours become inflexible. Similarly, lesions of dopamine terminals in lateral striatum disrupt the development of inflexible habits. This work suggests that dopamine release in lateral striatum may drive inflexible behaviours, though few studies have investigated a causative role of subpopulations of striatal dopamine terminals in reversal learning, a measure of flexibility. Here, we performed two optogenetic experiments to activate dopamine terminals in dorsomedial (DMS), dorsolateral (DLS) or ventral (nucleus accumbens [NAc]) striatum in DAT-Cre mice that expressed channelrhodopsin-2 via viral injection (Experiment I) or through transgenic breeding with an Ai32 reporter line (Experiment II) to determine how specific dopamine subpopulations impact reversal learning. Mice performed a reversal task in which they self-stimulated DMS, DLS, or NAc dopamine terminals by pressing one of two levers before action-outcome lever contingencies were reversed. Largely consistent with presumed ventromedial/lateral striatal function, we found that mice self-stimulating medial dopamine terminals reversed lever preference following contingency reversal, while mice self-stimulating NAc showed parial flexibility, and DLS self-stimulation resulted in impaired reversal. Impairments in DLS mice were characterized by more regressive errors and reliance on lose-stay strategies following reversal, as well as reduced within-session learning, suggesting reward insensitivity and overreliance on previously learned actions. This study supports a model of striatal function in which DMS and ventral dopamine facilitate goal-directed responding, and DLS dopamine supports more inflexible responding.

Repeated chemogenetic activation of dopaminergic neurons induces reversible changes in baseline and amphetamine-induced behaviors

RATIONALE

Repeated chemogenetic stimulation is often employed to study circuit function and behavior. Chronic or repeated agonist administration can result in homeostatic changes, but this has not been extensively studied with designer receptors exclusively activated by designer drugs (DREADDs).

OBJECTIVES

We sought to evaluate the impact of repeated DREADD activation of dopaminergic (DA) neurons on basal behavior, amphetamine response, and spike firing. We hypothesized that repeated DREADD activation would mimic compensatory effects that we observed with genetic manipulations of DA neurons.

METHODS

Excitatory hM3D(Gq) DREADDs were virally expressed in adult TH-Cre and WT mice. In a longitudinal design, clozapine N-oxide (CNO, 1.0 mg/kg) was administered repeatedly. We evaluated basal and CNO- or amphetamine (AMPH)-induced locomotion and stereotypy. DA neuronal activity was assessed using in vivo single-unit recordings.

RESULTS

Acute CNO administration increased locomotion, but basal locomotion decreased after repeated CNO exposure in TH-CrehM3Dq mice relative to littermate controls. Further, after repeated CNO administration, AMPH-induced hyperlocomotion and stereotypy were diminished in TH-CrehM3Dq mice relative to controls. Repeated CNO administration reduced DA neuronal firing in TH-CrehM3Dq mice relative to controls. A two-month CNO washout period rescued the decreases in basal locomotion and AMPH response.

CONCLUSIONS

We found that repeated DREADD activation of DA neurons evokes homeostatic changes that should be factored into the interpretation of chronic DREADD applications and their impact on circuit function and behavior. These effects are likely to also be seen in other neuronal systems and underscore the importance of studying neuroadaptive changes with chronic or repeated DREADD activation.

Dorsal raphe stimulation relays a reward signal to the ventral tegmental area via GluN2C NMDA receptors

BACKGROUND

Glutamate relays a reward signal from the dorsal raphe (DR) to the ventral tegmental area (VTA). However, the role of the different subtypes of N-methyl-D-aspartate (NMDA) receptors is complex and not clearly understood. Therefore, we measured NMDA receptors subunits expression in limbic brain areas. In addition, we studied the effects of VTA down-regulation of GluN2C NMDA receptor on the reward signal that arises from DR electrical stimulation.

METHODS

Using qPCR, we identified the relative composition of the different Grin2a-d subunits of the NMDA receptors in several brain areas. Then, we used fluorescent in situ hybridization (FISH) to evaluate the colocalization of Grin2c and tyrosine hydroxylase (TH) mRNA in VTA neurons. To assess the role of GluN2C in brain stimulation reward, we downregulated this receptor using small interfering RNA (siRNA) in rats self-stimulating for electrical pulses delivered to the DR. To delineate further the specific role of GluN2C in relaying the reward signal, we pharmacologically altered the function of VTA NMDA receptors by bilaterally microinjecting the NMDA receptor antagonist PPPA.

RESULTS

We identified GluN2C as the most abundant subunit of the NMDA receptor expressed in the VTA. FISH revealed that about 50% of TH-positive neurons colocalize with Grin2c transcript. siRNA manipulation produced a selective down-regulation of the GluN2C protein subunit and a significant reduction in brain stimulation reward. Interestingly, PPPA enhanced brain stimulation reward, but only in rats that received the nonactive RNA sequence.

CONCLUSION

The present results suggest that VTA glutamate neurotransmission relays a reward signal initiated by DR stimulation by acting on GluN2C NMDA receptors.

Neurocircuits for motivation

The nervous system coordinates various motivated behaviors such as feeding, drinking, and escape to promote survival and evolutionary fitness. Although the precise behavioral repertoires required for distinct motivated behaviors are diverse, common features such as approach or avoidance suggest that common brain substrates are required for a wide range of motivated behaviors. In this Review, I describe a framework by which neural circuits specified for some innate drives regulate the activity of ventral tegmental area (VTA) dopamine neurons to reinforce ongoing or planned actions to fulfill motivational demands. This framework may explain why signaling from VTA dopamine neurons is ubiquitously involved in many types of diverse volitional motivated actions, as well as how sensory and interoceptive cues can initiate specific goal-directed actions.

Long-Term In Vivo Molecular Monitoring Using Aptamer-Graphene Microtransistors

Long-term, real-time molecular monitoring in complex biological environments is critical for our ability to understand, prevent, diagnose, and manage human diseases. Aptamer-based electrochemical biosensors possess the promise due to their generalizability and a high degree of selectivity. Nevertheless, the operation of existing aptamer-based biosensors in vivo is limited to a few hours. Here, we report a first-generation long-term in vivo molecular monitoring platform, named aptamer-graphene microtransistors (AGMs). The AGM incorporates a layer of pyrene-(polyethylene glycol)5-alcohol and DNase inhibitor-doped polyacrylamide hydrogel coating to reduce biofouling and aptamer degradation. As a demonstration of function and generalizability, the AGM achieves the detection of biomolecules such as dopamine and serotonin in undiluted whole blood at 37 °C for 11 days. Furthermore, the AGM successfully captures optically evoked dopamine release in vivo in mice for over one week and demonstrates the capability to monitor behaviorally-induced endogenous dopamine release even after eight days of implantation in freely moving mice. The results reported in this work establish the potential for chronic aptamer-based molecular monitoring platforms, and thus serve as a new benchmark for molecular monitoring using aptamer-based technology.

Sensory cues potentiate VTA dopamine mediated reinforcement

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are critical in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-cre rats. We find that while VTA dopamine neuron activation in the absence of any external cueing stimulus is sufficient to maintain robust self stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Striatal Dopamine Signals and Reward Learning

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.

NAPE-PLD in the ventral tegmental area regulates reward events, feeding and energy homeostasis

The N-acyl phosphatidylethanolamine-specific phospholipase D (NAPE-PLD) catalyzes the production of N-acylethanolamines (NAEs), a family of endogenous bioactive lipids, which are involved in various biological processes ranging from neuronal functions to energy homeostasis and feeding behaviors. Reward-dependent behaviors depend on dopamine (DA) transmission between the ventral tegmental area (VTA) and the nucleus accumbens (NAc), which conveys reward-values and scales reinforced behaviors. However, whether and how NAPE-PLD may contribute to the regulation of feeding and reward-dependent behaviors has not yet been investigated. This biological question is of paramount importance since NAEs are altered in obesity and metabolic disorders. Here, we show that transcriptomic meta-analysis highlights a potential role for NAPE-PLD within the VTA®NAc circuit. Using brain-specific invalidation approaches, we report that the integrity of NAPE-PLD is required for the proper homeostasis of NAEs within the midbrain VTA and it affects food-reward behaviors. Moreover, region-specific knock-down of NAPE-PLD in the VTA enhanced food-reward seeking and reinforced behaviors, which were associated with increased in vivo DA release dynamics in response to both food and non-food-related rewards together with heightened tropism towards food consumption. Furthermore, midbrain knock-down of NAPE-PLD, which increased energy expenditure and adapted nutrient partitioning, elicited a relative protection against high-fat diet-mediated body fat gain and obesity-associated metabolic features. In conclusion, these findings reveal a new key role of VTA NAPE-PLD in shaping DA-dependent events, feeding behaviors and energy homeostasis, thus providing new insights on the regulation of body metabolism.

The role of orexin-1 receptors within the ventral tegmental area in the extinction and reinstatement of methamphetamine place preference

Targeting the orexin system has recently been identified as one of the promising options for treating drug addiction. It may be more feasible and achievable if we investigate the accurate function of the orexin system in brain areas implicated in reward and addiction, such as the ventral tegmental area (VTA) by animal reward models. This study investigated the contribution of the orexin system, mainly the orexin-1 receptors (OX1R) in the VTA, in the extinction and reinstatement of methamphetamine (METH) related memories in the conditioned place preference (CPP) model. Animals after the acquisition of METH place preference were subjected to two separate sets of extinction and reinstatement experiments to receive various concentrations of selective OX1R antagonist, SB334867 into the bilateral VTA before extinction sessions (1, 3, and 10 nmol/0.3 μl DMSO per side) or only on the reinstatement phase (3, 10, and 30 nmol/0.3 μl DMSO per side), respectively. Intra-VTA infusion of SB334867 throughout the extinction phase could remarkably facilitate the extinction process and decrease the maintenance of reinforcing effects of METH at the highest dosage (10 nmol; p < 0.0001). Data also indicated a single microinfusion of SB334867 into the VTA before reinstatement of the METH-seeking behavior could considerably prevent the relapse of previously formed reward-context memories (10 nmol; p < 0.01 and 30 nmol; p < 0.001). The present study provided evidence supporting the potential therapeutic effects of the orexin system modulation, specifically in the VTA, on different stages of METH-induced place preference.

A unified open-source platform for multimodal neural recording and perturbation during naturalistic behavior

Behavioral neuroscience faces two conflicting demands: long-duration recordings from large neural populations and unimpeded animal behavior. To meet this challenge, we developed ONIX, an open-source data acquisition system with high data throughput (2GB/sec) and low closed-loop latencies (<1ms) that uses a novel 0.3 mm thin tether to minimize behavioral impact. Head position and rotation are tracked in 3D and used to drive active commutation without torque measurements. ONIX can acquire from combinations of passive electrodes, Neuropixels probes, head-mounted microscopes, cameras, 3D-trackers, and other data sources. We used ONIX to perform uninterrupted, long (~7 hours) neural recordings in mice as they traversed complex 3-dimensional terrain. ONIX allowed exploration with similar mobility as non-implanted animals, in contrast to conventional tethered systems which restricted movement. By combining long recordings with full mobility, our technology will enable new progress on questions that require high-quality neural recordings during ethologically grounded behaviors.

Neural mechanisms underlying uninstructed orofacial movements during reward-based learning behaviors

During reward-based learning tasks, animals make orofacial movements that globally influence brain activity at the timings of reward expectation and acquisition. These orofacial movements are not explicitly instructed and typically appear along with goal-directed behaviors. Here, we show that reinforcing optogenetic stimulation of dopamine neurons in the ventral tegmental area (oDAS) in mice is sufficient to induce orofacial movements in the whiskers and nose without accompanying goal-directed behaviors. Pavlovian conditioning with a sensory cue and oDAS elicited cue-locked and oDAS-aligned orofacial movements, which were distinguishable by a machine-learning model. Inhibition or knockout of dopamine D1 receptors in the nucleus accumbens inhibited oDAS-induced motion but spared cue-locked motion, suggesting differential regulation of these two types of orofacial motions. In contrast, inactivation of the whisker primary motor cortex (wM1) abolished both types of orofacial movements. We found specific neuronal populations in wM1 representing either oDAS-aligned or cue-locked whisker movements. Notably, optogenetic stimulation of wM1 neurons successfully replicated these two types of movements. Our results thus suggest that accumbal D1-receptor-dependent and -independent neuronal signals converge in the wM1 for facilitating distinct uninstructed orofacial movements during a reward-based learning task.