Striatal dopamine integrates cost, benefit, and motivation

Neuronal encoding of behaviors and instrumental learning in the dorsal striatum

The dorsal striatum is instrumental in regulating motor control and goal-directed behaviors. The classical description of the two output pathways of the dorsal striatum highlights their antagonistic control over actions. However, recent experimental evidence implicates both pathways and their coordinated activities during actions. In this review, we examine the different models proposed for striatal encoding of actions during self-paced behaviors and how they can account for evidence harvested during goal-directed behaviors. We also discuss how the activation of striatal ensembles can be reshaped and reorganized to support the formation of instrumental learning and behavioral flexibility. Future work integrating these considerations may resolve controversies regarding the control of actions by striatal networks.

Dynamic overrepresentation of accumbal cues in food- and opioid-seeking rats after prenatal THC exposure

The increasing prevalence of cannabis use during pregnancy has raised medical concerns, primarily related to Δ9-tetrahydrocannabinol (THC), which readily crosses the placenta and affects fetal brain development. Previous research has identified dopaminergic alterations related to maternal THC consumption. However, the consequences that prenatal cannabis exposure (PCE) has on striatum-based processing during reward pursuit have not been determined. Here, we characterize PCE rats during food or opioid-maintained reward seeking. We find that the supramotivational phenotype of PCE rats is independent of value-based processing and is instead related to augmented reinforcing efficiency of opioid rewards. Our findings reveal that prenatal THC exposure leads to increased cue-evoked dopamine responses and an overrepresentation of effort-driven striatal encoding patterns. Recapitulating clinical findings, drug-related PCE adaptations were more pronounced in males, who showed increased vulnerability for relapse. Collectively, these findings indicate that prenatal THC exposure in male rats engenders a pronounced neurodevelopmental susceptibility to addiction-like disorders.

Effects of psychedelic, DOI, on nucleus accumbens dopamine signaling to predictable rewards and cues in rats

Psychedelics produce lasting therapeutic responses in neuropsychiatric diseases suggesting they may disrupt entrenched associations and catalyze learning. Here, we examine psychedelic 5-HT2A/2C agonist, DOI, effects on dopamine signaling in the nucleus accumbens (NAc) core, a region extensively linked to reward learning, motivation, and drug-seeking. We measure phasic dopamine transients following acute DOI administration in rats during well learned Pavlovian tasks in which sequential cues predict rewards. We find that DOI (0.0-1.2 mg/kg, i.p.) increases dopamine signals, photometrically measured using GRABDA optical sensor, to rewards and proximal reward cues, but not to the distal cues that predict these events. We determine that the elevated dopamine produced by DOI to reward cues occurs independently of DOI-induced changes in reward value. The increased dopamine associated with predictable reward cues and rewards supports DOI-induced increases in prediction error signaling. These findings lay a foundation for developing psychedelic strategies aimed at engaging error-driven learning mechanisms to disrupt entrenched associations or produce new associations.

Valence-dependent dopaminergic modulation during reversal learning in Parkinson's disease: A neurocomputational approach

Reinforcement learning, crucial for behavior in dynamic environments, is driven by rewards and punishments, modulated by dopamine (DA) changes. This study explores the dopaminergic system's influence on learning, particularly in Parkinson's disease (PD), where medication leads to impaired adaptability. Highlighting the role of tonic DA in signaling the valence of actions, this research investigates how DA affects response vigor and decision-making in PD. DA not only influences reward and punishment learning but also indicates the cognitive effort level and risk propensity in actions, which are essential for understanding and managing PD symptoms. In this work, we adapt our existing neurocomputational model of basal ganglia (BG) to simulate two reversal learning tasks proposed by Cools et al. We first optimized a Hebb rule for both probabilistic and deterministic reversal learning, conducted a sensitivity analysis (SA) on parameters related to DA effect, and compared performances between three groups: PD-ON, PD-OFF, and control subjects. In our deterministic task simulation, we explored switch error rates after unexpected task switches and found a U-shaped relationship between tonic DA levels and switch error frequency. Through SA, we classify these three groups. Then, assuming that the valence of the stimulus affects the tonic levels of DA, we were able to reproduce the results by Cools et al. As for the probabilistic task simulation, our results are in line with clinical data, showing similar trends with PD-ON, characterized by higher tonic DA levels that are correlated with increased difficulty in both acquisition and reversal tasks. Our study proposes a new hypothesis: valence, signaled by tonic DA levels, influences learning in PD, confirming the uncorrelation between phasic and tonic DA changes. This hypothesis challenges existing paradigms and opens new avenues for understanding cognitive processes in PD, particularly in reversal learning tasks.

Midbrain KCC2 downregulation: Implications for stress-related and substance use behaviors

Stress-related and substance use disorders are both characterized by disruptions in reward-related behaviors, and these disorders are often comorbid with one another. Recent investigations have identified a novel mechanism of inhibitory plasticity induced by both stress and substance use within the ventral tegmental area (VTA), a key region in reward processing. This mechanism involves the neuron-specific potassium chloride cotransporter isoform 2 (KCC2), which is essential in modulating inhibitory signaling through the regulation of intracellular chloride (Cl-) in VTA GABA neurons. Experiences, such as exposure to stress or substance use, diminish KCC2 expression in VTA GABA neurons, leading to abnormal reward-related behaviors. Here, we review literature suggesting that KCC2 downregulation contributes to irregular dopamine (DA) transmission, impacting multiple reward circuits and promoting maladaptive behaviors. Activating KCC2 restores canonical GABA functioning and reduces behavioral deficits in preclinical models, leading us to advocate for KCC2 as a target for therapies aimed at alleviating and mitigating various stress-related and substance use disorders.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Unraveling the Pathogenesis of Post-Stroke Depression in a Hemorrhagic Mouse Model through Frontal Lobe Circuitry and JAK-STAT Signaling

Post-stroke depression is a common complication that imposes significant burdens and challenges on patients. The occurrence of depression is often associated with frontal lobe hemorrhage, however, current understanding of the underlying mechanisms remains limited. Here, the pathogenic mechanisms associated with the circuitry connectivity, electrophysiological alterations, and molecular characteristics are investigated related to the frontal lobe in adult male mice following unilateral injection of blood in the medial prefrontal cortex (mPFC). It is demonstrated that depression is a specific neurological complication in the unilateral hematoma model of the mPFC, and the ventral tegmental area (VTA) shows a higher percentage of connectivity disruption compared to the lateral habenula (LHb) and striatum (STR). Additionally, long-range projections originating from the frontal lobe demonstrate higher damage percentages within the connections between each region and the mPFC. mPFC neurons reveal reduced neuronal excitability and altered synaptic communication. Furthermore, transcriptomic analysis identifies the involvement of the Janus Kinase-Signal Transducer and Activator of Transcription (JAK-STAT) signaling pathway, and targeting the JAK-STAT pathway significantly alleviates the severity of depressive symptoms. These findings improve the understanding of post-hemorrhagic depression and may guide the development of efficient treatments.

Noradrenergic modulation of stress induced catecholamine release: Opposing influence of FG7142 and yohimbine

Background

Life stress modulates decision making, particularly in the face of risk, in some cases prompting vulnerable populations to make suboptimal, life-altering choices. In the brain, stress is known to alter the extracellular release of catecholamines in structures such as basolateral amygdala (BLA) and nucleus accumbens (NAc), but the relationship between catecholamines and decision-making behavior under stress has not been systemically explored.

Methods

We developed an operant touchscreen decision-making task for rats comprising elements of loss aversion and risk seeking behavior. Rats were first injected systemically with an adrenergicα 2 A -receptor agonist (guanfacine) and antagonist (yohimbine), as well as a partial inverse GABAA agonist, FG 7142, known to induce anxiety and stress related physiological responses in a variety of species, including humans. We then used fiber photometry to monitor NE in the basolateral amygdala (BLA), and DA activity in the nucleus accumbens (NAc) while animals engaged in decision-making and following systemic injections of FG 7142 and yohimbine.

Results

Neither yohimbine nor guanfacine had any impact on decision making strategy but altered motivational state with yohimbine making the animal almost insensitive to the reward outcome. The pharmacological induction of stress with FG 7142 biased the rats' decisions towards safety, but this bias shifted toward risk when co-treated with yohimbine. In the BLA and NAc, the FG 7142 altered catecholamine release, with systemic yohimbine producing opposing effects on NE and DA release.

Conclusions

Stress induced changes in catecholamine release in the BLA and NAc can directly influence loss sensitivity, decisions and motivation, which can be modulated by theα 2 A adrenoreceptor antagonist, yohimbine.

Dynamic Overrepresentation of Accumbal Cues in Food- and Opioid-Seeking Rats after Prenatal THC Exposure

The increasing prevalence of cannabis use during pregnancy has raised significant medical concerns, primarily related to the presence of Δ9-tetrahydrocannabinol (THC), which readily crosses the placenta and impacts fetal brain development. Previous research has identified midbrain dopaminergic neuronal alterations related to maternal THC consumption. However, the enduring consequences that prenatal cannabis exposure (PCE) has on striatum-based processing during voluntary reward pursuit have not been specifically determined. Here, we characterize PCE rats during food (palatable pellets) or opioid (remifentanyl)-maintained reward seeking. We find that the supra motivational phenotype of PCE rats is independent of value-based processing and is instead related to augmented reinforcing efficiency of opioid rewards. Our findings reveal that in utero THC exposure leads to increased cue-evoked dopamine release responses and an overrepresentation of cue-aligned, effort-driven striatal patterns of encoding. Recapitulating findings in humans, drug-related neurobiological adaptations of PCE were more pronounced in males, who similarly showed increased vulnerability for relapse. Collectively, these findings indicate that prenatal THC exposure in male rats engenders a pronounced neurodevelopmental susceptibility to addiction-like disorders later in life.

Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate

The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.

Diabetes alters neuroeconomically dissociable forms of mental accounting

Those with diabetes mellitus are at high-risk of developing psychiatric disorders, yet the link between hyperglycemia and alterations in motivated behavior has not been explored in detail. We characterized value-based decision-making behavior of a streptozocin-induced diabetic mouse model on a naturalistic neuroeconomic foraging paradigm called Restaurant Row. Mice made self-paced choices while on a limited time-budget accepting or rejecting reward offers as a function of cost (delays cued by tone-pitch) and subjective value (flavors), tested daily in a closed-economy system across months. We found streptozocin-treated mice disproportionately undervalued less-preferred flavors and inverted their meal-consumption patterns shifted toward a more costly strategy that overprioritized high-value rewards. We discovered these foraging behaviors were driven by impairments in multiple decision-making systems, including the ability to deliberate when engaged in conflict and cache the value of the passage of time in the form of sunk costs. Surprisingly, diabetes-induced changes in behavior depended not only on the type of choice being made but also the salience of reward-scarcity in the environment. These findings suggest complex relationships between glycemic regulation and dissociable valuation algorithms underlying unique cognitive heuristics and sensitivity to opportunity costs can disrupt fundamentally distinct computational processes and could give rise to psychiatric vulnerabilities.