The power of price compels you: Behavioral economic insights into dopamine-based valuation of rewarding and aversively motivated behavior

Dynamic Overrepresentation of Accumbal Cues in Food- and Opioid-Seeking Rats after Prenatal THC Exposure

The increasing prevalence of cannabis use during pregnancy has raised significant medical concerns, primarily related to the presence of Δ9-tetrahydrocannabinol (THC), which readily crosses the placenta and impacts fetal brain development. Previous research has identified midbrain dopaminergic neuronal alterations related to maternal THC consumption. However, the enduring consequences that prenatal cannabis exposure (PCE) has on striatum-based processing during voluntary reward pursuit have not been specifically determined. Here, we characterize PCE rats during food (palatable pellets) or opioid (remifentanyl)-maintained reward seeking. We find that the supra motivational phenotype of PCE rats is independent of value-based processing and is instead related to augmented reinforcing efficiency of opioid rewards. Our findings reveal that in utero THC exposure leads to increased cue-evoked dopamine release responses and an overrepresentation of cue-aligned, effort-driven striatal patterns of encoding. Recapitulating findings in humans, drug-related neurobiological adaptations of PCE were more pronounced in males, who similarly showed increased vulnerability for relapse. Collectively, these findings indicate that prenatal THC exposure in male rats engenders a pronounced neurodevelopmental susceptibility to addiction-like disorders later in life.

Increased elasticity of sucrose demand during hyperdopaminergic states in rats

RATIONALE

Deficits in cost-benefit decision-making are a core feature of several psychiatric disorders, including substance addiction, eating disorders and bipolar disorder. Mesocorticolimbic dopamine signalling has been implicated in various processes related to cognition and reward, but its precise role in reward valuation and cost-benefit trade-off decisions remains incompletely understood.

OBJECTIVES

We assessed the role of mesocorticolimbic dopamine signalling in the relationship between price and consumption of sucrose, to better understand its role in cost-benefit decisions.

METHODS

Dopamine neurons in the ventral tegmental area (VTA) were chemogenetically activated in rats, and a behavioural economics approach was used to quantify the relationship between price and consumption of sucrose. Motivation for sucrose was also assessed under a progressive ratio (PR) schedule of reinforcement. To further gauge the role of dopamine in cost-benefit trade-offs for sucrose, the effects of treatment with D-amphetamine and the dopamine receptor antagonist alpha-flupentixol were assessed.

RESULTS

Chemogenetic activation of VTA dopamine neurons increased demand elasticity, while responding for sucrose under a PR schedule of reinforcement was augmented upon stimulation of VTA dopamine neurons. Treatment with amphetamine partially replicated the effects of chemogenetic dopamine neuron activation, whereas treatment with alpha-flupentixol reduced free consumption of sucrose and had mixed effects on demand elasticity.

CONCLUSIONS

Stimulation of mesocorticolimbic dopaminergic neurotransmission altered cost-benefit trade-offs in a complex manner. It reduced the essential value of palatable food, increased incentive motivation and left free consumption unaltered. Together, these findings imply that mesocorticolimbic dopamine signalling differentially influences distinct components of cost expenditure processes aimed at obtaining rewards.

Value-based cognition and drug dependency

Value-based decision-making is thought to play an important role in drug dependency. Achieving elevated levels of euphoria or ameliorating dysphoria/pain may motivate goal-directed drug consumption in both drug-naïve and long-time users. In other words, drugs become viewed as the preferred means of attaining a desired internal state. The bias towards choosing drugs may affect one's cognition. Observed biases in learning, attention and memory systems within the brain gradually focus one's cognitive functions towards drugs and related cues to the exclusion of other stimuli. In this narrative review, the effects of drug use on learning, attention and memory are discussed with a particular focus on changes across brain-wide functional networks and the subsequent impact on behaviour. These cognitive changes are then incorporated into the cycle of addiction, an established model outlining the transition from casual drug use to chronic dependency. If drug use results in the elevated salience of drugs and their cues, the studies highlighted in this review strongly suggest that this salience biases cognitive systems towards the motivated pursuit of addictive drugs. This bias is observed throughout the cycle of addiction, possibly contributing to the persistent hold that addictive drugs have over the dependent. Taken together, the excessive valuation of drugs as the preferred means of achieving a desired internal state affects more than just decision-making, but also learning, attentional and mnemonic systems. This eventually narrows the focus of one's thoughts towards the pursuit and consumption of addictive drugs.

Cannabinoid Modulation of Dopamine Release During Motivation, Periodic Reinforcement, Exploratory Behavior, Habit Formation, and Attention

Motivational and attentional processes energize action sequences to facilitate evolutionary competition and promote behavioral fitness. Decades of neuropharmacology, electrophysiology and electrochemistry research indicate that the mesocorticolimbic DA pathway modulates both motivation and attention. More recently, it was realized that mesocorticolimbic DA function is tightly regulated by the brain's endocannabinoid system and greatly influenced by exogenous cannabinoids-which have been harnessed by humanity for medicinal, ritualistic, and recreational uses for 12,000 years. Exogenous cannabinoids, like the primary psychoactive component of cannabis, delta-9-tetrahydrocannabinol, produce their effects by acting at binding sites for naturally occurring endocannabinoids. The brain's endocannabinoid system consists of two G-protein coupled receptors, endogenous lipid ligands for these receptor targets, and several synthetic and metabolic enzymes involved in their production and degradation. Emerging evidence indicates that the endocannabinoid 2-arachidonoylglycerol is necessary to observe concurrent increases in DA release and motivated behavior. And the historical pharmacology literature indicates a role for cannabinoid signaling in both motivational and attentional processes. While both types of behaviors have been scrutinized under manipulation by either DA or cannabinoid agents, there is considerably less insight into prospective interactions between these two important signaling systems. This review attempts to summate the relevance of cannabinoid modulation of DA release during operant tasks designed to investigate either motivational or attentional control of behavior. We first describe how cannabinoids influence DA release and goal-directed action under a variety of reinforcement contingencies. Then we consider the role that endocannabinoids might play in switching an animal's motivation from a goal-directed action to the search for an alternative outcome, in addition to the formation of long-term habits. Finally, dissociable features of attentional behavior using both the 5-choice serial reaction time task and the attentional set-shifting task are discussed along with their distinct influences by DA and cannabinoids. We end with discussing potential targets for further research regarding DA-cannabinoid interactions within key substrates involved in motivation and attention.

Value, drug addiction and the brain

Over the years, various models have been proposed to explain the psychology and biology of drug addiction, built primarily around the habit and compulsion models. Recent research indicates drug addiction may be goal-directed, motivated by excessive valuation of drugs. Drug consumption may initially occur for the sake of pleasure but may transition to a means of escaping withdrawal, stress and negative emotions. In this hypothetical paper, we propose a value-based neurobiological model for drug addiction. We posit that during dependency, the value-based decision-making system in the brain is not inactive but has instead prioritized drugs as the reward of choice. In support of this model, we consider the role of valuation in choice, its influence on pleasure and punishment, and how valuation is contrasted in impulsive and compulsive behaviours. We then discuss the neurobiology of value, beginning with the dopaminergic system and its relationship with incentive salience before moving to brain-wide networks involved in valuation, control and prospection. These value-based neurobiological components are then integrated into the cycle of addiction as we consider the development of drug dependency from a valuation perspective. We conclude with a discussion of cognitive interventions utilizing value-based decision-making, highlighting not just advances in recalibrating the valuation system to focus on non-drug rewards, but also areas for improvement in refining this approach.

Endocannabinoid modulation of dopamine release during reward seeking, interval timing, and avoidance

Endocannabinoids (eCBs) are neuromodulators that influence a wide range of neural systems and behaviors. In the current review, we describe our recent research showing how eCBs, particularly 2-arachidonoylglycerol (2-AG), concurrently shape mesolimbic dopamine (DA) release and associated behavior. We will restrict our discussion by emphasizing three distinct behaviors: reward seeking, interval timing, and active avoidance. During reward seeking we find that 2-AG is necessary to observe cue-evoked DA release events that are thought to represent the value of a rewarding outcome. We then describe data showing that 2-AG modulates unique patterns of DA release and behavior observed under conditions of periodic reinforcement. These data are discussed within the context of interval timing and adjunctive behavior. eCB modulation of DA release is also implicated in defensive behavior, including the avoidance of harm. As in reward seeking, our data suggest that the concentration of DA that is evoked by a warning signal can represent the value of an avoidance outcome. And, disrupting eCB signaling concomitantly reduces the concentration of the avoidance value signal and active avoidance. Disruptions in reward seeking, interval timing, and defensive behavior are commonly observed in a variety of movement disorders (e.g., Parkinson's and Huntington's disease) and disorders of motivation (e.g., addiction). We believe our data on eCB-DA interactions have implications for the development of novel pharmacotherapies to treat these disorders. Thus, we conclude by discussing how eCB pharmacology might be harnessed to treat disorders of movement and motivation.