Exposure to conditions of uncertainty promotes the pursuit of amphetamine

Dopamine mediates a directionally opposite correlation between empathy and the reinforcing effects of amphetamine and gambling in people with gambling disorder vs. healthy controls

Understanding the relationship between empathy, subjective effects of addictive reinforcers and dopamine function in people with gambling disorder (PGD) vs. healthy controls (HCs) may inform GD treatment. The current investigation addressed this issue via retrospective analysis of data from three studies using amphetamine and a slot machine (SLOTS) as reinforcers in PGD and HCs. The Empathy scale of Eysenck's Impulsiveness Questionnaire assessed trait Empathy. The Gamblers Beliefs Questionnaire assessed cognitive distortions. The Eysenck Lie scale assessed socially desirable responding. PET scans quantified dopamine receptor expression and amphetamine-induced dopamine release in Study 1. Pre-treatment with the D2-receptor (D2R)-preferring antagonist, haloperidol or D1R-D2R antagonist, fluphenazine before SLOTS tested the role of D2 autoreceptors and post-synaptic D2R in Study 2. Pre-treatment with the multi-system indirect dopamine agonist, modafinil before SLOTS assessed the reliability of correlations in PGD. Striatal D2R expression predicted greater Empathy and lower amphetamine 'Liking' in HCs, and predicted greater symptom severity in PGD. Empathy predicted lower 'Exciting' effects of SLOTS under placebo in HCs; no correlation emerged under either antagonist. Relative to placebo, haloperidol decreased, whereas fluphenazine increased, the positive correlation between Empathy and Exciting effects of SLOTS in PGD. Modafinil markedly reduced the positive correlation between Empathy and Exciting effects of SLOTS seen under placebo in PGD. Empathy predicted greater cognitive distortions in PGD in all studies. Lie scale variance influenced several primary effects. Prior research linking the insula with Empathy, reactivity to interoceptive signals for risky rewards (uncertainty), and cognitive distortions, provides a parsimonious account for these results.

Increased risky choice during forced abstinence from fentanyl on the cued rat gambling task

RATIONALE

The use of illicit opioids has arguably never been more risky; street drug potency can be dangerously high, is often unknown to the consumer, and results in multiple daily fatalities worldwide. Furthermore, substance use disorder (SUD) is associated with increased maladaptive, risky decisions in laboratory-based gambling tasks. Animal studies can help determine whether this decision-making deficit is a cause or consequence of drug use. However, most experiments have only assessed psychostimulant drugs.

OBJECTIVES

To assess differences in decision-making strategies both before, during, and after self-administration of fentanyl in male and female Long Evans rats.

METHODS

Male and female Long Evans rats were trained to perform the rat gambling task (rGT), loosely based on the Iowa Gambling Task (IGT) used clinically, and/or self-administer fentanyl. We used the cued version of the rGT, in which sound and light stimuli signal sugar pellet rewards, as cocaine self-administration has the greatest effects on decision making in this task variant.

RESULTS

After training on the cued rGT, female rats self-administered fentanyl more readily, an effect that was most apparent in optimal decision-makers. Contrary to previous reports using cocaine self-administration, decision-making was unaffected during fentanyl self-administration training in either sex. However, risky decision-making increased throughout forced abstinence from fentanyl in males.

CONCLUSIONS

These findings complement those from human subjects, in whom preference for uncertain outcomes increased before relapse. These data highlight an abstinence-induced change in cognition that is unique to opiates as compared to psychostimulants, and which may critically contribute to the maintenance of addiction and relapse.

Win-Paired Cues Modulate the Effect of Dopamine Neuron Sensitization on Decision Making and Cocaine Self-administration: Divergent Effects Across Sex

BACKGROUND

Both psychostimulant use and engagement with probabilistic schedules of reward sensitize the mesocorticolimbic dopamine (DA) system. Such behaviors may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation.

METHODS

To probe these interactions, we sensitized ventral tegmental area DA neurons via chronic chemogenetic stimulation while rats (n = 134) learned a rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort (n = 25), we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine and potentiated phasic excitability of ventral tegmental area DA neurons through in vivo electrophysiological recordings.

RESULTS

In the absence of cues, sensitization promoted risk taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males while attenuating cue-induced risk taking in females.

CONCLUSIONS

While these results provide further confirmation that ventral tegmental area DA neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact that dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision making on the cued rat gambling task increased as both males and females learned to self-administer cocaine. The combination of DA sensitization and win-paired cues while gambling led to significantly greater cocaine taking, but these rats did not show any increase in risky choice as a result. Therefore, cocaine and heavily cued gambles may partially substitute for each other once the DA system has been rendered labile through sensitization, thereby compounding addiction risk across modalities.

Unpredictable, intermittent access to sucrose or water promotes increased reward pursuit in rats

Reward uncertainty can sensitize reward pathways, promoting increased reward-seeking and -taking behaviours. This is relevant to human conditions such as pathological gambling, eating disorders and drug addiction. In the context of addiction, preclinical self-administration procedures have been developed to model the intermittency of human drug use. These intermittent-access (IntA) procedures involve intermittent but predictable access to drug during self-administration sessions. However, human drug use typically involves intermittent and unpredictable drug access. We introduce a new procedure modeling unpredictable, intermittent access (UIntA) to a reinforcer, and we compare it to procedures that provide predictable reinforcer availability; continuous (ContA) or intermittent (IntA) access. Female rats self-administered water or liquid sucrose in daily hour-long sessions. IntA and ContA rats had access to a fixed volume of water or sucrose (0.1 ml), under a fixed ratio 3 schedule of reinforcement. IntA rats had predictable 5-min reinforcer ON and 25-min reinforcer OFF periods. ContA rats had 60 min of reinforcer access during each session. For UIntA rats, variation in the length of ON and OFF periods (1, 5 or 9 min/period), response requirement (variable ratio 3 schedule of reinforcement), reinforcer probability (50%) and quantity (0, 0.1 or 0.2 ml) introduced reward uncertainty. Following 14 daily self-administration sessions, UIntA rats showed the highest levels of responding for water or sucrose under progressive ratio conditions, responding under extinction conditions, and cue-induced reinstatement of sucrose seeking. Thus, unpredictable, intermittent reward access promotes increased reward pursuit. This has implications for modeling addiction and other disorders of increased reward seeking.

Choice between food and cocaine or fentanyl reinforcers under fixed and variable schedules in female and male rhesus monkeys

RATIONALE

Illicit drugs may be unpredictable in terms of the time and effort required to obtain them, and this can be modeled with variable- (VR) vs. fixed-ratio (FR) schedules. In a recent experiment (Zamarripa et al. 2023), the potency of cocaine to maintain choice was greatest under a VR (compared with a FR) when food was available under a FR schedule.

OBJECTIVES

The goal of the current study was to extend prior choice results with VR vs. FR schedules to a more efficient procedure with cocaine or fentanyl vs. food. Furthermore, the FR schedule of food delivery was manipulated to determine whether increased drug choice under a VR (compared with a FR) schedule depends on the size of the schedule of nondrug reinforcement.

METHODS

Adult female (n = 2) and male (n = 4) monkeys chose between cocaine (0-30 µg/kg/injection) or fentanyl (0-1.0 µg/kg/injection) and food (2 pellets/delivery) under a 5-component procedure. In different conditions, food was available under a FR 25, 50, or 100 and cocaine or fentanyl were available under FR or VR 100 schedules.

RESULTS

Cocaine's potency to maintain choice was greatest under a VR 100 (compared with FR 100) when food was available under a FR 50 or 100, and fentanyl's potency to maintain choice was generally greatest under a VR 100 (compared with FR 100) when food was available under a FR 25 or 100. However, outcomes between FR and VR schedules with fentanyl were less robust compared with cocaine.

CONCLUSION

Variability in the time and effort required to obtain illicit drugs could contribute to excessive allocation of behavior toward drug use at the expense of more predictable nondrug alternatives, supporting treatment or policies aimed at making drug access more predictable through agonist medications or a safe supply. The impact of variable requirements on drug choice may be reduced if nondrug reinforcers are relatively less costly, supporting the use of low-cost reinforcers in behavioral therapies like contingency management.

Engineered highs: Reward variability and frequency as potential prerequisites of behavioural addiction

Influential learning-based accounts of substance addictions posit the attribution of incentive salience to drug-associated cues, and its escalation by the direct dopaminergic effects of drugs. In translating this account to disordered gambling, we have noted how the intermittent nature of monetary rewards in gambling (i.e. the variable ratio) may allow for analogous learning processes, via effects on dopaminergic signalling. The aim of the present article is to consider how multiple sources of reward variability operate within modern gambling products, and how similar sources of variability, as well as some novel sources of variability, also apply to other digital products implicated in behavioural addictions, including gaming, shopping, social media and online pornography. Online access to these activities facilitates not only unparalleled accessibility but also introduces novel forms of reward variability, as seen in the effects of infinite scrolls and personalized recommendations. We use the term uncertainty to refer to the subjective experience of reward variability. We further highlight two psychological factors that appear to moderate the effects of uncertainty: 1) the timecourse of uncertainty, especially with regard to its resolution, 2) the frequency of exposure, allowing temporal compression. Collectively, the evidence illustrates how qualitative and quantitative variability of reward can confer addictive potential to non-drug reinforcers by exploiting the psychological and neural processes that rely on predictability to guide reward seeking behaviour.

Reappraising the role of dopamine in adolescent risk-taking behavior

Adolescence is characterized by increased risk-taking, which is often ascribed to developmental changes in dopaminergic signaling. Popular models propose that these behaviors are caused by dopamine-induced hypersensitivity to rewards, which overrides adolescents' immature self-control mechanisms. However, these models are often based on oversimplified notions about the workings and functions of dopamine. Here we discuss the relationship between changes in the dopaminergic system and adolescent behavior in light of current theories/models about the functions of dopamine. We show that dopamine is linked to learning, adaptive decision-making under uncertainty, and increased motivation to work for rewards. Thus, changes in the dopaminergic system contribute to the maturation of cognitive control through various mechanisms, contrary to the false dichotomy between reward processing and self-control. Finally, we note that dopamine interacts with a number of other neuromodulator systems, which also change during adolescence, but that have been largely ignored in the field of adolescent development. A full understanding of adolescent behavior will require these neurochemicals and their interactions with dopamine to be taken into account.

Priming effects of a slot machine game and amphetamine on probabilistic risk-taking in people with gambling disorder and healthy controls

INTRODUCTION

The Game of Dice Task (GDT) captures probabilistic risk-taking, which is an important feature of addictions and integral to gambling disorder (GD). No research appears to have assessed effects of gambling-specific priming manipulations or the pharmacological basis of such effects on the GDT.

AIMS

To investigate effects of slot machine gambling (Slots) and d-amphetamine (AMPH; 20 mg) on risk-taking in people with GD and healthy controls (HCs) (n = 30/group). The role of dopamine (DA) was assessed by pre-treating participants with the D2 receptor (D2R)-preferring antagonist, haloperidol (HAL; 3-mg) or mixed D1R-D2R antagonist, fluphenazine (FLU; 3-mg).

HYPOTHESES

Slots and AMPH will each increase risk-taking based on fewer (less probable) possible outcomes selected (POS) and poorer net monetary outcomes (NMO; gains minus losses) on the GDT, with stronger effects in Group GD. If DA mediates these effects, outcomes will vary with pre-treatment.

METHOD

Participants attended a pre-experimental baseline session and 4 test sessions. Antagonist Group (HAL, FLU) was manipulated between-participants. Pre-treatment (antagonist, placebo) was manipulated within-participants and counterbalanced over sessions for Slots and AMPH test phases. Moderator/mediator effects of trait and neuropsychological factors and GD severity (South Oaks Gambling Screen; SOGS) were explored via covariance.

RESULTS

AMPH led to an escalation in risky POS over trial blocks in both groups, regardless of pre-treatment. Cognitive inflexibility (high perseveration-proneness) moderated this effect in Group HC. In Group GD, SOGS selectively predicted riskier POS on AMPH sessions. Group GD achieved poorer NMO vs. Group HC on the pre-experimental baseline and Placebo-Slots sessions. Group HC selectively displayed poorer NMO on the Antagonist-Slots session.

CONCLUSIONS

The GDT can detect behavioral and pharmacological priming effects. Cognitive inflexibility and symptom severity moderate AMPH-induced risk-taking in HC and GD participants, respectively. Sensitization-related "wanting" of risk may contribute to the latter effect in people with GD.

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

Choice between food and cocaine reinforcers under fixed and variable schedules in female and male rhesus monkeys

Illicit drugs like cocaine may be uncertain in terms of the time and effort required to obtain them. Behavior maintained by variable schedules resembles excessive drug-taking compared with fixed schedules. However, no prior research has examined fixed versus variable schedules in drug versus nondrug choice. The present study evaluated cocaine versus food choice under fixed- (FR) and variable-ratio (VR) schedules. The simpler food versus food and cocaine versus cocaine arrangements also were included. Adult female (n = 6) and male (n = 7) rhesus monkeys chose between cocaine (0.01-0.18 mg/kg/injection) and food (4 pellets/delivery), food and food (4 pellets/delivery), or cocaine and cocaine (0.018-0.03 mg/kg/injection) under FR and VR 100 and 200 schedules. In cocaine versus food choice, cocaine's potency to maintain choice was greatest when available under a VR 100 or 200 schedule and food under an FR schedule and was lowest when cocaine was available under an FR 200 schedule and food was available under a VR 200 schedule. In food versus food choice, males chose food associated with a VR schedule more than food associated with an FR schedule. In cocaine versus cocaine choice, females and males chose cocaine associated with a VR schedule more than cocaine associated with an FR schedule, particularly under VR 200. These findings suggest that uncertainty in terms of time and effort required to obtain cocaine, or perhaps the occasional low-cost access that results from VR schedules, results in greater allocation of behavior toward drug reinforcers at the expense of more certain, nondrug alternatives. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Effort-motivated behavior resolves paradoxes in appetitive conditioning

Motivated behavior has long been studied by psychologists, ethologists, and neuroscientists. To date, many scientists agree with the view that cue and reward attraction is the product of a dopamine-dependent unconscious process called incentive salience or "wanting". This process allows the influence of multiple factors such as hunger and odors on motivational attraction. In some cases, however, the resulting motivated behavior differs from what the incentive salience hypothesis would predict. I argue that seeking behavior under reward uncertainty illustrates this situation: Organisms do not just "want" (appetite-based attraction) cues that are inconsistent or associated with reward occasionally, they "hope" that those cues will consistently predict reward procurement in the ongoing trial. Said otherwise, they become motivated to invest time and energy to find consistent cue-reward associations despite no guarantee of success (effort-based attraction). A multi-test comparison of performance between individuals trained under uncertainty and certainty reveals behavioral paradoxes suggesting that the concept of incentive salience cannot fully account for responding to inconsistent cues. A mathematical model explains how appetite-based and effort-based attractions might combine their effects.

Circuit selectivity in drug versus natural reward seeking behaviors

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats

Individuals trained under partial reinforcement (PR) typically show a greater resistance to extinction than individuals exposed to continuous reinforcement (CR). This phenomenon is referred to as the PR extinction effect (PREE) and is interpreted as a consequence of uncertainty-induced frustration counterconditioning. In this study, we assessed the effects of PR and CR in acquisition and extinction in two strains of rats, the inbred Roman high- and low-avoidance (RHA and RLA, respectively) rats. These two strains mainly differ in the expression of anxiety, the RLA rats showing more anxiety-related behaviors (hence, more sensitive to frustration) than the RHA rats. At a neurobiological level, mild stress is known to elevate corticosterone in RLA rats and dopamine in RHA rats. We tested four groups of rats (RHA/CR, RHA/PR, RLA/CR, and RLA/PR) in two successive acquisition-extinction phases to try to consolidate the behavioral effects. Animals received training in a Pavlovian autoshaping procedure with retractable levers as the conditioned stimulus, food pellets as the unconditioned stimulus, and lever presses as the conditioned response. In Phase 1, we observed a PREE in lever pressing in both strains, but this effect was larger and longer lasting in RHA/PR than in RLA/PR rats. In Phase 2, reacquisition was fast and the PREE persisted in both strains, although the two PR groups no longer differed in lever pressing. The results are discussed in terms of frustration theory and of uncertainty-induced sensitization of dopaminergic neurons.

Unpredictability as a modulator of drug self-administration: Relevance for substance-use disorders

Drug self-administration has been regarded as a gold-standard preclinical model of addiction and substance-use disorder (SUD). However, investigators are becoming increasingly aware, that certain aspects of addiction or SUDs experienced by humans are not accurately captured in our preclinical self-administration models. The current review will focus on two such aspects of current preclinical drug self-administration models: 1) Predictable vs. unpredictable drug access in terms of the time and effort put into obtaining drugs (i.e., response requirement) and drug quality (i.e., amount) and 2) rich vs. lean access to drugs. Some behavioral and neurobiological mechanisms that could contribute to excessive allocation of behavior toward drug-seeking and drug-taking at the expense of engaging in nondrug-related activities are discussed, and some directions for future research are identified. Based on the experiments reviewed, lean and unpredictable drug access could worsen drug-seeking and drug-taking behavior in individuals with SUDs. Once more fully explored, this area of research will help determine whether and how unpredictable and lean cost requirements affect drug self-administration in preclinical laboratory studies with nonhuman subjects and will help determine whether incorporating these conditions in current self-administration models will increase their predictive validity.

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.

Maladaptive consequences of repeated intermittent exposure to uncertainty

Recently we reported that nucleus accumbens (NAcc) dopamine (DA) tracks uncertainty during operant responding for non-caloric saccharin. We also showed that repeated intermittent exposure to this uncertainty, like exposure to drugs of abuse, leads to sensitization of the locomotor and NAcc DA effects of amphetamine and promotes the subsequent self-administration of the drug. Here we review these findings together with others showing that NAcc glutamate signaling is similarly affected by uncertainty. Extracellular levels of glutamate in this site also track uncertainty in a task in which nose poking for saccharin on an escalating variable ratio schedule of reinforcement is associated with progressively increasing variance between performance of the operant and payout. Furthermore, sensitized behavioral responding to and for amphetamine following exposure to uncertainty is accompanied by increased levels of Ca2+/calmodulin-dependent protein kinase II (CaMKII) and protein kinase C (PKC) phosphorylation as well as altered protein levels of the transcription factor ∆FosB (increased) and glutamate transporter 1 (GLT1; decreased) in NAcc tissues. Notably, phosphorylation by CaMKII and PKC regulates AMPA receptor trafficking and function in this site, is elevated following psychostimulant exposure, and is necessary for the expression of enhanced drug taking. Increased ∆FosB and decreased GLT1 levels are observed following psychostimulant exposure, are associated with increased drug taking and seeking, and are known to modulate AMPA receptors and extracellular glutamate levels respectively. These adaptations in glutamate transmission as well as those observed with DA following repeated intermittent exposure to uncertainty are similar to those produced by exposure to abused drugs. Together, they point to the recruitment of both DA and glutamate signaling pathways in the NAcc in both drug and behavioral addictions. As uncertainty is central to games of chance, these findings have particular relevance for gambling disorders known to exhibit comorbidity with drug abuse.

Effects of exposure to chronic uncertainty and a sensitizing regimen of amphetamine injections on locomotion, decision-making, and dopamine receptors in rats

Gambling disorder (GD) is a behavioral addiction that may be linked to alterations in dopamine (DA) systems. Gambling involves chronic exposure to uncertain reward, which can sensitize the activity of DA systems. Here we explored how combinations of Pavlovian and instrumental uncertainty impact DA sensitization and risky decision-making. Experiment 1: 40 rats underwent 66 uncertainty exposure (UE) sessions during which they responded for saccharin. Animal responding was reinforced according to a fixed or variable (FR/VR) ratio schedule that turned on a conditioned stimulus (CS; light), which predicted saccharin on 50% or 100% of trials. Animals responded under one of the four conditions: FR-CS100% (no uncertainty), VR-CS100%, FR-CS50%, and VR-CS50% (maximal uncertainty). DA sensitization was inferred from an enhanced locomotor response to d-amphetamine (d-AMPH; 0.5 mg/kg) challenge. The rat gambling task (rGT) was used to assess decision-making. Experiment 2: 24 rats received 5 weeks of sensitizing d-AMPH or saline doses, followed by locomotor activity and rGT testing. Experiment 3: Effects of UE and a sensitizing d-AMPH regimen on DA D1, D2, and D3 receptor binding were assessed in 44 rats using autoradiography. Compared to FR-CS100%, VR-CS100% and VR-CS50% rats displayed a greater locomotor response to d-AMPH, and VR-CS50% rats demonstrated riskier decision-making. Chronic d-AMPH-treated rats mirrored the effects of VR-CS50% groups on these two indices. Both VR-CS50% and d-AMPH-treated groups had increased striatal DA D2 receptor binding. These results suggest that chronic uncertainty exposure, similar to exposure to a sensitizing d-AMPH regimen, sensitized the function of DA systems and increased risky decision-making.

Dissociable dopaminergic and pavlovian influences in goal-trackers and sign-trackers on a model of compulsive checking in OCD

RATIONALE

Checking is a functional behaviour that provides information to guide behaviour. However, in obsessive-compulsive disorder (OCD), checking may escalate to dysfunctional levels. The processes underpinning the transition from functional to dysfunctional checking are unclear but may be associated with individual differences that support the development of maladaptive behaviour. We examined one such predisposition, sign-tracking to a pavlovian conditioned stimulus, which we previously found associated with dysfunctional checking. How sign-tracking interacts with another treatment with emerging translational validity for OCD-like checking, chronic administration of the dopamine D₂ receptor agonist quinpirole, is unknown.

OBJECTIVES

We tested how functional and dysfunctional checking in the rat observing response task (ORT) was affected by chronic quinpirole administration in non-autoshaped controls and autoshaped animals classified as sign-trackers or goal-trackers.

METHODS

Sign-trackers or goal-trackers were trained on the ORT before the effects of chronic quinpirole administration on checking were assessed. Subsequently, the effects on checking of different behavioural challenges, including reward omission and the use of unpredictable reinforcement schedules, were tested.

RESULTS

Prior autoshaping increased checking. Sign-trackers and goal-trackers responded differently to quinpirole sensitization, reward omission and reinforcement uncertainty. Sign-trackers showed greater elevations in dysfunctional checking, particularly during uncertainty. By contrast, goal-trackers predominantly increased functional checking responses, possibly in response to reduced discrimination accuracy in the absence of cues signalling which lever was currently active.

CONCLUSIONS

The results are discussed in terms of how pavlovian associations influence behaviour that becomes compulsive in OCD and how this may be dependent on striatal dopamine D₂ receptors.

Challenges and Opportunities in Animal Models of Gambling-like Behavior

In the past several years, there has been an explosion of interest in animal models of risk-based decision-making, a fundamental process associated with gambling disorder. While early work focused on establishing various tasks for assaying decision-making, current studies are determining the (subtle and not-so-subtle) influence of cues in driving risky decisions to better understand problem gambling. In addition, these decision-making paradigms are now being used to investigate comorbid conditions such as substance dependence or brain injury and replicating observations from human patients. These animal models have now developed to a point where therapeutic interventions may be assessed for not just gambling disorder, but also a number of other conditions which engender risky decision-making.

Using rodent models to understand interactions between gambling and substance use

Substance use is strongly associated with gambling, but the nature of this association can be difficult to determine. Rodents offer the opportunity to test causal models of these relationships through isolation of individual variables of interest. This review describes recent research in rodents showing: a) predisposing factors for both gambling-like behavior and substance use; b) exposure to drugs of abuse increasing gambling-like behavior; c) experience with gambling-like behavior increasing substance use; and d) links between gambling-like behavior and substance use in models of Parkinson's disease therapies. These findings reveal novel relationships between gambling and substance use, and highlight the utility of rodent models for future work in this area.

Impulsivity moderates the effects of dopamine D2 and mixed D1-D2 antagonists in individuals with gambling disorder

BACKGROUND

The functional role of dopamine D1 and D2 receptors in gambling disorder (GD) remains unclear.

AIMS

This study aimed to investigate the role of D1 activation and the moderating effects of impulsivity, a trait linked with weaker D2-mediated inhibition of dopamine release, in GD subjects.

METHODS

Thirty (nine female) non-comorbid GD subjects with low (LI), moderate (MI), or high impulsivity (HI) received the preferential D2 antagonist haloperidol (HAL; 3 mg) or the mixed D1-D2 antagonist fluphenazine (FLU; 3 mg), on separate sessions before a 15-minute slot machine game or amphetamine (AMPH; 20 mg), in a placebo-controlled, double-blind, counterbalanced design.

RESULTS

On their own, HAL and FLU led to linear increases and decreases, respectively, in desire to gamble across increasing levels of impulsivity. The slot machine and AMPH each evoked an inverted-U pattern of desire to gamble across increasing impulsivity. HAL reversed this effect of the game, whereas FLU did not alter post-game desire. HAL and FLU decreased and increased psychostimulant-like effects of the game, respectively, in LI and MI subjects, but consistently reduced these effects in HI subjects. HAL also altered the salience of negative affective words on a reading task, such that greater salience of negative words coincided with lower post-game desire to gamble.

CONCLUSIONS

D1 receptors appear to gauge the incentive value of gambling in GD subjects. D1 activation has negative reinforcing effects in HI gamblers and positive reinforcing effects in LI gamblers. Medications that activate D1 could curtail chasing in HI gamblers. D1 blockade could benefit HI gamblers whose main concern is craving.

Cued for risk: Evidence for an incentive sensitization framework to explain the interplay between stress and anxiety, substance abuse, and reward uncertainty in disordered gambling behavior

Gambling disorder is an impairing condition confounded by psychiatric co-morbidity, particularly with substance use and anxiety disorders. Yet, our knowledge of the mechanisms that cause these disorders to coalesce remains limited. The Incentive Sensitization Theory suggests that sensitization of neural "wanting" pathways, which attribute incentive salience to rewards and their cues, is responsible for the excessive desire for drugs and cue-triggered craving. The resulting hyper-reactivity of the "wanting' system is believed to heavily influence compulsive drug use and relapse. Notably, evidence for sensitization of the mesolimbic dopamine pathway has been seen across gambling and substance use, as well as anxiety and stress-related pathology, with stress playing a major role in relapse. Together, this evidence highlights a phenomenon known as cross-sensitization, whereby sensitization to stress, drugs, or gambling behaviors enhance the sensitivity and dopaminergic response to any of those stimuli. Here, we review the literature on how cue attraction and reward uncertainty may underlie gambling pathology, and examine how this framework may advance our understanding of co-mordidity with substance-use disorders (e.g., alcohol, nicotine) and anxiety disorders. We argue that reward uncertainty, as seen in slot machines and games of chance, increases dopaminergic activity in the mesolimbic pathway and enhances the incentive value of reward cues. We propose that incentive sensitization by reward uncertainty may interact with and predispose individuals to drug abuse and stress, creating a mechanism through which co-mordidity of these disorders may emerge.

Incentive hope: A default psychological response to multiple forms of uncertainty

Our target article proposes that a new concept - incentive hope - is necessary in the behavioral sciences to explain animal foraging under harsh environmental conditions. Incentive hope refers to a specific motivational mechanism in the brain - considered only in mammals and birds. But it can also be understood at a functional level, as an adaptive behavioral strategy that contributes to improve survival. Thus, this concept is an attempt to bridge across different research fields such as behavioral psychology, reward neuroscience, and behavioral ecology. Many commentaries suggest that incentive hope even could help understand phenomena beyond these research fields, including food wasting and food sharing, mental energy conservation, diverse psychopathologies, irrational decisions in invertebrates, and some aspects of evolution by means of sexual selection. We are favorable to such extensions because incentive hope denotes an unconscious process capable of working against many forms of adversity; organisms do not need to hope as a subjective feeling, but to behave as if they had this feeling. In our response, we carefully discuss each suggestion and criticism and reiterate the importance of having a theory accounting for motivation under reward uncertainty.

Prior Exposure to Salient Win-Paired Cues in a Rat Gambling Task Increases Sensitivity to Cocaine Self-Administration and Suppresses Dopamine Efflux in Nucleus Accumbens: Support for the Reward Deficiency Hypothesis of Addiction

Rats trained to perform a version of the rat gambling task (rGT) in which salient audiovisual cues accompany reward delivery, similar to commercial gambling products, show greater preference for risky options. Given previous demonstrations that probabilistic reinforcement schedules can enhance psychostimulant-induced increases in accumbal DA and locomotor activity, we theorized that performing this cued task could perpetuate a proaddiction phenotype. Significantly more rats developed a preference for the risky options in the cued versus uncued rGT at baseline, and this bias was further exacerbated by cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. The addition of reward-paired cues therefore increased the proportion of rats exhibiting a maladaptive cognitive response to cocaine self-administration. Risky choice was not associated with responding for conditioned reinforcement or a marker of goal/sign-tracking, suggesting that reward-concurrent cues precipitate maladaptive choice via a unique mechanism unrelated to simple approach toward, or responding for, conditioned stimuli. Although "protected" from any resulting decision-making impairment, optimal decision-makers trained on the cued rGT nevertheless self-administered more cocaine than those trained on the uncued task. Collectively, these data suggest that repeated engagement with heavily cued probabilistic reward schedules can drive addiction vulnerability through multiple behavioral mechanisms. Rats trained on the cued rGT also exhibited blunted locomotor sensitization and lower basal accumbal DA levels, yet greater cocaine-induced increases in accumbal DA efflux. Gambling in the presence of salient cues may therefore result in an adaptive downregulation of the mesolimbic DA system, rendering individuals more sensitive to the deleterious effects of taking cocaine.SIGNIFICANCE STATEMENT Impaired cost/benefit decision making, exemplified by preference for the risky, disadvantageous options on the Iowa Gambling Task, is associated with greater risk of relapse and treatment failure in substance use disorder. Understanding factors that enhance preference for risk may help elucidate the neurobiological mechanisms underlying maladaptive decision making in addiction, thereby improving treatment outcomes. Problem gambling is also highly comorbid with substance use disorder, and many commercial gambling products incorporate salient win-paired cues. Here we show that adding reward-concurrent cues to a rat analog of the IGT precipitates a hypodopaminergic state, characterized by blunted accumbal DA efflux and attenuated locomotor sensitization, which may contribute to the enhanced responsivity to uncertain rewards or the reinforcing effects of cocaine we observed.