Uncertainty exposure causes behavioural sensitization and increases risky decision-making in male rats: toward modelling gambling disorder

Engineered highs: Reward variability and frequency as potential prerequisites of behavioural addiction

Influential learning-based accounts of substance addictions posit the attribution of incentive salience to drug-associated cues, and its escalation by the direct dopaminergic effects of drugs. In translating this account to disordered gambling, we have noted how the intermittent nature of monetary rewards in gambling (i.e. the variable ratio) may allow for analogous learning processes, via effects on dopaminergic signalling. The aim of the present article is to consider how multiple sources of reward variability operate within modern gambling products, and how similar sources of variability, as well as some novel sources of variability, also apply to other digital products implicated in behavioural addictions, including gaming, shopping, social media and online pornography. Online access to these activities facilitates not only unparalleled accessibility but also introduces novel forms of reward variability, as seen in the effects of infinite scrolls and personalized recommendations. We use the term uncertainty to refer to the subjective experience of reward variability. We further highlight two psychological factors that appear to moderate the effects of uncertainty: 1) the timecourse of uncertainty, especially with regard to its resolution, 2) the frequency of exposure, allowing temporal compression. Collectively, the evidence illustrates how qualitative and quantitative variability of reward can confer addictive potential to non-drug reinforcers by exploiting the psychological and neural processes that rely on predictability to guide reward seeking behaviour.

Priming effects of a slot machine game and amphetamine on probabilistic risk-taking in people with gambling disorder and healthy controls

INTRODUCTION

The Game of Dice Task (GDT) captures probabilistic risk-taking, which is an important feature of addictions and integral to gambling disorder (GD). No research appears to have assessed effects of gambling-specific priming manipulations or the pharmacological basis of such effects on the GDT.

AIMS

To investigate effects of slot machine gambling (Slots) and d-amphetamine (AMPH; 20 mg) on risk-taking in people with GD and healthy controls (HCs) (n = 30/group). The role of dopamine (DA) was assessed by pre-treating participants with the D2 receptor (D2R)-preferring antagonist, haloperidol (HAL; 3-mg) or mixed D1R-D2R antagonist, fluphenazine (FLU; 3-mg).

HYPOTHESES

Slots and AMPH will each increase risk-taking based on fewer (less probable) possible outcomes selected (POS) and poorer net monetary outcomes (NMO; gains minus losses) on the GDT, with stronger effects in Group GD. If DA mediates these effects, outcomes will vary with pre-treatment.

METHOD

Participants attended a pre-experimental baseline session and 4 test sessions. Antagonist Group (HAL, FLU) was manipulated between-participants. Pre-treatment (antagonist, placebo) was manipulated within-participants and counterbalanced over sessions for Slots and AMPH test phases. Moderator/mediator effects of trait and neuropsychological factors and GD severity (South Oaks Gambling Screen; SOGS) were explored via covariance.

RESULTS

AMPH led to an escalation in risky POS over trial blocks in both groups, regardless of pre-treatment. Cognitive inflexibility (high perseveration-proneness) moderated this effect in Group HC. In Group GD, SOGS selectively predicted riskier POS on AMPH sessions. Group GD achieved poorer NMO vs. Group HC on the pre-experimental baseline and Placebo-Slots sessions. Group HC selectively displayed poorer NMO on the Antagonist-Slots session.

CONCLUSIONS

The GDT can detect behavioral and pharmacological priming effects. Cognitive inflexibility and symptom severity moderate AMPH-induced risk-taking in HC and GD participants, respectively. Sensitization-related "wanting" of risk may contribute to the latter effect in people with GD.

D2/3 Agonist during Learning Potentiates Cued Risky Choice

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

Effort-motivated behavior resolves paradoxes in appetitive conditioning

Motivated behavior has long been studied by psychologists, ethologists, and neuroscientists. To date, many scientists agree with the view that cue and reward attraction is the product of a dopamine-dependent unconscious process called incentive salience or "wanting". This process allows the influence of multiple factors such as hunger and odors on motivational attraction. In some cases, however, the resulting motivated behavior differs from what the incentive salience hypothesis would predict. I argue that seeking behavior under reward uncertainty illustrates this situation: Organisms do not just "want" (appetite-based attraction) cues that are inconsistent or associated with reward occasionally, they "hope" that those cues will consistently predict reward procurement in the ongoing trial. Said otherwise, they become motivated to invest time and energy to find consistent cue-reward associations despite no guarantee of success (effort-based attraction). A multi-test comparison of performance between individuals trained under uncertainty and certainty reveals behavioral paradoxes suggesting that the concept of incentive salience cannot fully account for responding to inconsistent cues. A mathematical model explains how appetite-based and effort-based attractions might combine their effects.

Mitigating Nonattendance Using Clinic-Resourced Incentives Can Be Mutually Beneficial: A Contingency Management-Inspired Partially Observable Markov Decision Process Model

OBJECTIVES

Nonattendance of appointments in outpatient clinics results in many adverse effects including inefficient use of valuable resources, wasted capacity, increased delays, and gaps in patient care. This research presents a modeling framework for designing positive incentives aimed at decreasing patient nonattendance.

METHODS

We develop a partially observable Markov decision process (POMDP) model to identify optimal adaptive reinforcement schedules with which financial incentives are disbursed. The POMDP model is conceptually motivated based on contingency management evidence and practices. We compare the expected net profit and trade-offs for a clinic using data from the literature for a base case and the optimal positive incentive design resulting from the POMDP model. To accommodate a less technical audience, we summarize guidelines for reinforcement schedules from a simplified Markov decision process model.

RESULTS

The results of the POMDP model show that a clinic can increase its net profit per recurrent patient while simultaneously increasing patient attendance. An increase in net profit of 6.10% was observed compared with a policy with no positive incentive implemented. Underlying this net profit increase is a favorable trade-off for a clinic in investing in a targeted contingency management-based positive incentive structure and an increase in patient attendance rates.

CONCLUSIONS

Through a strategic positive incentive design, the POMDP model results show that principles from contingency management can support decreasing nonattendance rates and improving outpatient clinic efficiency of its appointment capacity, and improved clinic efficiency can offset the costs of contingency management.

Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task

BACKGROUND

Pairing rewards with sensory stimulation, in the form of auditory and visual cues, increases risky decision-making in both rats and humans. Understanding the neurobiological basis of this effect could help explain why electronic gambling machines are so addictive, and inform treatment development for compulsive gambling and gaming. Numerous studies implicate the dopamine system in mediating the motivational influence of reward-paired cues; recent data suggest the cholinergic system also plays a critical role. Previous work also indicates that cholinergic drugs alter decision-making under uncertainty.

AIMS

We investigated whether the addition of reward-concurrent cues to the rat gambling task (crGT) altered the effects of peripherally administered cholinergic compounds.

METHODS

Muscarinic and nicotinic agonists and antagonists were administered to 16 male, Long-Evans rats trained on the crGT. Measures of optimal/risky decision-making and motor impulsivity were the main dependent variables of interest.

RESULTS

The muscarinic receptor antagonist scopolamine improved decision-making overall, decreasing selection of one of the risky options while increasing choice of the more advantageous options. The muscarinic agonist oxotremorine increased choice latency but did not significantly affect option preference. Neither the nicotinic antagonist mecamylamine nor the agonist nicotine affected choice patterns, but mecamylamine decreased premature responding, an index of motor impulsivity.

CONCLUSIONS

These results contrast sharply from those obtained previously using the uncued rGT, and suggest that the deleterious effects of win-paired cues on decision-making and impulse control may result from elevated cholinergic tone.

Positive Affect: Nature and brain bases of liking and wanting

The positive affect of rewards is an important contributor to well-being. Reward involves components of pleasure 'liking', motivation 'wanting', and learning. 'Liking' refers to the hedonic impact of positive events, with underlying mechanisms that include hedonic hotspots in limbic brain structures that amplify 'liking' reactions. 'Wanting' refers to incentive salience, a motivational process that makes reward cues attractive and able to trigger craving for their reward, mediated by larger dopamine-related mesocorticolimbic networks. Under normal conditions, 'liking' and 'wanting' cohere. However, 'liking' and 'wanting' can be dissociated by alterations in neural signaling, either induced in animal neuroscience laboratories or arising spontaneously in addictions and other affective disorders, which can be detrimental to positive well-being.

Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats

Individuals trained under partial reinforcement (PR) typically show a greater resistance to extinction than individuals exposed to continuous reinforcement (CR). This phenomenon is referred to as the PR extinction effect (PREE) and is interpreted as a consequence of uncertainty-induced frustration counterconditioning. In this study, we assessed the effects of PR and CR in acquisition and extinction in two strains of rats, the inbred Roman high- and low-avoidance (RHA and RLA, respectively) rats. These two strains mainly differ in the expression of anxiety, the RLA rats showing more anxiety-related behaviors (hence, more sensitive to frustration) than the RHA rats. At a neurobiological level, mild stress is known to elevate corticosterone in RLA rats and dopamine in RHA rats. We tested four groups of rats (RHA/CR, RHA/PR, RLA/CR, and RLA/PR) in two successive acquisition-extinction phases to try to consolidate the behavioral effects. Animals received training in a Pavlovian autoshaping procedure with retractable levers as the conditioned stimulus, food pellets as the unconditioned stimulus, and lever presses as the conditioned response. In Phase 1, we observed a PREE in lever pressing in both strains, but this effect was larger and longer lasting in RHA/PR than in RLA/PR rats. In Phase 2, reacquisition was fast and the PREE persisted in both strains, although the two PR groups no longer differed in lever pressing. The results are discussed in terms of frustration theory and of uncertainty-induced sensitization of dopaminergic neurons.

Impaired decision making following escalation of cocaine self-administration predicts vulnerability to relapse in rats

Impairments in cost‐benefit decision making represent a cardinal feature of drug addiction. However, whether these alterations predate drug exposure, thereby contributing to facilitating loss of control over drug intake, or alternatively arise as a result of drug use and subsequently confer vulnerability to relapse has yet to be determined. Male Sprague‐Dawley rats were trained to self‐administer (SA) cocaine during 19 daily long‐access (12‐h) sessions; conditions reliably shown to promote escalation. One week after cocaine SA, rats underwent an extinction/relapse test immediately followed by conditioned stimuli–, stress‐, and drug‐primed reinstatement challenges. The influence of escalated cocaine intake on decision making was measured over time by four test sessions of a rodent analogue of the Iowa Gambling Task (rGT), once prior to cocaine exposure and then 1 day, 1 week, and 1 month after the last SA session. Substantial individual variability was observed in the influence of escalated cocaine SA on decision‐making performance. A subset of rats displayed pronounced deficits, while others showed unaffected or even improved performance on the rat Gambling Task (rGT) 24 hours after the last SA session. When challenged with a relapse test after 1 week of forced abstinence, animals that showed impaired decision making following SA displayed an increased propensity to respond for cocaine under extinction. These data suggest that decision‐making deficits in individuals with drug addiction are not antecedent to—but arise as a consequence of—drug exposure. Moreover, these data indicate that susceptibility to the deleterious effects of drugs on decision making confers vulnerability toward relapse.

Translating concepts of risk and loss in rodent models of gambling and the limitations for clinical applications

Gambling involves placing something of value at risk in exchange for the opportunity to potentially gain something of greater value in return. A variety of gambling paradigms have been designed to study the maladaptive decision-making that underlies problematic gambling. Central to these gambling models are the definitions of "risk" and "loss", especially when translating the results from rodent studies to clinical applications. Risk and loss are not mutually exclusive but rather share some overlap. With careful interpretation and consideration of the limitations of these behavioral paradigms, results from rodent models may provide insights into the neurobiology of risky decision-making that leads to problematic gambling in humans.

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.

Maladaptive consequences of repeated intermittent exposure to uncertainty

Recently we reported that nucleus accumbens (NAcc) dopamine (DA) tracks uncertainty during operant responding for non-caloric saccharin. We also showed that repeated intermittent exposure to this uncertainty, like exposure to drugs of abuse, leads to sensitization of the locomotor and NAcc DA effects of amphetamine and promotes the subsequent self-administration of the drug. Here we review these findings together with others showing that NAcc glutamate signaling is similarly affected by uncertainty. Extracellular levels of glutamate in this site also track uncertainty in a task in which nose poking for saccharin on an escalating variable ratio schedule of reinforcement is associated with progressively increasing variance between performance of the operant and payout. Furthermore, sensitized behavioral responding to and for amphetamine following exposure to uncertainty is accompanied by increased levels of Ca2+/calmodulin-dependent protein kinase II (CaMKII) and protein kinase C (PKC) phosphorylation as well as altered protein levels of the transcription factor ∆FosB (increased) and glutamate transporter 1 (GLT1; decreased) in NAcc tissues. Notably, phosphorylation by CaMKII and PKC regulates AMPA receptor trafficking and function in this site, is elevated following psychostimulant exposure, and is necessary for the expression of enhanced drug taking. Increased ∆FosB and decreased GLT1 levels are observed following psychostimulant exposure, are associated with increased drug taking and seeking, and are known to modulate AMPA receptors and extracellular glutamate levels respectively. These adaptations in glutamate transmission as well as those observed with DA following repeated intermittent exposure to uncertainty are similar to those produced by exposure to abused drugs. Together, they point to the recruitment of both DA and glutamate signaling pathways in the NAcc in both drug and behavioral addictions. As uncertainty is central to games of chance, these findings have particular relevance for gambling disorders known to exhibit comorbidity with drug abuse.

Effects of exposure to chronic uncertainty and a sensitizing regimen of amphetamine injections on locomotion, decision-making, and dopamine receptors in rats

Gambling disorder (GD) is a behavioral addiction that may be linked to alterations in dopamine (DA) systems. Gambling involves chronic exposure to uncertain reward, which can sensitize the activity of DA systems. Here we explored how combinations of Pavlovian and instrumental uncertainty impact DA sensitization and risky decision-making. Experiment 1: 40 rats underwent 66 uncertainty exposure (UE) sessions during which they responded for saccharin. Animal responding was reinforced according to a fixed or variable (FR/VR) ratio schedule that turned on a conditioned stimulus (CS; light), which predicted saccharin on 50% or 100% of trials. Animals responded under one of the four conditions: FR-CS100% (no uncertainty), VR-CS100%, FR-CS50%, and VR-CS50% (maximal uncertainty). DA sensitization was inferred from an enhanced locomotor response to d-amphetamine (d-AMPH; 0.5 mg/kg) challenge. The rat gambling task (rGT) was used to assess decision-making. Experiment 2: 24 rats received 5 weeks of sensitizing d-AMPH or saline doses, followed by locomotor activity and rGT testing. Experiment 3: Effects of UE and a sensitizing d-AMPH regimen on DA D1, D2, and D3 receptor binding were assessed in 44 rats using autoradiography. Compared to FR-CS100%, VR-CS100% and VR-CS50% rats displayed a greater locomotor response to d-AMPH, and VR-CS50% rats demonstrated riskier decision-making. Chronic d-AMPH-treated rats mirrored the effects of VR-CS50% groups on these two indices. Both VR-CS50% and d-AMPH-treated groups had increased striatal DA D2 receptor binding. These results suggest that chronic uncertainty exposure, similar to exposure to a sensitizing d-AMPH regimen, sensitized the function of DA systems and increased risky decision-making.

Challenges and Opportunities in Animal Models of Gambling-like Behavior

In the past several years, there has been an explosion of interest in animal models of risk-based decision-making, a fundamental process associated with gambling disorder. While early work focused on establishing various tasks for assaying decision-making, current studies are determining the (subtle and not-so-subtle) influence of cues in driving risky decisions to better understand problem gambling. In addition, these decision-making paradigms are now being used to investigate comorbid conditions such as substance dependence or brain injury and replicating observations from human patients. These animal models have now developed to a point where therapeutic interventions may be assessed for not just gambling disorder, but also a number of other conditions which engender risky decision-making.

Using rodent models to understand interactions between gambling and substance use

Substance use is strongly associated with gambling, but the nature of this association can be difficult to determine. Rodents offer the opportunity to test causal models of these relationships through isolation of individual variables of interest. This review describes recent research in rodents showing: a) predisposing factors for both gambling-like behavior and substance use; b) exposure to drugs of abuse increasing gambling-like behavior; c) experience with gambling-like behavior increasing substance use; and d) links between gambling-like behavior and substance use in models of Parkinson's disease therapies. These findings reveal novel relationships between gambling and substance use, and highlight the utility of rodent models for future work in this area.

Exposure to uncertainty mediates the effects of traumatic brain injury on probabilistic decision-making in rats

Primary Objective: Traumatic brain injury (TBI) is associated with numerous psychiatric comorbidities, and subclinical psychiatric symptoms. While many symptoms have been replicated in animal models of brain injury, a vast majority of studies utilize naïve rats as subjects, which fail to mimic the complex learning history of human patients.Methods and Procedures: In the current study, we evaluated the effects of a brain injury in animals with early exposure to uncertainty on post-injury decision-making in a probabilistic task, the rodent gambling task (RGT).Main Outcomes and Results: Exposure to uncertainty resulted in a heterogeneous sample relative to prior publications, and brain-injured rats showed no deficits in choice behavior compared to shams which contrasts with large, pervasive deficits in previously published work. However, TBI increased impulsivity and caused transient changes in behavioral variables indicative of initial motivational deficits (pellets earned, omitted responses). Notably, effects of amphetamine were similar on this heterogeneous sample of rats relative to a number of other published reports, suggesting consistent effects of gross monoaminergic manipulations on choice behavior, independent of experience.Conclusions: Going forward, translational studies need to consider the heterogeneity that exists at the clinical level and account for these problems when modeling diseases in animals.

Impulsivity moderates the effects of dopamine D2 and mixed D1-D2 antagonists in individuals with gambling disorder

BACKGROUND

The functional role of dopamine D1 and D2 receptors in gambling disorder (GD) remains unclear.

AIMS

This study aimed to investigate the role of D1 activation and the moderating effects of impulsivity, a trait linked with weaker D2-mediated inhibition of dopamine release, in GD subjects.

METHODS

Thirty (nine female) non-comorbid GD subjects with low (LI), moderate (MI), or high impulsivity (HI) received the preferential D2 antagonist haloperidol (HAL; 3 mg) or the mixed D1-D2 antagonist fluphenazine (FLU; 3 mg), on separate sessions before a 15-minute slot machine game or amphetamine (AMPH; 20 mg), in a placebo-controlled, double-blind, counterbalanced design.

RESULTS

On their own, HAL and FLU led to linear increases and decreases, respectively, in desire to gamble across increasing levels of impulsivity. The slot machine and AMPH each evoked an inverted-U pattern of desire to gamble across increasing impulsivity. HAL reversed this effect of the game, whereas FLU did not alter post-game desire. HAL and FLU decreased and increased psychostimulant-like effects of the game, respectively, in LI and MI subjects, but consistently reduced these effects in HI subjects. HAL also altered the salience of negative affective words on a reading task, such that greater salience of negative words coincided with lower post-game desire to gamble.

CONCLUSIONS

D1 receptors appear to gauge the incentive value of gambling in GD subjects. D1 activation has negative reinforcing effects in HI gamblers and positive reinforcing effects in LI gamblers. Medications that activate D1 could curtail chasing in HI gamblers. D1 blockade could benefit HI gamblers whose main concern is craving.

Increased motor impulsivity in a rat gambling task during chronic ropinirole treatment: potentiation by win-paired audiovisual cues

RATIONALE

Chronic administration of D_2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD).

OBJECTIVES

We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs).

METHODS

Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days.

RESULTS

Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task.

CONCLUSIONS

These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D_2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

Cued for risk: Evidence for an incentive sensitization framework to explain the interplay between stress and anxiety, substance abuse, and reward uncertainty in disordered gambling behavior

Gambling disorder is an impairing condition confounded by psychiatric co-morbidity, particularly with substance use and anxiety disorders. Yet, our knowledge of the mechanisms that cause these disorders to coalesce remains limited. The Incentive Sensitization Theory suggests that sensitization of neural "wanting" pathways, which attribute incentive salience to rewards and their cues, is responsible for the excessive desire for drugs and cue-triggered craving. The resulting hyper-reactivity of the "wanting' system is believed to heavily influence compulsive drug use and relapse. Notably, evidence for sensitization of the mesolimbic dopamine pathway has been seen across gambling and substance use, as well as anxiety and stress-related pathology, with stress playing a major role in relapse. Together, this evidence highlights a phenomenon known as cross-sensitization, whereby sensitization to stress, drugs, or gambling behaviors enhance the sensitivity and dopaminergic response to any of those stimuli. Here, we review the literature on how cue attraction and reward uncertainty may underlie gambling pathology, and examine how this framework may advance our understanding of co-mordidity with substance-use disorders (e.g., alcohol, nicotine) and anxiety disorders. We argue that reward uncertainty, as seen in slot machines and games of chance, increases dopaminergic activity in the mesolimbic pathway and enhances the incentive value of reward cues. We propose that incentive sensitization by reward uncertainty may interact with and predispose individuals to drug abuse and stress, creating a mechanism through which co-mordidity of these disorders may emerge.

Neuroimaging of reward mechanisms in Gambling disorder: an integrative review

Gambling disorder (GD) was reclassified as a behavioral addiction in the DSM-5 and shares clinical and behavioral features with substance use disorders (SUDs). Neuroimaging studies of GD hold promise in isolating core features of the addiction syndrome, avoiding confounding effects of drug neurotoxicity. At the same time, a neurobiologically-grounded theory of how behaviors like gambling can become addictive remains lacking, posing a significant hurdle for ongoing decisions in addiction nosology. This article integrates research on reward-related brain activity (functional MRI) and neurotransmitter function (PET) in GD, alongside the consideration of structural MRI data as to whether these signals more likely reflect pre-existing vulnerability or neuroadaptive change. Where possible, we point to qualitative similarities and differences with established markers for SUDs. Structural MRI studies indicate modest changes in regional gray matter volume and diffuse reductions in white matter integrity in GD, contrasting with clear structural deterioration in SUDs. Functional MRI studies consistently identify dysregulation in reward-related circuitry (primarily ventral striatum and medial prefrontal cortex), but evidence is mixed as to the direction of these effects. The need for further parsing of reward sub-processes is emphasized, including anticipation vs outcome, gains vs. losses, and disorder-relevant cues vs natural rewards. Neurotransmitter PET studies indicate amplified dopamine (DA) release in GD, in the context of minimal differences in baseline DA D2 receptor binding, highlighting a distinct profile from SUDs. Preliminary work has investigated further contributions of opioids, GABA and serotonin. Neuroimaging data increasingly highlight divergent profiles in GD vs. SUDs. The ability of gambling to perpetually activate DA (via maximal uncertainty) may contribute to neuroimaging similarities between GD and SUDs, whereas the supra-physiological DA effects of drugs may partly explain differences in the neuroimaging profile of the two syndromes. Coupled with consistent observations of correlations with gambling severity and related clinical variables within GD samples, the overall pattern of effects is interpreted as a likely combination of shared vulnerability markers across GD and SUDs, but with further experience-dependent neuroadaptive processes in GD.

Exposure to conditions of uncertainty promotes the pursuit of amphetamine

Prior exposure to abused drugs leads to long-lasting neuroadaptations culminating in excessive drug intake. Given the comorbidity between substance use and gambling disorders, surprisingly little is known about the effects of exposure to reinforcement contingencies experienced during games of chance. As it is a central feature of these games, we characterized the effects of exposure to uncertainty on biochemical and behavioral effects normally observed in rats exposed to amphetamine. Rats in different groups were trained to nose-poke for saccharin under certain [fixed-ratio (FR)] or uncertain conditions [variable-ratio (VR)] for 55 1-h sessions. Ratios were escalated on successive sessions and rats maintained on the last ratio (FR/VR 20) for 20-25 days. Two to three weeks later, rats were tested for their locomotor or nucleus accumbens dopamine (NAcc DA) response to amphetamine or self-administration of the drug using a lever press operant. NAcc DA overflow was also assessed in additional rats during the saccharin sessions. Rats exposed to uncertainty subsequently showed a higher locomotor and NAcc DA response to amphetamine and self-administered more drug infusions relative to rats exposed to predictable reinforcement. NAcc DA levels during the saccharin sessions tracked the variance of the scheduled ratios (a measure of uncertainty). VR rats showed escalating DA overflow with increasing ratios. Exposure to uncertainty triggered neuroadaptations similar to those produced by exposure to abused drugs. As these were produced in drug naive rats both during and after exposure to uncertainty, they provide a novel common pathway to drug and behavioral addictions.