Skewed by Cues? The Motivational Role of Audiovisual Stimuli in Modelling Substance Use and Gambling Disorders

Propensity for risky choices despite lower cue reactivity in adolescent rats

Adolescence is a time of heightened risk-taking across species. Salient audiovisual cues associated with rewards are a common feature of gambling environments and have been connected to increased risky decision-making. We have previously shown that, in adult male rats, sign tracking - a behavioral measure of cue reactivity - predicts an individual's propensity for suboptimal risky choices in a rodent gambling task (rGT) with win-paired cues. However, adolescents perform less sign tracking than adult animals, suggesting that they are less cue-reactive than adults in some circumstances. Therefore, we investigated the performance of adolescent male rats on the rGT with win cues and examined its relationship with their sign-tracking behavior. We found that adolescents make more risky choices and fewer optimal choices on the rGT compared with adults, evidence of the validity of the rGT as a model of adolescent gambling behavior. We also confirmed that adolescents perform less sign tracking than adults, and we found that, unlike in adults, adolescents' sign tracking was unrelated to their risk-taking in the rGT. This implies that adolescent risk-taking is less likely than that of adults to be driven by reward-related cues. Finally, we found that adults trained on the rGT as adolescents retained an adolescent-like propensity toward risky choices, suggesting that early exposure to a gambling environment may have a long-lasting impact on risk-taking behavior.

The associative learning roots of affect-driven impulsivity and its role in problem gambling: A replication attempt and extension of Quintero et al. (2020)

Background and aims

Negative/positive urgency (NU/PU) refers to the proneness to act rashly under negative/positive emotions. These traits are proxies to generalized emotion dysregulation, and are well-established predictors of gambling-related problems. We aimed to replicate a previous work (Quintero et al., 2020) showing NU to be related to faulty extinction of conditioned stimuli in an emotional conditioning task, to extend these findings to PU, and to clarify the role of urgency in the development of gambling-related craving and problems.

Methods

81 gamblers performed an acquisition-extinction task in which neutral, disgusting, erotic and gambling-related images were used as unconditioned stimuli (US), and color patches as conditioned stimuli (CS). Trial-by-trial predictive responses were analyzed using generalized linear mixed-effects models (GLME).

Results

PU was more strongly related than NU to craving and severity of gambling problems. PU did not influence acquisition in the associative task, whereas NU slightly slowed it. Extinction was hampered in individuals with high PU, and a follow-up analysis showed this effect to depend on relative preference for skill-based and casino games.

Discussion and conclusions

Results suggest that resistance to extinction of emotionally conditioned cues is a sign of malfunctioning emotion regulation in problematic gambling. In our work, the key effect was driven by PU (instead of NU), and gambling craving and symptoms were also more closely predicted by it. Future research should compare the involvement of PU and NU in emotion regulation and gambling problems, for gamblers with preference for different gambling modalities (e.g., pure chance vs skill games).

Alter Game: A Study Protocol on a Virtual "Serious Game" for Relapse Prevention in Patients With Gambling Disorder

Cognitive behavioral therapy (CBT) is the most successful protocol in gambling disorder (GD) treatment. However, it presents some weaknesses, especially concerning relapse prevention (RP). RP is one of the most important therapeutic steps, aiming at managing cravings and to avoid future relapse increasing perceived self-efficacy. Encouraging results come from the blending of psychotherapy and virtual reality (VR), containing gambling cues. The goal of Alter Game (approved by the Ethical Commission, Prot. No. 69346) is verifying the efficacy of an innovative psychological treatment for GD based on the integration of traditional CBT therapy and an immersive VR cue exposure therapy using a serious virtual game, which is a game designed for purposes other than entertainment. RP in virtual cue-exposure therapy allows pathological gamblers to manage the urge to gamble and to avoid relapse by becoming aware of which internal and external triggers are related to craving. We hypothesize that the integrated intervention will be more effective than simple CBT with regard to self-efficacy, craving, and gambling-related distortions. Four virtual ecological environments were developed, and a virtual app, Exludo, interfaced with a computerized multiparametric acquisition system for biofeedback, was created. A sample of about 60 patients aged between 18 and 65 with GD referring to the Addiction Medicine Unit of Verona (Rossi Hospital) will be recruited. Patients will be randomly assigned to the CBT group (16 CBT sessions) or the CBT + VR group (8 CBT sessions + 8 VR cue-exposure therapy sessions). The MCMI-III, the BIS-11, and the SOGS will be used to evaluate inclusion and exclusion criteria, while the Gambling Related Cognitions Scale and the Multidimensional Gambling Self-Efficacy Scale will be used to verify changes as a function of the treatment. Craving will be evaluated through VAS, and psychophysiological variables will be assessed through biofeedback. A pre-test/post-test experimental design with a 1-month follow-up will be conducted. This study will examine an innovative psychotherapeutic protocol for GD treatment, and it will help in identifying new virtual tools to increase the efficacy of traditional therapeutic approaches that could also be applied to treat other addictions.

Sign tracking predicts suboptimal behavior in a rodent gambling task

RATIONALE

Reward-associated cues can promote maladaptive behavior, including risky decision-making in a gambling setting. A propensity for sign tracking over goal tracking-i.e., interaction with a reward-predictive cue rather than the site of reward-demonstrates an individual's tendency to transfer motivational value to a cue. However, the relationship of sign tracking to risky decision-making remains unclear.

OBJECTIVES

To determine whether sign tracking predicts risky choice, we used a Pavlovian conditioned approach task to evaluate the tendency of male rats to sign track to a lever cue and then trained rats on a rodent gambling task (rGT) with win-associated cues. We also tested the effects of D-amphetamine, quinpirole (a D₂/D₃ receptor agonist), and PD128907 (a D₃ receptor agonist) on gambling behavior in sign tracker and goal tracker individuals.

RESULTS

Increased sign tracking relative to goal tracking was associated with suboptimal performance on the rGT, including decreased selection of the optimal choice, increased selection of a high-risk/high-reward option, and increased impulsive premature choices. Amphetamine increased choices of a low-risk/low-reward option at the expense of optimal and high-risk choices, whereas quinpirole and PD128907 had little effect on choice allocation, but reduced impulsivity. Drug effects were similar across sign tracker and goal tracker individuals.

CONCLUSIONS

Cue reactivity, as measured by sign tracking, is predictive and may be an important driver of risky and impulsive choices in a gambling setting laden with salient audiovisual cues. Evaluating an individual's sign tracking behavior may be an avenue to predict vulnerability to pathological gambling and the efficacy of treatments.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Reward uncertainty attributes incentive value to reward proximal cues, while amphetamine sensitization reverts attention to more predictive reward distal cues

Slot-machine gambling incorporates numerous audiovisual cues prior to and during reward delivery (e.g. spinning wheels, flashing lights, celebratory sounds). Over time, these cues may motivate playing and even elicit cravings and relapse in those affected by gambling disorder. Animal studies suggest a heightened attraction to these cues despite diminished predictive ability under reward uncertainty, as evidenced by sign-tracking behavior in rats. Repeated amphetamine administration may also enhance the incentive value attributed to cues. Here, we explored the impact of reward uncertainty and prior amphetamine sensitization on the relative attractiveness and conditioned reinforcing properties of serial Pavlovian cues with different degrees of predictive and incentive value in rats. Animals were sensitized through repeated injections of amphetamine (1-4 mg/kg) or saline and then trained in a Pavlovian autoshaping task involving two sequential lever-auditory cue combinations (CS1, CS2) under Certain (100%-1) or Uncertain (50%-1-2-3) reward conditions. Subsequently, we evaluated the impact of acute amphetamine exposure on cue attraction. Our results suggest that Uncertainty alone enhanced attraction towards the reward-proximal CS2. However, combined sensitization and Uncertainty reversed cue preference relative to Uncertainty alone, enhancing attraction towards the more predictive reward-distal CS1. Both cues acquired conditioned reinforcing properties, despite the CS2 being otherwise ignored in all groups besides Uncertainty. However, combined sensitization and Uncertainty increased the reinforcing value of both cues and doubled the amount of interaction with the CS1 lever per presentation. Our results imply competitive mechanisms for attributing incentive value to gambling-related cues between reward uncertainty, prior amphetamine sensitization, and acute amphetamine administration.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Using rodent models to understand interactions between gambling and substance use

Substance use is strongly associated with gambling, but the nature of this association can be difficult to determine. Rodents offer the opportunity to test causal models of these relationships through isolation of individual variables of interest. This review describes recent research in rodents showing: a) predisposing factors for both gambling-like behavior and substance use; b) exposure to drugs of abuse increasing gambling-like behavior; c) experience with gambling-like behavior increasing substance use; and d) links between gambling-like behavior and substance use in models of Parkinson's disease therapies. These findings reveal novel relationships between gambling and substance use, and highlight the utility of rodent models for future work in this area.

Investigating the influence of 'losses disguised as wins' on decision making and motivation in rats

Multiline slot machines encourage continued play through 'losses disguised as wins' (LDWs), outcomes in which the money returned is less than that wagered. Individuals with gambling problems may be susceptible to this game feature. The cognitive and neurobiological mechanisms through which LDWs act are unknown. In a novel rat operant task, animals chose between a 'certain' lever, which always delivered two sugar pellets, or an 'uncertain' lever, resulting in four sugar pellets on 50% of trials. LDWs were then introduced as a return of three sugar pellets on 30-40% of uncertain rewarded trials. For half the rats, winning outcomes were paired with audiovisual feedback (cues). In a second study, the basolateral amygdala (BLA) was inactivated during initial presentation of LDWs. While LDWs shifted most rats' choice toward the certain lever, a subgroup of LDW vulnerable rats continued to choose the uncertain option, when the reward rate diminished. This profile of LDW vulnerability was reproduced after inactivating the BLA. Persistent choice of uncertain outcomes despite lower reward rates may reflect impaired functioning within the BLA. Future work using this model may provide insight into the neurobiological mechanisms contributing to the motivational properties of LDWs and their contribution to problematic gambling.

Reinforcement learning models of risky choice and the promotion of risk-taking by losses disguised as wins in rats

Risky decisions are inherently characterized by the potential to receive gains or incur losses, and these outcomes have distinct effects on subsequent decision-making. One important factor is that individuals engage in loss-chasing, in which the reception of a loss is followed by relatively increased risk-taking. Unfortunately, the mechanisms of loss-chasing are poorly understood, despite the potential importance for understanding pathological choice behavior. The goal of the present experiment was to illuminate the mechanisms governing individual differences in loss-chasing and risky-choice behaviors. Rats chose between a low-uncertainty outcome that always delivered a variable amount of reward and a high-uncertainty outcome that probabilistically delivered reward. Loss-processing and loss-chasing were assessed in the context of losses disguised as wins (LDWs), which are loss outcomes that are presented along with gain-related stimuli. LDWs have been suggested to interfere with adaptive decision-making in humans and thus potentially increase loss-making. Here, the rats presented with LDWs were riskier, in that they made more choices for the high-uncertainty outcome. A series of nonlinear models were fit to individual rats' data to elucidate the possible psychological mechanisms that best account for individual differences in high-uncertainty choices and loss-chasing behaviors. The models suggested that the rats presented with LDWs were more prone to showing a stay bias following high-uncertainty outcomes compared to rats not presented with LDWs. These results collectively suggest that LDWs acquire conditioned reinforcement properties that encourage continued risk-taking and increase loss-chasing following previous high-risk decisions. (PsycINFO Database Record

The role of 'jackpot' stimuli in maladaptive decision-making: dissociable effects of D1/D2 receptor agonists and antagonists

RATIONALE

Laboratory experiments often model risk through a choice between a large, uncertain (LU) reward against a small, certain (SC) reward as an index of an individual's risk tolerance. An important factor generally lacking from these procedures are reward-associated cues that may modulate risk preferences.

OBJECTIVE

We tested whether the addition of cues signaling 'jackpot' wins to LU choices would modulate risk preferences and if these cue effects were mediated by dopaminergic signaling.

METHODS

Three groups of rats chose between LU and SC rewards for which the LU probability of reward decreased across blocks. The unsignaled group received a non-informative stimulus of trial outcome. The signaled group received a jackpot signal prior to reward delivery and blackout on losses. The signaled-light group received a similar jackpot for wins, but a salient loss signal distinct from the win signal.

RESULTS

Presenting win signals decreased the discounting of LU value for both signaled groups regardless of loss signal, while the unsignaled group showed discounting similar to previous research without cues. Pharmacological challenges with D1/D2 agonists and antagonists revealed that D1 antagonism increased and decreased sensitives to the relative probability of reward for unsignaled and signaled groups, respectively, while D2 agonists decreased sensitivities to the relative magnitude of reward.

CONCLUSION

The results highlight how signals predictive of wins can promote maladaptive risk taking in individuals, while loss signals have reduced effect. Additionally, the presence of reward-predictive cues may change the underlying neurobehavioral mechanisms mediating decision-making under risk.

Pharmacological evidence that 5-HT2C receptor blockade selectively improves decision making when rewards are paired with audiovisual cues in a rat gambling task

RATIONALE

Adding reward-concurrent cues to a rat gambling task (rGT) increases risky choice. This cued version of the task may reflect an "addiction-like" cognitive process, more similar to human gambling than the uncued task. Serotonergic drugs that target 5-HT₂ receptors alter mechanisms linked to impulse control. However, relatively little is known regarding the impact of such agents on either risky decision making, or the ability of conditioned stimuli to bias the choice process, despite potential relevance to addiction development and treatment.

OBJECTIVES

The aim of this study was to determine the effects of SB 242,084 and M100907, selective antagonists at the 5-HT_2C and 5-HT_2A receptors respectively, as well as the selective 5-HT_2C receptor agonist Ro-60-0175, on performance of both cued and uncued versions of the rGT.

RESULTS

SB 242,084 significantly and dose-dependently increased choice of the most optimal option in the cued rGT only, despite concurrently increasing impulsive responses made prematurely on both the cued and uncued rGT. M100907 and Ro-60-0175 did not alter risky decision making, but nevertheless produced the expected decrease in premature responses on both task variants.

CONCLUSIONS

These findings demonstrate that the 5-HT₂ receptor-mediated regulation of risky decision making and motor impulsivity can be pharmacologically dissociated and further show that the presence of highly salient reward-paired cues critically alters the neurochemical regulation of the choice process. Importantly, these results suggest that 5-HT_2C receptor antagonists may be of use in disrupting maladaptive patterns of decision making.

Gambling-like behavior in pigeons: 'jackpot' signals promote maladaptive risky choice

Individuals often face choices that have uncertain outcomes and have important consequences. As a model of this environment, laboratory experiments often offer a choice between an uncertain, large reward that varies in its probability of delivery against a certain but smaller reward as a measure of an individual’s risk aversion. An important factor generally lacking from these procedures are gambling related cues that may moderate risk preferences. The present experiment offered pigeons choices between unreliable and certain rewards but, for the Signaled group on winning choices, presented a ‘jackpot’ signal prior to reward delivery. The Unsignaled group received an ambiguous stimulus not informative of choice outcomes. For the Signaled group, presenting win signals effectively blocked value discounting for the large, uncertain outcome as the probability of a loss increased, whereas the Unsignaled group showed regular preference changes similar to previous research lacking gambling related cues. These maladaptive choices were further shown to be unaffected by more salient loss signals and resistant to response cost increases. The results suggest an important role of an individual’s sensitivity to outcome-correlated cues in influencing risky choices that may moderate gambling behaviors in humans, particularly in casino and other gambling-specific environments.