Disadvantageous decision-making on a rodent gambling task is associated with increased motor impulsivity in a population of male rats

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

Propensity for risky choices despite lower cue reactivity in adolescent rats

Adolescence is a time of heightened risk-taking across species. Salient audiovisual cues associated with rewards are a common feature of gambling environments and have been connected to increased risky decision-making. We have previously shown that, in adult male rats, sign tracking - a behavioral measure of cue reactivity - predicts an individual's propensity for suboptimal risky choices in a rodent gambling task (rGT) with win-paired cues. However, adolescents perform less sign tracking than adult animals, suggesting that they are less cue-reactive than adults in some circumstances. Therefore, we investigated the performance of adolescent male rats on the rGT with win cues and examined its relationship with their sign-tracking behavior. We found that adolescents make more risky choices and fewer optimal choices on the rGT compared with adults, evidence of the validity of the rGT as a model of adolescent gambling behavior. We also confirmed that adolescents perform less sign tracking than adults, and we found that, unlike in adults, adolescents' sign tracking was unrelated to their risk-taking in the rGT. This implies that adolescent risk-taking is less likely than that of adults to be driven by reward-related cues. Finally, we found that adults trained on the rGT as adolescents retained an adolescent-like propensity toward risky choices, suggesting that early exposure to a gambling environment may have a long-lasting impact on risk-taking behavior.

Methadone maintenance treatment and impulsivity: premature responding

INTRODUCTION

Previous research showed that methadone maintenance treatment (MMT) is linked to impulsivity, with higher impulsivity levels being associated with for example, increased drug use. One aspect of impulsivity, most commonly studied in rodent research, is premature responding, the failure to wait for a starting signal. Premature responding is of high translational significance since it predicts the development of addiction-like behaviors in rodents.

METHODS

We assessed 45 MMT patients and 46 demographically matched (age, sex, education, and handedness) healthy volunteers (HVs) on premature responding alongside action and inhibition of instructed and intentional trials using the Intentional Hand Task (IHT).

RESULTS

The results showed markedly enhanced premature responses in the MMT vs. the HV group, which correlated positively with methadone dosage in the MMT patients. Throughout the task, MMT patients were faster across all trial parts and less accurate in response to instructed trials compared to HVs.

CONCLUSIONS

The increase in premature motor reactions during variable waiting periods alongside increased motion speed and lower accuracy might reflect a specific motor inhibition deficit in MMT, a subcomponent of impulsivity not previously assessed in MMT. Incorporating an experimentally defined measure of impulsivity, such as premature responding, into existing test batteries used by clinicians might enable more tailored treatments addressing the increased impulsivity levels and associated dysfunctional behaviors in MMT.

Motor impulsivity but not risk-related impulsive choice is associated to drug intake and drug-primed relapse

Introduction

Motor impulsivity and risk-related impulsive choice have been proposed as vulnerability factors for drug abuse, due to their high prevalence in drug abusers. However, how these two facets of impulsivity are associated to drug abuse remains unclear. Here, we investigated the predictive value of both motor impulsivity and risk-related impulsive choice on characteristics of drug abuse including initiation and maintenance of drug use, motivation for the drug, extinction of drug-seeking behavior following drug discontinuation and, finally, propensity to relapse.

Methods

We used the Roman High- (RHA) and Low- Avoidance (RLA) rat lines, which display innate phenotypical differences in motor impulsivity, risk-related impulsive choice, and propensity to self-administer drugs. Individual levels of motor impulsivity and risk-related impulsive choice were measured using the rat Gambling task. Then, rats were allowed to self-administer cocaine (0.3 mg/kg/infusion; 14 days) to evaluate acquisition and maintenance of cocaine self-administration, after which motivation for cocaine was assessed using a progressive ratio schedule of reinforcement. Subsequently, rats were tested for their resistance to extinction, followed by cue-induced and drug-primed reinstatement sessions to evaluate relapse. Finally, we evaluated the effect of the dopamine stabilizer aripiprazole on reinstatement of drug-seeking behaviors.

Results

We found that motor impulsivity and risk-related impulsive choice were positively correlated at baseline. Furthermore, innate high levels of motor impulsivity were associated with higher drug use and increased vulnerability to cocaine-primed reinstatement of drug-seeking. However, no relationships were observed between motor impulsivity and the motivation for the drug, extinction or cue-induced reinstatement of drug-seeking. High levels of risk-related impulsive choice were not associated to any aspects of drug abuse measured in our study. Additionally, aripiprazole similarly blocked cocaine-primed reinstatement of drug-seeking in both high- and low-impulsive animals, suggesting that aripiprazole acts as a D_2/3R antagonist to prevent relapse independently of the levels of impulsivity and propensity to self-administer drugs.

Discussion

Altogether, our study highlights motor impulsivity as an important predictive factor for drug abuse and drug-primed relapse. On the other hand, the involvement of risk-related impulsive choice as a risk factor for drug abuse appears to be limited.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Exploring decision-making strategies in the Iowa gambling task and rat gambling task

Decision-making requires that individuals perceive the probabilities and risks associated with different options. Experimental human and animal laboratory testing provide complimentary insights on the psychobiological underpinnings of decision-making. The Iowa gambling task (IGT) is a widely used instrument that assesses decision-making under uncertainty and risk. In the task participants are faced with a choice conflict between cards with varying monetary reinforcer/loss contingencies. The rat gambling task (rGT) is a pre-clinical version using palatable reinforcers as wins and timeouts mimicking losses. However, interspecies studies elaborating on human and rat behavior in these tasks are lacking. This study explores decision-making strategies among young adults (N = 270) performing a computerized version of the IGT, and adult outbred male Lister Hooded rats (N = 72) performing the rGT. Both group and individual data were explored by normative scoring approaches and subgroup formations based on individual choices were investigated. Overall results showed that most humans and rats learned to favor the advantageous choices, but to a widely different extent. Human performance was characterized by both exploration and learning as the task progressed, while rats showed relatively consistent pronounced preferences for the advantageous choices throughout the task. Nevertheless, humans and rats showed similar variability in individual choice preferences during end performance. Procedural differences impacting on the performance in both tasks and their potential to study different aspects of decision-making are discussed. This is a first attempt to increase the understanding of similarities and differences regarding decision-making processes in the IGT and rGT from an explorative perspective.

Functional connectivity in reward-related networks is associated with individual differences in gambling strategies in male Lister hooded rats

Individuals with gambling disorder display deficits in decision-making in the Iowa Gambling Task. The rat Gambling Task (rGT) is a rodent analogue that can be used to investigate the neurobiological mechanisms underlying gambling behaviour. The aim of this explorative study was to examine individual strategies in the rGT and investigate possible behavioural and neural correlates associated with gambling strategies. Thirty-two adult male Lister hooded rats underwent behavioural testing in the multivariate concentric square field™ (MCSF) and the novel cage tests, were trained on and performed the rGT and subsequently underwent resting-state functional magnetic resonance imaging (R-fMRI). In the rGT, stable gambling strategies were found with subgroups of rats that preferred the suboptimal safest choice as well as the disadvantageous choice, that is, the riskiest gambling strategy. R-fMRI results revealed associations between gambling strategies and brain regions central for reward networks. Moreover, rats with risky gambling strategies differed from those with strategic and intermediate strategies in brain functional connectivity. No differences in behavioural profiles, as assessed with the MCSF and novel cage tests, were observed between the gambling strategy groups. In conclusion, stable individual differences in gambling strategies were found. Intrinsic functional connectivity using R-fMRI provides novel evidence to support the notion that individual differences in gambling strategies are associated with functional connectivity in brain regions important for reward networks.

Individual strategies in the rat gambling task are related to voluntary alcohol intake, but not sexual behavior, and can be modulated by naltrexone

INTRODUCTION

Gambling disorder (GD) is the first non-substance or behavioral addiction to be included in substance-related and addictive disorders in DSM-5. Since GD is a younger phenomenon relative to alcohol and substance use disorders, little is known about potential unique features in GD and to what extent characteristics are shared with alcohol and substance use disorders. The rat gambling task (rGT) is used to study decision-making in rats. This study aimed to identify individual differences in rGT strategies and explore the stability of these strategies over time. Moreover, motor impulsivity, sexual behavior, and voluntary alcohol intake were examined in rats with different rGT strategies. Finally, the response to naltrexone on performance in rats with different rGT strategies was investigated.

METHODS

Male Lister hooded rats (n = 40) underwent repeated testing in the rGT, repeated copulatory behavioral tests, and 7 weeks of voluntary alcohol intake through a modified intermittent two-bottle free-choice paradigm. Finally, rats were treated with naltrexone prior to testing in the rGT.

RESULTS

The results revealed individual choice strategies in the rGT that were stable over time, even after multiple interruptions and other behavioral testing. The rats with a risky choice strategy displayed higher motor impulsivity and voluntary alcohol intake than the other groups. No difference in sexual behavior was found between the different rGT groups. Finally, in all rats irrespectively of rGT strategy, treatment with naltrexone decreased the number of completed trials and premature responses, and increased omissions, which indicates an overall lowered motivation.

DISCUSSION

In conclusion, rats with risky rGT strategies had higher voluntary alcohol intake but not elevated sexual behavior, indicating shared underlying mechanisms between rGT strategies and alcohol intake but not natural rewards in terms of sexual behavior. Finally, naltrexone treatment resulted in an overall lowered motivation in the rGT.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT_2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT_2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT_2C antagonism may optimize choice by facilitating exploration.

Dopamine neurons gate the intersection of cocaine use, decision making, and impulsivity

Gambling and substance use disorders are highly comorbid. Both clinical populations are impulsive and exhibit risky decision-making. Drug-associated cues have long been known to facilitate habitual drug-seeking, and the salient audiovisual cues embedded within modern gambling products may likewise encourage problem gambling. The dopamine neurons of the ventral tegmental area (VTA) are exquisitely sensitive to drugs of abuse, uncertain rewards, and reward-paired cues and may therefore be the common neural substrate mediating synergistic features of both disorders. To test this hypothesis, we first gained specific inhibitory control over VTA dopamine neurons by transducing a floxed inhibitory DREADD (AAV5-hSyn-DIO-hM4D(Gi)-mCherry) in rats expressing Cre recombinase in tyrosine hydroxylase neurons. We then trained rats in our cued rat gambling task (crGT), inhibiting dopamine neurons throughout task acquisition and performance, before allowing them to self-administer cocaine in the same diurnal period as crGT sessions. The trajectories of addiction differ in women and men, and the dopamine system may differ functionally across the sexes; therefore, we used male and female rats here. We found that inhibition of VTA dopamine neurons decreased cue-induced risky choice and reduced motor impulsivity in males, but surprisingly, enhanced risky decision making in females. Inhibiting VTA dopamine neurons also prevented cocaine-induced changes in decision making in both sexes, but nevertheless drove all animals to consume more cocaine. These findings show that chronic dampening of dopamine signalling can have both protective and deleterious effects on addiction-relevant behaviours, depending on biological sex and dependent variable of interest.

Adaptive aspects of impulsivity and interactions with effects of catecholaminergic agents in the 5-choice serial reaction time task: implications for ADHD

BACKGROUND

Work in humans has shown that impulsivity can be advantageous in certain settings. However, evidence for so-called functional impulsivity is lacking in experimental animals.

AIMS

This study investigated the contexts in which high impulsive (HI) rats show an advantage in performance compared with mid- (MI) and low impulsive (LI) rats. We also assessed the effects of dopaminergic and noradrenergic agents to investigate underlying neurotransmitter mechanisms.

METHODS

We tested rats on a variable inter-trial interval (ITI) version of the 5-choice serial reaction time task (5CSRTT). Rats received systemic injections of methylphenidate (MPH, 1 mg/kg and 3 mg/kg), atomoxetine (ATO, 0.3 mg/kg and 1 mg/kg), amphetamine (AMPH, 0.2 mg/kg), the alpha-2a adrenoceptor antagonist atipamezole (ATI, 0.3 mg/kg) and the alpha-1 adrenoceptor agonist phenylephrine (PHEN, 1 mg/kg) prior to behavioural testing.

RESULTS

Unlike LI rats, HI rats exhibited superior performance, earning more reinforcers, on short ITI trials, when the task required rapid responding. MPH, AMPH and ATI improved performance on short ITI trials and increased impulsivity in long ITI trials, recapitulating the behavioural profile of HI. In contrast, ATO and PHEN impaired performance on short ITI trials and decreased impulsivity, thus mimicking the behavioural profile of LI rats. The effects of ATO were greater on MI rats and LI rats.

CONCLUSIONS

These findings indicate that impulsivity can be advantageous when rapid focusing and actions are required, an effect that may depend on increased dopamine neurotransmission. Conversely, activation of the noradrenergic system, with ATO and PHEN, led to a general inhibition of responding.

Sign tracking predicts suboptimal behavior in a rodent gambling task

RATIONALE

Reward-associated cues can promote maladaptive behavior, including risky decision-making in a gambling setting. A propensity for sign tracking over goal tracking-i.e., interaction with a reward-predictive cue rather than the site of reward-demonstrates an individual's tendency to transfer motivational value to a cue. However, the relationship of sign tracking to risky decision-making remains unclear.

OBJECTIVES

To determine whether sign tracking predicts risky choice, we used a Pavlovian conditioned approach task to evaluate the tendency of male rats to sign track to a lever cue and then trained rats on a rodent gambling task (rGT) with win-associated cues. We also tested the effects of D-amphetamine, quinpirole (a D₂/D₃ receptor agonist), and PD128907 (a D₃ receptor agonist) on gambling behavior in sign tracker and goal tracker individuals.

RESULTS

Increased sign tracking relative to goal tracking was associated with suboptimal performance on the rGT, including decreased selection of the optimal choice, increased selection of a high-risk/high-reward option, and increased impulsive premature choices. Amphetamine increased choices of a low-risk/low-reward option at the expense of optimal and high-risk choices, whereas quinpirole and PD128907 had little effect on choice allocation, but reduced impulsivity. Drug effects were similar across sign tracker and goal tracker individuals.

CONCLUSIONS

Cue reactivity, as measured by sign tracking, is predictive and may be an important driver of risky and impulsive choices in a gambling setting laden with salient audiovisual cues. Evaluating an individual's sign tracking behavior may be an avenue to predict vulnerability to pathological gambling and the efficacy of treatments.

Impaired decision making following escalation of cocaine self-administration predicts vulnerability to relapse in rats

Impairments in cost‐benefit decision making represent a cardinal feature of drug addiction. However, whether these alterations predate drug exposure, thereby contributing to facilitating loss of control over drug intake, or alternatively arise as a result of drug use and subsequently confer vulnerability to relapse has yet to be determined. Male Sprague‐Dawley rats were trained to self‐administer (SA) cocaine during 19 daily long‐access (12‐h) sessions; conditions reliably shown to promote escalation. One week after cocaine SA, rats underwent an extinction/relapse test immediately followed by conditioned stimuli–, stress‐, and drug‐primed reinstatement challenges. The influence of escalated cocaine intake on decision making was measured over time by four test sessions of a rodent analogue of the Iowa Gambling Task (rGT), once prior to cocaine exposure and then 1 day, 1 week, and 1 month after the last SA session. Substantial individual variability was observed in the influence of escalated cocaine SA on decision‐making performance. A subset of rats displayed pronounced deficits, while others showed unaffected or even improved performance on the rat Gambling Task (rGT) 24 hours after the last SA session. When challenged with a relapse test after 1 week of forced abstinence, animals that showed impaired decision making following SA displayed an increased propensity to respond for cocaine under extinction. These data suggest that decision‐making deficits in individuals with drug addiction are not antecedent to—but arise as a consequence of—drug exposure. Moreover, these data indicate that susceptibility to the deleterious effects of drugs on decision making confers vulnerability toward relapse.

Translating concepts of risk and loss in rodent models of gambling and the limitations for clinical applications

Gambling involves placing something of value at risk in exchange for the opportunity to potentially gain something of greater value in return. A variety of gambling paradigms have been designed to study the maladaptive decision-making that underlies problematic gambling. Central to these gambling models are the definitions of "risk" and "loss", especially when translating the results from rodent studies to clinical applications. Risk and loss are not mutually exclusive but rather share some overlap. With careful interpretation and consideration of the limitations of these behavioral paradigms, results from rodent models may provide insights into the neurobiology of risky decision-making that leads to problematic gambling in humans.

Unilateral parietal brain injury increases risk-taking on a rat gambling task

Traumatic brain injury (TBI) affects millions of individuals every year. Many of these injuries lead to lasting effects, particularly impairments in domains broadly classified as executive functions, such as impulse control and decision-making. While these impairments have been historically associated with frontal brain damage, other injuries such as concussion or parietal injury also contribute to similar dysfunction. However, it is unknown whether animal models of TBI would replicate these broad effects that are observed in human patients. In the current study, we delivered a unilateral parietal controlled cortical impact injury and assessed the performance of rats on a motoric task (rotarod) and a test of decision-making and impulsivity (rodent gambling task). TBI rats demonstrated significant motor impairments on the rotarod task; however, this did not extend to difficulties inhibiting motor actions (impulsivity). In addition, TBI caused chronic alterations to risk-based decision-making, extending out to 12 weeks post-injury. Specifically, rats with TBI preferred the riskiest, and most suboptimal option over all others. The current data suggest that models of unilateral TBI are sufficient for replicating some aspects of executive dysfunction (risky decision-making), while others are limited to frontal damage (impulsivity). These models may be used to develop therapeutics targeted at the chronic post-injury period when these symptoms often manifest in patients, a critically understudied area in preclinical TBI research.

Relative insensitivity to time-out punishments induced by win-paired cues in a rat gambling task

RATIONALE

Pairing rewarding outcomes with audiovisual cues in simulated gambling games increases risky choice in both humans and rats. However, the cognitive mechanism through which this sensory enhancement biases decision-making is unknown.

OBJECTIVES

To assess the computational mechanisms that promote risky choice during gambling, we applied a series of reinforcement learning models to a large dataset of choices acquired from rats as they each performed one of two variants of a rat gambling task (rGT), in which rewards on "win" trials were delivered either with or without salient audiovisual cues.

METHODS

We used a sampling technique based on Markov chain Monte Carlo to obtain posterior estimates of model parameters for a series of RL models of increasing complexity, in order to assess the relative contribution of learning about positive and negative outcomes to the latent valuation of each choice option on the cued and uncued rGT.

RESULTS

Rats which develop a preference for the risky options on the rGT substantially down-weight the equivalent cost of the time-out punishments during these tasks. For each model tested, the reduction in learning from the negative time-outs correlated with the degree of risk preference in individual rats. We found no apparent relationship between risk preference and the parameters that govern learning from the positive rewards.

CONCLUSIONS

The emergence of risk-preferring choice on the rGT derives from a relative insensitivity to the cost of the time-out punishments, as opposed to a relative hypersensitivity to rewards. This hyposensitivity to punishment is more likely to be induced in individual rats by the addition of salient audiovisual cues to rewards delivered on win trials.

Increased motor impulsivity in a rat gambling task during chronic ropinirole treatment: potentiation by win-paired audiovisual cues

RATIONALE

Chronic administration of D_2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD).

OBJECTIVES

We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs).

METHODS

Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days.

RESULTS

Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task.

CONCLUSIONS

These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D_2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

Long-term deficits in risky decision-making after traumatic brain injury on a rat analog of the Iowa gambling task

Traumatic brain injury (TBI) affects 2.8 million people annually in the United States, with significant populations suffering from ongoing cognitive dysfunction. Impairments in decision-making can have major implications for patients and their caregivers, often enduring for years to decades, yet are rarely explored in experimental TBI. In the current study, the Rodent Gambling Task (RGT), an Iowa Gambling Task analog, was used to assess risk-based decision-making and motor impulsivity after TBI. During testing, rats chose between options associated with different probabilities of reinforcement (sucrose) or punishment (timeout). To determine effects of TBI on learned behaviors versus the learning process, rats were trained either before, or after, a bilateral frontal controlled cortical impact TBI, and then assessed for 12 weeks. To evaluate the degree to which monoamine systems, such as dopamine, were affected by TBI, rats were given an amphetamine challenge, and behavior recorded. Injury immediately and chronically decreased optimal decision-making, and biased rats towards both riskier, and safer (but suboptimal) choices, regardless of prior learning history. TBI also increased motor impulsivity across time, reflecting ongoing neural changes. Despite these similarities in trained and acquisition rats, those that learned the task after injury demonstrated reduced effects of amphetamine on optimal decision-making, suggesting a lesser role of monoamines in post-injury learning. Amphetamine also dose-dependently reduced motor impulsivity in injured rats. This study opens up the investigation of psychiatric-like dysfunction in animal models of TBI and tasks such as the RGT will be useful in identifying therapeutics for the chronic post-injury period.

Effects of the NMDA receptor antagonists dizocilpine and Ro 63-1908 on delay-discounting and risky decision-making in a gambling task

Previous studies demonstrated that NMDA receptor antagonists such as dizocilpine (MK801) and the GluN2B NMDA antagonist Ro 63-1908 promote impulsive action (motor impulsivity). The effects of these treatments on impulsive choice and decision-making is less well characterized. Two experiments were undertaken. In the first experiment, given evidence for delay order as a factor in choice selection, the effect of dizocilpine was examined in a delay discounting task with separate groups of male Long-Evans rats trained to a schedule of either ascending (i.e. 0-40 s), or descending delays (i.e. 40-0 s). Under the ascending-delay schedule, dizocilpine (0.03-0.06 mg/kg SC) reduced discounting, yet on the descending-delay schedule discounting was increased. Subgrouping rats according to discounting rate under vehicle pretreatment were consistent with a treatment-induced choice perseveration. In a second experiment, male Long-Evans rats were trained to a gambling task (rGT). Neither dizocilpine (0.01-0.06 mg/kg SC) nor Ro 63-1908 (0.1-1 mg/kg SC) shifted choice from the advantageous to the disadvantageous options. However dizocilpine, and marginally Ro 63-1908, increased choice of the least risky, but suboptimal option. This effect was most evident in rats that initially preferred the disadvantageous options. Consistent with previous studies, both treatments increased measures of motor impulsivity. These results demonstrate that dizocilpine has effects on discounting dependent on delay order and likely reflective of perseveration. On the rGT task, neither dizocilpine nor Ro 63-1908 promoted risky choice, yet both NMDA receptor antagonists increased impulsive action.

Pharmacological evidence that 5-HT2C receptor blockade selectively improves decision making when rewards are paired with audiovisual cues in a rat gambling task

RATIONALE

Adding reward-concurrent cues to a rat gambling task (rGT) increases risky choice. This cued version of the task may reflect an "addiction-like" cognitive process, more similar to human gambling than the uncued task. Serotonergic drugs that target 5-HT₂ receptors alter mechanisms linked to impulse control. However, relatively little is known regarding the impact of such agents on either risky decision making, or the ability of conditioned stimuli to bias the choice process, despite potential relevance to addiction development and treatment.

OBJECTIVES

The aim of this study was to determine the effects of SB 242,084 and M100907, selective antagonists at the 5-HT_2C and 5-HT_2A receptors respectively, as well as the selective 5-HT_2C receptor agonist Ro-60-0175, on performance of both cued and uncued versions of the rGT.

RESULTS

SB 242,084 significantly and dose-dependently increased choice of the most optimal option in the cued rGT only, despite concurrently increasing impulsive responses made prematurely on both the cued and uncued rGT. M100907 and Ro-60-0175 did not alter risky decision making, but nevertheless produced the expected decrease in premature responses on both task variants.

CONCLUSIONS

These findings demonstrate that the 5-HT₂ receptor-mediated regulation of risky decision making and motor impulsivity can be pharmacologically dissociated and further show that the presence of highly salient reward-paired cues critically alters the neurochemical regulation of the choice process. Importantly, these results suggest that 5-HT_2C receptor antagonists may be of use in disrupting maladaptive patterns of decision making.

Risk-preferring rats make worse decisions and show increased incubation of craving after cocaine self-administration

Maladaptive decision-making may play an integral role in the development and maintenance of an addiction. Substance-dependent individuals make riskier choices on the Iowa Gambling Task, and these deficits persist during withdrawal and are predictive of relapse. However, it is unclear from clinical studies whether this cognitive impairment is a cause or consequence of drug use. We trained male Long-Evans rats on the rat Gambling Task, a rodent analogue of the Iowa Gambling Task, to determine how choice preference influenced, and was influenced by, cocaine self-administration, withdrawal and incubation of craving. Rats that exhibited a preference for the risky, disadvantageous options at baseline were uniquely and adversely affected by cocaine self-administration. Risky choice was exacerbated in these rats when decision-making was assessed during the same diurnal period as cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. This decision-making deficit was maintained during 30 days of withdrawal and correlated with greater cue-induced incubation of craving. Risk-preferring rats also made more drug-seeking responses during cocaine self-administration. These data demonstrate that poor decision-making prior to contact with addictive drugs is associated with a pro-addictive behavioural phenotype, characterized by further increased risky choice and heightened responding for drug both during cocaine self-administration and withdrawal. Such findings indicate that the elevated risky decision-making observed in substance-dependent populations is not merely circumstantial, but makes an important contribution to addiction vulnerability and severity that can now be effectively modelled in laboratory rats.

Deep-Brain Stimulation of the Subthalamic Nucleus Selectively Decreases Risky Choice in Risk-Preferring Rats

Deep brain stimulation of the subthalamic nucleus (STN-DBS) can improve the motor symptoms of Parkinson's disease (PD) and negate the problematic side effects of dopamine replacement therapy. Although there is concern that STN-DBS may enhance the development of gambling disorder and other impulse control disorders in this patient group, recent data suggest that STN-DBS may actually reduce iatrogenic impulse control disorders, and alleviate obsessive-compulsive disorder (OCD). Here, we sought to determine whether STN-DBS was beneficial or detrimental to performance of the rat gambling task (rGT), a rodent analogue of the Iowa Gambling Task (IGT) used to assess risky decision making clinically. Rats chose between four options associated with different amounts and probabilities of sugar pellet rewards versus timeout punishments. As in the IGT, the optimal approach was to favor options associated with smaller per-trial gains but lower timeout penalties. Once a stable behavioral baseline was established, electrodes were implanted bilaterally into the STN, and the effects of STN-DBS assessed on-task over 10 consecutive sessions using an A-B-A design. STN-DBS did not affect choice in optimal decision makers that correctly favored options associated with smaller per-trial gains but also lower penalties. However, a minority (∼25%) preferred the maladaptive "high-risk, high-reward" options at baseline. STN-DBS significantly and progressively improved choice in these risk-preferring rats. These data support the hypothesis that STN-DBS may be beneficial in ameliorating maladaptive decision making associated with compulsive and addiction disorders.

Genetic and Modeling Approaches Reveal Distinct Components of Impulsive Behavior

Impulsivity is an endophenotype found in many psychiatric disorders including substance use disorders, pathological gambling, and attention deficit hyperactivity disorder. Two behavioral features often considered in impulsive behavior are behavioral inhibition (impulsive action) and delayed gratification (impulsive choice). However, the extent to which these behavioral constructs represent distinct facets of behavior with discrete biological bases is unclear. To test the hypothesis that impulsive action and impulsive choice represent statistically independent behavioral constructs in mice, we collected behavioral measures of impulsivity in a single cohort of mice using well-validated operant behavioral paradigms. Mice with manipulation of serotonin 1B receptor (5-HT_1BR) expression were included as a model of disordered impulsivity. A factor analysis was used to characterize correlations between the measures of impulsivity and to identify covariates. Using two approaches, we dissociated impulsive action from impulsive choice. First, the absence of 5-HT_1BRs caused increased impulsive action, but not impulsive choice. Second, based on an exploratory factor analysis, a two-factor model described the data well, with measures of impulsive action and choice separating into two independent factors. A multiple-indicator multiple-causes analysis showed that 5-HT_1BR expression and sex were significant covariates of impulsivity. Males displayed increased impulsivity in both dimensions, whereas 5-HT_1BR expression was a predictor of increased impulsive action only. These data support the conclusion that impulsive action and impulsive choice are distinct behavioral phenotypes with dissociable biological influences that can be modeled in mice. Our work may help inform better classification, diagnosis, and treatment of psychiatric disorders, which present with disordered impulsivity.

Chronic administration of the dopamine D2/3 agonist ropinirole invigorates performance of a rodent slot machine task, potentially indicative of less distractible or compulsive-like gambling behaviour

RATIONALE

Whilst dopamine agonist therapies can successfully manage the symptoms of diseases such as Parkinson's disease (PD), fibromyalgia and restless leg syndrome, they can also cause impulse control and addiction disorders such as gambling disorder (GD). These compulsive behaviours seriously undermine the utility of such treatments.

OBJECTIVES

The objective of the study was to model this phenomenon using a rodent slot machine task (rSMT) in order to investigate the neurobiological basis underlying such behavioural changes.

METHODS

Male Long Evans rats were trained to perform the rSMT. The D₂-like agonist ropinirole, or saline, was then delivered continuously for 28 days via osmotic mini-pump. The effects of ropinirole on baseline rSMT performance, as well as extinction and reinstatement sessions, were determined during this time. Brain samples from key frontostriatal regions implicated in GD and PD were then harvested immediately or after a 4-week washout period during which behaviour returned to pre-drug baseline.

RESULTS

Ropinirole invigorated task performance, in that drug treatment resulted in a robust and sustained increase in the number of trials completed. Ex vivo analyses revealed that chronic ropinirole treatment led to a pattern of changes indicative of upregulation within the β-arrestin-AKT-GSK3β intracellular cascade, recently theorised to dominate D₂-mediated signalling under hyperdopaminergic conditions, in the dorsal striatum, rather than the canonical PKA-dependent signalling pathway associated with D₂ receptor activation.

CONCLUSIONS

Such findings provide novel insight into the role of dopamine signalling in mediating compulsive-like gambling behaviour and may inform more directed pharmacotherapies for the treatment of both idiopathic and iatrogenic GD.

Strong interactions between learned helplessness and risky decision-making in a rat gambling model

Risky decision-making is characteristic of depression and of addictive disorders, including pathological gambling. However it is not clear whether a propensity to risky choices predisposes to depressive symptoms or whether the converse is the case. Here we tested the hypothesis that rats showing risky decision-making in a rat gambling task (rGT) would be more prone to depressive-like behaviour in the learned helplessness (LH) model. Results showed that baseline rGT choice behaviour did not predict escape deficits in the LH protocol. In contrast, exposure to the LH protocol resulted in a significant increase in risky rGT choices on retest. Unexpectedly, control rats subjected only to escapable stress in the LH protocol showed a subsequent decrease in riskier rGT choices. Further analyses indicated that the LH protocol affected primarily rats with high baseline levels of risky choices and that among these it had opposite effects in rats exposed to LH-inducing stress compared to rats exposed only to the escape trials. Together these findings suggest that while baseline risky decision making may not predict LH behaviour it interacts strongly with LH conditions in modulating subsequent decision-making behaviour. The suggested possibility that stress controllability may be a key factor should be further investigated.

Dopamine D3 Receptors Modulate the Ability of Win-Paired Cues to Increase Risky Choice in a Rat Gambling Task

Similar to other addiction disorders, the cues inherent in many gambling procedures are thought to play an important role in mediating their addictive nature. Animal models of gambling-related behavior, while capturing dimensions of economic decision making, have yet to address the impact that these salient cues may have in promoting maladaptive choice. Here, we determined whether adding win-associated audiovisual cues to a rat gambling task (rGT) would influence decision making. Thirty-two male Long-Evans rats were tested on either the cued or uncued rGT. In these tasks, animals chose between four options associated with different magnitudes and frequencies of reward and punishing time-out periods. As in the Iowa Gambling Task, favoring options associated with smaller per-trial rewards but smaller losses and avoiding the tempting "high-risk, high-reward" decks maximized profits. Although the reinforcement contingencies were identical in both task versions, rats' choice of the disadvantageous risky options was significantly greater on the cued task. Furthermore, a D3 receptor agonist increased choice of the disadvantageous options, whereas a D3 antagonist had the opposite effects, only on the cued task. These findings are consistent with the reported role of D3 receptors in mediating the facilitatory effects of cues in addiction. Collectively, these results indicate that the cued rGT is a valuable model with which to study the mechanism by which salient cues can invigorate maladaptive decision making, an important and understudied component of both gambling and substance use disorders. Significance statement: We used a rodent analog of the Iowa Gambling Task to determine whether the addition of audiovisual cues would affect choice preferences. Adding reward-concurrent cues significantly increased risky choice. This is the first clear demonstration that reward-paired cues can bias cost/benefit decision making against a subject's best interests in a manner concordant with elevated addiction susceptibility. Choice on the cued task was uniquely sensitive to modulation by D3 receptor ligands, yet these drugs did not alter decision making on the uncued task. The relatively unprecedented sensitivity of choice on the cued task to D3-receptor-mediated neurotransmission data suggest that similar neurobiological processes underlie the ability of cues to both bias animals toward risky options and facilitate drug addiction.

Enhanced attention and impulsive action following NMDA receptor GluN2B-selective antagonist pretreatment

NMDA GluN2B (NR2B) subtype selective antagonists are currently in clinical development for a variety of indications, including major depression. We previously reported the selective NMDA GluN2B antagonists Ro 63-1908 and traxoprodil, increase premature responding in a 5-choice serial reaction time task (5-CSRTT) suggesting an effect on impulsive action. The present studies extend these investigations to a Go-NoGo and delay discounting task, and the 5-CSRTT under test conditions of both regular (5s) and short (2-5s) multiple ITI (Intertrial interval). Dizocilpine was included for comparison. Both Ro 63-1908 (0.1-1mg/kg SC) and traxoprodil (0.3-3mg/kg SC) increased premature and perseverative responses in both 5-CSRT tasks and improved attention when tested under a short ITI test condition. Ro 63-1908 but not traxoprodil increased motor impulsivity (false alarms) in a Go-NoGo task. Dizocilpine (0.01-0.06mg/kg SC) affected both measures of motor impulsivity and marginally improved attention. In a delay discounting test of impulsive choice, both dizocilpine and Ro 63-1908 decreased impulsive choice (increased choice for the larger, delayed reward), while traxoprodil showed a similar trend. Motor stimulant effects were evident following Ro 63-1908, but not traxoprodil treatment - although no signs of motor stereotypy characteristic of dizocilpine (>0.1mg/kg) were noted. The findings of both NMDA GluN2B antagonists affecting measures of impulsive action and compulsive behavior may underpin emerging evidence to suggest glutamate signaling through the NMDA GluN2B receptor plays an important role in behavioural flexibility. The profiles between Ro 63-1908 and traxoprodil were not identical, perhaps suggesting differences between members of this drug class.

Inactivation of the orbitofrontal cortex reduces irrational choice on a rodent Betting Task

Cognitive biases may play a significant role in disorders of decision making such as pathological gambling and addiction. Understanding the neurobiology of these biases could lead to more effective pharmacological and therapeutic treatments for disorders in which aberrant decision making is prominent. The rodent Betting Task (rBT) was designed to measure one commonly observed decision-making heuristic in rodents, namely "escalation of commitment" in which subjects become more risk averse as the stakes increase, even if the odds of success remain constant. In the rodent task, the animal is presented with a choice between two options of equivalent expected value, such that reward on one option is guaranteed while the other has a 50% chance of double the prize or nothing. Past work has shown that a subset of animals (termed wager sensitive) adopt an irrationally risk-averse choice preference in which they shift their choice away from the uncertain option as the bet size grows larger. In the current study, the orbitofrontal (OFC), prelimbic (PrL), and infralimbic cortex (IL) were inactivated to evaluate the contributions made by these regions to choice behavior on the rBT. Inactivation of the OFC (but not the IL or the PrL) selectively ameliorated the risk-averse choice pattern characteristic of wager-sensitive animals. This finding suggests that the OFC may have a relatively unique role in promoting this type of non-normative decision-making under uncertainty, an effect that is potentially related to its role in representing the subjective value of reinforcing outcomes.

High levels of impulsivity in rats are not accompanied by sensorimotor gating deficits and locomotor hyperactivity

High levels of impulsivity have been linked to a number of psychiatric disorders, including attention-deficit/hyperactivity disorder, drug abuse and schizophrenia. Additionally, schizophrenia patients commonly show deficits in another rather preattentive form of response inhibition, called sensorimotor gating. Given that higher-order functions, such as impulse control, are protected by early and preattentive processes, disturbed gating mechanisms may hamper more complex cognitive-executive functions. In the present study, we therefore tested whether high levels of impulsivity are accompanied by impaired sensorimotor gating in rats. High (HI) and low impulsive (LI) rats were identified based on the number of premature responses in the 5-choice serial reaction time task. Here, LI rats showed higher numbers of omission errors which may suggest attentional deficits while HI rats completed significantly less trials which could indicate a decrease in motivation. However, HI and LI rats did not differ in terms of impulsive decision-making in a delay-based decision-making T-maze task, prepulse inhibition of the acoustic startle response (a measure of sensorimotor gating mechanisms) or locomotor activity levels. Overall, our data indicate that high motor impulsivity is not a suitable predictor of deficient sensorimotor gating and is further not necessarily associated with attentional deficits and/or locomotor hyperactivity in rats.

Translational Models of Gambling-Related Decision-Making

Gambling is a harmless, recreational pastime that is ubiquitous across cultures. However, for some, gambling becomes a maladaptive and compulsive, and this syndrome is conceptualized as a behavioural addiction. Laboratory models that capture the key cognitive processes involved in gambling behaviour, and that can be translated across species, have the potential to make an important contribution to both decision neuroscience and the study of addictive disorders. The Iowa gambling task has been widely used to assess human decision-making under uncertainty, and this paradigm can be successfully modelled in rodents. Similar neurobiological processes underpin choice behaviour in humans and rats, and thus, a preference for the disadvantageous "high-risk, high-reward" options may reflect meaningful vulnerability for mental health problems. However, the choice behaviour operationalized by these tasks does not necessarily approximate the vulnerability to gambling disorder (GD) per se. We consider a number of psychological challenges that apply to modelling gambling in a translational way, and evaluate the success of the existing models. Heterogeneity in the structure of gambling games, as well as in the motivations of individuals with GD, is highlighted. The potential issues with extrapolating too directly from established animal models of drug dependency are discussed, as are the inherent difficulties in validating animal models of GD in the absence of any approved treatments for GD. Further advances in modelling the cognitive biases endemic in human decision-making, which appear to be exacerbated in GD, may be a promising line of research.