Simultaneous blockade of dopamine and noradrenaline reuptake promotes disadvantageous decision making in a rat gambling task

Atomoxetine reduces decisional impulsivity in human cocaine addiction

BACKGROUND

Impulsivity is a well-known determinant of maladaptive behaviour in cocaine use disorder, but there are currently no effective strategies for managing excessive impulsivity. Growing evidence from preclinical and clinical studies suggests that atomoxetine, a selective noradrenaline reuptake inhibitor, is effective in improving impulse control in both health and neuropsychiatric conditions.

METHODS

We investigated the effects of atomoxetine on decisional impulsivity in patients with cocaine use disorder. In a randomised, double-blind, placebo-controlled, crossover study, 28 patients diagnosed with moderate-to-severe cocaine use disorder and 28 matched healthy control participants completed the Cambridge Gamble Task in two separate sessions, where they either received placebo or a single dose of 40 mg atomoxetine on each session. Computational modelling was used to decompose decision-making into three separable components: value, probability, and decisional impulsivity.

RESULTS

Our analyses revealed that patients with cocaine use disorder were impaired in all components of decision-making. Atomoxetine selectively reduced decisional impulsivity in cocaine use disorder patients by reducing their risk-seeking tendencies whilst enhancing their ability to tolerate delays. By contrast, atomoxetine did not affect impulsivity in control participants, but increased their sensitivity to prospective losses.

CONCLUSION

Taken together, our findings support the hypothesis of noradrenergic dysfunction in patients with cocaine use disorder and provide novel translational evidence for the efficacy of atomoxetine in remediating decisional impulsivity in cocaine use disorder.

Manipulation of radixin phosphorylation in the nucleus accumbens core modulates risky choice behavior

Ezrin-Radixin-Moesin (ERM) proteins are actin-binding proteins that contribute to morphological changes in dendritic spines. Despite their significant role in regulating spine structure, the role of ERM proteins in the nucleus accumbnes (NAcc) is not well known, especially in in the context of risk-reward decision-making. Here, we measured the relationship between synaptic excitation and inhibition (E/I ratio) from medium spiny neurons in the NAcc core obtained in the rat after a rat gambling task (rGT). Then, after surgery of a phosphomimetic pseudo-active mutant form of radixin (Rdx-T564D) in the NAcc core, we examined its role in synaptic plasticity and the accompanying risk-choice behavior in rGT. We found that basal E/I ratio in the NAcc core was higher in risk-averse rats than risk-seeking rats. However, it was significantly reduced in risk-averse rats similar to that in risk-seeking rats in the presence of Rdx-T564D in the NAcc core. Furthermore, the head sizes of spines were shifted in risk-averse rats expressing Rdx-T564D in the NAcc core, similar to those observed in risk-seeking rats. The effects of Rdx-T564D in risk-averse rats were again manifested as behavioral changes, with reduced selection of optimal choices and increased selection of disadvantageous ones. In this study, we demonstrated that manipulation of radixin phosphorylation status in the NAcc core can alter glutamatergic synaptic transmission and spine structure at this site, as well as risk choice behaviors in the rGT. These novel findings illustrate that radixin in the NAcc core plays a significant role in determining risk preference during the rGT.

Trait Impulsivity as a Feature of Parkinson's Disease Treatment and Progression

Heightened trait impulsivity in both subclinical and pathological senses is becoming increasingly recognised in Parkinson's disease (PD). Impulsive behaviours and impulse control disorders (ICDs) are a consequence of perturbation to the rewards pathway leading individuals to conduct activities in a repetitive, excessive, and maladaptive fashion. Commonly linked to PD, heightened trait impulsivity has been found to primarily manifest in the forms of hypersexuality, pathological gambling, compulsive shopping, and binge eating, all of which may significantly impact social and financial standing. Subsequent burden to quality of life for both individuals with PD and caregivers are common. Although risk factors and indicators for ICDs in PD are currently lacking, it is recognised that the condition is often precipitated by dopamine replacement therapies, primarily dopamine agonist administration. While this nonmotor symptom is being increasingly diagnosed in PD populations, it remains relatively elusive in comparison to its motor counterparts. Through discussion of impulsivity characteristics, neuroanatomy, and neurochemistry, in addition to reviewing existing research on the potential contributing factors to impulsivity in PD, this review highlights impulsivity as a significant and detrimental PD symptom. Thus, emphasising the imperative need to establish efficacious diagnostic tools and treatments.

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

BACKGROUND

Acute stress alters risk-based decision-making; however, the underlying neural and neurochemical substrates are underexplored. Given their well-documented stress-inducing effects in humans and laboratory animals, glucocorticoids such as cortisol and corticosterone and the α2-adrenoceptor antagonist yohimbine represent potent pharmacological tools to mimic some characteristics of acute stress.

METHODS

Here, we analyzed the effects of the pharmacological stressors corticosterone and yohimbine given systemically on risk-based decision-making in male rats. Moreover, we investigated whether pharmacological stressor effects on risk-based decision-making involve dopamine D1 receptor stimulation in the dorsal prelimbic cortex (PL). We used a risk discounting task that requires choosing between a certain/small reward lever that always delivered 1 pellet and a risky/large reward lever that delivered 4 pellets with a decreasing probability across subsequent trials.

RESULTS

Systemic administration of yohimbine increased the preference for the risky/large reward lever. By contrast, systemic single administration of corticosterone did not significantly promote risky choice. Moreover, co-administration of corticosterone did not enhance the effects of yohimbine on risky choice. The data further show that the increased preference for the risky/large reward lever under systemic yohimbine was lowered by a concurrent pharmacological blockade of dopamine D1 receptors in the PL.

CONCLUSIONS

Our rodent data provide causal evidence that stimulation of PL D1 receptors may represent a neurochemical mechanism by which the acute pharmacological stressor yohimbine, and possibly nonpharmacological stressors as well, promote risky choice.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Exploring decision-making strategies in the Iowa gambling task and rat gambling task

Decision-making requires that individuals perceive the probabilities and risks associated with different options. Experimental human and animal laboratory testing provide complimentary insights on the psychobiological underpinnings of decision-making. The Iowa gambling task (IGT) is a widely used instrument that assesses decision-making under uncertainty and risk. In the task participants are faced with a choice conflict between cards with varying monetary reinforcer/loss contingencies. The rat gambling task (rGT) is a pre-clinical version using palatable reinforcers as wins and timeouts mimicking losses. However, interspecies studies elaborating on human and rat behavior in these tasks are lacking. This study explores decision-making strategies among young adults (N = 270) performing a computerized version of the IGT, and adult outbred male Lister Hooded rats (N = 72) performing the rGT. Both group and individual data were explored by normative scoring approaches and subgroup formations based on individual choices were investigated. Overall results showed that most humans and rats learned to favor the advantageous choices, but to a widely different extent. Human performance was characterized by both exploration and learning as the task progressed, while rats showed relatively consistent pronounced preferences for the advantageous choices throughout the task. Nevertheless, humans and rats showed similar variability in individual choice preferences during end performance. Procedural differences impacting on the performance in both tasks and their potential to study different aspects of decision-making are discussed. This is a first attempt to increase the understanding of similarities and differences regarding decision-making processes in the IGT and rGT from an explorative perspective.

Differential transcriptome profile underlying risky choice in a rat gambling task

BACKGROUND AND AIMS

Proper measurement of expected risk is important for making rational decisions, and maladaptive decision making may underlie various psychiatric disorders. However, differentially expressed genetic profiling involved in this process is still largely unknown. A rodent version of the gambling task (rGT) has been developed to measure decision-making by adopting the same principle of Iowa Gambling Task in humans. In the present study, we examined using next-generation sequencing (NGS) technique whether there are differences in gene expression profiles in the medial prefrontal cortex (mPFC) and the nucleus accumbens (NAc) when rats make different choices toward risk in rGT.

METHODS

Rats were trained in a touch screen chamber to learn the relationships between 4 different light signals on the window of the screen and accompanied reward outcomes or punishments set up with different magnitudes and probabilities. Once they showed a stabilized pattern of preference upon free choice, rats were classified into risk-averse or risk-seeking groups. After performing the rGT, rats were decapitated, the mPFC and the NAc was dissected out, and NGS was performed with the total RNA extracted.

RESULTS

We found that 477 and 36 genes were differentially expressed (approximately 75 and 83% out of them were downregulated) in the mPFC and the NAc, respectively, in risk-seeking compared to risk-averse rats. Among those, we suggested a few top ranked genes that may contribute to promoting risky choices.

DISCUSSION AND CONCLUSIONS

Our findings provide insights into transcriptional components underlying risky choices in rats.

Functional connectivity in reward-related networks is associated with individual differences in gambling strategies in male Lister hooded rats

Individuals with gambling disorder display deficits in decision-making in the Iowa Gambling Task. The rat Gambling Task (rGT) is a rodent analogue that can be used to investigate the neurobiological mechanisms underlying gambling behaviour. The aim of this explorative study was to examine individual strategies in the rGT and investigate possible behavioural and neural correlates associated with gambling strategies. Thirty-two adult male Lister hooded rats underwent behavioural testing in the multivariate concentric square field™ (MCSF) and the novel cage tests, were trained on and performed the rGT and subsequently underwent resting-state functional magnetic resonance imaging (R-fMRI). In the rGT, stable gambling strategies were found with subgroups of rats that preferred the suboptimal safest choice as well as the disadvantageous choice, that is, the riskiest gambling strategy. R-fMRI results revealed associations between gambling strategies and brain regions central for reward networks. Moreover, rats with risky gambling strategies differed from those with strategic and intermediate strategies in brain functional connectivity. No differences in behavioural profiles, as assessed with the MCSF and novel cage tests, were observed between the gambling strategy groups. In conclusion, stable individual differences in gambling strategies were found. Intrinsic functional connectivity using R-fMRI provides novel evidence to support the notion that individual differences in gambling strategies are associated with functional connectivity in brain regions important for reward networks.

Increased elasticity of sucrose demand during hyperdopaminergic states in rats

RATIONALE

Deficits in cost-benefit decision-making are a core feature of several psychiatric disorders, including substance addiction, eating disorders and bipolar disorder. Mesocorticolimbic dopamine signalling has been implicated in various processes related to cognition and reward, but its precise role in reward valuation and cost-benefit trade-off decisions remains incompletely understood.

OBJECTIVES

We assessed the role of mesocorticolimbic dopamine signalling in the relationship between price and consumption of sucrose, to better understand its role in cost-benefit decisions.

METHODS

Dopamine neurons in the ventral tegmental area (VTA) were chemogenetically activated in rats, and a behavioural economics approach was used to quantify the relationship between price and consumption of sucrose. Motivation for sucrose was also assessed under a progressive ratio (PR) schedule of reinforcement. To further gauge the role of dopamine in cost-benefit trade-offs for sucrose, the effects of treatment with D-amphetamine and the dopamine receptor antagonist alpha-flupentixol were assessed.

RESULTS

Chemogenetic activation of VTA dopamine neurons increased demand elasticity, while responding for sucrose under a PR schedule of reinforcement was augmented upon stimulation of VTA dopamine neurons. Treatment with amphetamine partially replicated the effects of chemogenetic dopamine neuron activation, whereas treatment with alpha-flupentixol reduced free consumption of sucrose and had mixed effects on demand elasticity.

CONCLUSIONS

Stimulation of mesocorticolimbic dopaminergic neurotransmission altered cost-benefit trade-offs in a complex manner. It reduced the essential value of palatable food, increased incentive motivation and left free consumption unaltered. Together, these findings imply that mesocorticolimbic dopamine signalling differentially influences distinct components of cost expenditure processes aimed at obtaining rewards.

The Effects of Drug Treatments for ADHD in Measures of Cognitive Performance

Based on core symptoms of inattention and deficient impulse control, and the identification of effective pharmacotherapies such as amphetamine (AMP; Adderall^®), methylphenidate (MPH; Ritalin^®), and atomoxetine (ATX; Strattera^®), ADHD is a clinical condition which provides opportunity for translational research. Neuropsychological tests such as the 5-Choice and Continuous Performance Tasks, which measure aspects of attention and impulse control in animals and humans, provide scope for both forward (animal to human) and reverse (human to animal) translation. Rodent studies support pro-attentive effects of AMP and MPH and effectiveness in controlling some forms of impulsive behavior. In contrast, any pro-attentive effects of ATX appear to be less consistent, the most reliable effects of ATX are recorded in tests of impulsivity. These differences may account for AMP and MPH being recognized as first-line treatments for ADHD with a higher efficacy relative to ATX. DSM-5 classifies three "presentations" of ADHD: predominantly inattentive type (ADHD-I), predominantly hyperactive/impulsive type (ADHD-HI), or combined (ADHD-C). Presently, it is unclear whether AMP, MPH, or ATX has differential levels of efficacy across these presentation types. Nonetheless, these studies encourage confidence for the forward translation of NCEs in efforts to identify newer pharmacotherapies for ADHD.

Individual strategies in the rat gambling task are related to voluntary alcohol intake, but not sexual behavior, and can be modulated by naltrexone

INTRODUCTION

Gambling disorder (GD) is the first non-substance or behavioral addiction to be included in substance-related and addictive disorders in DSM-5. Since GD is a younger phenomenon relative to alcohol and substance use disorders, little is known about potential unique features in GD and to what extent characteristics are shared with alcohol and substance use disorders. The rat gambling task (rGT) is used to study decision-making in rats. This study aimed to identify individual differences in rGT strategies and explore the stability of these strategies over time. Moreover, motor impulsivity, sexual behavior, and voluntary alcohol intake were examined in rats with different rGT strategies. Finally, the response to naltrexone on performance in rats with different rGT strategies was investigated.

METHODS

Male Lister hooded rats (n = 40) underwent repeated testing in the rGT, repeated copulatory behavioral tests, and 7 weeks of voluntary alcohol intake through a modified intermittent two-bottle free-choice paradigm. Finally, rats were treated with naltrexone prior to testing in the rGT.

RESULTS

The results revealed individual choice strategies in the rGT that were stable over time, even after multiple interruptions and other behavioral testing. The rats with a risky choice strategy displayed higher motor impulsivity and voluntary alcohol intake than the other groups. No difference in sexual behavior was found between the different rGT groups. Finally, in all rats irrespectively of rGT strategy, treatment with naltrexone decreased the number of completed trials and premature responses, and increased omissions, which indicates an overall lowered motivation.

DISCUSSION

In conclusion, rats with risky rGT strategies had higher voluntary alcohol intake but not elevated sexual behavior, indicating shared underlying mechanisms between rGT strategies and alcohol intake but not natural rewards in terms of sexual behavior. Finally, naltrexone treatment resulted in an overall lowered motivation in the rGT.

Executive function in obesity and anorexia nervosa: Opposite ends of a spectrum of disordered feeding behaviour?

Higher-order executive functions such as decision-making, cognitive flexibility and behavioural control are critical to adaptive success in all aspects of life, including the maintenance of a healthy body weight by regulating food intake. Performance on tasks designed to assess these aspects of cognition is impaired in individuals with obesity and anorexia nervosa (AN); conditions at either end of a spectrum of body weight disturbance. While the conceptualisation of obesity and AN as mirror images of each other makes some sense from a metabolic point of view, whether or not these conditions also reflect opposing states of executive function is less clear. Here, we review evidence from neurocognitive and neuroimaging studies to compare the direction and extent of executive dysfunction in subjects with obesity and AN and how these are underpinned by changes in structure and function of subregions of the prefrontal cortex (PFC). Both conditions of extreme body weight disturbance are associated with impaired decision-making and cognitive inflexibility, however, impulsive behaviour presents in opposing directions; obesity being associated with reduced behavioural control and AN being associated with elevated control over behaviour with respect to food and feeding. Accordingly, the subregions of the PFC that guide inhibitory control and valuation of action outcomes (dorsolateral prefrontal cortex and orbitofrontal cortex) show opposite patterns of activation in subjects with obesity compared to those with AN, whereas the subregions implicated in cognitive and behavioural flexibility (ventromedial prefrontal cortex and anterior cingulate cortex) show alterations in the same direction in both conditions but with differential extent of dysfunction. We synthesise these findings in the context of the utility of animal models of obesity and AN to interrogate the detail of the neurobiological contributions to cognition in patient populations and the utility of such detail to inform future treatment strategies that specifically target executive dysfunction.

Animal Models of the Behavioral Symptoms of Substance Use Disorders

To more effectively manage substance use disorders, it is imperative to understand the neural, genetic, and psychological underpinnings of addictive behavior. To contribute to this understanding, considerable efforts have been made to develop translational animal models that capture key behavioral characteristics of addiction on the basis of DSM5 criteria of substance use disorders. In this review, we summarize empirical evidence for the occurrence of addiction-like behavior in animals. These symptoms include escalation of drug use, neurocognitive deficits, resistance to extinction, exaggerated motivation for drugs, increased reinstatement of drug seeking after extinction, preference for drugs over nondrug rewards, and resistance to punishment. The occurrence of addiction-like behavior in laboratory animals has opened the opportunity to investigate the neural, genetic, and psychological background of key aspects of addiction, which may ultimately contribute to the prevention and treatment of substance use disorders.

Noradrenergic contributions to cue-driven risk-taking and impulsivity

RATIONALE

The flashing lights and sounds of modern casinos are alluring and may contribute to the addictive nature of gambling. Such cues can have a profound impact on the noradrenaline (NA) system, which could therefore be a viable therapeutic target for gambling disorder (GD). While there is substantial evidence to support the involvement of NA in the impulsive symptoms of GD, its function in mediating the "pro-addictive" impact of cues is less understood.

OBJECTIVE

We wished to investigate the role of NA in our rodent assay of decision making and impulsivity, the cued rat gambling task (crGT). Given that sex differences are prominent in addiction disorders, and increasingly reported in the monoaminergic regulation of behaviour, we also prioritised evaluating noradrenergic drugs in both sexes.

METHODS

Female and male rats were trained to stability on the crGT and then given intraperitoneal injections of the noradrenaline reuptake inhibitor atomoxetine, the α_2A receptor agonist guanfacine, the beta receptor antagonist propranolol, and the α₂ receptor antagonist yohimbine.

RESULTS

Atomoxetine dose-dependently improved decision-making score. Guanfacine selectively enhanced decision making in risk-preferring males and optimal performing females. Propranolol and yohimbine did not influence decision making. Atomoxetine and guanfacine reduced premature responses, while yohimbine bi-phasically affected this index of motor impulsivity.

CONCLUSIONS

These results support the hypothesis that NA is an important neuromodulator of the cue-induced deficits in decision making observed in laboratory-based gambling paradigms, and suggest that NAergic drugs like atomoxetine and guanfacine may be useful in treating GD.

Contrasting effects of d-amphetamine and atomoxetine on measures of impulsive action and choice

Amphetamine (AMP) and atomoxetine (ATX) represent two of the most widely studied drug treatments used in the investigation of impulsive behaviour. While both drugs have relatively well defined effects in tests designed to investigate impulsive action (e.g. 5-choice task; 5-CSRTT), the effects of both drugs in tests of impulsive choice (e.g. delay discounting) are less consistent. In the present study both AMP and ATX were tested in a rodent gambling task (rGT) and delay discounting in rats separately trained to either an ascending or descending delay schedule. Effects of both drugs were compared to measures of impulsive action (premature (PREM) responses) and perseverative (PSV) responses measured in the 5-choice and rGT tasks. Consistent with previous studies, AMP (0.1-1 mg/kg) increased both PREM and PSV responses, and ATX (0.5-2 mg/kg) reduced both measures in the 5-choice and rGT tasks. At equivalent doses ATX had no reliable effect on choice behaviour in either the rGT or delay discounting suggesting a null effect of this drug on impulsive choice and risky decision making. The effects of AMP were more complex, with a subtle shift in preference to a low risk (P1) choice in the rGT, and an effect on discounting that was unrelated to reinforcer value, but instead dependent on delay sequence and baseline choice preference. One aspect to these outcomes is to highlight the importance of multiple methodological factors when assessing drug effects on complex behaviours such as impulsive choice, and question what are the most appropriate test conditions under which to examine these drugs on discounting.

Affective Dysregulation in Children Is Associated With Difficulties in Response Control in Emotional Ambiguous Situations

BACKGROUND

Affective dysregulation (AD), or synonymously "irritability," is a transdiagnostic construct that serves as a diagnostic criterion in various childhood mental disorders. It is characterized by severe or persistent outbursts of anger and aggression. Emotional self-regulation is highly dependent on the ability to process relevant and ignore conflicting emotional information. Understanding neurophysiological mechanisms underlying impairment in AD may provide a starting point for research on pharmacological treatment options and evaluation of psychotherapeutic intervention.

METHODS

A total of 120 children 8 to 12 years of age (63 with AD and 57 typically developing) were examined using an emotional Stroop task. Signal-decomposed electroencephalographic recordings providing information about the affected sensory-perceptual, response selection, or motor information processing stage were combined with source localization.

RESULTS

Behavioral performance revealed dysfunctional cognitive-emotional conflict monitoring in children with AD, suggesting difficulties in differentiating between conflicting and nonconflicting cognitive-emotional information. This was confirmed by the electroencephalographic data showing that they cannot intensify response selection processes during conflicting cognitive-emotional situations. Typically developing children were able to do so and activated a functional-neuroanatomical network comprising the left inferior parietal cortex (Brodmann area 40), right middle frontal (Brodmann area 10), and right inferior/orbitofrontal (Brodmann area 47) regions. Purely sensory-perceptual selection and motor execution processes were not modulated in AD, as evidenced by Bayesian analyses.

CONCLUSIONS

Behavioral and electroencephalogram data suggest that children with AD cannot adequately modulate controlled response selection processes given emotionally ambiguous information. Which neurotransmitter systems underlie these deficits and how they can be improved are important questions for future research.

Dopamine receptors regulate preference between high-effort and high-risk rewards

RATIONALE

Optimal decision-making necessitates evaluation of multiple rewards that are each offset by distinct costs, such as high effort requirement or high risk of failure. The neurotransmitter dopamine is fundamental toward these cost-benefit analyses, and D1-like and D2-like dopamine receptors differently modulate the reward-discounting effects of both effort and risk. However, measuring the role of dopamine in regulating decision-making between options associated with distinct costs exceeds the scope of traditional rodent economic decision-making paradigms.

OBJECTIVES

We developed the effort vs probability economic conflict task (EvP) to model multimodal economic decision-making in rats. This task measures choice between two rewards of uniform magnitude associated with either a high effort requirement or risk of reward omission. We then tested the modulatory effects of systemic cocaine and D1/D2 blockade or activation on the preference between high-effort and high-risk alternatives.

METHODS

In the EvP, two reinforcers of equal magnitude are associated with either (1) an effort requirement that increases throughout the session (1, 5, 10, and 20 lever presses), or (2) a low probability of reward receipt (25% of probabilistic choices). Critically, the reinforcer for each choice is comparable (one pellet), which eliminates the influence of magnitude discrimination on the decision-making process. After establishing the task, the dopamine transporter blocker cocaine and D1/D2 antagonists and agonists were administered prior to EvP performance.

RESULTS

Preference shifted away from either effortful or probabilistic choice when either option became more costly, and this preference was highly variable between subjects and stable over time. Cocaine, D1 activation, and D2 blockade produced limited, dose-dependent shifts in choice preference contingent on high or low effort conditions. In contrast, D2 activation across multiple doses evoked a robust shift from effortful to risky choice that was evident even when clearly disadvantageous.

CONCLUSIONS

The EvP clearly demonstrates that rats can evaluate distinct effortful or risky costs associated with rewards of comparable magnitude, and shift preference away from either option with increasing cost. This preference is more tightly linked to D2 than D1 receptor manipulation, suggesting D2-like receptors as a possible therapeutic target for maladaptive biases toward risk-taking over effort.

Kindling of the basolateral or central nucleus of the amygdala increases suboptimal choice in a rat gambling task and increases motor impulsivity in risk-preferring animals

Impairments in decision making under uncertainty, as measured by the Iowa Gambling Task (IGT), are observed in persons suffering from temporal lobe epilepsy (TLE), in which seizures originate in the amygdala and hippocampal formations. Gambling disorder is also more prevalent in this population. Individuals with amygdala damage show similar deficits in decision-making, as do rats with lesions restricted to the basolateral amygdala (BLA) performing an analogous rat gambling task (rGT), yet whether hyperstimulation of the BLA impacts risky decision-making has yet to be demonstrated. We therefore investigated whether kindling of the BLA affected rGT performance. In this task, sugar pellet profits are maximised through consistent selection of options associated with smaller per-trial gains but shorter punishing time-outs. Just as in the IGT, subjects must avoid the risky options, as penalties are disproportionately high despite the higher reward available. Most rats adopt the optimal strategy, but some instead make high numbers of risky, disadvantageous choices. Once stable choice preferences had been established on-task, sixteen male Long Evans rats were implanted unilaterally with a bipolar electrode targeting the BLA and stimulated twice daily until three stage five seizures had been elicited. The electrodes revealed to be nearly evenly places in the BLA and the Central Nucleus of the Amygdala (CeA). Kindling transiently increased choice of the option paired with the smallest reward but also the lowest level of punishment- a risk-averse, but suboptimal, choice. Risk-preferring rats also made more premature responses, a marker of motor impulsivity, and were faster to make a choice, whereas these variables were unaffected in optimal decision-makers. These data suggest epileptiform activity originating within the amygdala can impair choice and promote impulsivity, at least in some individuals.

Involvement of noradrenergic and serotonergic systems in risk-based decisions between options of equivalent expected value in rats

Risk perception is an important factor that may mediate risk-based decision-making processes regulated by noradrenergic (NA) and serotonergic (5-HT) systems. Most risk-based decision-making models involve complex factors, such as risk perception or reward value, such that the final decision is the result of the interactions among these factors. However, the contribution of risk perception per se in risk decisions has remained unclear. Therefore, in the present study, we made some modifications to the classical probabilistic discounting task (PDT) to focus on the impact of risk perception and noradrenergic/serotonergic systems on decision-making behavior. Meanwhile, we conducted an elevated plus-maze (EPM) test to detect the correlation between anxiety and choice behavior. In the current study, rats had to choose between a "certain" lever that delivered a certain number of pellets and a "risky" lever that delivered eight pellets in a probabilistic manner (descending: 50%, 25%, 12.5% or ascending 12.5%, 25%, 50% of the time). The long-term rewarding values of the two levers were always identical in each block within each session. According to their baseline performances in choosing the risky lever, rats were divided into the risk-prefer group and risk-averse group. The results showed that there was a significant correlation between open arm time in EPM and risky choice for both descending order and ascending order, indicating that highly anxious rats more often preferred the safe option under risk. Pharmacological stimulation of α2-adrenergic receptors via dexmedetomidine (0.01 mg/kg) decreased the preference of probabilistic rewards in the risk-prefer group, while blocking α2 receptors by atipamezole (0.3 mg/kg) also reduced risky choices. The NA reuptake inhibitor, atomoxetine, increased the preference for risky choices in the risk-prefer group, the effect of which was attained via multiple superimposed doses. Administration of the 5-HT_2A receptor agonist, DOI (0.1 mg/kg), increased risk-taking behavior in the risk-prefer group. Taken together, these results suggest that NA may be more inclined to process negative information such as loss or uncertainty in the regulation of risk-related decision making, whereas 5-HT may function primarily to increase risk-taking behavior. Our findings may help to further elucidate how noradrenergic and serotonergic systems differentially affect individuals with different risk preferences in terms of regulating risk perception in risk-related decision making.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Self-reported and neurocognitive impulsivity in obsessive-compulsive disorder

BACKGROUND

Although a behavioural addiction model of obsessive-compulsive disorder (OCD) has been proposed, it is still unclear if and how self-report and neurocognitive measures of impulsivity (such as risk-taking-, reflection- and motor-impulsivities) are impaired and/or inter-related in this particular clinical population.

METHODS

Seventeen OCD patients and 17 age-, gender-, education- and IQ-matched controls completed the Barratt Impulsivity Scale, the Obsessive-Compulsive Inventory-Revised, and the Beck Depression Inventory and were evaluated with the Yale-Brown Obsessive-Compulsive Scale and three computerized paradigms including reward (the Cambridge Gambling Task), reflection (the Information Sampling Task) and motor impulsivity (Stop Signal Task).

RESULTS

Despite not differing from healthy controls in any neurocognitive impulsivity domain, OCD patients demonstrated increased impulsivity in a self-report measure (particularly attentional impulsivity). Further, attentional impulsivity was predicted by severity of obsessive-compulsive symptoms.

CONCLUSIONS

Our findings suggest that OCD is characterized by a subjective (rather than objective) impulsivity; in addition, self-reported impulsivity was largely determined by severity of OCD symptoms.

Unilateral parietal brain injury increases risk-taking on a rat gambling task

Traumatic brain injury (TBI) affects millions of individuals every year. Many of these injuries lead to lasting effects, particularly impairments in domains broadly classified as executive functions, such as impulse control and decision-making. While these impairments have been historically associated with frontal brain damage, other injuries such as concussion or parietal injury also contribute to similar dysfunction. However, it is unknown whether animal models of TBI would replicate these broad effects that are observed in human patients. In the current study, we delivered a unilateral parietal controlled cortical impact injury and assessed the performance of rats on a motoric task (rotarod) and a test of decision-making and impulsivity (rodent gambling task). TBI rats demonstrated significant motor impairments on the rotarod task; however, this did not extend to difficulties inhibiting motor actions (impulsivity). In addition, TBI caused chronic alterations to risk-based decision-making, extending out to 12 weeks post-injury. Specifically, rats with TBI preferred the riskiest, and most suboptimal option over all others. The current data suggest that models of unilateral TBI are sufficient for replicating some aspects of executive dysfunction (risky decision-making), while others are limited to frontal damage (impulsivity). These models may be used to develop therapeutics targeted at the chronic post-injury period when these symptoms often manifest in patients, a critically understudied area in preclinical TBI research.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

Increased motor impulsivity in a rat gambling task during chronic ropinirole treatment: potentiation by win-paired audiovisual cues

RATIONALE

Chronic administration of D_2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD).

OBJECTIVES

We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs).

METHODS

Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days.

RESULTS

Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task.

CONCLUSIONS

These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D_2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

Atomoxetine modulates the relationship between perceptual abilities and response bias

Elucidation of how neuromodulators influence motivated behaviors is a major challenge of neuroscience research. It has been proposed that the locus-cœruleus-norepinephrine system promotes behavioral flexibility and provides resources required to face challenges in a wide range of cognitive processes. Both theoretical models and computational models suggest that the locus-cœruleus-norepinephrine system tunes neural gain in brain circuits to optimize behavior. However, to the best of our knowledge, empirical proof demonstrating the role of norepinephrine in performance optimization is scarce. Here, we modulated norepinephrine transmission in monkeys performing a Go/No-Go discrimination task using atomoxetine, a norepinephrine-reuptake inhibitor. We tested the optimization hypothesis by assessing perceptual sensitivity, response bias, and their functional relationship within the framework of the signal detection theory. We also manipulated the contingencies of the task (level of stimulus discriminability, target stimulus frequency, and decision outcome values) to modulate the relationship between sensitivity and response bias. We found that atomoxetine increased the subject's perceptual sensitivity to discriminate target stimuli regardless of the task contingency. Atomoxetine also improved the functional relationship between sensitivity and response bias, leading to a closer fit with the optimal strategy in different contexts. In addition, atomoxetine tended to reduce reaction time variability. Taken together, these findings support a role of norepinephrine transmission in optimizing response strategy.

Long-term deficits in risky decision-making after traumatic brain injury on a rat analog of the Iowa gambling task

Traumatic brain injury (TBI) affects 2.8 million people annually in the United States, with significant populations suffering from ongoing cognitive dysfunction. Impairments in decision-making can have major implications for patients and their caregivers, often enduring for years to decades, yet are rarely explored in experimental TBI. In the current study, the Rodent Gambling Task (RGT), an Iowa Gambling Task analog, was used to assess risk-based decision-making and motor impulsivity after TBI. During testing, rats chose between options associated with different probabilities of reinforcement (sucrose) or punishment (timeout). To determine effects of TBI on learned behaviors versus the learning process, rats were trained either before, or after, a bilateral frontal controlled cortical impact TBI, and then assessed for 12 weeks. To evaluate the degree to which monoamine systems, such as dopamine, were affected by TBI, rats were given an amphetamine challenge, and behavior recorded. Injury immediately and chronically decreased optimal decision-making, and biased rats towards both riskier, and safer (but suboptimal) choices, regardless of prior learning history. TBI also increased motor impulsivity across time, reflecting ongoing neural changes. Despite these similarities in trained and acquisition rats, those that learned the task after injury demonstrated reduced effects of amphetamine on optimal decision-making, suggesting a lesser role of monoamines in post-injury learning. Amphetamine also dose-dependently reduced motor impulsivity in injured rats. This study opens up the investigation of psychiatric-like dysfunction in animal models of TBI and tasks such as the RGT will be useful in identifying therapeutics for the chronic post-injury period.

Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders

Punishment involves learning about the relationship between behavior and its adverse consequences. Punishment is fundamental to reinforcement learning, decision-making and choice, and is disrupted in psychiatric disorders such as addiction, depression, and psychopathy. However, little is known about the brain mechanisms of punishment and much of what is known is derived from study of superficially similar, but fundamentally distinct, forms of aversive learning such as fear conditioning and avoidance learning. Here we outline the unique conditions that support punishment, the contents of its learning, and its behavioral consequences. We consider evidence implicating GABA and monoamine neurotransmitter systems, as well as corticostriatal, amygdala, and dopamine circuits in punishment. We show how maladaptive punishment processes are implicated in addictions, impulse control disorders, psychopathy, anxiety, and depression and argue that a better understanding of the cellular, circuit, and cognitive mechanisms of punishment will make important contributions to next generation therapeutic approaches.

Examination of the effects of cannabinoid ligands on decision making in a rat gambling task

Although exposure to delta-9-tetrahydrocannabinol (THC) is perceived to be relatively harmless, mounting evidence has begun to show that it is associated with a variety of cognitive deficits, including poor decision making. THC-induced impairments in decision making are thought to be the result of cannabinoid CB1 receptor activation, and although clinical literature suggests that chronic activation via THC contributes to perturbations in decision making, acute CB1 receptor modulation has yielded mixed results. Using an animal model to examine how CB1-specific ligands impact choice biases would provide significant insight as to how recruitment of the endocannabinoid system may influence decision making. Here, we used the rat gambling task (rGT), a validated analogue of the human Iowa Gambling Task, to assess baseline decision making preferences in male Wistar rats. After acquisition rGT performance was measured. Animals were challenged with the CB1 receptor antagonist rimonabant, the partial agonist THC, and the synthetic agonist WIN55,212-2. Animals were also treated acutely with the fatty acid amide hydrolase (FAAH) inhibitor URB597 to selectively upregulate the endocannabinoid anandamide. Blockade of the CB1 receptor produced a trend improvement in decision making in animals who preferred the advantageous task options, yet left choice unaffected in risk-prone rats. Neither CB1 receptor agonist had strong effects on decision making, but a high dose THC decreased premature responses, whereas WIN55,212-2 did the opposite. URB597 did not affect task performance. These results indicate that although chronic CB1 receptor activation may be associated with impaired decision making, acute modulation has modest effects on choice and instead may play a substantive role in regulating impulsive responding.

Effects of the NMDA receptor antagonists dizocilpine and Ro 63-1908 on delay-discounting and risky decision-making in a gambling task

Previous studies demonstrated that NMDA receptor antagonists such as dizocilpine (MK801) and the GluN2B NMDA antagonist Ro 63-1908 promote impulsive action (motor impulsivity). The effects of these treatments on impulsive choice and decision-making is less well characterized. Two experiments were undertaken. In the first experiment, given evidence for delay order as a factor in choice selection, the effect of dizocilpine was examined in a delay discounting task with separate groups of male Long-Evans rats trained to a schedule of either ascending (i.e. 0-40 s), or descending delays (i.e. 40-0 s). Under the ascending-delay schedule, dizocilpine (0.03-0.06 mg/kg SC) reduced discounting, yet on the descending-delay schedule discounting was increased. Subgrouping rats according to discounting rate under vehicle pretreatment were consistent with a treatment-induced choice perseveration. In a second experiment, male Long-Evans rats were trained to a gambling task (rGT). Neither dizocilpine (0.01-0.06 mg/kg SC) nor Ro 63-1908 (0.1-1 mg/kg SC) shifted choice from the advantageous to the disadvantageous options. However dizocilpine, and marginally Ro 63-1908, increased choice of the least risky, but suboptimal option. This effect was most evident in rats that initially preferred the disadvantageous options. Consistent with previous studies, both treatments increased measures of motor impulsivity. These results demonstrate that dizocilpine has effects on discounting dependent on delay order and likely reflective of perseveration. On the rGT task, neither dizocilpine nor Ro 63-1908 promoted risky choice, yet both NMDA receptor antagonists increased impulsive action.

The neurobiology of impulse control disorders in Parkinson's disease: from neurotransmitters to neural networks

Impulse control disorders (ICD) are common neuropsychiatric disorders that can arise in Parkinson’s disease (PD) patients after commencing dopamine replacement therapy. Approximately 15% of all patients develop these disorders and many more exhibit subclinical symptoms of impulsivity. ICD is thought to develop due to an interaction between the use of dopaminergic medication and an as yet unknown neurobiological vulnerability that either pre-existed before PD onset (possibly genetic) or is associated with neural alterations due to the PD pathology. This review discusses genes, neurotransmitters and neural networks that have been implicated in the pathophysiology of ICD in PD. Although dopamine and the related reward system have been the main focus of research, recently, studies have started to look beyond those systems to find new clues to the neurobiological underpinnings of ICD and come up with possible new targets for treatment. Studies on the whole-brain connectome to investigate the global alterations due to ICD development are currently lacking. In addition, there is a dire need for longitudinal studies that are able to disentangle the contributions of individual (genetic) traits and secondary effects of the PD pathology and chronic dopamine replacement therapy to the development of ICD in PD.

Dopamine and Stress System Modulation of Sex Differences in Decision Making

Maladaptive decision making is associated with several neuropsychiatric disorders, including problem gambling and suicidal behavior. The prevalence of these disorders is higher in men vs women, suggesting gender-dependent regulation of their pathophysiology underpinnings. We assessed sex differences in decision making using the rat version of the Iowa gambling task. Female rats identified the most optimal choice from session 1, whereas male rats from session 5. Male, but not female rats, progressively improved their advantageous option responding and surpassed females. Estrus cycle phase did not affect decision making. To test whether pharmacological manipulations targeting the dopaminergic and stress systems affect decision making in a sex-dependent manner, male and female rats received injections of a dopamine D₂ receptor (D₂R) antagonist (eticlopride), D₂R agonist (quinpirole), corticotropin-releasing factor 1 (CRF₁) antagonist (antalarmin), and α₂-adrenergic receptor antagonist (yohimbine; used as a pharmacological stressor). Alterations in mRNA levels of D₂R and CRF₁ were also assessed. Eticlopride decreased advantageous responding in male, but not female rats, whereas quinpirole decreased advantageous responding specifically in females. Yohimbine dose-dependently decreased advantageous responding in female rats, whereas decreased advantageous responding was only observed at higher doses in males. Antalarmin increased optimal choice responding only in female rats. Higher Drd2 and Crhr1 expression in the amygdala were observed in female vs male rats. Higher amygdalar Crhr1 expression was negatively correlated with advantageous responding specifically in females. This study demonstrates the relevance of dopaminergic- and stress-dependent sex differences to maladaptive decision making.

Impulsive Action and Impulsive Choice Are Differentially Expressed in Rats Depending on the Age at Exposure to a Gambling Task

Impulsivity is considered an important feature associated with the development of numerous psychiatric disorders, including addictions. In the behavioral approach, impulsivity can be broadly divided into two distinct subtypes: impulsive action and choice. In the present study, we used a rodent version of the gambling task (rGT) to examine how impulsive action and impulsive choice are differentially influenced by difference in age at exposure (i.e., late adolescents/young adults vs. mature adults) to rGT. Rats were trained in a touch-screen chamber to learn the relationships between 4 light signals on the window of the screen and accompanying reward outcomes or punishments associated with different magnitudes and probabilities. Depending on their stabilized pattern of preference when allowed free choice, rats were categorized into risk-averse or risk-seeking group. While undergoing a series of experimental schemes, including extinction, re-acquisition, and acute cocaine injection, rats were re-tested for their premature response during inter-trial interval and choice preference toward the 4 different windows in rGT. Notably, rats exposed early, compared with those exposed late, to rGT showed increased impulsive action, particularly during re-acquisition period, in all sub-groups. In contrast, rats exposed late, compared with those exposed early, to rGT showed increased impulsive choice after acute cocaine injection, but these results were only obtained in a sub-group pre-categorized as high impulsive and risk-averse. These results suggest that different aspects of impulsivity can be differentially expressed during decision-making, and differentially influenced by the age at exposure to a gambling task.

Effects of disulfiram on choice behavior in a rodent gambling task: association with catecholamine levels

RATIONALE

Gambling disorder is a growing societal concern, as recognized by its recent classification as an addictive disorder in the DSM-5. Case reports have shown that disulfiram reduces gambling-related behavior in humans.

OBJECTIVES

The purpose of the present study was to determine whether disulfiram affects performance on a rat gambling task, a rodent version of the Iowa gambling task in humans, and whether any changes were associated with alterations in dopamine and/or norepinephrine levels.

METHODS

Rats were administered disulfiram prior to testing on the rat gambling task or prior to analysis of dopamine or norepinephrine levels in brain homogenates. Rats in the behavioral task were divided into two subgroups (optimal vs suboptimal) based on their baseline levels of performance in the rat gambling task. Rats in the optimal group chose the advantageous strategy more, and rats in the suboptimal group (a parallel to problem gambling) chose the disadvantageous strategy more. Rats were not divided into optimal or suboptimal groups prior to neurochemical analysis.

RESULTS

Disulfiram administered 2 h, but not 30 min, before the task dose-dependently improved choice behavior in the rats with an initial disadvantageous "gambling-like" strategy, while having no effect on the rats employing an advantageous strategy. The behavioral effects of disulfiram were associated with increased striatal dopamine and decreased striatal norepinephrine.

CONCLUSIONS

These findings suggest that combined actions on dopamine and norepinephrine may be a useful treatment for gambling disorders.

Chronic atomoxetine treatment during adolescence does not influence decision-making on a rodent gambling task, but does modulate amphetamine's effect on impulsive action in adulthood

In addition to the symptoms of inattention, hyperactivity, and impulsivity, individuals with attention deficit hyperactivity disorder exhibit impaired performance on tests of real-world cost/benefit decision-making. Atomoxetine, a nonstimulant drug approved for the treatment of attention deficit hyperactivity disorder, is a selective norepinephrine reuptake inhibitor administered chronically during adolescence, a time during which the frontal brain regions necessary for executive function undergo extensive maturation. This treatment protocol can affect behavior well into adulthood, but whether it produces long-term changes in complex decision-making has not been investigated. Twenty-four Long-Evans rats were administered saline or 1.0 mg/kg atomoxetine daily from postnatal day 40 to 54. Two weeks after treatment, the adult rats were trained and assessed on the rodent gambling task, in which the animals chose from four options varying in reward, punishment, and uncertainty. Impulsive action was also measured by recording the number of premature responses made. Regardless of the treatment administered during adolescence, rats learned to favor the advantageous options characterized by small, low-penalty rewards in lieu of the larger, higher-penalty reward options. Rodent gambling task performance was then assessed following acute treatment with atomoxetine (0.1-1.0 mg/kg) and amphetamine (0.3-1.5 mg/kg). Across groups, the highest dose of atomoxetine impaired decision-making and decreased premature responding at all doses tested. Amphetamine also impaired choice performance, but selectively increased impulsive action in rats that had previously received atomoxetine treatment during adolescence. These findings contribute to our understanding of the long-term effects associated with chronic adolescent atomoxetine exposure and suggest that this treatment does not alter decision-making under conditions of risk and uncertainty in adulthood.

Uncertainty exposure causes behavioural sensitization and increases risky decision-making in male rats: toward modelling gambling disorder

BACKGROUND

An animal model of gambling disorder, previously known as pathological gambling, could advance our understanding of the disorder and help with treatment development. We hypothesized that repeated exposure to uncertainty during gambling induces behavioural and dopamine (DA) sensitization - similar to chronic exposure to drugs of abuse. Uncertainty exposure (UE) may also increase risky decision-making in an animal model of gambling disorder.

METHODS

Male Sprague Dawley rats received 56 UE sessions, during which animals responded for saccharin according to an unpredictable, variable ratio schedule of reinforcement (VR group). Control animals responded on a predictable, fixed ratio schedule (FR group). Rats yoked to receive unpredictable reward were also included (Y group). Animals were then tested on the Rat Gambling Task (rGT), an analogue of the Iowa Gambling Task, to measure decision-making.

RESULTS

Compared with the FR group, the VR and Y groups experienced a greater locomotor response following administration of amphetamine. On the rGT, the FR and Y groups preferred the advantageous options over the risky, disadvantageous options throughout testing (40 sessions). However, rats in the VR group did not have a significant preference for the advantageous options during sessions 20-40. Amphetamine had a small, but significant, effect on decision-making only in the VR group. After rGT testing, only the VR group showed greater hyperactivity following administration of amphetamine compared with the FR group.

LIMITATIONS

Reward uncertainty was the only gambling feature modelled.

CONCLUSION

Actively responding for uncertain reward likely sensitized the DA system and impaired the ability to make optimal decisions, modelling some aspects of gambling disorder.

Pharmacological evidence that 5-HT2C receptor blockade selectively improves decision making when rewards are paired with audiovisual cues in a rat gambling task

RATIONALE

Adding reward-concurrent cues to a rat gambling task (rGT) increases risky choice. This cued version of the task may reflect an "addiction-like" cognitive process, more similar to human gambling than the uncued task. Serotonergic drugs that target 5-HT₂ receptors alter mechanisms linked to impulse control. However, relatively little is known regarding the impact of such agents on either risky decision making, or the ability of conditioned stimuli to bias the choice process, despite potential relevance to addiction development and treatment.

OBJECTIVES

The aim of this study was to determine the effects of SB 242,084 and M100907, selective antagonists at the 5-HT_2C and 5-HT_2A receptors respectively, as well as the selective 5-HT_2C receptor agonist Ro-60-0175, on performance of both cued and uncued versions of the rGT.

RESULTS

SB 242,084 significantly and dose-dependently increased choice of the most optimal option in the cued rGT only, despite concurrently increasing impulsive responses made prematurely on both the cued and uncued rGT. M100907 and Ro-60-0175 did not alter risky decision making, but nevertheless produced the expected decrease in premature responses on both task variants.

CONCLUSIONS

These findings demonstrate that the 5-HT₂ receptor-mediated regulation of risky decision making and motor impulsivity can be pharmacologically dissociated and further show that the presence of highly salient reward-paired cues critically alters the neurochemical regulation of the choice process. Importantly, these results suggest that 5-HT_2C receptor antagonists may be of use in disrupting maladaptive patterns of decision making.

Interaction between trait and housing condition produces differential decision-making toward risk choice in a rat gambling task

Poor decision-making is a core problem in psychiatric disorders such as pathological gambling and substance abuse. Both trait and environmental factors are considerably important to affect decision-making. However, it has not yet been systematically shown how they interact to affect risk preference in animal models evaluating decision-making. Here, we trained rats, housed in pairs or in isolation, in a touch screen chamber to detect the association between four different light signals on the screen and accompanied reward and punishment outcomes arranged with different schedules. Then, the rats were allowed to freely choose from 4 different light signals. Once animals showed a stabilized pattern of preference (risk-averse or risk-seeking), they were injected with saline or cocaine (a single injection per day for 7 days) followed by 2 weeks of withdrawal. Then, their preference of choice was re-tested in the touch screen chamber while they were cocaine challenged. All rats significantly changed their preference toward more risky choices when they were exposed to and challenged with cocaine, except those in the risk-averse/isolated housing group. These results indicate that the pre-existing trait toward risk and the housing condition interact to affect the quality of decision-making, and cocaine may help to aggravate this process.

Mirtazapine and ketanserin alter preference for gambling-like schedules of reinforcement in rats

Drug and behavioral addictions have overlapping features, e.g., both manifest preference for larger, albeit costlier, reinforcement options in cost/benefit decision-making tasks. Our prior work revealed that the mixed-function serotonergic compound, mirtazapine, attenuates behaviors by rats motivated by abused drugs. To extend this work to behavioral addictions, here we determined if mirtazapine and/or ketanserin, another mixed-function serotonin-acting compound, can alter decision-making in rats that is independent of drug (or food)-motivated reward. Accordingly, we developed a novel variable-ratio task in rats wherein intracranial self-stimulation was used as the positive reinforcer. Using lever pressing for various levels of brain stimulation, the operant task provided choices between a small brain stimulation current delivered on a fixed-ratio schedule (i.e., a predictable reward) and a large brain stimulation delivered following an unpredictable number of responses (i.e., a variable-ratio schedule). This task allowed for demonstration of individualized preference and detection of shifts in motivational influences during a pharmacological treatment. Once baseline preference was established, we determined that pretreatment with mirtazapine or ketanserin significantly decreased preference for the large reinforcer presented after gambling-like schedules of reinforcement. When the rats were tested the next day without drug, preference for the unpredictable large reinforcer option was restored. These data demonstrate that mirtazapine and ketanserin can reduce preference for larger, costlier reinforcement options, and illustrate the potential for these drugs to alter behavior.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself.

Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach

RATIONALE

Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood.

OBJECTIVES

This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol.

METHODS

LD and HD were tested in the rat gambling task (rGT) or the delayed reward task (DRT). Next, the effect of alcohol (0-1.0 g/kg) was tested in these tasks. Pavlovian-conditioned approach (PCA) was assessed both prior to and after intermittent alcohol access (IAA). Principal component analyses were performed to identify relationships between the most important behavioral parameters.

RESULTS

HD showed more optimal decision making in the rGT. In the DRT, HD transiently showed reduced impulsive choice. In both LD and HD, alcohol treatment increased optimal decision making in the rGT and increased impulsive choice in the DRT. PCA prior to and after IAA was comparable for LD and HD. When PCA was tested after IAA only, HD showed a more sign-tracking behavior. The principal component analyses indicated dimensional relationships between alcohol intake, impulsivity, and sign-tracking behavior in the PCA task after IAA.

CONCLUSIONS

HD showed a more efficient performance in the rGT and DRT. Moreover, alcohol consumption enhanced approach behavior to reward-predictive cues, but sign-tracking did not predict the level of alcohol consumption. Taken together, these findings suggest that high levels of voluntary alcohol intake are associated with enhanced cue- and reward-driven behavior.

Pharmacologically distinct pramipexole-mediated akinesia vs. risk-taking in a rat model of Parkinson's disease

Pramipexole and ropinirole are dopamine agonists that are efficacious in treating motor disturbances of neuropathologies, e.g., Parkinson's disease and restless legs syndrome. A significant portion of treated patients develop impulsive/compulsive behaviors. Current treatment is dose reduction or switching to an alternative dopamine replacement, both of which can undermine the motor benefits. Needed is a preclinical model that can assist in identifying adjunct treatments to dopamine agonist therapy that reduce impulsive/compulsive behaviors without interfering with motor benefits of the dopamine agonist. Toward that objective, the current study implemented a rat model of Parkinson's disease to behaviorally profile chronically administered pramipexole. This was accomplished with male Sprague-Dawley rats wherein (i) 6-hydroxydopamine-induced lesions of the dorsolateral striatum produced Parkinson's disease-like akinesia, measured in the forelimbs, (ii) intracranial self-stimulation-mediated probability discounting indicated impulsivity/risk-taking, and (iii) two doses of pramipexole were continuously administered for 14-28days via osmotic minipumps to mirror the chronic, stable exposure achieved with extended release formulations. The atypical antidepressant, mirtazapine, is known to reduce behaviors associated with drug addiction in rats; thus, we demonstrated model utility here by determining the effects of mirtazapine on pramipexole-induced motor improvements versus probability discounting. We observed that forelimb akinesia subsequent to striatal lesions was attenuated by both pramipexole doses tested (0.3 and 1.2mg/kg/day) within 4h of pump implant dispensing 0.3mg/kg/day and 1h by 1.2mg/kg/day. By contrast, 12-14days of infusion with 0.3mg/kg/day did not alter discounting, but increases were obtained with 1.2mg/kg/day pramipexole, with 67% of 1.2mg/kg/day-treated rats meeting categorical criteria for 'high risk-taking'. Insertion of a second minipump delivering mirtazapine did not alter motor function during 14days of co-administration with pramipexole, but was sufficient to attenuate risk-taking. These outcomes revealed distinct probability discounting and anti-akinesia profiles for pramipexole, indicating that pharmacotherapy, (e.g., mirtazapine treatments), can be developed that reduce risk-taking while leaving motor benefits intact.