Dopaminergic lesions of the dorsolateral striatum in rats increase delay discounting in an impulsive choice task

Differential phase-amplitude coupling in nucleus accumbens and orbitofrontal cortex reflects decision-making during a delay discounting task

BACKGROUND

The impulsive choice is characterized by the preference for a small immediate reward over a bigger delayed one. The mechanisms underlying impulsive choices are linked to the activity in the Nucleus Accumbens (NAc), the orbitofrontal cortex (OFC), and the dorsolateral striatum (DLS). While the study of functional connectivity between brain areas has been key to understanding a variety of cognitive processes, it remains unclear whether functional connectivity differentiates impulsive-control decisions.

METHODS

To study the functional connectivity both between and within NAc, OFC, and DLS during a delay discounting task, we concurrently recorded local field potential in NAc, OFC, and DLS in rats. We then quantified the degree of phase-amplitude coupling (PAC), coherence, and Granger Causality between oscillatory activities in animals exhibiting either a high (HI) or low (LI) tendency for impulsive choices.

RESULTS

Our results showed a differential pattern of PAC during decision-making in OFC and NAc, but not in DLS. While theta-gamma PAC in OFC was associated with self-control decisions, a higher delta-gamma PAC in both OFC and NAc biased decisions toward impulsive choices in both HI and LI groups. Furthermore, during the reward event, Granger Causality analysis indicated a stronger NAc➔OFC gamma contribution in the HI group, while the LI group showed a higher OFC➔NAc gamma contribution.

CONCLUSIONS

The overactivity in NAc during reward in the HI group suggests that exacerbated contribution of NAcCore can lead to an overvaluation of reward that biases the behavior toward the impulsive choice.

Neural substrates of the interaction between effort-expenditure reward decision-making and outcome anticipation

OBJECTIVE

Reward anticipation is important for future decision-making, possibly due to re-evaluation of prior decisions. However, the exact relationship between reward anticipation and prior effort-expenditure decision-making, and its neural substrates are unknown.

METHOD

Thirty-three healthy participants underwent fMRI scanning while performing the Effort-based Pleasure Experience Task (E-pet). Participants were required to make effort-expenditure decisions and anticipate the reward.

RESULTS

We found that stronger anticipatory activation at the posterior cingulate cortex was correlated with slower reaction time while making decisions with a high-probability of reward. Moreover, the substantia nigra was significantly activated in the prior decision-making phase, and involved in reward-anticipation in view of its strengthened functional connectivity with the mammillary body and the putamen in trial conditions with a high probability of reward.

CONCLUSIONS

These findings support the role of reward anticipation in re-evaluating decisions based on the brain-behaviour correlation. Moreover, the study revealed the neural interaction between reward anticipation and decision-making.

Trait Impulsivity as a Feature of Parkinson's Disease Treatment and Progression

Heightened trait impulsivity in both subclinical and pathological senses is becoming increasingly recognised in Parkinson's disease (PD). Impulsive behaviours and impulse control disorders (ICDs) are a consequence of perturbation to the rewards pathway leading individuals to conduct activities in a repetitive, excessive, and maladaptive fashion. Commonly linked to PD, heightened trait impulsivity has been found to primarily manifest in the forms of hypersexuality, pathological gambling, compulsive shopping, and binge eating, all of which may significantly impact social and financial standing. Subsequent burden to quality of life for both individuals with PD and caregivers are common. Although risk factors and indicators for ICDs in PD are currently lacking, it is recognised that the condition is often precipitated by dopamine replacement therapies, primarily dopamine agonist administration. While this nonmotor symptom is being increasingly diagnosed in PD populations, it remains relatively elusive in comparison to its motor counterparts. Through discussion of impulsivity characteristics, neuroanatomy, and neurochemistry, in addition to reviewing existing research on the potential contributing factors to impulsivity in PD, this review highlights impulsivity as a significant and detrimental PD symptom. Thus, emphasising the imperative need to establish efficacious diagnostic tools and treatments.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Reward prediction-errors weighted by cue salience produces addictive behaviours in simulations, with asymmetrical learning and steeper delay discounting

Dysfunction in learning and motivational systems are thought to contribute to addictive behaviours. Previous models have suggested that dopaminergic roles in learning and motivation could produce addictive behaviours through pharmacological manipulations that provide excess dopaminergic signalling towards these learning and motivational systems. Redish (2004) suggested a role based on dopaminergic signals of value prediction error, while (Zhang et al., 2009) suggested a role based on dopaminergic signals of motivation. However, both models present significant limitations. They do not explain the reduced sensitivity to drug-related costs/negative consequences, the increased impulsivity generally found in people with a substance use disorder, craving behaviours, and non-pharmacological dependence, all of which are key hallmarks of addictive behaviours. Here, we propose a novel mathematical definition of salience, that combines aspects of dopamine's role in both learning and motivation within the reinforcement learning framework. Using a single parameter regime, we simulated addictive behaviours that the (Zhang et al., 2009; Redish, 2004) models also produce but we went further in simulating the downweighting of drug-related negative prediction-errors, steeper delay discounting of drug rewards, craving behaviours and aspects of behavioural/non-pharmacological addictions. The current salience model builds on our recently proposed conceptual theory that salience modulates internal representation updating and may contribute to addictive behaviours by producing misaligned internal representations (Kalhan et al., 2021). Critically, our current mathematical model of salience argues that the seemingly disparate learning and motivational aspects of dopaminergic functioning may interact through a salience mechanism that modulates internal representation updating.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Relationship between insulin and Netrin-1/DCC guidance cue pathway regulation in the prefrontal cortex of rodents exposed to prenatal dietary restriction

Fetal restriction (FR) alters insulin sensitivity, but it is unknown how the metabolic profile associated with restriction affects development of the dopamine (DA) system and DA-related behaviors. The Netrin-1/DCC guidance cue system participates in maturation of the mesocorticolimbic DA circuitry. Therefore, our objective was to identify if FR modifies Netrin-1/DCC receptor protein expression in the prefrontal cortex (PFC) at birth and mRNA in adulthood in rodent males. We used cultured HEK293 cells to assess if levels of miR-218, microRNA regulator of DCC, are sensitive to insulin. To assess this, pregnant dams were subjected to a 50% FR diet from gestational day 10 until birth. Medial PFC (mPFC) DCC/Netrin-1 protein expression was measured at P0 at baseline and Dcc/Netrin-1 mRNA levels were quantified in adults 15 min after a saline/insulin injection. miR-218 levels in HEK-293 cells were measured in response to insulin exposure. At P0, Netrin-1 levels are downregulated in FR animals in comparison to controls. In adult rodents, insulin administration results in an increase in Dcc mRNA levels in control but not FR rats. In HEK293 cells, there is a positive correlation between insulin concentration and miR-218 levels. Since miR-218 is a Dcc gene expression regulator and our in vitro results show that insulin regulates miR-218 levels, we suggest that FR-induced changes in insulin sensitivity could be affecting Dcc expression via miR-218, impacting DA system maturation and organization. As fetal adversity is linked to nonadaptive behaviors later in life, this may contribute to early identification of vulnerability to chronic diseases associated with fetal adversity.

Excessive response to provocation rather than disinhibition mediates irritable behaviour in Huntington's disease

Background

Irritable and impulsive behaviour are common in Huntington's disease (HD: an autosomal dominant disorder causing degeneration in cortico-striatal networks). However, the cognitive mechanisms underlying these symptoms remain unclear, and previous research has not determined if common mechanisms underpin both symptoms. Here we used established and novel tasks to probe different aspects of irritable and impulsive behaviour to determine the neural mechanisms involved.

Methods

We recruited a cohort of 53 gene positive HD participants and 26 controls from non-affected family members and local volunteers. We used established questionnaire measures of irritability in HD (Snaith Irritability Scale, Problem Behaviours Assessment) and impulsivity [Urgency, Premeditation Perseverance, Sensation-seeking, Positive urgency scale (UPPSP), Barratt Impulsivity Scale], in addition to cognitive tasks of provocation, motor inhibition, delay discounting and decision making under uncertainty. We used generalised linear models to determine differences between cases and controls, and associations with irritability in the HD group.

Results

We found differences between cases and controls on the negative urgency subscale of the UPPSP, which was associated with irritability in HD. The frustrative non-reward provocation task also showed differences between cases and controls, in addition to predicting irritability in HD. The stop signal reaction time task showed case-control differences but was not associated with irritability in HD. None of the other measures showed group differences or predicted irritability in HD after correcting for confounding variables.

Discussion

Irritability in HD is mediated by excessive response to provocation, rather than a failure of motor inhibition.

Assessment of Repetitive and Compulsive Behaviors Induced by Pramipexole in Rats: Effect of Alpha-Synuclein-Induced Nigrostriatal Degeneration

Treatment with dopamine agonists in Parkinson’s disease (PD) is associated with debilitating neuropsychiatric side-effects characterized by impulsive and compulsive behaviors. The vulnerability to develop such impairments is thought to involve interactions between individual vulnerability traits, types of antiparkinsonian medications, and the neurodegenerative process. We investigated the effect of the dopamine D3/D2 agonist pramipexole (PPX) and selective nigrostriatal degeneration achieved by viral-mediated expression of alpha-synuclein on the expression of repetitive and compulsive-like behaviors in rats. In a task assessing spontaneous food hoarding behavior, PPX increased the time spent interacting with food pellets at the expense of hoarding. This disruption of hoarding behavior was identical in sham and lesioned rats. In an operant post-training signal attenuation task, the combination of nigrostriatal lesion and PPX decreased the number of completed trials and increased the number of uncompleted trials. The lesion led to an increased compulsive behavior after signal attenuation, and PPX shifted the overall behavioral output towards an increased proportion of compulsive lever-presses. Given the magnitude of the behavioral effects and the lack of strong interaction between PPX and nigral degeneration, these results suggest that extra-nigral pathology may be critical to increase the vulnerability to develop compulsive behaviors following treatment with D3/D2 agonists.

Neuropsychiatric and Cognitive Deficits in Parkinson's Disease and Their Modeling in Rodents

Parkinson’s disease (PD) is associated with a large burden of non-motor symptoms including olfactory and autonomic dysfunction, as well as neuropsychiatric (depression, anxiety, apathy) and cognitive disorders (executive dysfunctions, memory and learning impairments). Some of these non-motor symptoms may precede the onset of motor symptoms by several years, and they significantly worsen during the course of the disease. The lack of systematic improvement of these non-motor features by dopamine replacement therapy underlines their multifactorial origin, with an involvement of monoaminergic and cholinergic systems, as well as alpha-synuclein pathology in frontal and limbic cortical circuits. Here we describe mood and neuropsychiatric disorders in PD and review their occurrence in rodent models of PD. Altogether, toxin-based rodent models of PD indicate a significant but non-exclusive contribution of mesencephalic dopaminergic loss in anxiety, apathy, and depressive-like behaviors, as well as in learning and memory deficits. Gene-based models display significant deficits in learning and memory, as well as executive functions, highlighting the contribution of alpha-synuclein pathology to these non-motor deficits. Collectively, neuropsychiatric and cognitive deficits are recapitulated to some extent in rodent models, providing partial but nevertheless useful options to understand the pathophysiology of non-motor symptoms and develop therapeutic options for these debilitating symptoms of PD.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

Impulse Control Disorders in Parkinson's Disease: From Bench to Bedside

Parkinson’s disease (PD) is a neurodegenerative disorder that is characterized by symptoms that impact both motor and non-motor domains. Outside of motor impairments, PD patients are at risk for impulse control disorders (ICDs), which include excessively disabling impulsive and compulsive behaviors. ICD symptoms in PD (PD + ICD) can be broadly conceptualized as a synergistic interaction between dopamine agonist therapy and the many molecular and circuit-level changes intrinsic to PD. Aside from discontinuing dopamine agonist treatment, there remains a lack of consensus on how to best address ICD symptoms in PD. In this review, we explore recent advances in the molecular and neuroanatomical mechanisms underlying ICD symptoms in PD by summarizing a rapidly accumulating body of clinical and preclinical studies, with a special focus on the utility of rodent models in gaining new insights into the neurochemical basis of PD + ICD. We also discuss the relevance of these findings to the broader problem of impulsive and compulsive behaviors that impact a range of neuropsychiatric syndromes.

Which came first: Cannabis use or deficits in impulse control?

Impulse control deficits are often found to co-occur with substance use disorders (SUDs). On the one hand, it is well known that chronic intake of drugs of abuse remodels the brain with significant consequences for a range of cognitive behaviors. On the other hand, individual variation in impulse control may contribute to differences in susceptibility to SUDs. Both of these relationships have been described, thus leading to a "chicken or the egg" debate which remains to be fully resolved. Does impulsivity precede drug use or does it manifest as a function of problematic drug usage? The link between impulsivity and SUDs has been most strongly established for cocaine and alcohol use disorders using both preclinical models and clinical data. Much less is known about the potential link between impulsivity and cannabis use disorder (CUD) or the directionality of this relationship. The initiation of cannabis use occurs most often during adolescence prior to the brain's maturation, which is recognized as a critical period of development. The long-term effects of chronic cannabis use on the brain and behavior have started to be explored. In this review we will summarize these observations, especially as they pertain to the relationship between impulsivity and CUD, from both a psychological and biological perspective. We will discuss impulsivity as a multi-dimensional construct and attempt to reconcile the results obtained across modalities. Finally, we will discuss possible avenues for future research with emerging longitudinal data.

High impulsive choice is accompanied by an increase in dopamine release in rat dorsolateral striatum

Dopamine neurotransmission has been consistently associated with individual differences in impulsive choice. Clinical and preclinical evidence suggests that low striatal dopamine D₂ signaling predisposes to engage in impulsive behaviors. Although dopamine D₂ signaling controls dopamine (DA) extracellular levels, the relationship between striatal dopamine extracellular levels and impulsive choice remains poorly understood. Using quantitative microdialysis, we investigated whether extracellular DA levels in rat dorsolateral striatum (DLS) correlates with preference for an immediate small reward or for a delayed larger reward. Rats were tested in a delay-discounting task and classified as high impulsive (HI) or low impulsive (LI) according to the area under the discounting curve (AUC). No-net flux microdialysis experiments, assessing basal DA release, DA-uptake, and DA extracellular concentration (DA C_ext), were carried out in dorsolateral striatum (DLS) of urethane-anesthetized rats. Rats classified as HI showed a higher DA release compared with LI rats. Differences in DLS DA-uptake and DA C_ext were non-significant. Importantly, a significant negative correlation was observed between AUC and DA release, indicating that the lower the AUC, the higher the DLS DA release. This finding shows that DA release is augmented in the DLS of rats classified as HI, suggesting that a hyper-activated nigro-striatal pathway contributes to impulsive choice.

Precision Medicine Care in ADHD: The Case for Neural Excitation and Inhibition

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that has become increasingly prevalent worldwide. Its core symptoms, including difficulties regulating attention, activity level, and impulses, appear in early childhood and can persist throughout the lifespan. Current pharmacological options targeting catecholamine neurotransmissions have effectively alleviated symptoms in some, but not all affected individuals, leaving clinicians to implement trial-and-error approach to treatment. In this review, we discuss recent experimental evidence from both preclinical and human studies that suggest imbalance of excitation/inhibition (E/I) in the fronto-striatal circuitry during early development may lead to enduring neuroanatomical abnormality of the circuitry, causing persistence of ADHD symptoms in adulthood. We propose a model of precision medicine care that includes E/I balance as a candidate biomarker for ADHD, development of GABA-modulating medications, and use of magnetic resonance spectroscopy and scalp electrophysiology methods to monitor the effects of treatments on shifting E/I balance throughout the lifespan.

The role of dopamine pharmacotherapy and addiction-like behaviors in Parkinson's disease

Addictions involve a spectrum of behaviors that encompass features of impulsivity and compulsivity, herein referred to as impulsive-compulsive spectrum disorders (ICSDs). The etiology of ICSDs likely involves a complex interplay among neurobiological, psychological and social risk factors. Neurobiological risk factors include the status of the neuroanatomical circuits that govern ICSDs. These circuits can be altered by disease, as well as exogenous influences such as centrally-acting pharmacologics. The 'poster child' for this scenario is Parkinson's disease (PD) medically managed by pharmacological treatments. PD is a progressive neurodegenerative disease that involves a gradual loss of dopaminergic neurons largely within nigrostriatal projections. Replacement therapy includes dopamine receptor agonists that directly activate postsynaptic dopamine receptors (bypassing the requirement for functioning presynaptic terminals). Some clinically useful dopamine agonists, e.g., pramipexole and ropinirole, exhibit high affinity for the D2/D3 receptor subtypes. These agonists provide excellent relief from PD motor symptoms, but some patients exhibit debilitating ICSD. Teasing out the neuropsychiatric contribution of PD-associated pathology from the drugs used to treat PD motor symptoms is challenging. In this review, we posit that modern clinical and preclinical research converge on the conclusion that dopamine replacement therapy can mediate addictions in PD and other neurological disorders. We provide five categories of evidences that align with this position: (i) ICSD prevalence is greater with D2/D3 receptor agonist therapy vs PD alone. (ii) Capacity of dopamine replacement therapy to produce addiction-like behaviors is independent of disease for which the therapy is being provided. (iii) ICSD-like behaviors are recapitulated in laboratory rats with and without PD-like pathology. (iv) Behavioral pathology co-varies with drug exposure. (v) ICSD Features of ICSDs are consistent with agonist pharmacology and neuroanatomical substrates of addictions. Considering the underpinnings of ICSDs in PD should not only help therapeutic decision-making in neurological disorders, but also apprise ICSDs in general.

Motor impulsivity and delay intolerance are elicited in a dose-dependent manner with a dopaminergic agonist in parkinsonian rats

RATIONALE

Impulse control disorders (ICD) and other impulsive-compulsive behaviours are frequently found in Parkinson's disease (PD) patients treated with dopaminergic agonists. To date, there are no available animal models to investigate their pathophysiology and determine whether they can be elicited by varying doses of dopaminergic drugs. In addition, there is some controversy regarding the predispositional pattern of striatal dopaminergic depletion.

OBJECTIVES

To study the effect of two doses of pramipexole (PPX) on motor impulsivity, delay intolerance and compulsive-like behaviour.

METHODS

Male rats with mild dopaminergic denervation in the dorsolateral striatum (bilateral injections of 6-hydroxidopamine (6-OHDA)) treated with two doses of PPX (0.25 mg/kg and 3 mg/kg) and tested in the variable delay-to-signal paradigm.

RESULTS

Partial (50%) dopaminergic depletion did not induce significant changes in motor impulsivity or delay intolerance. However, 0.25 mg/kg of PPX increased motor impulsivity, while 3 mg/kg of PPX increased both motor impulsivity and delay intolerance. These effects were independent of the drug's antiparkinsonian effects. Importantly, impulsivity scores before and after dopaminergic lesion were positively associated with the impulsivity observed after administering 3 mg/kg of PPX. No compulsive-like behaviour was induced by PPX administration.

CONCLUSIONS

We described a rat model, with a moderate dorsolateral dopaminergic lesion resembling that suffered by patients with early PD, that develops different types of impulsivity in a dose-dependent manner dissociated from motor benefits when treated with PPX. This model recapitulates key features of abnormal impulsivity in PD and may be useful for deepening our understanding of the pathophysiology of ICD.

Chronic HIV-1 Tat exposure alters anterior cingulate cortico-basal ganglia-thalamocortical synaptic circuitry, associated behavioral control, and immune regulation in male mice

HIV-1 selectively disrupts neuronal integrity within specific brain regions, reflecting differences in viral tropism and/or the regional differences in the vulnerability of distinct neuronal subpopulations within the CNS. Deficits in prefrontal cortex (PFC)-mediated executive function and the resultant loss of behavioral control are a particularly debilitating consequence of neuroHIV. To explore how HIV-1 disrupts executive function, we investigated the effects of 48 h, 2 and/or 8 weeks of HIV-1 Tat exposure on behavioral control, synaptic connectivity, and neuroimmune function in the anterior cingulate cortex (ACC) and associated cortico-basal ganglia (BG)-thalamocortical circuitry in adult, Tat transgenic male mice. HIV-1 Tat exposure increased novelty-exploration in response to novel food, flavor, and environmental stimuli, suggesting that Tat triggers increased novelty-exploration in situations of competing motivation (e.g., drive to feed or explore vs. fear of novel, brightly lit open areas). Furthermore, Tat induced adaptability in response to an environmental stressor and pre-attentive filtering deficits. The behavioral insufficiencies coincided with decreases in the inhibitory pre- and post-synaptic proteins, synaptotagmin 2 and gephyrin, respectively, in the ACC, and alterations in specific pro- and anti-inflammatory cytokines out of 23 assayed. The interaction of Tat exposure and the resultant time-dependent, selective alterations in CCL4, CXCL1, IL-12p40, and IL-17A levels in the PFC predicted significant decreases in adaptability. Tat decreased dendritic spine density and cortical VGLUT1 inputs, while increasing IL-1β, IL-6, CCL5, and CCL11 in the striatum. Alternatively, IL-1α, CCL5, and IL-13 were decreased in the mediodorsal thalamus despite the absence of synaptic changes. Thus, HIV-1 Tat appears to uniquely and systematically disrupt immune regulation and the inhibitory and excitatory synaptic balance throughout the ACC-BG-thalamocortical circuitry resulting in a loss of behavioral control.

Ethanol induces maladaptive impulse control and decreased seeking behaviors in mice

Waiting impulsivity is a risk factor for many psychiatric disorders including alcohol use disorder (AUD). Highly impulsive individuals are vulnerable to alcohol abuse. However, it is not well understood whether chronic alcohol use increases the propensity for impulsive behavior. Here, we establish a novel experimental paradigm demonstrating that continuous binge-like ethanol exposure progressively leads to maladaptive impulsive behavior. To test waiting impulsivity, we employed the 5-choice serial reaction time task (5-CSRTT) in C57BL/6J male mice. We assessed premature responses in the fixed and variable intertrial interval (ITI) 5-CSRTT sessions. We further characterized our ethanol-induced impulsive mice using Open Field, y-maze, two-bottle choice, and an action-outcome task. Our results indicate that continuous binge-like ethanol exposure significantly increased premature responses when mice were tested in variable ITI sessions even during a prolonged abstinent period. Ethanol-induced impulsive mice exhibited anxiety-like behavior during chronic exposures. This behavior was also observed in a separate cohort that was subjected to 20 days of abstinence. Ethanol-treated mice were less motivated for a sucrose reward compared with air-exposed control mice, while also demonstrating reduced responding during action-outcome testing. Overall, ethanol-treated mice demonstrated increased impulsive behavior, but a reduced motivation for a sucrose reward. Although waiting impulsivity has been hypothesized to be a trait or risk factor for AUD, our findings indicate that maladaptive impulse control can also be potentiated or induced by continuous chronic ethanol exposure in mice.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Neuropsychiatric Disorders in Parkinson's Disease: What Do We Know About the Role of Dopaminergic and Non-dopaminergic Systems?

Besides the hallmark motor symptoms (rest tremor, hypokinesia, rigidity, and postural instability), patients with Parkinson’s disease (PD) have non-motor symptoms, namely neuropsychiatric disorders. They are frequent and may influence the other symptoms of the disease. They have also a negative impact on the quality of life of patients and their caregivers. In this article, we will describe the clinical manifestations of the main PD-related behavioral disorders (depression, anxiety disorders, apathy, psychosis, and impulse control disorders). We will also provide an overview of the clinical and preclinical literature regarding the underlying mechanisms with a focus on the role of the dopaminergic and non-dopaminergic systems.

Gene network analysis reveals a role for striatal glutamatergic receptors in dysregulated risk-assessment behavior of autism mouse models

Autism spectrum disorder (ASD) presents a wide, and often varied, behavioral phenotype. Improper assessment of risks has been reported among individuals diagnosed with ASD. Improper assessment of risks may lead to increased accidents and self-injury, also reported among individuals diagnosed with ASD. However, there is little knowledge of the molecular underpinnings of the impaired risk-assessment phenotype. In this study, we have identified impaired risk-assessment activity in multiple male ASD mouse models. By performing network-based analysis of striatal whole transcriptome data from each of these ASD models, we have identified a cluster of glutamate receptor-associated genes that correlate with the risk-assessment phenotype. Furthermore, pharmacological inhibition of striatal glutamatergic receptors was able to mimic the dysregulation in risk-assessment. Therefore, this study has identified a molecular mechanism that may underlie risk-assessment dysregulation in ASD.

Differential effects of d-amphetamine and atomoxetine on risk-based decision making of Lewis and Fischer 344 rats

Individuals with attention-deficit/hyperactivity disorder tend to make risker choices during probabilistic-discounting procedures. Thus, how common attention-deficit/hyperactivity disorder medications affect probabilistic discounting is of interest. In general, d-amphetamine increases risk-taking while atomoxetine has produced mixed effects in rats. Results from previous studies may result from genetic factors. Lewis and F344 rats have neurochemical differences that may be relevant to probabilistic discounting and how drugs affect such behavior. In this study, we evaluated dose-dependent effects of d-amphetamine and atomoxetine on probabilistic discounting of Lewis and F344. Male Lewis and F344 chose between one food pellet delivered 100% of the time and three food pellets delivered following decreasing probabilities of delivery (i.e. 100%, 66.7%, 33.3%, 16.5%, and 8.25%). Saline, d-amphetamine (0.1-1.8 mg/kg), and atomoxetine (0.1-7.8 mg/kg) were tested acutely. Lewis and F344 did not differ in choice at baseline. d-Amphetamine increased risky choice for both rat strains at low-to-moderate doses, although it did so at a lower dose (0.1 and 0.3 mg/kg) for F344 as compared to Lewis (0.3 mg/kg only). At high doses (1.0 and 1.8 mg/kg), d-amphetamine disrupted choice, increased frequencies of omitted trials, and reduced reinforcer sensitivity. Although atomoxetine increased frequencies of omitted trials at high doses (5.6 and 7.8 mg/kg), it had no effect on probabilistic discounting for either rat strain. Although Lewis and F344 differ in various types of impulsivity (i.e. motor, choice), with Lewis being the more impulsive of the two, the present results suggest that Lewis and F344 do not differ in risk-based decision-making. Effects of d-amphetamine on probabilistic discounting may be biology-dependent and differ from effects of atomoxetine.

Prelimbic Cortical Neurons Track Preferred Reward Value and Reflect Impulsive Choice during Delay Discounting Behavior

In delay discounting, individuals discount the value of a reward based on the delay to its receipt. The prelimbic cortex (PrL) is heavily interconnected with several brain regions implicated in delay discounting, but the specific contributions of the PrL to delay discounting are unknown. Here, we used multineuron electrophysiological recording methods in Long-Evans male (n = 10) and female (n = 9) rats to characterize the firing dynamics of PrL neurons during discrete cue and lever press events in a delay discounting task. Rats' initial preference for the large reward decreased as delays for that outcome increased across blocks, reflecting classic discounting behavior. Electrophysiological recordings revealed that subgroups of neurons exhibited phasic responses to cue presentations and lever presses. These phasic neurons were found to respond to either large/delay, small/immediate, or both trial types and the percentage of these neurons shifted across blocks as the expected value of the reward changed. Critically, this shift was only seen during trials in which animals could choose their preferred option (free choice trials) and not during trials where animals could choose only one option (forced choice trials). Further, this shift was dependent on rats' inherent impulsivity because high impulsive rats demonstrated a greater percentage of small/immediate-responsive neurons as the task progressed. Collectively, these findings suggest a unique role for the PrL in encoding reward value during delay discounting that is influenced by individual differences in impulsivity.SIGNIFICANCE STATEMENT In delay discounting, individuals discount the value of a reward based on the delay to its receipt. Here, we used electrophysiology to investigate the role of the prelimbic cortex (PrL) in this process. We found that subsets of neurons shifted activity as a function of the changing expected delay and reward magnitude, but this shift was only evident during trials in which animals could choose their preferred option. Further, this dynamic neural activity depended on rats' inherent impulsivity, with impulsive rats exhibiting a stronger neural shift toward the immediate reward as the task progressed. These findings suggest a role for the PrL in encoding reward value during delay discounting that is influenced by goal-directed context and individual differences in impulsivity.

Intrauterine growth restriction increases impulsive behavior and is associated with altered dopamine transmission in both medial prefrontal and orbitofrontal cortex in female rats

Recent studies have implicated a role for impulsivity in the altered eating behaviors and the increased risk for obesity consistently associated with intrauterine growth restriction (IUGR). Changes in dopamine transmission within prefrontal areas are believed to contribute to these adverse outcomes. Here we investigated the impulsive behavior toward a delayed reward and evaluated dopamine levels and its receptors in the medial prefrontal (mPFC) and orbitofrontal (OFC) cortex of female adult rats exposed to IUGR. From day 10 of pregnancy and until birth, Sprague-Dawley dams received either an ad libitum (Adlib) or a 50% food-restricted (FR) diet. At birth, all pups were adopted by Adlib mothers, generating the groups Adlib/Adlib (control) and FR/Adlib (intrauterine growth-restricted). Adult impulsive behavior was evaluated using a Tolerance to Delay of Reward Task. In vivo dopamine responses to sweet food intake were measured by voltammetry, and D1, D2 and DAT levels were accessed by Western Blot. Animals from FR group showed a pronounced aversion to delayed rewards. DA response to sweet food was found to be blunted in the mPFC of FR animals, whereas in the OFC, the DA levels appear to be unaffected by reward consumption. Moreover, FR animals presented reduced D1 receptors in the OFC and a later increase in the mPFC D2 levels. These findings suggest that IUGR female rats are more impulsive and that the associated mechanism involves changes in the dopamine signaling in both the mPFC and OFC.

Controllability affects endocrine response of adolescent male rats to stress as well as impulsivity and behavioral flexibility during adulthood

Exposure to stress during adolescence exerts a long-term impact on behavior and might contribute to the development of several neuropsychiatric disorders. In adults, control over stress has been found to protect from the negative consequences of stress, but the influence of controllability at early ages has not been extensively studied. Here, we evaluated in a rodent model the effects of repeated exposure in adolescent male rats to controllable versus uncontrollable foot-shock stress (CST or UST, respectively). Rats were assigned to three groups: non-stress (stress-naïve), CST (exposed to 8 sessions of a two-way shuttle active avoidance task over a period of 22 days) and UST (receiving the same amount of shocks as CST, regardless of their actual behavior). During adulthood, different cohorts were tested in several tasks evaluating inhibitory control and cognitive flexibility: 5-choice serial reaction time, delay-discounting, gambling test and probabilistic reversal learning. Results showed that the hypothalamic-pituitary-adrenal response to the first shock session was similar in CST and UST animals, but the response to the 8^th session was lower in CST animals. In adulthood, the UST animals presented impaired motor (but not cognitive) impulsivity and more perseverative behavior. The behavioral effects of UST were associated with increased number of D2 dopamine receptors in dorsomedial striatum, but not in other striatal regions. In summary, UST exposure during adolescence induced long-term impairments in impulsivity and compulsivity, whereas CST had only minor effects. These data support a critical role of stress uncontrollability on the long-lasting consequences of stress, as a risk factor for mental illnesses.

Time preferences are reliable across time-horizons and verbal versus experiential tasks

Individual differences in delay-discounting correlate with important real world outcomes, for example education, income, drug use, and criminality. As such, delay-discounting has been extensively studied by economists, psychologists and neuroscientists to reveal its behavioral and biological mechanisms in both human and non-human animal models. However, two major methodological differences hinder comparing results across species. Human studies present long time-horizon options verbally, whereas animal studies employ experiential cues and short delays. To bridge these divides, we developed a novel language-free experiential task inspired by animal decision-making studies. We found that the ranks of subjects' time-preferences were reliable across both verbal/experiential and second/day differences. Yet, discount factors scaled dramatically across the tasks, indicating a strong effect of temporal context. Taken together, this indicates that individuals have a stable, but context-dependent, time-preference that can be reliably assessed using different methods, providing a foundation to bridge studies of time-preferences across species.

Editorial note

This article has been through an editorial process in which the authors decide how to respond to the issues raised during peer review. The Reviewing Editor's assessment is that all the issues have been addressed (see decision letter).

Nigrostriatal Dopaminergic Denervation Does Not Promote Impulsive Choice in the Rat: Implication for Impulse Control Disorders in Parkinson's Disease

Impulse control disorders (ICDs) are frequent behavioral complications of dopaminergic (DA) replacement therapies (DRTs) in Parkinson’s disease (PD). Impulsive choice, which refers to an inability to tolerate delays to reinforcement, has been identified as a core pathophysiological process of ICDs. Although impulsive choices are exacerbated in PD patients with ICDs under DRTs, some clinical and preclinical studies suggest that the DA denervation of the dorsal striatum induced by the neurodegenerative process as well as a pre-existing high impulsivity trait, may both contribute to the emergence of ICDs in PD. We therefore investigated in a preclinical model in rats, specifically designed to study PD-related non-motor symptoms, the effect of nigrostriatal DA denervation on impulsive choice, in relation to pre-existing levels of impulsivity, measured in a Delay Discounting Task (DDT). In this procedure, rats had the choice between responding for a small sucrose reinforcer delivered immediately, or a larger sucrose reinforcer, delivered after a 0, 5, 10 or 15 s delay. In two different versions of the task, the preference for the large reinforcer decreased as the delay increased. However, and in contrast to our initial hypothesis, this discounting effect was neither exacerbated by, or related to, the extent of the substantia nigra pars compacta (SNc) DA lesion, nor it was influenced by pre-existing variability in impulsive choice. These results therefore question the potential implication of the nigrostriatal DA system in impulsive choice, as well as the DA neurodegenerative process as a factor contributing significantly to the development of ICDs in PD.

Pramipexole-induced impulsivity in mildparkinsonian rats: a model of impulse control disorders in Parkinson's disease

Treatment with dopaminergic agonists such as pramipexole (PPX) contributes to the development of impulse control disorders (ICDs) in patients with Parkinson's disease (PD). As such, animal models of abnormal impulse control in PD are needed to better study the pathophysiology of these behaviors. Thus, we investigated impulsivity and related behaviors using the 5-choice serial reaction time task, as well as FosB/ΔFosB expression, in rats with mild parkinsonism induced by viral-mediated substantia nigra overexpression of human A53T mutated α-synuclein, and following chronic PPX treatment (0.25 mg/kg/d) for 4 weeks. The bilateral loss of striatal dopamine transporters (64%) increased the premature response rate of these rats, indicating enhanced waiting impulsivity. This behavior persisted in the OFF state after the second week of PPX treatment and it was further exacerbated in the ON state throughout the treatment period. The enhanced rate of premature responses following dopaminergic denervation was positively correlated with the premature response rate following PPX treatment (both in the ON and OFF states). Moreover, the striatal dopaminergic deficit was negatively correlated with the premature response rate at all times (pretreatment, ON and OFF states) and it was positively correlated with the striatal FosB/ΔFosB expression. By contrast, PPX treatment was not associated with changes in compulsivity (perseverative responses rate). This model recapitulates some features of PD with ICD, namely the dopaminergic deficit of early PD and the impulsivity traits provoked by dopaminergic loss in association with PPX treatment, making this model a useful tool to study the pathophysiology of ICDs.

The role of the dorsal striatum in choice impulsivity

It has long been recognized that the dorsal striatum is an essential brain region for control of action selection based on action-outcome contingency learning, particularly when the available actions are bound to rewarding outcomes. In principle, intertemporal choice in the delay-discounting task-a validated measure of choice impulsivity-involves reward-associated actions that require the recruitment of the dorsal striatum. Here, we conjecture about ways the dorsal striatum is involved in choice impulsivity. Based on a selective body of studies, we begin with a brief history of research on choice impulsivity and the dorsal striatum, and then provide a comprehensive summary of contemporary studies utilizing human neuroimaging and animal models to search for links between choice impulsivity and the dorsal striatum. In particular, we discuss in-depth the converging evidence for the associations of choice impulsivity with the reward valuation coded by the caudate, a ventral-to-dorsal gradient in the dorsal striatum, the origins of striatal afferents, and developmental maturation of frontostriatal connectivity during adolescence.

Impulse control disorders in Parkinson's disease

Impulse control disorders (ICD) are frequent side effects of dopamine replacement therapy (DRT) used in Parkinson's disease (PD) with devastating consequences on the patients and caregivers. ICD are behavioural addictions including compulsive gambling, shopping, sexual behaviour, and binge eating that are mainly associated with dopamine D2/D3 agonists. Their management is a real clinical challenge due to the lack of therapeutic alternative. Clinical studies have identified demographic and clinical risk factors for ICD such as younger age at disease onset, male gender, prior history of depression or substance abuse, REM sleep behaviour disorders and higher rate of dyskinesia. PD patients with ICD may also have a specific pattern of dopaminergic denervation in the ventral striatum. Specific evaluation tools have now been designed to better evaluate the severity and impact of ICD in PD. Patients with ICD display altered processing of reward and loss, and decisional bias associated with altered activity in cortical and subcortical areas such as the orbitofrontal cortex, amygdala, insula, anterior cingular cortex, and ventral striatum. Preclinical studies have demonstrated that D2/D3 agonists induce impairments in behavioural processes likely relevant to ICD such as risk-taking behaviour, preference for uncertainty, perseverative responding and sustained drive to engage in gambling-like behaviour. Whether interactions between dopamine denervation and DRT significantly contribute to the pathogenesis of ICD remains poorly understood so far, although features unique to PD have been identified in patients with ICD. Large-scale longitudinal studies are needed to better identify subjects with increased risk to develop ICD and develop therapeutic options.

Mirtazapine and ketanserin alter preference for gambling-like schedules of reinforcement in rats

Drug and behavioral addictions have overlapping features, e.g., both manifest preference for larger, albeit costlier, reinforcement options in cost/benefit decision-making tasks. Our prior work revealed that the mixed-function serotonergic compound, mirtazapine, attenuates behaviors by rats motivated by abused drugs. To extend this work to behavioral addictions, here we determined if mirtazapine and/or ketanserin, another mixed-function serotonin-acting compound, can alter decision-making in rats that is independent of drug (or food)-motivated reward. Accordingly, we developed a novel variable-ratio task in rats wherein intracranial self-stimulation was used as the positive reinforcer. Using lever pressing for various levels of brain stimulation, the operant task provided choices between a small brain stimulation current delivered on a fixed-ratio schedule (i.e., a predictable reward) and a large brain stimulation delivered following an unpredictable number of responses (i.e., a variable-ratio schedule). This task allowed for demonstration of individualized preference and detection of shifts in motivational influences during a pharmacological treatment. Once baseline preference was established, we determined that pretreatment with mirtazapine or ketanserin significantly decreased preference for the large reinforcer presented after gambling-like schedules of reinforcement. When the rats were tested the next day without drug, preference for the unpredictable large reinforcer option was restored. These data demonstrate that mirtazapine and ketanserin can reduce preference for larger, costlier reinforcement options, and illustrate the potential for these drugs to alter behavior.

Increased temporal discounting after chronic stress in CHL1-deficient mice is reversed by 5-HT2C agonist Ro 60-0175

Schizophrenia is a neurodevelopmental disorder in which impaired decision-making and goal-directed behaviors are core features. One of the genes associated with schizophrenia is the Close Homolog of L1 (CHL1); CHL1-deficient mice are considered a model of schizophrenia-like deficits, including sensorimotor gating, interval timing and spatial memory impairments. Here we investigated temporal discounting in CHL1-deficient (KO) mice and their wild-type littermates. Although no discounting differences were found under baseline conditions, CHL1-KO mice showed increased impulsive choice following chronic unpredictable stress (fewer % larger-later choices, and reduced area under the discounting curve). Stressed CHL1-KO mice also showed decreased neuronal activation (number of cFos positive neurons) in the discounting task in the prelimbic cortex and dorsal striatum, areas thought to be part of executive and temporal processing circuits. Impulsive choice alterations were reversed by the 5-HT2C agonist Ro 60-0175. Our results provide evidence for a gene x environment, double-hit model of stress-related decision-making impairments, and identify CHL1-deficient mice as a mouse model for these deficits in regard to schizophrenia-like phenotypes.

Investigation of impulsivity in binge-eating rats in a delay-discounting task and its prevention by the d-amphetamine prodrug, lisdexamfetamine

Freely-fed, female, rats were trained in a two-lever, delay-discounting task: one lever delivered a single chocolate-flavoured pellet immediately and the other a three-pellet reward after increasing delay (0, 4, 8, 16, 32 s). Rats were divided into two groups (i.e. binge-eating rats given irregular, limited access to chocolate in addition to normal chow and controls maintained on normal chow). Both groups exhibited increased preference for the immediate reward as the delay interval was lengthened. The discounting rate was significantly greater in binge-eating rats than non-binge-eating controls, especially as the behaviour became more established indicating that increased impulsivity and intolerance of delayed reward are part of the psychopathology of binge-eating. Lisdexamfetamine (0.8 mg/kg, orally ( d-amphetamine base)) reversed the reduced preference of binge-eating rats for larger rewards at delay intervals of 4 s, 8 s and 32 s and across all sessions. Lisdexamfetamine-treated binge-eating rats consumed the same number of pellets as vehicle-treated, binge-eating rats and non-binge-eating controls eliminating the possibility lisdexamfetamine's actions on appetite or satiety mediated its effects on operant responding for food pellets in delay-discounting. In summary, binge-eating rats showed increased impulsive choice compared with non-binge-eating controls that was reversed by lisdexamfetamine, complementing results showing lisdexamfetamine reduced impulsiveness scores in patients with binge-eating disorder.

Fractionating impulsivity: neuropsychiatric implications

The ability to make decisions and act quickly without hesitation can be advantageous in many settings. However, when persistently expressed, impulsive decisions and actions are considered risky, maladaptive and symptomatic of such diverse brain disorders as attention-deficit hyperactivity disorder, drug addiction and affective disorders. Over the past decade, rapid progress has been made in the identification of discrete neural networks that underlie different forms of impulsivity - from impaired response inhibition and risky decision making to a profound intolerance of delayed rewards. Herein, we review what is currently known about the neural and psychological mechanisms of impulsivity, and discuss the relevance and application of these new insights to various neuropsychiatric disorders.

Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward

Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Pharmacologically distinct pramipexole-mediated akinesia vs. risk-taking in a rat model of Parkinson's disease

Pramipexole and ropinirole are dopamine agonists that are efficacious in treating motor disturbances of neuropathologies, e.g., Parkinson's disease and restless legs syndrome. A significant portion of treated patients develop impulsive/compulsive behaviors. Current treatment is dose reduction or switching to an alternative dopamine replacement, both of which can undermine the motor benefits. Needed is a preclinical model that can assist in identifying adjunct treatments to dopamine agonist therapy that reduce impulsive/compulsive behaviors without interfering with motor benefits of the dopamine agonist. Toward that objective, the current study implemented a rat model of Parkinson's disease to behaviorally profile chronically administered pramipexole. This was accomplished with male Sprague-Dawley rats wherein (i) 6-hydroxydopamine-induced lesions of the dorsolateral striatum produced Parkinson's disease-like akinesia, measured in the forelimbs, (ii) intracranial self-stimulation-mediated probability discounting indicated impulsivity/risk-taking, and (iii) two doses of pramipexole were continuously administered for 14-28days via osmotic minipumps to mirror the chronic, stable exposure achieved with extended release formulations. The atypical antidepressant, mirtazapine, is known to reduce behaviors associated with drug addiction in rats; thus, we demonstrated model utility here by determining the effects of mirtazapine on pramipexole-induced motor improvements versus probability discounting. We observed that forelimb akinesia subsequent to striatal lesions was attenuated by both pramipexole doses tested (0.3 and 1.2mg/kg/day) within 4h of pump implant dispensing 0.3mg/kg/day and 1h by 1.2mg/kg/day. By contrast, 12-14days of infusion with 0.3mg/kg/day did not alter discounting, but increases were obtained with 1.2mg/kg/day pramipexole, with 67% of 1.2mg/kg/day-treated rats meeting categorical criteria for 'high risk-taking'. Insertion of a second minipump delivering mirtazapine did not alter motor function during 14days of co-administration with pramipexole, but was sufficient to attenuate risk-taking. These outcomes revealed distinct probability discounting and anti-akinesia profiles for pramipexole, indicating that pharmacotherapy, (e.g., mirtazapine treatments), can be developed that reduce risk-taking while leaving motor benefits intact.

Effects of striatal lesions on components of choice: Reward discrimination, preference, and relative valuation

The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relative valuation in both the single and multi-option week studies. A major factor involved in these deficits was a significant aversion to the multi-option that contained a larger outcome option but with a longer delay to reward. Dorsal striatal lesions caused less impairment even leading to enhanced choice behavior compared to control animals during the more difficult multi-option free choice series. Overall, the results suggest that the context of action is crucial when linking striatal function to choice behavior and its diverse components. The implications include the idea that striatal involvement in decision-making is increased when responses are self-paced and diverse in a more naturalistic environment.

Multi-facetted impulsivity following nigral degeneration and dopamine replacement therapy

Impulse control disorders (ICDs) are debilitating side effects of dopamine replacement therapy (DRT) in Parkinson’s disease (PD) that severely affect the quality of life of patients. While DRT, the pattern and extent of neurodegeneration, and prodromic factors of vulnerability (e.g. impulsivity) have all been hypothesized to play a role in the development of ICDs, their respective, and potentially interacting, contributions remain to be established. High impulsive (HI), Intermediate (Int) or low impulsive (LI) rats were identified based on their performance in both a differential reinforcement of low rate of responding (DRL) and a fixed consecutive number (FCN) schedules, that operationalize two independent facets of impulsivity, waiting and action inhibition (motor impulsivity). We investigated whether high impulsivity trait influenced the progressive development of a parkinsonian state induced by viral-mediated overexpression of α-synuclein, and whether impulsivity trait and nigrostriatal neurodegeneration independently or jointly influenced the effects of DRT on impulse control. α-synuclein-induced nigrostriatal neurodegeneration increased both waiting and motor impulsivity. The D2/D3 dopamine receptor agonist pramipexole exacerbated motor impulsivity more than waiting. However, the pramipexole-induced increase in waiting impulsivity observed in both sham and lesioned rats, was more pronounced in HI lesioned rats, which displayed a restricted α-synuclein-induced dopaminergic neurodegeneration. Thus, a PD-like nigrostriatal lesion increases both motor and waiting impulsivity, but its interaction with a pre-existing impulsivity trait, which, at the cellular level, confers resilience to dopaminergic neurodegeneration, worsens the detrimental effects of D2/D3 dopamine receptor agonists on inhibitory control.

•

Degeneration of the substantia nigra increases both waiting and action impulsivity.

•

Reduced alpha-synuclein-induced degeneration in high impulsive rats.

•

Pramipexole increases waiting and action impulsivity in sham and lesioned rats.

•

Exacerbated effect of pramipexole in high impulsive vs. low impulsive lesioned rats.

Trait Impulsivity and Anhedonia: Two Gateways for the Development of Impulse Control Disorders in Parkinson's Disease?

Apathy and impulsivity are two major comorbid syndromes of Parkinson's disease (PD) that may represent two extremes of a behavioral spectrum modulated by dopamine-dependent processes. PD is characterized by a progressive loss of dopaminergic neurons in the substantia nigra pars compacta to which are attributed the cardinal motor symptoms of the disorder. Dopamine replacement therapy (DRT), used widely to treat these motor symptoms, is often associated with deficits in hedonic processing and motivation, including apathy and depression, as well as impulse control disorders (ICDs). ICDs comprise pathological gambling, hypersexuality, compulsive shopping, binge eating, compulsive overuse of dopaminergic medication, and punding. More frequently observed in males with early onset PD, ICDs are associated not only with comorbid affective symptoms, such as depression and anxiety, but also with behavioral traits, such as novelty seeking and impulsivity, as well as with personal or familial history of alcohol use. This constellation of associated risk factors highlights the importance of inter-individual differences in the vulnerability to develop comorbid psychiatric disorders in PD patients. Additionally, withdrawal from DRT in patients with ICDs frequently unmasks a severe apathetic state, suggesting that apathy and ICDs may be caused by overlapping neurobiological mechanisms within the cortico-striato-thalamo-cortical networks. We suggest that altered hedonic and impulse control processes represent distinct prodromal substrates for the development of these psychiatric symptoms, the etiopathogenic mechanisms of which remain unknown. Specifically, we argue that deficits in hedonic and motivational states and impulse control are mediated by overlapping, yet dissociable, neural mechanisms that differentially interact with DRT to promote the emergence of ICDs in vulnerable individuals. Thus, we provide a novel heuristic framework for basic and clinical research to better define and treat comorbid ICDs in PD.