Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Aberrant glutamatergic systems underlying impulsive behaviors: Insights from clinical and preclinical research

Impulsivity is a broad construct that often refers to one of several distinct behaviors and can be measured with self-report questionnaires and behavioral paradigms. Several psychiatric conditions are characterized by one or more forms of impulsive behavior, most notably the impulsive/hyperactive subtype of attention-deficit/hyperactivity disorder (ADHD), mood disorders, and substance use disorders. Monoaminergic neurotransmitters are known to mediate impulsive behaviors and are implicated in various psychiatric conditions. However, growing evidence suggests that glutamate, the major excitatory neurotransmitter of the mammalian brain, regulates important functions that become dysregulated in conditions like ADHD. The purpose of the current review is to discuss clinical and preclinical evidence linking glutamate to separate aspects of impulsivity, specifically motor impulsivity, impulsive choice, and affective impulsivity. Hyperactive glutamatergic activity in the corticostriatal and the cerebro-cerebellar pathways are major determinants of motor impulsivity. Conversely, hypoactive glutamatergic activity in frontal cortical areas and hippocampus and hyperactive glutamatergic activity in anterior cingulate cortex and nucleus accumbens mediate impulsive choice. Affective impulsivity is controlled by similar glutamatergic dysfunction observed for motor impulsivity, except a hyperactive limbic system is also involved. Loss of glutamate homeostasis in prefrontal and nucleus accumbens may contribute to motor impulsivity/affective impulsivity and impulsive choice, respectively. These results are important as they can lead to novel treatments for those with a condition characterized by increased impulsivity that are resistant to conventional treatments.

Effects of chronic stress on cognitive function - From neurobiology to intervention

Exposure to chronic stress contributes considerably to the development of cognitive impairments in psychiatric disorders such as depression, generalized anxiety disorder (GAD), obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), and addictive behavior. Unfortunately, unlike mood-related symptoms, cognitive impairments are not effectively treated by available therapies, a situation in part resulting from a still incomplete knowledge of the neurobiological substrates that underly cognitive domains and the difficulty in generating interventions that are both efficacious and safe. In this review, we will present an overview of the cognitive domains affected by stress with a specific focus on cognitive flexibility, behavioral inhibition, and working memory. We will then consider the effects of stress on neuronal correlates of cognitive function and the factors which may modulate the interaction of stress and cognition. Finally, we will discuss intervention strategies for treatment of stress-related disorders and gaps in knowledge with emerging new treatments under development. Understanding how cognitive impairment occurs during exposure to chronic stress is crucial to make progress towards the development of new and effective therapeutic approaches.

Involvement of dopamine D3 receptor in impulsive choice decision-making in male rats

Impulsive decision-making has been linked to impulse control disorders and substance use disorders. However, the neural mechanisms underlying impulsive choice are not fully understood. While previous PET imaging and autoradiography studies have shown involvement of dopamine and D2/3 receptors in impulsive behavior, the roles of distinct D1, D2, and D3 receptors in impulsive decision-making remain unclear. In this study, we used a food reward delay-discounting task (DDT) to identify low- and high-impulsive rats, in which low-impulsive rats exhibited preference for large delayed reward over small immediate rewards, while high-impulsive rats showed the opposite preference. We then examined D1, D2, and D3 receptor gene expression using RNAscope in situ hybridization assays. We found that high-impulsive male rats exhibited lower levels of D2 and D3, and particularly D3, receptor expression in the nucleus accumbens (NAc), with no significant changes in the insular, prelimbic, and infralimbic cortices. Based on these findings, we further explored the role of the D3 receptor in impulsive decision-making. Systemic administration of a selective D3 receptor agonist (FOB02-04) significantly reduced impulsive choices in high-impulsive rats but had no effects in low-impulsive rats. Conversely, a selective D3 receptor antagonist (VK4-116) produced increased both impulsive and omission choices in both groups of rats. These findings suggest that impulsive decision-making is associated with a reduction in D3 receptor expression in the NAc. Selective D3 receptor agonists, but not antagonists, may hold therapeutic potentials for mitigating impulsivity in high-impulsive subjects.

Acute stress differentially alters reward-related decision making and inhibitory control under threat of punishment

Acute stress has various effects on cognition, executive function and certain forms of cost/benefit decision making. Recent studies in rodents indicate that acute stress differentially alters reward-related decisions involving particular types of costs and slows choice latencies. Yet, how stress alters decisions where rewards are linked to punishment is less clear. We examined how 1 h restraint stress, followed by behavioral testing 10 min later altered action-selection on two tasks involving reward-seeking under threat of punishment in well-trained male and female rats. One study used a risky decision-making task involving choice between a small/safe reward and a large/risky one that could coincide with shock, delivered with a probability that increased over blocks of trials. Stress increased risk aversion and punishment sensitivity, reducing preference for the larger/risky reward, while increasing decision latencies and trial omissions in both sexes, when rats were teste. A second study used a "behavioral control" task, requiring inhibition of approach towards a readily available reward associated with punishment. Here, food pellets were delivered over discrete trials, half of which coincided with a 12 s audiovisual cue, signalling that reward retrieval prior to cue termination would deliver shock. Stress exerted sex- and timing-dependent effects on inhibitory control. Males became more impulsive and received more shocks on the stress test, whereas females were unaffected on the stress test, and were actually less impulsive when tested 24 h later. None of the effects of restraint stress were recapitulated by systemic treatment with physiological doses of corticosterone. These findings suggest acute stress induces qualitatively distinct and sometimes sex-dependent effects on punished reward-seeking that are critically dependent on whether animals must either choose between different actions or withhold them to obtain rewards and avoid punishment.

Dopaminergic modulation of sensitivity to immediate and delayed punishment during decision-making

Effective decision-making involves careful consideration of all rewarding and aversive outcomes. Importantly, negative outcomes often occur later in time, leading to underestimation, or "discounting," of these consequences. Despite the frequent occurrence of delayed outcomes, little is known about the neurobiology underlying sensitivity to delayed punishment during decision-making. The Delayed Punishment Decision-making Task (DPDT) addresses this by assessing sensitivity to delayed versus immediate punishment in rats. Rats initially avoid punished reinforcers, then select this option more frequently when delay precedes punishment. We used DPDT to examine effects of acute systemic administration of catecholaminergic drugs on sensitivity to delayed punishment in male and female adult rats. Cocaine did not affect choice of rewards with immediate punishment but caused a dose-dependent reduction in choice of delayed punishment. Neither activation nor blockade of D1-like dopamine receptor affected decision-making, but activation of D2-like dopamine receptors reduced choice of delayed punishment. D2 blockade did not attenuate cocaine's effects on decision-making, suggesting that cocaine's effects are not dependent on D2 receptor activation. Increasing synaptic norepinephrine via atomoxetine also reduced choice of delayed (but not immediate) punishment. Notably, when DPDT was modified from ascending to descending pre-punishment delays, these drugs did not affect choice of delayed or immediate punishment, although high-dose quinpirole impaired behavioral flexibility. In summary, sensitivity to delayed punishment is regulated by both dopamine and norepinephrine transmission in task-specific fashion. Understanding the neurochemical modulation of decision-making with delayed punishment is a critical step toward treating disorders characterized by aberrant sensitivity to negative consequences.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

The effects of early life stress on impulsivity

Elevated impulsivity is a symptom shared by various psychiatric disorders such as substance use disorder, bipolar disorder, and attention-deficit/hyperactivity disorder. However, impulsivity is not a unitary construct and impulsive behaviors fall into two subcategories: impulsive action and impulsive choice. Impulsive choice refers to the tendency to prefer immediate, small rewards over delayed, large rewards, whereas impulsive action involves difficulty inhibiting rash, premature, or mistimed behaviors. These behaviors are mediated by the mesocorticolimbic dopamine (DA) system, which consists of projections from the ventral tegmental area to the nucleus accumbens and prefrontal cortex. Early life stress (ELS) alters both impulsive choice and impulsive action in rodents. ELS also changes DA receptor expression, transmission, and activity within the mesocorticolimbic system. This review integrates the dopamine, impulsivity, and ELS literature to provide evidence that ELS alters impulsivity via inducing changes in the mesocorticolimbic DA system. Understanding how ELS affects brain circuits associated with impulsivity can help advance treatments aimed towards reducing impulsivity symptoms in a variety of psychiatric disorders.

Early life adversity promotes resilience to opioid addiction-related phenotypes in male rats and sex-specific transcriptional changes

Experiencing some early life adversity can have an "inoculating" effect that promotes resilience in adulthood. However, the mechanisms underlying stress inoculation are unknown, and animal models are lacking. Here we used the limited bedding and nesting (LBN) model of adversity to evaluate stress inoculation of addiction-related phenotypes. In LBN, pups from postnatal days 2 to 9 and their dams were exposed to a low-resource environment. In adulthood, they were tested for addiction-like phenotypes and compared to rats raised in standard housing conditions. High levels of impulsivity are associated with substance abuse, but in males, LBN reduced impulsive choice compared to controls. LBN males also self-administered less morphine and had a lower breakpoint on a progressive ratio reinforcement schedule than controls. These effects of LBN on addiction-related behaviors were not found in females. Because the nucleus accumbens (NAc) mediates these behaviors, we tested whether LBN altered NAc physiology in drug-naïve and morphine-exposed rats. LBN reduced the frequency of spontaneous excitatory postsynaptic currents in males, but a similar effect was not observed in females. Only in males did LBN prevent a morphine-induced increase in the AMPA/NMDA ratio. RNA sequencing was performed to delineate the molecular signature in the NAc associated with LBN-derived phenotypes. LBN produced sex-specific changes in transcription, including in genes related to glutamate transmission. Collectively, these studies reveal that LBN causes a male-specific stress inoculation effect against addiction-related phenotypes. Identifying factors that promote resilience to addiction may reveal novel treatment options for patients.

Dopamine D1 receptor signalling in the lateral shell of the nucleus accumbens controls dietary fat intake in male rats

Central dopamine signaling regulates reward-related aspects of feeding behavior, and during diet-induced obesity dopamine receptor signaling is altered. Yet, the influence of dopamine signaling on the consumption of specific dietary components remains to be elucidated. We have previously shown that 6-hydroxydopamine-mediated lesions of dopamine neuron terminals in the lateral shell of the nucleus accumbens promotes fat intake in rats fed a multi-component free-choice high-fat high-sugar (fcHFHS) diet. It is however not yet determined which dopamine receptors are responsible for this shift towards fat preference. In this study, we assess the effects of D1-or D2 receptor acute inhibition in the lateral shell of the nucleus accumbens on fcHFHS diet consumption. We report that infusion of the D1 receptor antagonist SCH2 3390, but not the D2 receptor antagonist raclopride, promotes dietary fat consumption in male Sprague Dawley rats on a fcHFHS diet during 2 h after infusion. Furthermore, anatomical analysis of infusion sites revealed that the rostral region, but not the caudal region, of the lateral shell of the nucleus accumbens is sensitive to the D1 receptor inhibition effects on fat consumption. Our data highlight a role for D1 receptors in the rostral region of the lateral shell of the nucleus accumbens to control dietary fat consumption.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

Involvement of the dopamine system in the effect of chronic social isolation during adolescence on social behaviors in male C57 mice

In the early stage of life, experiencing social isolation can generate long-lasting deleterious effects on behaviors and brain development. However, the effects of chronic social isolation during adolescence on social behaviors and its underlying neurobiological mechanisms remain unclear. The present study found that four weeks of social isolation during adolescence impaired social recognition ability in the three-chamber test and five-trial social recognition test, and increased aggressive-like behaviors, but reduced environmental exploration, as showed in the social interaction test. Chronic social isolation decreased levels of dopamine D2 receptor in the shell of the nucleus accumbens (NAcc) and medial prefrontal cortex. It also reduced TH in the NAcc. Using in vivo fiber photometry, it was also found that isolated mice displayed a reduction in NAcc shell activity upon exploring unfamiliar social stimuli. An injection of a 100 ng dose of the D2R agonist quinpirole into the shell of the NAcc reversed behavioral abnormalities induced by chronic social isolation. These data suggest that the dopamine system is involved in alterations in social behaviors induced by chronic social isolation. This finding sheds light on the mechanism underlying abnormalities in social behavior induced by adolescent chronic social isolation and provides a promising target to treat mental diseases relevant to social isolation.

The Neurobiology of Impulsive Decision-Making and Reinforcement Learning in Nonhuman Animals

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

Deconstructing value-based decision making via temporally selective manipulation of neural activity: Insights from rodent models

The ability to choose among options that differ in their rewards and costs (value-based decision making) has long been a topic of interest for neuroscientists, psychologists, and economists alike. This is likely because this is a cognitive process in which all animals (including humans) engage on a daily basis, be it routine (which road to take to work) or consequential (which graduate school to attend). Studies of value-based decision making (particularly at the preclinical level) often treat it as a uniform process. The results of such studies have been invaluable for our understanding of the brain substrates and neurochemical systems that contribute to decision making involving a range of different rewards and costs. Value-based decision making is not a unitary process, however, but is instead composed of distinct cognitive operations that function in concert to guide choice behavior. Within this conceptual framework, it is therefore important to consider that the known neural substrates supporting decision making may contribute to temporally distinct and dissociable components of the decision process. This review will describe this approach for investigating decision making, drawing from published studies that have used techniques that allow temporal dissection of the decision process, with an emphasis on the literature in animal models. The review will conclude with a discussion of the implications of this work for understanding pathological conditions that are characterized by impaired decision making.

Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making

Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.

Brain and Cognition for Addiction Medicine: From Prevention to Recovery Neural Substrates for Treatment of Psychostimulant-Induced Cognitive Deficits

Addiction to psychostimulants like cocaine, methamphetamine, and nicotine poses a continuing medical and social challenge both in the United States and all over the world. Despite a desire to quit drug use, return to drug use after a period of abstinence is a common problem among individuals dependent on psychostimulants. Recovery for psychostimulant drug-dependent individuals is particularly challenging because psychostimulant drugs induce significant changes in brain regions associated with cognitive functions leading to cognitive deficits. These cognitive deficits include impairments in learning/memory, poor decision making, and impaired control of behavioral output. Importantly, these drug-induced cognitive deficits often impact adherence to addiction treatment programs and predispose abstinent addicts to drug use relapse. Additionally, these cognitive deficits impact effective social and professional rehabilitation of abstinent addicts. The goal of this paper is to review neural substrates based on animal studies that could be pharmacologically targeted to reverse psychostimulant-induced cognitive deficits such as impulsivity and impairment in learning and memory. Further, the review will discuss neural substrates that could be used to facilitate extinction learning and thus reduce emotional and behavioral responses to drug-associated cues. Moreover, the review will discuss some non-pharmacological approaches that could be used either alone or in combination with pharmacological compounds to treat the above-mentioned cognitive deficits. Psychostimulant addiction treatment, which includes treatment for cognitive deficits, will help promote abstinence and allow for better rehabilitation and integration of abstinent individuals into society.