Effects of selective dopaminergic compounds on a delay-discounting task

Involvement of dopamine D3 receptor in impulsive choice decision-making in male rats

Impulsive decision-making has been linked to impulse control disorders and substance use disorders. However, the neural mechanisms underlying impulsive choice are not fully understood. While previous PET imaging and autoradiography studies have shown involvement of dopamine and D2/3 receptors in impulsive behavior, the roles of distinct D1, D2, and D3 receptors in impulsive decision-making remain unclear. In this study, we used a food reward delay-discounting task (DDT) to identify low- and high-impulsive rats, in which low-impulsive rats exhibited preference for large delayed reward over small immediate rewards, while high-impulsive rats showed the opposite preference. We then examined D1, D2, and D3 receptor gene expression using RNAscope in situ hybridization assays. We found that high-impulsive male rats exhibited lower levels of D2 and D3, and particularly D3, receptor expression in the nucleus accumbens (NAc), with no significant changes in the insular, prelimbic, and infralimbic cortices. Based on these findings, we further explored the role of the D3 receptor in impulsive decision-making. Systemic administration of a selective D3 receptor agonist (FOB02-04) significantly reduced impulsive choices in high-impulsive rats but had no effects in low-impulsive rats. Conversely, a selective D3 receptor antagonist (VK4-116) produced increased both impulsive and omission choices in both groups of rats. These findings suggest that impulsive decision-making is associated with a reduction in D3 receptor expression in the NAc. Selective D3 receptor agonists, but not antagonists, may hold therapeutic potentials for mitigating impulsivity in high-impulsive subjects.

Dopaminergic modulation of sensitivity to immediate and delayed punishment during decision-making

Effective decision-making involves careful consideration of all rewarding and aversive outcomes. Importantly, negative outcomes often occur later in time, leading to underestimation, or "discounting," of these consequences. Despite the frequent occurrence of delayed outcomes, little is known about the neurobiology underlying sensitivity to delayed punishment during decision-making. The Delayed Punishment Decision-making Task (DPDT) addresses this by assessing sensitivity to delayed versus immediate punishment in rats. Rats initially avoid punished reinforcers, then select this option more frequently when delay precedes punishment. We used DPDT to examine effects of acute systemic administration of catecholaminergic drugs on sensitivity to delayed punishment in male and female adult rats. Cocaine did not affect choice of rewards with immediate punishment but caused a dose-dependent reduction in choice of delayed punishment. Neither activation nor blockade of D1-like dopamine receptor affected decision-making, but activation of D2-like dopamine receptors reduced choice of delayed punishment. D2 blockade did not attenuate cocaine's effects on decision-making, suggesting that cocaine's effects are not dependent on D2 receptor activation. Increasing synaptic norepinephrine via atomoxetine also reduced choice of delayed (but not immediate) punishment. Notably, when DPDT was modified from ascending to descending pre-punishment delays, these drugs did not affect choice of delayed or immediate punishment, although high-dose quinpirole impaired behavioral flexibility. In summary, sensitivity to delayed punishment is regulated by both dopamine and norepinephrine transmission in task-specific fashion. Understanding the neurochemical modulation of decision-making with delayed punishment is a critical step toward treating disorders characterized by aberrant sensitivity to negative consequences.

Pramipexole restores behavioral inhibition in highly impulsive rats through a paradoxical modulation of frontostriatal networks

Impulse control disorders (ICDs), a wide spectrum of maladaptive behaviors which includes pathological gambling, hypersexuality and compulsive buying, have been recently suggested to be triggered or aggravated by treatments with dopamine D2/3 receptor agonists, such as pramipexole (PPX). Despite evidence showing that impulsivity is associated with functional alterations in corticostriatal networks, the neural basis of the exacerbation of impulsivity by PPX has not been elucidated. Here we used a hotspot analysis to assess the functional recruitment of several corticostriatal structures by PPX in male rats identified as highly (HI), moderately impulsive (MI) or with low levels of impulsivity (LI) in the 5-choice serial reaction time task (5-CSRTT). PPX dramatically reduced impulsivity in HI rats. Assessment of the expression pattern of the two immediate early genes C-fos and Zif268 by in situ hybridization subsequently revealed that PPX resulted in a decrease in Zif268 mRNA levels in different striatal regions of both LI and HI rats accompanied by a high impulsivity specific reduction of Zif268 mRNA levels in prelimbic and cingulate cortices. PPX also decreased C-fos mRNA levels in all striatal regions of LI rats, but only in the dorsolateral striatum and nucleus accumbens core (NAc Core) of HI rats. Structural equation modeling further suggested that the anti-impulsive effect of PPX was mainly attributable to the specific downregulation of Zif268 mRNA in the NAc Core. Altogether, our results show that PPX restores impulse control in highly impulsive rats by modulation of limbic frontostriatal circuits.

Reward prediction-errors weighted by cue salience produces addictive behaviours in simulations, with asymmetrical learning and steeper delay discounting

Dysfunction in learning and motivational systems are thought to contribute to addictive behaviours. Previous models have suggested that dopaminergic roles in learning and motivation could produce addictive behaviours through pharmacological manipulations that provide excess dopaminergic signalling towards these learning and motivational systems. Redish (2004) suggested a role based on dopaminergic signals of value prediction error, while (Zhang et al., 2009) suggested a role based on dopaminergic signals of motivation. However, both models present significant limitations. They do not explain the reduced sensitivity to drug-related costs/negative consequences, the increased impulsivity generally found in people with a substance use disorder, craving behaviours, and non-pharmacological dependence, all of which are key hallmarks of addictive behaviours. Here, we propose a novel mathematical definition of salience, that combines aspects of dopamine's role in both learning and motivation within the reinforcement learning framework. Using a single parameter regime, we simulated addictive behaviours that the (Zhang et al., 2009; Redish, 2004) models also produce but we went further in simulating the downweighting of drug-related negative prediction-errors, steeper delay discounting of drug rewards, craving behaviours and aspects of behavioural/non-pharmacological addictions. The current salience model builds on our recently proposed conceptual theory that salience modulates internal representation updating and may contribute to addictive behaviours by producing misaligned internal representations (Kalhan et al., 2021). Critically, our current mathematical model of salience argues that the seemingly disparate learning and motivational aspects of dopaminergic functioning may interact through a salience mechanism that modulates internal representation updating.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Altered delay discounting in neurodegeneration: insight into the underlying mechanisms and perspectives for clinical applications

Steeper delay discounting (i.e., the extent to which future rewards are perceived as less valuable than immediate ones) has been proposed as a transdiagnostic process across different health conditions, in particular psychiatric disorders. Impulsive decision-making is a hallmark of different neurodegenerative conditions but little is known about delay discounting in the domain of neurodegenerative conditions. We reviewed studies on delay discounting in patients with Parkinson's disease (PD) and in patients with dementia (Alzheimer's disease / AD or frontotemporal dementia / FTD). We proposed that delay discounting could be an early marker of the neurodegenerative process. We developed the idea that altered delay discounting is associated with overlapping but distinct neurocognitive mechanisms across neurodegenerative diseases: dopaminergic-related disorders of reward processing in PD, memory/projection deficits due to medial temporal atrophy in AD, modified reward processing due to orbitofrontal atrophy in FTD. Neurodegeneration could provide a framework to decipher the neuropsychological mechanisms of value-based decision-making. Further, delay discounting could become a marker of interest in clinical practice, in particular for differential diagnosis.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Contrasting effects of DOI and lisuride on impulsive decision-making in delay discounting task

RATIONALE

The 5-HT2A receptor is the major target of classic hallucinogens. Both DOI (2,5-dimethoxy-4-iodoamphetamine) and lisuride act at 5-HT2A receptors, and lisuride shares comparable affinity with DOI and acts as a partial agonist at 5-HT2A receptors. However, not like DOI, lisuride lacks hallucinogenic properties. Impulsive decision-making refers to the preference for an immediate small reinforcer (SR) over a delayed large reinforcer (LR).

OBJECTIVES

The current study aims to compare the effects of DOI and lisuride on impulsive decision-making and further to investigate the possible receptor mechanisms responsible for the actions of the two drugs.

METHODS

Impulsive decision-making was evaluated in male Sprague-Dawley rats by the percentage of choice for the LR in delay discounting task (DDT). Delay to the LR changed in an ascending order (0, 4, 8, 16, and 32 s) across one session.

RESULTS

DOI (0.5 and 1.0 mg/kg) increased impulsive decision-making, and the effects of DOI (1.0 mg/kg) were blocked by the 5-HT2A receptor antagonist ketanserin (1.0 mg/kg) rather than the 5-HT2C receptor antagonist SB-242084 (1.0 mg/kg). Contrarily, lisuride (0.1, 0.3, and 0.5 mg/kg) decreased impulsive decision-making. The effects of lisuride (0.3 mg/kg) were not antagonized by ketanserin (1.0 mg/kg), selective 5-HT1A antagonist WAY-100635 (1.0 mg/kg), or selective dopamine D4 receptor antagonist L-745870 (1.0 mg/kg) but were attenuated by the selective dopamine D2/D3 receptor antagonist tiapride (40 mg/kg).

CONCLUSIONS

DOI and lisuride have contrasting effects on impulsive decision-making via distinct receptors. DOI-induced increase of impulsivity is mediated by the 5-HT2A receptor, while lisuride-induced inhibition of impulsivity is regulated by the dopamine D2/D3 receptor.

Impulsivity and risk-seeking as Bayesian inference under dopaminergic control

Bayesian models successfully account for several of dopamine (DA)'s effects on contextual calibration in interval timing and reward estimation. In these models, tonic levels of DA control the precision of stimulus encoding, which is weighed against contextual information when making decisions. When DA levels are high, the animal relies more heavily on the (highly precise) stimulus encoding, whereas when DA levels are low, the context affects decisions more strongly. Here, we extend this idea to intertemporal choice and probability discounting tasks. In intertemporal choice tasks, agents must choose between a small reward delivered soon and a large reward delivered later, whereas in probability discounting tasks, agents must choose between a small reward that is always delivered and a large reward that may be omitted with some probability. Beginning with the principle that animals will seek to maximize their reward rates, we show that the Bayesian model predicts a number of curious empirical findings in both tasks. First, the model predicts that higher DA levels should normally promote selection of the larger/later option, which is often taken to imply that DA decreases 'impulsivity,' and promote selection of the large/risky option, often taken to imply that DA increases 'risk-seeking.' However, if the temporal precision is sufficiently decreased, higher DA levels should have the opposite effect-promoting selection of the smaller/sooner option (higher impulsivity) and the small/safe option (lower risk-seeking). Second, high enough levels of DA can result in preference reversals. Third, selectively decreasing the temporal precision, without manipulating DA, should promote selection of the larger/later and large/risky options. Fourth, when a different post-reward delay is associated with each option, animals will not learn the option-delay contingencies, but this learning can be salvaged when the post-reward delays are made more salient. Finally, the Bayesian model predicts correlations among behavioral phenotypes: Animals that are better timers will also appear less impulsive.

Delays to Reward Delivery Enhance the Preference for an Initially Less Desirable Option: Role for the Basolateral Amygdala and Retrosplenial Cortex

Temporal costs influence reward-based decisions. This is commonly studied in temporal discounting tasks that involve choosing between cues signaling an imminent reward option or a delayed reward option. However, it is unclear whether the temporal delay before a reward can alter the value of that option. To address this, we identified the relative preference between different flavored rewards during a free-feeding test using male and female rats. Animals underwent training where either the initial preferred or the initial less preferred reward was delivered noncontingently. By manipulating the intertrial interval during training sessions, we could determine whether temporal delays impact reward preference in a subsequent free-feeding test. Rats maintained their initial preference if the same delays were used across all training sessions. When the initial less preferred option was delivered after short delays (high reward rate) and the initial preferred option was delivered after long delays (low reward rate), rats expectedly increased their preference for the initial less desirable option. However, rats also increased their preference for the initial less desirable option under the opposite training contingencies: delivering the initial less preferred reward after long delays and the initial preferred reward after short delays. These data suggest that sunk temporal costs enhance the preference for a less desirable reward option. Pharmacological and lesion experiments were performed to identify the neural systems responsible for this behavioral phenomenon. Our findings demonstrate the basolateral amygdala and retrosplenial cortex are required for temporal delays to enhance the preference for an initially less desirable reward.SIGNIFICANCE STATEMENT The goal of this study was to determine how temporal delays influence reward preference. We demonstrate that delivering an initially less desirable reward after long delays subsequently increases the consumption and preference for that reward. Furthermore, we identified the basolateral amygdala and the retrosplenial cortex as essential nuclei for mediating the change in reward preference elicited by sunk temporal costs.

Chronic, Multi-Site Recordings Supported by Two Low-Cost, Stationary Probe Designs Optimized to Capture Either Single Unit or Local Field Potential Activity in Behaving Rats

Rodent models of cognitive behavior have greatly contributed to our understanding of human neuropsychiatric disorders. However, to elucidate the neurobiological underpinnings of such disorders or impairments, animal models are more useful when paired with methods for measuring brain function in awake, behaving animals. Standard tools used for systems-neuroscience level investigations are not optimized for large-scale and high-throughput behavioral battery testing due to various factors including cost, time, poor longevity, and selective targeting limited to measuring only a few brain regions at a time. Here we describe two different "user-friendly" methods for building extracellular electrophysiological probes that can be used to measure either single units or local field potentials in rats performing cognitive tasks. Both probe designs leverage several readily available, yet affordable, commercial products to facilitate ease of production and offer maximum flexibility in terms of brain-target locations that can be scalable (32-64 channels) based on experimental needs. Our approach allows neural activity to be recorded simultaneously with behavior and compared between micro (single unit) and more macro (local field potentials) levels of brain activity in order to gain a better understanding of how local brain regions and their connected networks support cognitive functions in rats. We believe our novel probe designs make collecting electrophysiology data easier and will begin to fill the gap in knowledge between basic and clinical research.

Dopaminergic modulation of reward discounting in healthy rats: a systematic review and meta-analysis

RATIONALE

Although numerous studies have suggested that pharmacological alteration of the dopamine (DA) system modulates reward discounting, these studies have produced inconsistent findings.

OBJECTIVES

Here, we conducted a systematic review and pre-registered meta-analysis to evaluate DA drug-mediated effects on reward discounting of time, probability, and effort costs in studies of healthy rats. This produced a total of 1343 articles to screen for inclusion/exclusion. From the literature, we identified 117 effects from approximately 1549 individual rats.

METHODS

Using random effects with maximum-likelihood estimation, we meta-analyzed placebo-controlled drug effects for (1) DA D1-like receptor agonists and (2) antagonists, (3) D2-like agonists and (4) antagonists, and (5) DA transporter-modulating drugs.

RESULTS

Meta-analytic effects showed that DAT-modulating drugs decreased reward discounting. While D1-like and D2-like antagonists both increased discounting, agonist drugs for those receptors had no significant effect on discounting behavior. A number of these effects appear contingent on study design features like cost type, rat strain, and microinfusion location.

CONCLUSIONS

These findings suggest a nuanced relationship between DA and discounting behavior and urge caution when drawing generalizations about the effects of pharmacologically manipulating dopamine on reward-based decision-making.

Attention-Deficit/Hyperactivity Disorder Symptoms Are Associated with Greater Delay Discounting of Condom-Protected Sex and Money

Attention-deficit/hyperactivity disorder (ADHD) is associated with increased risk of detrimental life outcomes. Recent research also indicates that ADHD is associated with sexual risk behavior, such as unprotected sex. Some risky sexual behaviors may be driven, in part, by preference for immediate rewards, referred to as delay discounting, which is prominent in etiological models of ADHD. Therefore, the present study examined the effect of delay on preference for both monetary and sexual outcomes in adults with many ADHD symptoms (both on and off medication) and with fewer ADHD symptoms. Online participants (N = 275; n = 161 males, n = 114 females) completed a monetary delay discounting task, assessing preference for smaller sooner versus larger delayed hypothetical money, and the Sexual Delay Discounting Task, assessing preference for condom use in hypothetical casual sex scenarios based on delay until condom availability. Those with greater ADHD symptoms discounted delayed monetary outcomes as well as delayed condom-protected sex (i.e., preferred sooner money rewards and immediate unprotected sex) significantly more than those with fewer symptoms; however, no effect of current medication use was found across monetary or sexual delay discounting among those with greater ADHD symptoms. This study is the first to demonstrate the relation between ADHD symptoms and reduced condom-use likelihood. Increased discounting of delayed condom-protected sex might constitute one mechanism of risky sexual behavior among individuals with ADHD symptoms. Interventions geared toward increasing condom use in situations in which condoms may otherwise be unavailable, may mitigate risky sexual behaviors and their associated harms in this population.

Effects of benztropine analogs on delay discounting in rats

RATIONALE

Methylphenidate and d-amphetamine, medications used for treatment of attention deficit hyperactivity disorder (ADHD), are used recreationally and self-administered by laboratory animals. Benztropine (BZT) analogs, like those medications, increase synaptic dopamine levels but are less effective in maintaining self-administration, suggesting clinical utility with less abuse liability.

OBJECTIVES

The current study was designed to evaluate potential therapeutic effects of BZT analogs related to ADHD.

METHODS

Rats responded under a delay-discounting procedure in which responses on one lever produced immediate delivery of a single food pellet and alternative responses produced four food pellets either immediately or with various temporal delays, with those delays arranged in ascending or random orders in different groups of rats. Selection of the smaller more immediate reinforcer has been suggested as an aspect of "impulsivity," a trait with suggested involvement in ADHD. Other rats were studied under fixed-interval (FI) 300-s schedules to assess drug effects on behavior under temporal control.

RESULTS

d-Amphetamine, methylphenidate, and the BZT analog AHN 1-055, but not AHN 2-005 or JHW 007, increased selection of the large, delayed reinforcer with either arrangement of delays. All drugs changed the temporal distribution of responses within the FI from one with responses concentrated at the end to a more uniform distribution. Changes in the temporal distribution of FI responding occurred with drugs that did not affect discounting suggesting that discounting does not arise directly from the same temporal control processes controlling FI responding.

CONCLUSIONS

AHN 1-055 may be of clinical utility in the treatment of ADHD.

Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults

Dopamine (DA) plays a key role in reward processing and is implicated in psychological disorders such as depression, substance use, and schizophrenia. The role of DA in reward processing is an area of highly active research. One approach to this question is drug challenge studies with drugs known to alter DA function. These studies provide good experimental control and can be performed in parallel in laboratory animals and humans. This review aimed to summarize results of studies using pharmacological manipulations of DA in healthy adults. 'Reward' is a complex process, so we separated 'phases' of reward, including anticipation, evaluation of cost and benefits of upcoming reward, execution of actions to obtain reward, pleasure in response to receiving a reward, and reward learning. Results indicated that i) DAergic drugs have different effects on different phases of reward; ii) the relationship between DA and reward functioning appears unlikely to be linear; iii) our ability to detect the effects of DAergic drugs varies depending on whether subjective, behavioral, imaging measures are used.

Open-source raspberry Pi-based operant box for translational behavioral testing in rodents

BACKGROUND

Rodents have been used for decades to probe neural circuits involved in behavior. Increasingly, attempts have been developed to standardize training paradigms across labs; and to use visual/auditory paradigms that can be also tested in humans. Commercially available systems are expensive and thus do not scale easily, and are not optimized for electrophysiology.

NEW METHOD

Using the rich open-source technology built around Raspberry Pi, we were able to develop an inexpensive (<$1000) visual-screen based operant chamber with electrophysiological and optogenetic compatibility. The chamber is operated within MATLAB/Simulink, a commonly used scientific programming language allowing for rapid customization.

RESULTS

Here, we describe and provide all relevant details needed to develop and produce these chambers, and show examples of behavior and electrophysiology data collected using these chambers. We also include all of the tools needed to allow readers to build and develop their own boxes (CAD models for 3D printing and laser-cutting; PCB-board design; all bill of materials for required parts and supplies, and some examples of Simulink models to operate the boxes).

COMPARISON WITH EXISTING METHODS

The new boxes are far more cost-effective than commercially available environments and allow for the combination of automated behavioral testing with electrophysiological read-outs with high temporal precision.

CONCLUSION

These open-source boxes can be used for labs interested in developing high-throughput visual/auditory behavioral assays for ∼ 10th the cost of commercial systems.

Heroin delay discounting and impulsivity: Modulation by DRD1 genetic variation

BACKGROUND

Dopamine D1 receptors (encoded by DRD1) are implicated in drug addiction and high-risk behaviors. Delay discounting (DD) procedures measure decisional balance between choosing smaller/sooner rewards vs larger/later rewards. Individuals with higher DD (rapid discounting) are prone to maladaptive behaviors that provide immediate reinforcement (eg, substance use). DRD1 variants have been linked with increased DD (in healthy volunteers) and opioid abuse. This study determined whether four dopaminergic functional variants modulated heroin DD and impulsivity.

METHODS

Substance use, DD, and genotype data (DRD1 rs686 and rs5326, DRD3 rs6280, COMT rs4680) were obtained from 106 current heroin users. Subjects completed an array of DD choices during two imagined conditions: heroin satiation and withdrawal. Rewards were expressed as $10 heroin bag units, with maximum delayed amount of 30 bags. Delays progressively increased from 3 to 96 hours.

RESULTS

DRD1 rs686 (A/A, n = 25; G/A, n = 56; G/G, n = 25) was linearly related to the difference in heroin DD (area under the curve; AUC) between the heroin satiation and withdrawal conditions; specifically, G/G homozygotes had a significantly smaller (satiation minus withdrawal) AUC difference score had higher drug-use impulsivity questionnaire scores, relative to A/A homozygotes, with G/A intermediate. DRD3 and COMT variants were not associated with these DD and impulsivity outcomes.

CONCLUSION

DRD1 rs686 modulated the difference in heroin DD score between pharmacological states and was associated with drug-use impulsivity. These data support a role of DRD1 in opioid DD and impulsive behaviors.

Pre-clinical models of reward deficiency syndrome: A behavioral octopus

Individuals with mood disorders or with addiction, impulsivity and some personality disorders can share in common a dysfunction in how the brain perceives reward, where processing of natural endorphins or the response to exogenous dopamine stimulants is impaired. Reward Deficiency Syndrome (RDS) is a polygenic trait with implications that suggest cross-talk between different neurological systems that include the known reward pathway, neuroendocrine systems, and motivational systems. In this review we evaluate well-characterized animal models for their construct validity and as potential models for RDS. Animal models used to study substance use disorder, major depressive disorder (MDD), early life stress, immune dysregulation, attention deficit hyperactivity disorder (ADHD), post traumatic stress disorder (PTSD), compulsive gambling and compulsive eating disorders are discussed. These disorders recruit underlying reward deficiency mechanisms in multiple brain centers. Because of the widespread and remarkable array of associated/overlapping behavioral manifestations with a common root of hypodopaminergia, the basic endophenotype recognized as RDS is indeed likened to a behavioral octopus. We conclude this review with a look ahead on how these models can be used to investigate potential therapeutics that target the underlying common deficiency.

The anterior caudate nucleus supports impulsive choices triggered by pramipexole

BACKGROUND

Pramipexole is a dopamine agonist used as a treatment in PD and restless legs syndrome to reduce motor symptoms, but it often induces impulse control disorders. In particular, patients with impulse control disorders tend to make more impulsive choices in the delay discounting task, that is, they choose small immediate rewards over larger delayed ones more often than patients without impulse control disorders and healthy subjects do. Yet the site of action of pramipexole that produces these impulsive choices remains unknown. Based on the heterogeneity of corticostriatal projections and the massive dopamine innervation of the striatum, we hypothesized that impulsive choices triggered by dopamine treatments may be supported by a specific striatal territory.

OBJECTIVES

This study aims to determine by which anteriorstriatum territory the Pramipexole trigger impulsive choices; the caudate nucleus, the ventral striatum or the putamen.

METHODS

We compared pramipexole intramuscular injections to intracerebral microinjections within the three striatal territories in healthy monkeys trained to execute the delay discounting task, a behavioral paradigm typically used to evaluate impulsive choices.

RESULTS

We found that pramipexole intramuscular injections induced impulsive choices in all monkeys. Local microinjections were performed inside the anterior caudate nucleus, ventral striatum, and anterior putamen and reproduced those impulsive choices when pramipexole was directly injected into the caudate nucleus, whereas injections into the ventral striatum or putamen had no effect on monkeys' choices.

CONCLUSIONS

These results, consistent with clinical studies, suggest that impulsive choices triggered by pramipexole are supported by the caudate nucleus, allowing us to emphasize the importance of dopamine modulation inside this striatal territory in decision processes underlying impulsive behaviors. © 2019 International Parkinson and Movement Disorder Society.

Effects of d-amphetamine and MK-801 on impulsive choice: Modulation by schedule of reinforcement and delay length

Procedural modifications can modulate drug effects in delay discounting, such as signaling the delay to reinforcement and altering the order in which delays are presented. Although the schedule of reinforcement can alter the rate at which animals discount a reinforcer, research has not determined if animals trained on different schedules of reinforcement are differentially affected by pharmacological manipulations. Similarly, research has not determined if using different delays to reinforcement can modulate drug effects in delay discounting. Male Sprague Dawley rats (n = 36) were split into four groups and were trained in a delay-discounting procedure. The schedule of reinforcement (fixed ratio [FR] 1 vs. FR 10) and delays to reinforcement (0, 5, 10, 20, and 50 s vs. 0, 10, 30, 60, 100 s) were manipulated for each group. Following behavioral training, rats were treated with d-amphetamine (0, 0.25, 0.5, and 1.0 mg/kg) and MK-801 (0, 0.03, and 0.06 mg/kg). Results showed that amphetamine decreased impulsive choice when a FR 1 schedule was used, but only when the short delay sequence was used. Conversely, amphetamine decreased impulsive choice when a FR 10 schedule was used, but only when rats were trained on the long delay sequence. MK-801 decreased impulsive choice in rats trained on a FR 1 schedule, regardless of delay sequence, but did not alter choice in rats trained on a FR 10 schedule. These results show that schedule of reinforcement and delay length can modulate drug effects in delay discounting.

Monoaminergic modulation of decision-making under risk of punishment in a rat model

The ability to decide advantageously among options that vary in both their risks and rewards is critical for survival and well-being. Previous work shows that some forms of risky decision-making are robustly modulated by monoamine signaling, but it is less clear how monoamine signaling modulates decision-making under risk of explicit punishment. The goal of these experiments was to determine how this form of decision-making is modulated by dopamine, serotonin, and norepinephrine signaling, using a task in which rats choose between a small, 'safe' food reward and a large food reward associated with variable risks of punishment. Preference for the large, risky reward (risk-taking) was reduced by administration of a D2/3 dopamine receptor agonist (bromocriptine) and a selective D2 agonist (sumanirole). The selective D3 agonist PD128907 appeared to attenuate reward discrimination abilities but did not affect risk-taking per se. In contrast, drugs targeting serotonergic and noradrenergic signaling had few if any effects on choice behavior. These data suggest that in contrast to other forms of risky decision-making, decision-making under risk of punishment is selectively modulated by dopamine signaling, predominantly through D2 receptors.

Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making

Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.

Individual Differences in Dopamine Are Associated with Reward Discounting in Clinical Groups But Not in Healthy Adults

Some people are more willing to make immediate, risky, or costly reward-focused choices than others, which has been hypothesized to be associated with individual differences in dopamine (DA) function. In two studies using PET imaging, one empirical (Study 1: N = 144 males and females across 3 samples) and one meta-analytic (Study 2: N = 307 across 12 samples), we sought to characterize associations between individual differences in DA and time, probability, and physical effort discounting in human adults. Study 1 demonstrated that individual differences in DA D2-like receptors were not associated with time or probability discounting of monetary rewards in healthy humans, and associations with physical effort discounting were inconsistent across adults of different ages. Meta-analytic results for temporal discounting corroborated our empirical finding for minimal effect of DA measures on discounting in healthy individuals but suggested that associations between individual differences in DA and reward discounting depend on clinical features. Addictions were characterized by negative correlations between DA and discounting, but other clinical conditions, such as Parkinson's disease, obesity, and attention-deficit/hyperactivity disorder, were characterized by positive correlations between DA and discounting. Together, the results suggest that trait differences in discounting in healthy adults do not appear to be strongly associated with individual differences in D2-like receptors. The difference in meta-analytic correlation effects between healthy controls and individuals with psychopathology suggests that individual difference findings related to DA and reward discounting in clinical samples may not be reliably generalized to healthy controls, and vice versa.SIGNIFICANCE STATEMENT Decisions to forgo large rewards for smaller ones due to increasing time delays, uncertainty, or physical effort have been linked to differences in dopamine (DA) function, which is disrupted in some forms of psychopathology. It remains unclear whether alterations in DA function associated with psychopathology also extend to explaining associations between DA function and decision making in healthy individuals. We show that individual differences in DA D2 receptor availability are not consistently related to monetary discounting of time, probability, or physical effort in healthy individuals across a broad age range. By contrast, we suggest that psychopathology accounts for observed inconsistencies in the relationship between measures of DA function and reward discounting behavior.

The role of 'jackpot' stimuli in maladaptive decision-making: dissociable effects of D1/D2 receptor agonists and antagonists

RATIONALE

Laboratory experiments often model risk through a choice between a large, uncertain (LU) reward against a small, certain (SC) reward as an index of an individual's risk tolerance. An important factor generally lacking from these procedures are reward-associated cues that may modulate risk preferences.

OBJECTIVE

We tested whether the addition of cues signaling 'jackpot' wins to LU choices would modulate risk preferences and if these cue effects were mediated by dopaminergic signaling.

METHODS

Three groups of rats chose between LU and SC rewards for which the LU probability of reward decreased across blocks. The unsignaled group received a non-informative stimulus of trial outcome. The signaled group received a jackpot signal prior to reward delivery and blackout on losses. The signaled-light group received a similar jackpot for wins, but a salient loss signal distinct from the win signal.

RESULTS

Presenting win signals decreased the discounting of LU value for both signaled groups regardless of loss signal, while the unsignaled group showed discounting similar to previous research without cues. Pharmacological challenges with D1/D2 agonists and antagonists revealed that D1 antagonism increased and decreased sensitives to the relative probability of reward for unsignaled and signaled groups, respectively, while D2 agonists decreased sensitivities to the relative magnitude of reward.

CONCLUSION

The results highlight how signals predictive of wins can promote maladaptive risk taking in individuals, while loss signals have reduced effect. Additionally, the presence of reward-predictive cues may change the underlying neurobehavioral mechanisms mediating decision-making under risk.

Impulse control disorders in Parkinson's disease

Impulse control disorders (ICD) are frequent side effects of dopamine replacement therapy (DRT) used in Parkinson's disease (PD) with devastating consequences on the patients and caregivers. ICD are behavioural addictions including compulsive gambling, shopping, sexual behaviour, and binge eating that are mainly associated with dopamine D2/D3 agonists. Their management is a real clinical challenge due to the lack of therapeutic alternative. Clinical studies have identified demographic and clinical risk factors for ICD such as younger age at disease onset, male gender, prior history of depression or substance abuse, REM sleep behaviour disorders and higher rate of dyskinesia. PD patients with ICD may also have a specific pattern of dopaminergic denervation in the ventral striatum. Specific evaluation tools have now been designed to better evaluate the severity and impact of ICD in PD. Patients with ICD display altered processing of reward and loss, and decisional bias associated with altered activity in cortical and subcortical areas such as the orbitofrontal cortex, amygdala, insula, anterior cingular cortex, and ventral striatum. Preclinical studies have demonstrated that D2/D3 agonists induce impairments in behavioural processes likely relevant to ICD such as risk-taking behaviour, preference for uncertainty, perseverative responding and sustained drive to engage in gambling-like behaviour. Whether interactions between dopamine denervation and DRT significantly contribute to the pathogenesis of ICD remains poorly understood so far, although features unique to PD have been identified in patients with ICD. Large-scale longitudinal studies are needed to better identify subjects with increased risk to develop ICD and develop therapeutic options.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Pharmacotherapies for decreasing maladaptive choice in drug addiction: Targeting the behavior and the drug

Drug addiction can be conceptualized as a disorder of maladaptive decision making in which drugs are chosen at the expense of pro-social, nondrug alternatives. The study of decision making in drug addiction has focused largely on the role of impulsivity as a facilitator of addiction, in particular the tendency for drug abusers to choose small, immediate gains over larger but delayed outcomes (i.e., delay discounting). A parallel line of work, also focused on decision making in drug addiction, has focused on identifying the determinants underlying the choice to take drugs over nondrug alternatives (i.e., drug vs. nondrug choice). Both tracks of research have been valuable tools in the development of pharmacotherapies for treating maladaptive decision making in drug addiction, and a number of common drugs have been studied in both designs. However, we have observed that there is little uniformity in the administration regimens of potential treatments between the designs, which hinders congruence in the development of single treatment strategies to reduce both impulsive behavior and drug choice. The current review provides an overview of the drugs that have been tested in both delay-discounting and drug-choice designs, and focuses on drugs that reduced the maladaptive choice in both designs. Suggestions to enhance congruence between the findings in future studies are provided. Finally, we propose the use of a hybridized, experimental approach that may enable researchers to test the effectiveness of therapeutics at decreasing impulsive and drug choice in a single design.

Effects of a cafeteria diet on delay discounting in adolescent and adult rats: Alterations on dopaminergic sensitivity

Diet-induced obesity is a laboratory procedure in which nonhuman animals are chronically exposed to a high-fat, high-sugar diet (i.e. cafeteria diet), which results in weight gain, altered sensitivity to reward, and alterations in the dopamine D₂ system. To date, few (if any) studies have examined age-related diet-induced obesity effects in a rat model or have used an impulsive choice task to characterize diet-induced behavioral alterations in reward processes. We exposed rats to a cafeteria-style diet for eight weeks starting at age 21 or 70 days. Following the diet exposures, the rats were tested on a delay discounting task - a measure of impulsive choice in which preference for smaller, immediate vs larger, delayed food reinforcers was assessed. Acute injections of haloperidol (0.03-0.3 mg/kg) were administered to assess the extent to which diet-induced changes in dopamine D₂ influence impulsive food choice. Across both age groups, rats fed a cafeteria diet gained the most weight and consumed more calories than rats fed a standard diet, with rats exposed during development showing the highest weight gain. No age- or diet-related baseline differences in delay discounting were revealed, however, haloperidol unmasked subtle diet-related differences by dose-dependently reducing choice for the larger, later reinforcer. Rats fed a cafeteria diet showed a leftward shift in the dose-response curve, suggesting heightened sensitivity to haloperidol, regardless of age, compared to rats fed a standard diet. Results indicate that chronic exposure to a cafeteria diet resulted in changes in underlying dopamine D₂ that manifested as greater impulsivity independent of age at diet exposure.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

Distinct Roles of Dopamine Receptors in the Lateral Thalamus in a Rat Model of Decisional Impulsivity

The thalamus and central dopamine signaling have been shown to play important roles in high-level cognitive processes including impulsivity. However, little is known about the role of dopamine receptors in the thalamus in decisional impulsivity. In the present study, rats were tested using a delay discounting task and divided into three groups: high impulsivity (HI), medium impulsivity (MI), and low impulsivity (LI). Subsequent in vivo voxel-based magnetic resonance imaging revealed that the HI rats displayed a markedly reduced density of gray matter in the lateral thalamus compared with the LI rats. In the MI rats, the dopamine D1 receptor antagonist SCH23390 or the D2 receptor antagonist eticlopride was microinjected into the lateral thalamus. SCH23390 significantly decreased their choice of a large, delayed reward and increased their omission of lever presses. In contrast, eticlopride increased the choice of a large, delayed reward but had no effect on the omissions. Together, our results indicate that the lateral thalamus is involved in decisional impulsivity, and dopamine D1 and D2 receptors in the lateral thalamus have distinct effects on decisional impulsive behaviors in rats. These results provide a new insight into the dopamine signaling in the lateral thalamus in decisional impulsivity.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Pharmacological modulation of lateral habenular dopamine D2 receptors alters the anxiogenic response to cocaine in a runway model of drug self-administration

Cocaine has long been known to produce an initial "high" followed by an aversive/anxiogenic "crash". While much is known about the neurobiology of cocaine's positive/rewarding effects, the mechanisms that give rise to the drug's negative/anxiogenic actions remain unclear. Recent research has implicated the lateral habenula (LHb) in the encoding of aversive events including the anxiogenic response to cocaine. Of particular interest in this regard are the reciprocal connections between the LHb and the ventral tegmental area (VTA). VTA-DA neurons innervate different subsets of LHb cells that in turn feedback upon and modulate VTA neuronal activity. Here we examined the impact of D2 receptor activation and inhibition on the anxiogenic response to cocaine using a runway model of self-administration that is sensitive to the dual and opposing effects of the drug. Male rats ran a straight alley for IV cocaine (1.0mg/kg) following bilateral intra-LHb infusions of the D2 receptor antagonist, cis-flupenthixol (0, 7.5 or 15μg/side) or the D2 agonist, sumanirole (0, 5 or 10μg/side). Vehicle-pretreated controls developed approach-avoidance conflict behaviors about goal-box entry reflective of the dual positive and negative effects of cocaine. These behaviors were significantly diminished during LHb-D2 receptor antagonism and increased by the LHb D2 receptor agonist. These results demonstrate that activity at the D2 receptor in the lateral habenula serves to modulate the anxiogenic response to cocaine.

Infection of male rats with Toxoplasma gondii results in enhanced delay aversion and neural changes in the nucleus accumbens core

Rats infected with the protozoan parasite Toxoplasma gondii exhibit reduced avoidance of predator odours. This behavioural change is likely to increase transmission of the parasite from rats to cats. Here, we show that infection with T. gondii increases the propensity of the infected rats to make more impulsive choices, manifested as delay aversion in an intertemporal choice task. Concomitantly, T. gondii infection causes reduction in dopamine content and neuronal spine density of the nucleus accumbens core, but not of the nucleus accumbens shell. These results are consistent with a role of the nucleus accumbens dopaminergic system in mediation of choice impulsivity and goal-directed behaviours. Our observations suggest that T. gondii infection in rats causes a syndromic shift in related behavioural constructs of innate aversion and making foraging decisions.

Differential effects of co-administration of oxotremorine with SCH 23390 on impulsive choice in high-impulsive rats and low-impulsive rats

The effect of acetylcholine on impulsive choice is thought to be due to interactions between cholinergic and dopaminergic systems, but this hypothesis has not been proven. This study investigated whether D1-like receptors were involved in the effects of the muscarinic cholinergic agonist oxotremorine on impulsive choice in high-impulsive rats (HI rats, n=8) and low-impulsive rats (LI rats, n=8) characterized by basal levels of impulsive choice in a delay-discounting task. The results revealed that oxotremorine (0.05mg/kg) significantly increased the choice of the large reinforcer in HI rats, whereas decreased the choice of the large reinforcer in LI rats. The D1-like antagonist SCH 23390 produced significant reductions in the large-reinforcer choice in HI rats (0.01mg/kg) and LI rats (0.005, 0.0075, and 0.01mg/kg). SCH 23390 significantly inhibited the increase in the choice of the large reinforcer induced by oxotremorine (0.05mg/kg) in HI rats at doses of 0.005 and 0.0075mg/kg, but enhanced the effect of oxotremorine in LI rats only at the dose of 0.0075mg/kg. These findings suggested that D1-like receptors might be involved in the differential effects of oxotremorine on impulsive choice between HI rats and LI rats.

Dopamine receptor agonists modulate voluntary alcohol intake independently of individual levels of alcohol intake in rats

RATIONALE

Individual susceptibility to alcohol use disorder has been related to functional changes in dopaminergic neurotransmission.

OBJECTIVES

The aim of the current work was to assess the effects of selective dopamine D1 and D2 receptor agonists and antagonists on alcohol consumption in rats that differ in individual levels of alcohol intake.

METHODS

The effects of the dopamine D1 receptor agonist SKF 82958, the dopamine D1 receptor antagonist SCH 23390, the dopamine D2 receptor agonist sumanirole and the dopamine D2 receptor antagonist L741,626 on alcohol consumption and preference were assessed at different time points after treatment in subgroups of low and high alcohol drinking rats (LD and HD) using an intermittent alcohol access paradigm.

RESULTS

SKF 82958 decreased alcohol intake and alcohol preference throughout the 24-h session. Sumanirole decreased alcohol intake during the first 2 h, but increased alcohol intake during the remainder of the session. The effects of SKF 82958 and sumanirole on alcohol intake and alcohol preference were comparable in LD and HD. By contrast, the dopamine receptor antagonists SCH 23390 and L741,626 did not alter alcohol consumption in either group at any time point.

CONCLUSIONS

These data indicate that stimulation of dopamine D1 receptors reduces alcohol intake, but that endogenous dopamine does not play a primary role in alcohol consumption. Moreover, the difference in alcohol consumption between LD and HD does not involve altered dopamine signaling.

Pathophysiology of L-dopa-induced motor and non-motor complications in Parkinson's disease

Involuntary movements, or dyskinesia, represent a debilitating complication of levodopa (L-dopa) therapy for Parkinson's disease (PD). L-dopa-induced dyskinesia (LID) are ultimately experienced by the vast majority of patients. In addition, psychiatric conditions often manifested as compulsive behaviours, are emerging as a serious problem in the management of L-dopa therapy. The present review attempts to provide an overview of our current understanding of dyskinesia and other L-dopa-induced dysfunctions, a field that dramatically evolved in the past twenty years. In view of the extensive literature on LID, there appeared a critical need to re-frame the concepts, to highlight the most suitable models, to review the central nervous system (CNS) circuitry that may be involved, and to propose a pathophysiological framework was timely and necessary. An updated review to clarify our understanding of LID and other L-dopa-related side effects was therefore timely and necessary. This review should help in the development of novel therapeutic strategies aimed at preventing the generation of dyskinetic symptoms.

Dopamine in socioecological and evolutionary perspectives: implications for psychiatric disorders

Dopamine (DA) transmission in brain areas such as the prefrontal cortex (PFC) and nucleus accumbens (NAcc) plays important roles in cognitive and affective function. As such, DA deficits have been implicated in a number of psychiatric disorders such as schizophrenia and attention deficit/hyperactivity disorder (ADHD). Accumulating evidence suggests that DA is also involved in social behavior of animals and humans. Although most animals organize and live in social groups, how the DA system functions in such social groups of animals, and its dysfunction causes compromises in the groups has remained less understood. Here we propose that alterations of DA signaling and associated genetic variants and behavioral phenotypes, which have been normally considered as “deficits” in investigation at an individual level, may not necessarily yield disadvantages, but even work advantageously, depending on social contexts in groups. This hypothesis could provide a novel insight into our understanding of the biological mechanisms of psychiatric disorders, and a potential explanation that disadvantageous phenotypes associated with DA deficits in psychiatric disorders have remained in humans through evolution.

Dopaminergic lesions of the dorsolateral striatum in rats increase delay discounting in an impulsive choice task

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors.

Role of ionotropic glutamate receptors in delay and probability discounting in the rat

RATIONALE

Discounting of delayed and probabilistic reinforcement is linked to increased drug use and pathological gambling. Understanding the neurobiology of discounting is important for designing treatments for these disorders. Glutamate is considered to be involved in addiction-like behaviors; however, the role of ionotropic glutamate receptors (iGluRs) in discounting remains unclear.

OBJECTIVES

The current study examined the effects of N-methyl-D-aspartate (NMDA) and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) glutamate receptor blockade on performance in delay and probability discounting tasks.

METHODS

Following training in either delay or probability discounting, rats (n = 12, each task) received pretreatments of the NMDA receptor antagonists MK-801 (0, 0.01, 0.03, 0.1, or 0.3 mg/kg, s.c.) or ketamine (0, 1.0, 5.0, or 10.0 mg/kg, i.p.), as well as the AMPA receptor antagonist CNQX (0, 1.0, 3.0, or 5.6 mg/kg, i.p.). Hyperbolic discounting functions were used to estimate sensitivity to delayed/probabilistic reinforcement and sensitivity to reinforcer amount.

RESULTS

An intermediate dose of MK-801 (0.03 mg/kg) decreased sensitivity to both delayed and probabilistic reinforcement. In contrast, ketamine did not affect the rate of discounting in either task but decreased sensitivity to reinforcer amount. CNQX did not alter sensitivity to reinforcer amount or delayed/probabilistic reinforcement.

CONCLUSIONS

These results show that blockade of NMDA receptors, but not AMPA receptors, decreases sensitivity to delayed/probabilistic reinforcement (MK-801) and sensitivity to reinforcer amount (ketamine). The differential effects of MK-801 and ketamine demonstrate that sensitivities to delayed/probabilistic reinforcement and reinforcer amount are pharmacologically dissociable.

D1-dependent 4 Hz oscillations and ramping activity in rodent medial frontal cortex during interval timing

Organizing behavior in time is a fundamental process that is highly conserved across species. Here we study the neural basis of timing processes. First, we found that rodents had a burst of stimulus-triggered 4 Hz oscillations in the medial frontal cortex (MFC) during interval timing tasks. Second, rodents with focally disrupted MFC D1 dopamine receptor (D1DR) signaling had impaired interval timing performance and weaker stimulus-triggered oscillations. Prior work has demonstrated that MFC neurons ramp during interval timing, suggesting that they underlie temporal integration. We found that MFC D1DR blockade strongly attenuated ramping activity of MFC neurons that correlated with behavior. These macro- and micro-level phenomena were linked, as we observed that MFC neurons with strong ramping activity tended to be coherent with stimulus-triggered 4 Hz oscillations, and this relationship was diminished with MFC D1DR blockade. These data provide evidence demonstrating how D1DR signaling controls the temporal organization of mammalian behavior.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive.

Recent Translational Findings on Impulsivity in Relation to Drug Abuse

Impulsive behavior is strongly implicated in drug abuse, as both a cause and a consequence of drug use. To understand how impulsive behaviors lead to and result from drug use, translational evidence from both human and non-human animal studies is needed. Here, we review recent (2009 or later) studies that have investigated two major components of impulsive behavior, inhibitory control and impulsive choice, across preclinical and clinical studies. We concentrate on the stop-signal task as the measure of inhibitory control and delay discounting as the measure of impulsive choice. Consistent with previous reports, recent studies show greater impulsive behavior in drug users compared with non-users. Additionally, new evidence supports the prospective role of impulsive behavior in drug abuse, and has begun to identify the neurobiological mechanisms underlying impulsive behavior. We focus on the commonalities and differences in findings between preclinical and clinical studies, and suggest future directions for translational research.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.