Impulsive action and impulsive choice are mediated by distinct neuropharmacological substrates in rat

Pain Comorbidities with Attention Deficit: A Narrative Review of Clinical and Preclinical Research

A negative correlation exists between attention and pain. The cognitive impairments linked to pain can significantly impede a patient's healing process and everyday tasks, particularly for individuals experiencing persistent pain. Furthermore, it has been demonstrated that diversion can effectively decrease pain levels in individuals. The focus of this review is to analyze clinical trials and fundamental investigations regarding alterations in focus and persistent discomfort. Moreover, we investigated the common neuroanatomy associated with attention and pain. Furthermore, we examined the impact of various neuromodulators on the transmission of pain and processes related to attention, while also considering the potential neural mechanisms that contribute to the co-occurrence of pain and attention deficits. Further investigation in this field will enhance our comprehension of patient symptoms and the underlying pathophysiology, ultimately resulting in more objective approaches to treatment.

Maternal choline supplementation lessens the behavioral dysfunction produced by developmental manganese exposure in a rodent model of ADHD

Studies in children have reported associations between elevated manganese (Mn) exposure and ADHD-related symptoms of inattention, impulsivity/hyperactivity, and psychomotor impairment. Maternal choline supplementation (MCS) during pregnancy/lactation may hold promise as a protective strategy because it has been shown to lessen cognitive dysfunction caused by numerous early insults. Our objectives were to determine whether (1) developmental Mn exposure alters behavioral reactivity/emotion regulation, in addition to impairing learning, attention, impulse control, and sensorimotor function, and (2) MCS protects against these Mn-induced impairments. Pregnant Long-Evans rats were given standard diet, or a diet supplemented with additional choline throughout gestation and lactation (GD 3 - PND 21). Male offspring were exposed orally to 0 or 50 mg Mn/kg/day over PND 1-21. In adulthood, animals were tested in a series of learning, attention, impulse control, and sensorimotor tasks. Mn exposure caused lasting dysfunction in attention, reactivity to errors and reward omission, learning, and sensorimotor function, recapitulating the constellation of symptoms seen in ADHD children. MCS lessened Mn-induced attentional dysfunction and partially normalized reactivity to committing an error or not receiving an expected reward but provided no protection against Mn-induced learning or sensorimotor dysfunction. In the absence of Mn exposure, MCS produces lasting offspring benefits in learning, attention, and reactivity to errors. To conclude, developmental Mn exposure produces a constellation of deficits consistent with ADHD symptomology, and MCS offered some protection against the adverse Mn effects, adding to the evidence that maternal choline supplementation is neuroprotective for offspring and improves offspring cognitive functioning.

Relationship between two forms of impulsivity in mice at baseline and under acute and sub-chronic atomoxetine treatment

RATIONALE

Impulsivity is a symptom of various mental disorders, including attention deficit hyperactivity disorder (ADHD), bipolar disorder, and addiction. Impulsivity is not a unitary construct, but is present in different forms, yet only a few rodent studies have explored the relationship between these forms within individual subjects.

OBJECTIVES

In this study, we compared behaviors representing two impulsivity forms, delay discounting (choice impulsivity) and premature responding (waiting impulsivity), within the same mice.

METHODS

C57BL/6J male mice were concurrently trained and tested in the delay discounting task and the rodent continuous performance test in a counterbalanced design. The effects of the ADHD medication atomoxetine were tested in both tasks, after both acute (0.3-5.0 mg/kg) and sub-chronic (0.3 mg/kg twice daily for seven days) administration.

RESULTS

There was no correlation between the two impulsivity forms at baseline. Acute atomoxetine treatment (1, 3, and 5 mg/kg) significantly reduced premature responding. Furthermore, sub-chronic treatment with 0.3 mg/kg of atomoxetine caused a stable decrease in premature responding. Atomoxetine had no significant effect on delay discounting after acute or sub-chronic administration, although the acute administration of 1 mg/kg showed a trend towards increasing delay discounting.

CONCLUSIONS

The present results support that delay discounting and premature responding represent two different forms of impulsivity that show dissimilar responses to atomoxetine treatment. The consistency with findings in humans lends support to the translatability of the results in mice.

A thalamocortical pathway controlling impulsive behavior

Planning and anticipating motor actions enables movements to be quickly and accurately executed. However, if anticipation is not properly controlled, it can lead to premature impulsive actions. Impulsive behavior is defined as actions that are poorly conceived and are often risky and inappropriate. Historically, impulsive behavior was thought to be primarily controlled by the frontal cortex and basal ganglia. More recently, two additional brain regions, the ventromedial (VM) thalamus and the anterior lateral motor cortex (ALM), have been shown to have an important role in mice. Here, we explore this newly discovered role of the thalamocortical pathway and suggest cellular mechanisms that may be involved in driving the cortical activity that contributes to impulsive behavior.

Methadone maintenance treatment and impulsivity: premature responding

INTRODUCTION

Previous research showed that methadone maintenance treatment (MMT) is linked to impulsivity, with higher impulsivity levels being associated with for example, increased drug use. One aspect of impulsivity, most commonly studied in rodent research, is premature responding, the failure to wait for a starting signal. Premature responding is of high translational significance since it predicts the development of addiction-like behaviors in rodents.

METHODS

We assessed 45 MMT patients and 46 demographically matched (age, sex, education, and handedness) healthy volunteers (HVs) on premature responding alongside action and inhibition of instructed and intentional trials using the Intentional Hand Task (IHT).

RESULTS

The results showed markedly enhanced premature responses in the MMT vs. the HV group, which correlated positively with methadone dosage in the MMT patients. Throughout the task, MMT patients were faster across all trial parts and less accurate in response to instructed trials compared to HVs.

CONCLUSIONS

The increase in premature motor reactions during variable waiting periods alongside increased motion speed and lower accuracy might reflect a specific motor inhibition deficit in MMT, a subcomponent of impulsivity not previously assessed in MMT. Incorporating an experimentally defined measure of impulsivity, such as premature responding, into existing test batteries used by clinicians might enable more tailored treatments addressing the increased impulsivity levels and associated dysfunctional behaviors in MMT.

Reduced attentional lapses in male rats following a combination treatment of low-dose D-serine and atomoxetine

BACKGROUND

Goal-directed attention involves the selective processing of behaviorally relevant sensory information. This selective processing is thought to be supported by glutamatergic and noradrenergic systems. Pharmacotherapies that simultaneously target these systems could therefore be effective treatments for impaired attention.

AIMS

We first tested an N-methyl-D-aspartate (NMDA) receptor co-agonist (D-serine) for effects on attention (processing speed and attentional lapses). NMDA receptor activation is thought to support noradrenergic effects on sensory processing; therefore, we tested a combination treatment comprising D-serine and a norepinephrine reuptake inhibitor (atomoxetine).

METHODS

D-serine was first tested in rats performing a two-choice visuospatial discrimination task. Combination treatments comprising relatively low doses of D-serine and atomoxetine were then tested in a separate group.

RESULTS

In experiment 1, D-serine reduced the skew of initiation time (IT) distributions (IT devmode) at the highest dose tested (300 mg/kg). In experiment 2, low-dose D-serine (125 mg/kg) had no effect, while low-dose atomoxetine (0.3 mg/kg) reduced IT devmode and slowed movement speed. Importantly, the combination of these relatively low doses of D-serine and atomoxetine reduced IT devmode more than either drug alone without further slowing movement speed.

CONCLUSIONS

IT devmode is thought to reflect attentional lapses; therefore, D-serine's effects on IT devmode suggest that NMDA receptors are involved in the preparatory deployment of attention. Greater effects following a combination of D-serine and atomoxetine suggest that preparatory attention can be facilitated by targeting glutamatergic and noradrenergic systems simultaneously. These results could inform the development of improved treatments for individuals with ADHD who experience abnormally high attentional lapses.

Neurocognitive Impulsivity in Opiate Users at Different Lengths of Abstinence

The aim of the current study was to examine the effects of length of abstinence on decision making (impulsive choice) and response inhibition (impulsive action) in former opiate users (OU). Participants included 45 OU in early remission [0−12 months of abstinence], 68 OU in sustained remission [>12 months of abstinence], and 68 control participants. Decision making was assessed with the Iowa Gambling Task (IGT), the Cambridge Gambling Task (CGT), and the Monetary Choice Questionnaire (MCQ). Response inhibition was examined with the Stop Signal Task (SST), and the Go/No-Go Task (GNG). Results revealed group differences in decision making under risk (CGT) and ambiguity (IGT), where control participants displayed better decision making compared to OU in early remission. Both groups of former OU were also characterized by higher discounting of delayed rewards (MCQ). Regression analyses revealed minimal effects of length of abstinence on performance on decision-making tasks and no effects on delay discounting. In addition, both OU groups showed reduced action inhibition (GNG) relative to controls and there were no group differences in action cancellation (SST). Length of abstinence had no effect on response inhibition. Overall, our findings suggest that neurocognitive function may not fully recover even with protracted abstinence, which should be addressed by relapse prevention and cognitive remediation programs for OU.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Theory of visual attention (TVA) applied to rats performing the 5-choice serial reaction time task: differential effects of dopaminergic and noradrenergic manipulations

RATIONALE

Attention is compromised in many psychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). While dopamine and noradrenaline systems have been implicated in ADHD, their exact role in attentional processing is yet unknown.

OBJECTIVES

We applied the theory of visual attention (TVA) model, adapted from human research, to the rat 5-choice serial reaction time task (5CSRTT) to investigate catecholaminergic modulation of visual attentional processing in healthy subjects of high- and low-attention phenotypes.

METHODS

Rats trained on the standard 5CSRTT and tested with variable stimulus durations were treated systemically with noradrenergic and/or dopaminergic agents (atomoxetine, methylphenidate, amphetamine, phenylephrine and atipamezole). TVA modelling was applied to estimate visual processing speed for correct and incorrect visual perceptual categorisations, independent of motor reaction times, as measures of attentional capacity.

RESULTS

Atomoxetine and phenylephrine decreased response frequencies, including premature responses, increased omissions and slowed responding. In contrast, methylphenidate, amphetamine and atipamezole sped up responding and increased premature responses. Visual processing speed was also affected differentially. Atomoxetine and phenylephrine slowed, whereas methylphenidate and atipamezole sped up, visual processing, both for correct and incorrect categorisations. Amphetamine selectively improved visual processing for correct, though not incorrect, responses in high-attention rats only, possibly reflecting improved attention.

CONCLUSIONS

These data indicate that the application of TVA to the 5CSRTT provides an enhanced sensitivity to capturing attentional effects. Unexpectedly, we found overall slowing effects, including impaired visual processing, following drugs either increasing extracellular noradrenaline (atomoxetine) or activating the α1-adrenoceptor (phenylephrine), while also ameliorating premature responses (impulsivity). In contrast, amphetamine had potential pro-attentional effects by enhancing visual processing, probably due to central dopamine upregulation.

Contrasting effects of DOI and lisuride on impulsive decision-making in delay discounting task

RATIONALE

The 5-HT2A receptor is the major target of classic hallucinogens. Both DOI (2,5-dimethoxy-4-iodoamphetamine) and lisuride act at 5-HT2A receptors, and lisuride shares comparable affinity with DOI and acts as a partial agonist at 5-HT2A receptors. However, not like DOI, lisuride lacks hallucinogenic properties. Impulsive decision-making refers to the preference for an immediate small reinforcer (SR) over a delayed large reinforcer (LR).

OBJECTIVES

The current study aims to compare the effects of DOI and lisuride on impulsive decision-making and further to investigate the possible receptor mechanisms responsible for the actions of the two drugs.

METHODS

Impulsive decision-making was evaluated in male Sprague-Dawley rats by the percentage of choice for the LR in delay discounting task (DDT). Delay to the LR changed in an ascending order (0, 4, 8, 16, and 32 s) across one session.

RESULTS

DOI (0.5 and 1.0 mg/kg) increased impulsive decision-making, and the effects of DOI (1.0 mg/kg) were blocked by the 5-HT2A receptor antagonist ketanserin (1.0 mg/kg) rather than the 5-HT2C receptor antagonist SB-242084 (1.0 mg/kg). Contrarily, lisuride (0.1, 0.3, and 0.5 mg/kg) decreased impulsive decision-making. The effects of lisuride (0.3 mg/kg) were not antagonized by ketanserin (1.0 mg/kg), selective 5-HT1A antagonist WAY-100635 (1.0 mg/kg), or selective dopamine D4 receptor antagonist L-745870 (1.0 mg/kg) but were attenuated by the selective dopamine D2/D3 receptor antagonist tiapride (40 mg/kg).

CONCLUSIONS

DOI and lisuride have contrasting effects on impulsive decision-making via distinct receptors. DOI-induced increase of impulsivity is mediated by the 5-HT2A receptor, while lisuride-induced inhibition of impulsivity is regulated by the dopamine D2/D3 receptor.

Impulsivity and risk-seeking as Bayesian inference under dopaminergic control

Bayesian models successfully account for several of dopamine (DA)'s effects on contextual calibration in interval timing and reward estimation. In these models, tonic levels of DA control the precision of stimulus encoding, which is weighed against contextual information when making decisions. When DA levels are high, the animal relies more heavily on the (highly precise) stimulus encoding, whereas when DA levels are low, the context affects decisions more strongly. Here, we extend this idea to intertemporal choice and probability discounting tasks. In intertemporal choice tasks, agents must choose between a small reward delivered soon and a large reward delivered later, whereas in probability discounting tasks, agents must choose between a small reward that is always delivered and a large reward that may be omitted with some probability. Beginning with the principle that animals will seek to maximize their reward rates, we show that the Bayesian model predicts a number of curious empirical findings in both tasks. First, the model predicts that higher DA levels should normally promote selection of the larger/later option, which is often taken to imply that DA decreases 'impulsivity,' and promote selection of the large/risky option, often taken to imply that DA increases 'risk-seeking.' However, if the temporal precision is sufficiently decreased, higher DA levels should have the opposite effect-promoting selection of the smaller/sooner option (higher impulsivity) and the small/safe option (lower risk-seeking). Second, high enough levels of DA can result in preference reversals. Third, selectively decreasing the temporal precision, without manipulating DA, should promote selection of the larger/later and large/risky options. Fourth, when a different post-reward delay is associated with each option, animals will not learn the option-delay contingencies, but this learning can be salvaged when the post-reward delays are made more salient. Finally, the Bayesian model predicts correlations among behavioral phenotypes: Animals that are better timers will also appear less impulsive.

The Effects of Drug Treatments for ADHD in Measures of Cognitive Performance

Based on core symptoms of inattention and deficient impulse control, and the identification of effective pharmacotherapies such as amphetamine (AMP; Adderall^®), methylphenidate (MPH; Ritalin^®), and atomoxetine (ATX; Strattera^®), ADHD is a clinical condition which provides opportunity for translational research. Neuropsychological tests such as the 5-Choice and Continuous Performance Tasks, which measure aspects of attention and impulse control in animals and humans, provide scope for both forward (animal to human) and reverse (human to animal) translation. Rodent studies support pro-attentive effects of AMP and MPH and effectiveness in controlling some forms of impulsive behavior. In contrast, any pro-attentive effects of ATX appear to be less consistent, the most reliable effects of ATX are recorded in tests of impulsivity. These differences may account for AMP and MPH being recognized as first-line treatments for ADHD with a higher efficacy relative to ATX. DSM-5 classifies three "presentations" of ADHD: predominantly inattentive type (ADHD-I), predominantly hyperactive/impulsive type (ADHD-HI), or combined (ADHD-C). Presently, it is unclear whether AMP, MPH, or ATX has differential levels of efficacy across these presentation types. Nonetheless, these studies encourage confidence for the forward translation of NCEs in efforts to identify newer pharmacotherapies for ADHD.

Sex differences in noradrenergic modulation of attention and impulsivity in rats

RATIONALE

Noradrenaline (NE) is closely related to attentive performance and impulsive control. However, the potential sex differences regarding attention and impulsivity under the noradrenergic modulation have been largely neglected. Therefore, our study aimed to investigate whether male and female rats exhibit differential responses to NE-related drugs during the five-choice serial reaction time task (5CSRT).

METHODS

Male and female rats were trained in 5CSRT and administered with different NE drugs after obtaining stable baseline performance: atipamezole, a highly selective α2 receptor antagonist; prazosin, an α1 receptor antagonist; and atomoxetine, a selective NE reuptake inhibitor. Later, prazosin was selected to co-administration with atomoxetine.

RESULTS

Male and female rats exhibited equal learning speed, and no significant baseline differences were found as measured by the 5CSRT. Atomoxetine decreased premature responses in both sexes, but the extent of this reduction was different, with the reduction greater in males. Besides, atomoxetine (1.8 mg/kg) increased the error of omissions in females. The high dose of prazosin (0.5 mg/kg) decreased the accuracy only in male rats, but this was ameliorated by the co-administration with atomoxetine.

CONCLUSIONS

Atomoxetine showed significant improvement in impulsivity, but atomoxetine had less beneficial effects on impulsive control in females than in males, and it even impaired attentional performance in female rats. The α1 receptors were mainly responsible for NE drug-related sex differences in attention rather than impulsivity. The results obtained in this study indicate that the sex differences exist in both attention and impulsivity by the modulation of noradrenaline and raise the concern to improve sex-specific treatments.

Contrasting effects of d-amphetamine and atomoxetine on measures of impulsive action and choice

Amphetamine (AMP) and atomoxetine (ATX) represent two of the most widely studied drug treatments used in the investigation of impulsive behaviour. While both drugs have relatively well defined effects in tests designed to investigate impulsive action (e.g. 5-choice task; 5-CSRTT), the effects of both drugs in tests of impulsive choice (e.g. delay discounting) are less consistent. In the present study both AMP and ATX were tested in a rodent gambling task (rGT) and delay discounting in rats separately trained to either an ascending or descending delay schedule. Effects of both drugs were compared to measures of impulsive action (premature (PREM) responses) and perseverative (PSV) responses measured in the 5-choice and rGT tasks. Consistent with previous studies, AMP (0.1-1 mg/kg) increased both PREM and PSV responses, and ATX (0.5-2 mg/kg) reduced both measures in the 5-choice and rGT tasks. At equivalent doses ATX had no reliable effect on choice behaviour in either the rGT or delay discounting suggesting a null effect of this drug on impulsive choice and risky decision making. The effects of AMP were more complex, with a subtle shift in preference to a low risk (P1) choice in the rGT, and an effect on discounting that was unrelated to reinforcer value, but instead dependent on delay sequence and baseline choice preference. One aspect to these outcomes is to highlight the importance of multiple methodological factors when assessing drug effects on complex behaviours such as impulsive choice, and question what are the most appropriate test conditions under which to examine these drugs on discounting.

Which came first: Cannabis use or deficits in impulse control?

Impulse control deficits are often found to co-occur with substance use disorders (SUDs). On the one hand, it is well known that chronic intake of drugs of abuse remodels the brain with significant consequences for a range of cognitive behaviors. On the other hand, individual variation in impulse control may contribute to differences in susceptibility to SUDs. Both of these relationships have been described, thus leading to a "chicken or the egg" debate which remains to be fully resolved. Does impulsivity precede drug use or does it manifest as a function of problematic drug usage? The link between impulsivity and SUDs has been most strongly established for cocaine and alcohol use disorders using both preclinical models and clinical data. Much less is known about the potential link between impulsivity and cannabis use disorder (CUD) or the directionality of this relationship. The initiation of cannabis use occurs most often during adolescence prior to the brain's maturation, which is recognized as a critical period of development. The long-term effects of chronic cannabis use on the brain and behavior have started to be explored. In this review we will summarize these observations, especially as they pertain to the relationship between impulsivity and CUD, from both a psychological and biological perspective. We will discuss impulsivity as a multi-dimensional construct and attempt to reconcile the results obtained across modalities. Finally, we will discuss possible avenues for future research with emerging longitudinal data.

Effects of Psychopathy on Neurocognitive Domains of Impulsivity in Abstinent Opiate and Stimulant Users

Background: Psychopathy and substance use disorders (SUDs) are both characterized by neurocognitive impairments reflecting higher levels of impulsivity such as reward-driven decision-making and deficient inhibitory control. Previous studies suggest that psychopathy may exacerbate decision-making deficits, but it may be unrelated to other neurocognitive impairments among substance dependent individuals (SDIs). The aim of the present study was to examine the role of psychopathy and its interpersonal-affective and impulsive-antisocial dimensions in moderating the relationships between dependence on different classes of drugs and neurocognitive domains of impulsivity. Method: We tested 693 participants (112 heroin mono-dependent individuals, 71 heroin polysubstance dependent individuals, 115 amphetamine mono-dependent individuals, 76 amphetamine polysubstance dependent individuals, and 319 non-substance dependent control individuals). Participants were administered the Psychopathy Checklist: Screening Version (PCL:SV) and seven neurocognitive tasks measuring impulsive choice/decision-making (Iowa Gambling Task; Cambridge Gambling Task; Kirby Delay Discounting Task; Balloon Analog Risk Task), and impulsive action/response inhibition (Go/No-Go Task, Immediate Memory Task, and Stop Signal Task). Results: A series of hierarchical multiple regressions revealed that the interpersonal-affective dimension of psychopathy moderated the association between decision-making, response inhibition and both amphetamine and heroin dependence, albeit differently. For amphetamine users, low levels of interpersonal-affective traits predicted poor decision-making on the Iowa Gambling Task and better response inhibition on the Stop Signal task. In contrast, in heroin users high interpersonal-affective psychopathy traits predicted lower risk taking on the Cambridge Gambling Task and better response inhibition on the Go/No-Go task. The impulsive-antisocial dimension of psychopathy predicted poor response inhibition in both amphetamine and heroin users. Conclusions: Our findings reveal that psychopathy and its dimensions had both common and unique effects on neurocognitive function in heroin and amphetamine dependent individuals. Our results suggest that the specific interactions between psychopathy dimensions and dependence on different classes of drugs may lead to either deficient or superior decision-making and response inhibition performance in SDIs, suggesting that psychopathy may paradoxically play a protective role for some neurocognitive functions in specific subtypes of substance users.

Using a dependent schedule to measure risky choice in male rats: Effects of d-amphetamine, methylphenidate, and methamphetamine

Risky choice is the tendency to choose a large, uncertain reward over a small, certain reward, and is typically measured with probability discounting, in which the probability of obtaining the large reinforcer decreases across blocks of trials. One caveat to traditional procedures is that independent schedules are used, in which subjects can show exclusive preference for one alternative relative to the other. For example, some rats show exclusive preference for the small, certain reinforcer as soon as delivery of the large reinforcer becomes probabilistic. Therefore, determining if a drug increases risk aversion (i.e., decreases responding for the probabilistic alternative) is difficult (due to floor effects). The overall goal of this experiment was to use a concurrent-chains procedure that incorporated a dependent schedule during the initial link, thus preventing animals from showing exclusive preference for one alternative relative to the other. To determine how pharmacological manipulations alter performance in this task, male Sprague-Dawley rats (n = 8) received injections of amphetamine (0, 0.25, 0.5, 1.0 mg/kg), methylphenidate (0, 0.3, 1.0, 3.0 mg/kg), and methamphetamine (0, 0.5, 1.0, 2.0 mg/kg). Amphetamine (0.25 mg/kg) and methylphenidate (3.0 mg/kg) selectively increased risky choice, whereas higher doses of amphetamine (0.5 and 1.0 kg/mg) and each dose of methamphetamine impaired stimulus control (i.e., flattened the discounting function). These results show that dependent schedules can be used to measure risk-taking behavior and that psychostimulants promote suboptimal choice when this schedule is used. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Effects of 5-HT2C, 5-HT1A receptor challenges and modafinil on the initiation and persistence of gambling behaviours

RATIONALE

Problematic patterns of gambling are characterised by loss of control and persistent gambling often to recover losses. However, little is known about the mechanisms that mediate initial choices to begin gambling and then continue to gamble in the face of losing outcomes.

OBJECTIVES

These experiments first assessed gambling and loss-chasing performance under different win/lose probabilities in C57Bl/6 mice, and then investigated the effects of antagonism of 5-HT_2CR with SB242084, 5-HT_1AR agonism with 8-OH-DPAT and modafinil, a putative cognitive enhancer.

RESULTS

As seen in humans and other species, mice demonstrated the expected patterns of behaviour as the odds for winning were altered increasing gambling and loss-chasing when winning was more likely. SB242084 decreased the likelihood to initially gamble, but had no effects on subsequent gambling choices in the face of repeated losses. In contrast, 8-OH-DPAT had no effects on choosing to gamble in the first place, but once started 8-OH-DPAT increased gambling choices in a dose-sensitive manner. Modafinil effects were different to the serotonergic drugs in both decreasing the propensity to initiate gambling and chase losses.

CONCLUSIONS

We present evidence for dissociable effects of systemic drug administration on different aspects of gambling behaviour. These data extend and reinforce the importance of serotonergic mechanisms in mediating discrete components of gambling behaviour. They further demonstrate the ability of modafinil to reduce gambling behaviour. Our work using a novel mouse paradigm may be of utility in modelling the complex psychological and neurobiological underpinnings of gambling problems, including the analysis of genetic and environmental factors.

The use of reaction time distributions to study attention in male rats: the effects of atomoxetine and guanfacine

RATIONALE

Norepinephrine (NE) is involved in the control of sustained attention. Studies of sustained attention in humans include measures of reaction time (RT) and RT variability (RTV). The present study tested the role of NE using components of the RT distribution in rats in a manner thought to be similar to human studies of RTV.

OBJECTIVES

This study tested the effects of increased synaptic NE (atomoxetine (ATX)) and α-2 receptor binding (guanfacine) on attentional lapses in rats.

METHODS

Male Sprague-Dawley rats (n = 20) were trained and tested in a two-choice RT task (2CRTT). Atomoxetine dose (saline, 0.1, 0.5, 1.0 mg/kg, i.p.), guanfacine dose (saline, 0.01, 0.1, 0.3 mg/kg, i.p.), and distractors were manipulated in three experiments. RT was divided into initiation time (IT) and movement time (MT). Analyses of distribution mode (peak) and deviation from the mode (skew) were then performed.

RESULTS

ATX and guanfacine had no effect on IT mode, reduced IT devmode, and increased MT mode. When distractors were introduced, ATX again improved devmode, but a lack of interaction between ATX and distractor indicated that ATX did not prevent distractor-induced impairments.

CONCLUSIONS

IT devmode is a measure of distribution skew thought to reflect lapses of attention. The effects of ATX on IT devmode suggest that increased synaptic NE reduces attentional lapses. These findings are consistent with human reports of reduced RTV after ATX administration. The same pattern of results with guanfacine suggests that the effects of increased NE are due in part to binding at α-2 noradrenergic receptors.

The effect of 5-HT1A receptor antagonist on reward-based decision-making

When choosing the best action from several alternatives, we compare each value that depends on the balance between benefit and cost. Previous studies have shown that animals and humans with low brain serotonin (5-HT) level tend to choose smaller immediate reward. We used a decision-making schedule task to investigate whether 5-HT1A receptor is responsible for the decisions related to reward. In this task, the monkeys chose either of two different alternatives that were comprised of 1-4 drops of liquid reward (benefit) and 1-4 repeats of a color discrimination trial (workload cost), then executed the chosen schedule. By the administration of 5-HT1A antagonist, WAY100635, the choice tendency did not change, however, the sensitivity to the amount of reward in the schedule part was diminished. The 5-HT1A could have a role in maintaining reward value to keep track with the promised reward rather than modulating workload discounting of reward value.

Resting state oscillations suggest a motor component of Parkinson's Impulse Control Disorders

OBJECTIVES

Impulse control disorders (ICDs) in Parkinson's disease (PD) have been associated with cognitive impulsivity and dopaminergic dysfunction and treatment. The present study tests the neglected hypothesis that the neurofunctional networks involved in motor impulsivity might also be dysfunctional in PD-ICDs.

METHODS

We performed blind spectral analyses of resting state electroencephalographic (EEG) data in PD patients with and without ICDs to probe the functional integrity of all cortical networks. Analyses were performed directly at the source level after blind source separation. Discrete differences between groups were tested by comparing patients with and without ICDs. Gradual dysfunctions were assessed by means of correlations between power changes and clinical scores reflecting ICD severity (QUIP score).

RESULTS

Spectral signatures of ICDs were found in the medial prefrontal cortex, the dorsal anterior cingulate and the supplementary motor area, in the beta and gamma bands. Beta power changes in the supplementary motor area were found to predict ICDs severity.

CONCLUSION

ICDs are associated with abnormal activity within frequency bands and cortical circuits supporting the control of motor response inhibition.

SIGNIFICANCE

These results bring to the forefront the need to consider, in addition to the classical interpretation based on aberrant mesocorticolimbic reward processing, the issue of motor impulsivity in PD-ICDs and its potential implications for PD therapy.

Examining the neurochemical underpinnings of animal models of risky choice: Methodological and analytic considerations

Because risky choice is associated with several psychiatric conditions, recent research has focused on examining the underlying neurochemical processes that control risk-based decision-making. Not surprisingly, several tasks have been developed to study the neural mechanisms involved in risky choice. The current review will briefly discuss the major tasks used to measure risky choice and will summarize the contribution of several major neurotransmitter systems to this behavior. To date, the most common measures of risky choice are the probability discounting task, the risky decision task, and the rat gambling task. Across these three tasks, the contribution of the dopaminergic system has been most studied, although the effects of serotonergic, adrenergic, cholinergic, and glutamatergic ligands will be discussed. Drug effects across these tasks have been inconsistent, which makes determining the precise role of neurotransmitter systems in risky choice somewhat difficult. Furthermore, procedural differences can modulate drug effects in these procedures, and the way data are analyzed can alter the interpretations one makes concerning pharmacological manipulations. By taking these methodological/analytic considerations into account, we may better elucidate the neurochemistry of risky decision-making. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Time preferences are reliable across time-horizons and verbal versus experiential tasks

Individual differences in delay-discounting correlate with important real world outcomes, for example education, income, drug use, and criminality. As such, delay-discounting has been extensively studied by economists, psychologists and neuroscientists to reveal its behavioral and biological mechanisms in both human and non-human animal models. However, two major methodological differences hinder comparing results across species. Human studies present long time-horizon options verbally, whereas animal studies employ experiential cues and short delays. To bridge these divides, we developed a novel language-free experiential task inspired by animal decision-making studies. We found that the ranks of subjects' time-preferences were reliable across both verbal/experiential and second/day differences. Yet, discount factors scaled dramatically across the tasks, indicating a strong effect of temporal context. Taken together, this indicates that individuals have a stable, but context-dependent, time-preference that can be reliably assessed using different methods, providing a foundation to bridge studies of time-preferences across species.

Editorial note

This article has been through an editorial process in which the authors decide how to respond to the issues raised during peer review. The Reviewing Editor's assessment is that all the issues have been addressed (see decision letter).

Functional imaging studies of Impulse Control Disorders in Parkinson's disease need a stronger neurocognitive footing

Impulse control disorders (ICDs) in Parkinson's disease (PD) are associated with dopaminergic dysfunction and treatment, but have no satisfactory therapeutic solution. While studies assessing the neurofunctional bases of ICDs are important for advancing our understanding and management of ICDs, they remain sparse and inconsistent. Based on a systematic analysis of the neuroimaging literature, the present review pinpoints various abnormalities beyond the mesocorticolimbic circuit that supports reward processing, suggesting possible dysfunction at the sensorimotor, executive and affective levels. We advocate that: 1) Future studies should use more sophisticated psychological models and behavioral designs that take into account the potentially multifaceted aspect of ICDs; this would allow a more accurate assessment of the underlying neurocognitive processes, which are not all dependent on the dopaminergic system. 2) Future neuroimaging studies should rely more strongly on task-based, event-related analyses to disentangle the various mechanisms that can be dysfunctional in ICDs. We believe these guidelines constitute a prerequisite towards distinguishing causes, correlates and individual susceptibility factors of PD patients with ICDs.

Executive (dys)function after stroke: special considerations for behavioral pharmacology

Stroke is a worldwide leading cause of death and long-term disability with concurrent secondary consequences that are largely comprised of mood dysfunction, as well as sensory, motor, and cognitive deficits. This review focuses on the cognitive deficits associated with stroke specific to executive dysfunction (including decision making, working memory, and cognitive flexibility) in humans, nonhuman primates, and additional animal models. Further, we review some of the cellular and molecular underpinnings of the individual components of executive dysfunction and their neuroanatomical substrates after stroke, with an emphasis on the changes that occur during biogenic monoamine neurotransmission. We concentrate primarily on changes in the catecholaminergic (dopaminergic and noradrenergic) and serotonergic systems at the levels of neurotransmitter synthesis, distribution, reuptake, and degradation. We also discuss potential secondary stroke-related behavioral deficits (specifically, poststroke depression as well as drug-abuse potential and addiction) and their relationship with stroke-induced deficits in executive function, an especially important consideration given that the average age of the human stroke population is decreasing. In the final sections, we address pharmacological considerations for the treatment of ischemia and the subsequent functional impairment, as well as current limitations in the field of stroke and executive function research.

The putative lithium-mimetic ebselen reduces impulsivity in rodent models

BACKGROUND

Deficits in impulse control feature in many psychiatric conditions including bipolar disorder, suicidality and addictions. Lithium lowers impulsivity in clinical populations and decreases pathological gambling in experimental medicine studies, but suffers from adverse effects, poor compliance and a low therapeutic index.

AIMS

Recently we identified that the neuroprotective agent ebselen, which is reportedly safe in humans, inhibited inositol monophosphatase (IMPase), a candidate lithium mechanism. Ebselen also reduced 5-HT receptor (5-HT_2A) function which predicts impulsivity lowering properties. Here we investigated the effect of ebselen in rat models of impulsive behaviour.

METHODS

Ebselen was tested in two models of impulsivity with human analogues: the five-choice serial reaction time task (5-CSRTT) and rodent gambling task (rGT). The main outcome measures were premature responses (5-CSRTT and rGT) and choice behaviour (rGT), which model motor impulsivity and choice impulsivity, respectively.

RESULTS

At doses that decreased 5-HT_2A receptor function (DOI-induced wet dog shakes), ebselen decreased premature responding in the 5-CSRTT both in the absence and presence of cocaine. The 5-HT_2A receptor antagonist MDL 100,907 also reduced premature responding in the 5-CSRTT although not in the presence of cocaine. In the rGT ebselen showed a tendency to reduce premature responding but had no effect on choice behaviour.

CONCLUSIONS

These findings suggest that ebselen preferentially reduces motor impulsivity over choice impulsivity, and that inhibition of 5-HT_2A receptor function is a contributing mechanism. Collectively, these data support the repurposing of ebselen as an anti-impulsive treatment and fast-tracking to clinical trials in patient groups characterised by poor impulse control.

5-HT3 antagonists decrease discounting rate without affecting sensitivity to reward magnitude in the delay discounting task in mice

RATIONALE

Impulsive choice has often been evaluated in rodents according to the proportion of choices for the delayed large magnitude reinforcer (%large choice) in a delay-discounting task (DDT). However, because %large choice is influenced by both sensitivity to reinforcer magnitude and sensitivity to delayed reinforcement (i.e., discounting rate), distinctively evaluating such discounting parameters represents a critical issue demanding methods to determine each parameter in rats. The serotonin (5-HT) system is well known to be involved in impulsive choice; nevertheless, only a few studies have distinguished discounting parameters and investigated how 5-HT modulators affect discounting rate.

OBJECTIVE

Here, we performed a discounting parameter analysis in mice and examined the effects of various 5-HT modulators on discounting rate.

METHODS

We set up DDTs with different delay schedules to determine which schedule could address delay-discounting rates in mice. We examined the effect of the following drugs on impulsive choice: a 5-HT reuptake inhibitor (paroxetine), a 5-HT_1A receptor agonist (8-OH-DPAT), and two 5-HT₃ receptor antagonists (granisetron and ondansetron).

RESULTS

Mice showed typical delay discounting at the shorter delay schedules (up to 4 s delay). The %large choice under shorter, but not longer, schedules followed an exponential function and allowed us to derive discounting rates. We selected a DDT with a 4-s delay schedule for further experiments. Granisetron and ondansetron, but not paroxetine or 8-OH-DPAT, decreased discounting rates without affecting sensitivity to reinforcer magnitude.

CONCLUSION

We found that a method to calculate discounting rates in rats is also applicable to mouse models. We also provided evidence that 5-HT₃ antagonism controls impulsive choice in mice.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Impulsive Action and Impulsive Choice Are Differentially Expressed in Rats Depending on the Age at Exposure to a Gambling Task

Impulsivity is considered an important feature associated with the development of numerous psychiatric disorders, including addictions. In the behavioral approach, impulsivity can be broadly divided into two distinct subtypes: impulsive action and choice. In the present study, we used a rodent version of the gambling task (rGT) to examine how impulsive action and impulsive choice are differentially influenced by difference in age at exposure (i.e., late adolescents/young adults vs. mature adults) to rGT. Rats were trained in a touch-screen chamber to learn the relationships between 4 light signals on the window of the screen and accompanying reward outcomes or punishments associated with different magnitudes and probabilities. Depending on their stabilized pattern of preference when allowed free choice, rats were categorized into risk-averse or risk-seeking group. While undergoing a series of experimental schemes, including extinction, re-acquisition, and acute cocaine injection, rats were re-tested for their premature response during inter-trial interval and choice preference toward the 4 different windows in rGT. Notably, rats exposed early, compared with those exposed late, to rGT showed increased impulsive action, particularly during re-acquisition period, in all sub-groups. In contrast, rats exposed late, compared with those exposed early, to rGT showed increased impulsive choice after acute cocaine injection, but these results were only obtained in a sub-group pre-categorized as high impulsive and risk-averse. These results suggest that different aspects of impulsivity can be differentially expressed during decision-making, and differentially influenced by the age at exposure to a gambling task.

Comparison of some behavioral effects of d- and l-methamphetamine in adult male rats

RATIONALE

Both l- and d-methamphetamine (l- and d-MA) are more potent to release norpepinephrine (NE) than dopamine, and the selectivity is greater for l-MA than d-MA. Little is known of the in vivo pharmacology of l-MA.

OBJECTIVE

This study compared the effects of l-MA and d-MA in assays of nociception, behavioral disruption, and impulsivity.

METHODS

Antinociceptive effects of d- and l-MA were examined in two pain assays: the warm water tail withdrawal test for acute nociception and the von Frey test in complete Freund's adjuvant (CFA)-treated rats for chronic inflammatory pain. Food-maintained operant responding and locomotion tests were used to assess generalized behavioral disruption. The 5-choice serial reaction time test (5-CSRTT) was used to assess drug-induced effects on impulse control. A delay discounting procedure was used to determine drug-induced changes in sensitivity to reinforcer delay (impulsive choice).

RESULTS

l-MA (3.2-10 mg/kg) produced dose-dependent antinociception in both pain assays, decreased the rate of food-maintained operant responding, and decreased locomotor activity at a higher dose (17.8 mg/kg). In contrast, d-MA (0.32-3.2 mg/kg) did not produce antinociception in either assay, produced biphasic effects on response rate, and increased locomotor activity. In the 5-CSRTT, d-MA but not l-MA produced significant increase in premature responses. In the delay discounting procedure, both drugs did not affect the delay function at doses that did not increase omissions.

CONCLUSIONS

These data suggest that d- and l-MA have different behavioral profiles. Consideration should be given to these differences in future studies when l-MA is proposed for potential therapies.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Effects of methylphenidate on attention in Wistar rats treated with the neurotoxin N-(2-chloroethyl)-N-ethyl-2-bromobenzylamine (DSP4)

The aim of this study was to assess the effects of the neurotoxin N-(2-chloroethyl)-N-ethyl-2-bromobenzylamine (DSP4) on attention in rats as measured using the 5-choice-serial-reaction-time task (5CSRTT) and to investigate whether methylphenidate has effects on DSP4-treated rats. Methylphenidate is a noradrenaline and dopamine reuptake inhibitor and commonly used in the pharmacological treatment of individuals with attention deficit/hyperactivity disorder (ADHD). Wistar rats were trained in the 5CSRTT and treated with one of three doses of DSP4 or saline. Following the DSP4 treatment rats were injected with three doses of methylphenidate or saline and again tested in the 5CSRTT. The treatment with DSP4 caused a significant decline of performance in the number of correct responses and a decrease in response accuracy. A reduction in activity could also be observed. Whether or not the cognitive impairments are due to attention deficits or changes in explorative behaviour or activity remains to be investigated. The treatment with methylphenidate had no beneficial effect on the rats' performance regardless of the DSP4 treatment. In the group without DSP4 treatment, methylphenidate led to a reduction in response accuracy and bidirectional effects in regard to parameters related to attention. These findings support the role of noradrenaline in modulating attention and call for further investigations concerning the effects of methylphenidate on attentional processes in rats.

Pharmacologically distinct pramipexole-mediated akinesia vs. risk-taking in a rat model of Parkinson's disease

Pramipexole and ropinirole are dopamine agonists that are efficacious in treating motor disturbances of neuropathologies, e.g., Parkinson's disease and restless legs syndrome. A significant portion of treated patients develop impulsive/compulsive behaviors. Current treatment is dose reduction or switching to an alternative dopamine replacement, both of which can undermine the motor benefits. Needed is a preclinical model that can assist in identifying adjunct treatments to dopamine agonist therapy that reduce impulsive/compulsive behaviors without interfering with motor benefits of the dopamine agonist. Toward that objective, the current study implemented a rat model of Parkinson's disease to behaviorally profile chronically administered pramipexole. This was accomplished with male Sprague-Dawley rats wherein (i) 6-hydroxydopamine-induced lesions of the dorsolateral striatum produced Parkinson's disease-like akinesia, measured in the forelimbs, (ii) intracranial self-stimulation-mediated probability discounting indicated impulsivity/risk-taking, and (iii) two doses of pramipexole were continuously administered for 14-28days via osmotic minipumps to mirror the chronic, stable exposure achieved with extended release formulations. The atypical antidepressant, mirtazapine, is known to reduce behaviors associated with drug addiction in rats; thus, we demonstrated model utility here by determining the effects of mirtazapine on pramipexole-induced motor improvements versus probability discounting. We observed that forelimb akinesia subsequent to striatal lesions was attenuated by both pramipexole doses tested (0.3 and 1.2mg/kg/day) within 4h of pump implant dispensing 0.3mg/kg/day and 1h by 1.2mg/kg/day. By contrast, 12-14days of infusion with 0.3mg/kg/day did not alter discounting, but increases were obtained with 1.2mg/kg/day pramipexole, with 67% of 1.2mg/kg/day-treated rats meeting categorical criteria for 'high risk-taking'. Insertion of a second minipump delivering mirtazapine did not alter motor function during 14days of co-administration with pramipexole, but was sufficient to attenuate risk-taking. These outcomes revealed distinct probability discounting and anti-akinesia profiles for pramipexole, indicating that pharmacotherapy, (e.g., mirtazapine treatments), can be developed that reduce risk-taking while leaving motor benefits intact.

Sex differences in the reduction of impulsive choice (delay discounting) for cocaine in rats with atomoxetine and progesterone

RATIONALE

Impulsive choice, or an inability to delay immediate gratification, has been strongly linked to the development and persistence of drug abuse. Indeed, delaying drug use itself may underlie drug addiction and relapse. Thus, employing treatments that are efficacious in reducing impulsive choice (atomoxetine; ATO) or drug-seeking behavior (progesterone; PRO) may be an effective means of treating drug addiction.

OBJECTIVE

The current study assessed sex differences in the effects of PRO, ATO, and their combination in a delay discounting paradigm for cocaine and for sucrose pellets.

METHOD

Male and female rats chose between a small-immediate or a large-delayed (0, 7.5, 15, 30, 60 s) outcome in an impulsive choice procedure for sucrose pellets (1 vs. 3 pellets) or for iv cocaine infusions (0.3 vs. 0.9 mg/kg). Following baseline assessment of impulsive choice, rats received daily treatment of vehicle (VEH), PRO (0.5 mg/kg), ATO (1.5 mg/kg), or a combination (PRO + ATO) until a second assessment of impulsive choice was determined.

RESULTS

Compared to the VEH group, females were less impulsive for cocaine following PRO or the PRO + ATO combined treatment, whereas males were less impulsive for cocaine following ATO. No treatment effects were observed on impulsive choice for sucrose pellets.

CONCLUSIONS

The present results indicate that impulsive choice for cocaine is reduced by PRO in females and by ATO in males. These findings suggest both treatments may be an effective intervention in treating cocaine abuse, but that their effectiveness differs by sex.

Short- and long-run goals in ultimatum bargaining: impatience predicts spite-based behavior

The ultimatum game (UG) is widely used to study human bargaining behavior and fairness norms. In this game, two players have to agree on how to split a sum of money. The proposer makes an offer, which the responder can accept or reject. If the responder rejects, neither player gets anything. The prevailing view is that, beyond self-interest, the desire to equalize both players’ payoffs (i.e., fairness) is the crucial motivation in the UG. Based on this view, previous research suggests that fairness is a short-run oriented motive that conflicts with the long-run goal of self-interest. However, competitive spite, which reflects an antisocial (not norm-based) desire to minimize others’ payoffs, can also account for the behavior observed in the UG, and has been linked to short-run, present-oriented aspirations as well. In this paper, we explore the relationship between individuals’ intertemporal preferences and their behavior in a citywide dual-role UG experiment (N = 713). We find that impatience (short-run orientation) predicts the rejection of low, “unfair” offers as responder and the proposal of low, “unfair” offers as proposer, which is consistent with spitefulness but inconsistent with fairness motivations. This behavior systematically reduces the payoffs of those who interact with impatient individuals. Thus, impatient individuals appear to be keen to minimize their partners’ share of the pie, even at the risk of destroying it. These findings indicate that competitively reducing other’s payoffs, rather than fairness (or self-interest), is the short-run goal in ultimatum bargaining.

Therapeutic Potential of 5-HT2C Receptor Agonists for Addictive Disorders

The neurotransmitter 5-hydroxytryptamine (5-HT; serotonin) has long been associated with the control of a variety of motivated behaviors, including feeding. Much of the evidence linking 5-HT and feeding behavior was obtained from studies of the effects of the 5-HT releaser (dex)fenfluramine in laboratory animals and humans. Recently, the selective 5-HT2C receptor agonist lorcaserin received FDA approval for the treatment of obesity. This review examines evidence to support the use of selective 5-HT2C receptor agonists as treatments for conditions beyond obesity, including substance abuse (particularly nicotine, psychostimulant, and alcohol dependence), obsessive compulsive, and excessive gambling disorder. Following a brief survey of the early literature supporting a role for 5-HT in modulating food and drug reinforcement, we propose that intrinsic differences between SSRI and serotonin releasers may have underestimated the value of serotonin-based pharmacotherapeutics to treat clinical forms of addictive behavior beyond obesity. We then highlight the critical involvement of the 5-HT2C receptor in mediating the effect of (dex)fenfluramine on feeding and body weight gain and the evidence that 5-HT2C receptor agonists reduce measures of drug reward and impulsivity. A recent report of lorcaserin efficacy in a smoking cessation trial further strengthens the idea that 5-HT2C receptor agonists may have potential as a treatment for addiction. This review was prepared as a contribution to the proceedings of the 11th International Society for Serotonin Research Meeting held in Hermanus, South Africa, July 9-12, 2014.

Waiting Impulsivity: The Influence of Acute Methylphenidate and Feedback

BACKGROUND

The ability to wait and to weigh evidence is critical to behavioral regulation. These behaviors are known as waiting and reflection impulsivity. In Study 1, we examined the effects of methylphenidate, a dopamine and norepinephrine reuptake inhibitor, on waiting and reflection impulsivity in healthy young individuals. In study 2, we assessed the role of learning from feedback in disorders of addiction.

METHODS

We used the recently developed 4-Choice Serial Reaction Time task and the Beads task. Twenty-eight healthy volunteers were tested twice in a randomized, double-blind, placebo-controlled cross-over trial with 20mg methylphenidate. In the second study, we analyzed premature responses as a function of prior feedback in disorders of addiction.

RESULTS

Study 1: Methylphenidate was associated with greater waiting impulsivity to a cue predicting reward along with faster responding to target onset without a generalized effect on reaction time or attention. Methylphenidate influenced reflection impulsivity based on baseline impulsivity. Study 2: More premature responses occurred after premature responses in stimulant-dependent subjects.

CONCLUSIONS

We show that methylphenidate has dissociable effects on waiting and reflection impulsivity. Chronic stimulant exposure impairs learning from prior premature responses, suggesting a failure to learn that premature responding is suboptimal. These findings provide a greater mechanistic understanding of waiting impulsivity.

Effects of the selective 5-HT7 receptor antagonist SB-269970 on premature responding in the five-choice serial reaction time test in rats

The antagonists of serotonin 5-HT7 receptors have been demonstrated to ameliorate cognitive impairments in pharmacological animal models of schizophrenia that involve blockade of N-methyl-D-aspartate receptors (NMDARs). The administration of NMDAR antagonists evokes a broad range of cognitive deficits, including a loss of impulse control. The involvement of 5-HT7 receptors in the modulation of impulsivity has been recently suggested but has not been studied in great detail. The aim of the present study was to examine the effect of a selective 5-HT7 receptor antagonist SB-269970 on a measure of impulsive action, i.e., premature responding on the five-choice serial reaction time task (5-CSRTT) in rats. The antagonist of 5-HT2A receptor M100,907 was used as a positive control. The efficacies of both compounds were assessed in conditions of increased impulsivity that were produced by the administration of the NMDAR antagonist MK-801 or/and non-drug stimuli, i.e., using variable inter-trial intervals (vITIs). To examine the general ability of SB-269970 to counteract the MK-801-induced impairments, a discrete paired-trial delayed alternation task in a T-maze was employed. MK-801 significantly increased the number of premature responses in 5-CSRTT, and this effect was abolished by the administration of M100,907 (0.5 mg/kg) and SB-269970 (1 mg/kg). In addition, M100,907, but not SB-269970, reduced premature responding in the prolonged ITI trials. Both M100,907 and SB-269970 attenuated MK-801-induced working memory impairment in a T-maze. The present study demonstrated the efficacy of SB-269970 against MK-801-induced premature responding in the 5-CSRTT. This anti-impulsive action may offer additional benefits to the cognitive-enhancing effects of pharmacological blockade of 5-HT7 receptors.

Putative therapeutic targets for symptom subtypes of adult ADHD: D4 receptor agonism and COMT inhibition improve attention and response inhibition in a novel translational animal model

Prefrontal cortical dopamine plays an important role in cognitive control, specifically in attention and response inhibition; the core deficits in ADHD. We have previously shown that methylphenidate and atomoxetine differentially improve these deficits dependent on baseline performance. The present study extends this work to investigate the effects of putative therapeutic targets in our model. A selective dopamine D4 receptor agonist (A-412997) and the catechol-O-methyl-transferase (COMT) inhibitor; tolcapone, were investigated in the combined subtype of adult ADHD (ADHD-C). Adult female rats were trained to criterion in the 5C-CPT (5-Choice Continuous Performance Task) and then separated into subgroups according to baseline levels of sustained attention, vigilance, and response disinhibition. The subgroups included: high-attentive (HA) and low-attentive with high response disinhibition (ADHD-C). The ADHD-C subgroup was selected to represent the combined subtype of adult ADHD. Effects of tolcapone (3.0, 10.0, 15.0mg/kg) and A-412997 (0.1, 0.3, 1.0µmol/kg) were tested by increasing the variable inter-trial-interval (ITI) duration in the 5C-CPT. Tolcapone (15mg/kg) significantly increased sustained attention, vigilance and response inhibition in ADHD-C animals, and impaired attention in HA animals. A-412997 (1.0µmol/kg) significantly increased vigilance and response inhibition in ADHD-C animals only, with no effect in HA animals. This is the first study to use the translational 5C-CPT to model the adult ADHD-C subtype in rats and to study new targets in this model. Both tolcapone and A-412997 increased vigilance and response inhibition in the ADHD-C subgroup. D4 and COMT are emerging as important potential therapeutic targets in adult ADHD that warrant further investigation.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive.

Impulsive action and impulsive choice across substance and behavioral addictions: cause or consequence?

Substance use disorders are prevalent and debilitating. Certain behavioral syndromes ('behavioral addictions') characterized by repetitive habits, such as gambling disorder, stealing, shopping, and compulsive internet use, may share clinical, co-morbid, and neurobiological parallels with substance addictions. This review considers overlap between substance and behavioral addictions with a particular focus on impulsive action (inability to inhibit motor responses), and impulsive choice (preference for immediate smaller rewards to the detriment of long-term outcomes). We find that acute consumption of drugs with abuse potential is capable of modulating impulsive choice and action, although magnitude and direction of effect appear contingent on baseline function. Many lines of evidence, including findings from meta-analyses, show an association between chronic drug use and elevated impulsive choice and action. In some instances, elevated impulsive choice and action have been found to predate the development of substance use disorders, perhaps signifying their candidacy as objective vulnerability markers. Research in behavioral addictions is preliminary, and has mostly focused on impulsive action, finding this to be elevated versus controls, similar to that seen in chronic substance use disorders. Only a handful of imaging studies has explored the neural correlates of impulsive action and choice across these disorders. Key areas for future research are highlighted along with potential implications in terms of neurobiological models and treatment. In particular, future work should further explore whether the cognitive deficits identified are state or trait in nature: i.e. are evident before addiction perhaps signaling risk; or are a consequence of repetitive engagement in habitual behavior; and effects of novel agents known to modulate these cognitive abilities on various addictive disorders.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.

Using the five-choice serial reaction time task to examine the effects of atomoxetine and methylphenidate in the male spontaneously hypertensive rat

Attention deficit hyperactivity disorder (ADHD) is the most common neurodevelopmental disorder and is normally treated with either stimulant or non-stimulant medication such as methylphenidate and atomoxetine respectively. The impact of these drugs on attention and impulsivity has been explored extensively in healthy animals but there is little research into their effects in an animal model of ADHD. In the present study we investigated the effects of both drugs on the spontaneously hypertensive rat (SHR) model of ADHD using the five-choice serial reaction time task (5CSRTT). We found a number of difficulties associated with training this vulnerable strain on such a complex task. However, where rats were able to learn the task we found very small effects of methylphenidate; increased incorrect responding and therefore decreased accuracy, a marker of attention at a single dose. There were no significant effects of atomoxetine on accuracy once multiple comparisons were taken into consideration. We found no effects of either drug on premature responding, a marker of impulsivity. These results indicate that the 5CSRTT may not be most sensitive to the impulsivity displayed in the SHR. Furthermore, they suggest that the SHR may lack predictive validity and further investigation is needed to optimise use of this model.

Serotonin depletion induces 'waiting impulsivity' on the human four-choice serial reaction time task: cross-species translational significance

Convergent results from animal and human studies suggest that reducing serotonin neurotransmission promotes impulsive behavior. Here, serotonin depletion was induced by the dietary tryptophan depletion procedure (TD) in healthy volunteers to examine the role of serotonin in impulsive action and impulsive choice. We used a novel translational analog of a rodent 5-choice serial reaction time task (5-CSRTT)-- the human 4-CSRTT--and a reward delay-discounting questionnaire to measure effects on these different forms of 'waiting impulsivity'. There was no effect of TD on impulsive choice as indexed by the reward delay-discounting questionnaire. However, TD significantly increased 4-CSRTT premature responses (or impulsive action), which is remarkably similar to the previous findings of effect of serotonin depletion on rodent 5-CSRTT performance. Moreover, the increased premature responding in TD correlated significantly with individual differences on the motor impulsivity subscale of the Barratt Impulsivity Scale. TD also improved the accuracy of performance and speeded responding, possibly indicating enhanced attention and reward processing. The results suggest: (i) the 4-CSRTT will be a valuable addition to the tests already available to measure impulsivity in humans in a direct translational analog of a test extensively used in rodents; (ii) TD in humans produces a qualitatively similar profile of effects to those in rodents (ie, enhancing premature responding), hence supporting the conclusion that TD in humans exerts at least some of its effects on central serotonin; and (iii) this manipulation of serotonin produces dissociable effects on different measures of impulsivity, suggesting considerable specificity in its modulatory role.

Methylphenidate and impulsivity: a comparison of effects of methylphenidate enantiomers on delay discounting in rats

RATIONALE

Current formulations of methylphenidate (MPH) used in treatment of attention-deficit/hyperactivity disorder (ADHD) result in significantly different bioavailability of MPH enantiomers. Daytrana®, a dl-MPH transdermal patch system, produces higher levels of l-MPH than when dl-MPH is administered orally (e.g., Ritalin®). One potential limitation of increased l-MPH was indicated in a preclinical study showing l-MPH may attenuate effects of d-MPH.

OBJECTIVES

The objective of the study was to investigate the interactive effects of MPH enantiomers by (1) assessing drug effects via a preclinical model of "impulsivity" and (2) performing a quantitative dose equivalence analysis of MPH enantiomer interactions.

METHODS

Sprague-Dawley rats were trained to emit either of two responses, one producing an immediate food pellet, the other producing four pellets delivered at increasing delays (0, 8, and 32 s). The percent selection of the larger food amount was graphed as a function of delay with the area under the curve (AUC) assessed. Increases in AUC are consistent with decreases in "impulsivity" (i.e., selection of the smaller, immediate over the larger, delayed reinforcer).

RESULTS

Systemic administration of dl-MPH and d-MPH dose-dependently increased AUC, while l-MPH, morphine, and pentobarbital did not alter AUC. An analysis based upon dose equivalence indicated that dl-MPH produced additive effects that were not different from that predicted from effects of the enantiomers administered alone.

CONCLUSIONS

The present results indicate pharmacologically selective effects in that only drugs prescribed for the treatment of ADHD symptoms decreased a measure of "impulsivity" and that l-MPH likely does not attenuate or enhance the effects of d-MPH in the current delay-discounting task.

A novel translational assay of response inhibition and impulsivity: effects of prefrontal cortex lesions, drugs used in ADHD, and serotonin 2C receptor antagonism

Animal models are making an increasing contribution to our understanding of the psychology and brain mechanisms underlying behavioral inhibition and impulsivity. The aim here was to develop, for the first time, a mouse analog of the stop-signal reaction time task with high translational validity in order to be able to exploit this species in genetic and molecular investigations of impulsive behaviors. Cohorts of mice were trained to nose-poke to presentations of visual stimuli. Control of responding was manipulated by altering the onset of an auditory 'stop-signal' during the go response. The anticipated systematic changes in action cancellation were observed as stopping was made more difficult by placing the stop-signal closer to the execution of the action. Excitotoxic lesions of medial prefrontal cortex resulted in impaired stopping, while the clinically effective drugs methylphenidate and atomoxetine enhanced stopping abilities. The specific 5-HT2C receptor antagonist SB242084 also led to enhanced response control in this task. We conclude that stop-signal reaction time task performance can be successfully modeled in mice and is sensitive to prefrontal cortex dysfunction and drug treatments in a qualitatively similar manner to humans and previous rat models. Additionally, using this model we show novel and highly discrete effects of 5-HT2C receptor antagonism that suggest manipulation of 5-HT2C receptor function may be of use in correcting maladaptive impulsive behaviors and provide further evidence for dissociable contributions of serotonergic transmission to response control.