The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Dissociation between binge eating behavior and incentive motivation

Binge-like eating behavior (BLE) has been characterized as an eating disorder in which subjects have an enhanced intake of food, mainly fats. However, intake of fats and carbohydrates may have differential effects on motivation. Previously it was shown that BLE produces an increase in operant responding for vegetable shortening. Our aim was to determine if BLE behavior induced with a sucrose solution would produce an increment in performance for sucrose reinforcers. Male Wistar rats were trained under an exponential progressive ratio schedule of sucrose reinforcement; thereafter, the limited access model was used to induce BLE. Finally, subjects were tested for increments in break points (BPs) in the progressive ratio schedule. We were unable to observe an increase in BPs after BLE. No increments in BPs were observed when a distinctive flavor (vanilla-flavored sucrose) was correlated with BLE induction and reinforcement, or when different types of ratio progression in the operant schedules were employed. However, rats adjusted their BPs according to reinforcer concentration after BLE induction, demonstrating that valuation (cost/benefit decision) of reinforcers was intact. Extent of training, alterations of reward processing after extended exposure to sucrose, and different mechanisms for processing high fat and high carbohydrate reinforcers are variables worth exploring to gain a better understanding of BLE behavior in rodent models.

The non-selective adenosine antagonist theophylline reverses the effects of dopamine antagonism on tremor, motor activity and effort-based decision-making

Considerable evidence indicates that adenosine and dopamine systems interact in the regulation of basal ganglia function. Nonselective adenosine antagonists such as the methylxanthine caffeine as well as selective adenosine A_2A antagonists have been shown to produce antiparkinsonian and antidepressant effects in animal models. The present studies were conducted to assess if another methylxantine, theophylline, can reverse motor and motivational impairments induced by dopamine antagonism in rats. RESULTS: Theophylline (3.75-30.0 mg/kg, IP) reversed tremulous jaw movements (TJMs), catalepsy, and locomotor suppression induced by the dopamine D2 antagonist pimozide. It also reversed TJMs induced by the muscarinic receptor agonist pilocarpine, which is a well-known tremorogenic agent. Parallel studies assessed the ability of theophylline (5.0-20.0 mg/kg, IP) to reverse the changes in effort-related choice behavior induced by the dopamine D1 antagonist ecopipam (0.2 mg/kg, IP) and the D2 antagonist haloperidol (0.1 mg/kg, IP). Rats were tested on two different operant choice tasks which assess the tendency to work for a preferred reinforcer by lever pressing (for palatable pellets or a high 5% sucrose solution) vs. approaching and consuming a less preferred reinforcer (freely available lab chow or a less concentrated 0.3% sucrose solution). Theophylline restored food and sucrose-reinforced lever pressing in animals treated with the D2 antagonist. However, it was unable to reverse the effects of the D1 antagonist. Overall, the effects of theophylline resembled those previously reported for adenosine A_2A antagonists, and suggest that theophylline could be clinically useful for the treatment of motor and motivational symptoms in humans.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Chronic corticosterone shifts effort-related choice behavior in male mice

RATIONALE

Effort-related choice tasks are used to study aspects of motivation in both rodents and humans (Der-Avakian and Pizzagalli Biol Psychiatry 83(11):932-939, 2018). Various dopaminergic manipulations and antidepressant treatments can shift responding to these tasks (Randall et al. Int J Neuropsychopharmacol 18(2), 2014; Yohn et al. Psychopharmacology 232(7):1313-1323, 2015). However, while chronic stress can precipitate mood disorders in humans, there is relatively little known about whether chronic stress elicits maladaptive behaviors in rodent effort-related choice tasks.

OBJECTIVES

Chronic corticosterone (CORT) elicits an increase in negative maladaptive behaviors in male mice (David et al. Neuron 62(4):479-493, 2009; Gourley et al. Biol Psychiatry 64(10):884-890, 2008; Olausson et al. Psychopharmacology 225(3):569-577, 2013). We hypothesized that chronic CORT administration to male mice would reduce motivation for a higher effort, higher reward option, and shift responding to a less effortful, but a lesser reward.

METHODS

Adult male C57BL/6J mice were administered either vehicle (n = 10) or CORT (n = 10) (~ 9.5 mg/kg/day) in their drinking water for 4 weeks, and then throughout all behavioral experiments (15 weeks total), and were tested in a Y-Maze barrier task and a fixed ratio concurrent (FR/chow) choice task.

RESULTS

Chronic CORT reduced Y-maze HR arm choice when more effort was required to obtain the 4 food pellets (15-cm barrier in the high-reward (HR) arm, p < 0.001; 20-cm barrier in HR arm, p < 0.001) and shifted choice to the low reward (LR) arm where only 2 pellets were available. Chronic CORT also reduced lever pressing for food pellets in FR30/chow sessions of the concurrent choice task (p = 0.009), without impacting lab chow consumed.

CONCLUSIONS

Chronic stress induces maladaptive shifts in effort-related choice behavior in the Y-maze barrier task in male mice. Furthermore, males subjected to chronic CORT administration show reduced lever pressing in FR30/chow sessions where lab chow is concurrently available. These data demonstrate that chronic corticosterone reduces motivation to work for and obtain a highly rewarding reinforcer when a lesser reinforcer is concurrently available.

Effort-related decision making in humanized COMT mice: Effects of Val158Met polymorphisms and possible implications for negative symptoms in humans

Catechol-o-methyltransferase (COMT) is an enzyme that metabolizes catecholamines, and is crucial for clearance of dopamine (DA) in prefrontal cortex. Val¹⁵⁸Met polymorphism, which causes a valine (Val) to methionine (Met) substitution at codon 158, is reported to be associated with human psychopathologies in some studies. The Val/Val variant of the enzyme results in higher dopamine metabolism, which results in reduced dopamine transmission. Thus, it is important to investigate the relation between Val¹⁵⁸Met polymorphisms using rodent models of psychiatric symptoms, including negative symptoms such as motivational dysfunction. In the present study, humanized COMT transgenic mice with two genotype groups (Val/Val (Val) and Met/Met (Met) homozygotes) and wild-type (WT) mice from the S129 background were tested using a touchscreen effort-based choice paradigm. Mice were trained to choose between delivery of a preferred liquid diet that reinforced panel pressing on various fixed ratio (FR) schedules (high-effort alternative), vs. intake of pellets concurrently available in the chamber (low-effort alternative). Panel pressing requirements were controlled by varying the FR levels (FR1, 2, 4, 8, 16) in ascending and descending sequences across weeks of testing. All mice were able to acquire the initial touchscreen operant training, and there was an inverse relationship between the number of reinforcers delivered by panel pressing and pellet intake across different FR levels. There was a significant group x FR level interaction in the ascending limb, with panel presses in the Val group being significantly lower than the WT group in FR1-8, and lower than Met in FR4. These findings indicate that the humanized Val allele in mice modulates FR/pellet-choice performance, as marked by lower levels of panel pressing in the Val group when the ratio requirement was moderately high. These studies may contribute to the understanding of the role of COMT polymorphisms in negative symptoms such as motivational dysfunctions in schizophrenic patients.

Investigating serotonergic contributions to cognitive effort allocation, attention, and impulsive action in female rats

BACKGROUND

Individuals must frequently evaluate whether it is worth allocating cognitive effort for desired outcomes. Motivational deficits are a common feature of psychiatric illness such as major depression. Selective serotonin reuptake inhibitors are commonly used to treat this disorder, yet some data suggest these compounds are ineffective at treating amotivation, and may even exacerbate it.

AIMS

Here we used the rodent Cognitive Effort Task (rCET) to assess serotonergic (5-hydroxytryptamine, 5-HT) contributions to decision-making with cognitive effort costs.

METHODS

The rCET is a modified version of the 5-choice serial reaction time task, a well-validated test of visuospatial attention and impulse control. At the start of each rCET trial, rats chose one of two levers, which set the difficulty of an attentional challenge, namely the localization of a visual stimulus illuminated for 0.2 or 1 s on hard versus easy trials. Successful completion of hard trials was rewarded with double the sugar pellets. Twenty-four female Long-Evans rats were trained on the rCET and systemically administered the 5-HT_1A agonist 8-OH-DPAT, the 5-HT_2A antagonist M100907, the 5-HT_2C agonist Ro-60-0175, as well as the 5-HT_2C antagonist SB 242, 084.

RESULTS

5-HT_2A antagonism dose-dependently reduced premature responding, while 5-HT_2C antagonism had the opposite effect. 8-OH-DPAT impaired accuracy of target detection at higher doses, while Ro-60-0175 dose-dependently improved accuracy on difficult trials. However, none of the drugs affected the rats' choice of the harder option.

CONCLUSION

When considered with existing work evaluating decision-making with physical effort costs, it appears that serotonergic signalling plays a minor role in guiding effort allocation.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

A Novel Weight Lifting Task for Investigating Effort and Persistence in Rats

Here we present a novel effort-based task for laboratory rats: the weight lifting task (WLT). Studies of effort expenditure in rodents have typically involved climbing barriers within T-mazes or operant lever pressing paradigms. These task designs have been successful for neuropharmacological and neurophysiological investigations, but both tasks involve simple action patterns. High climbing barriers may also present risk of injury to animals and/or issues with tethered recording equipment. In the WLT, a rat is placed in a large rectangular arena and tasked with pulling a rope 30 cm to trigger food delivery at a nearby spout; weights can be added to the rope in 45 g increments to increase the intensity of effort. As compared to lever pressing and barrier jumping, 30 cm of rope pulling is a multi-step action sequence requiring sustained effort. The actions are carried out on the single plane of the arena floor, making it safer for the animal and more suitable for tethered equipment and video tracking. A microcontroller and associated sensors enable precise timestamping of specific behaviors to synchronize with electrophysiological recordings. The rope and reward spout are spatially segregated to allow for spatial discrimination of the effort zone and the reward zone. We validated the task across five cohorts of rats (total n = 35) and report consistent behavioral metrics. The WLT is well-suited for neuropharmacological and/or in vivo neurophysiological investigations surrounding effortful behaviors, particularly when wanting to probe different aspects of effort expenditure (intensity vs. duration).

Role of dopamine D1-like and D2-like receptors in the activation of ingestive behaviour in thirsty rats licking for water

RATIONALE

Analysis of lick pattern for sucrose and NaCl and of the forced swimming response after dopamine antagonist administration led us to suggest that dopamine on D₁-like receptors is involved in behavioural activation, and the level of activation is "reboosted" on the basis of an evaluation process involving D₂-like receptors. Although some studies investigated licking microstructure for water after dopamine antagonists, the within-session time course of their effect was never investigated.

OBJECTIVES

The aims of this study were to further investigate the role of dopamine receptors in the mechanisms governing water ingestion, focussing on the within-session time course of the microstructure parameters, and to test the proposed hypothesis.

MATERIALS AND METHODS

The effects of the dopamine D₁-like receptor antagonist SCH 23390 (0.01-0.04 mg/kg) and of the dopamine D₂-like receptor antagonist raclopride (0.025-0.25 mg/kg) on licking microstructure for water were examined in 20-h water-deprived rats in 30-min sessions.

RESULTS

As previously observed with sucrose and NaCl, SCH 23390 reduced licking by reducing burst number, suggesting reduced behavioural activation. Moreover, it resulted in an increased burst size. Raclopride reduced the size of licking bursts, while their number was either increased or decreased depending on the dose.

CONCLUSION

The results support the suggestion that D₁ receptors are involved in behavioural activation and D₂ receptors are involved in a related evaluation process. Within the framework of the proposed hypothesis, the increased burst size after D₁-like receptor blockade might be interpreted as a pro-hedonic effect consequent to the increased cost of the activation of the licking response.

Affective biases and their interaction with other reward-related deficits in rodent models of psychiatric disorders

Major depressive disorder (MDD) is one of the leading global causes of disability. Symptoms of MDD can vary person to person, and current treatments often fail to alleviate the poor quality of life that patients experience. One of the two core diagnostic criteria for MDD is the loss of interest in previously pleasurable activities, which suggests a link between the disease aetiology and reward processing. Cognitive impairments are also common in patients with MDD, and more recently, emotional processing deficits known as affective biases have been recognised as a key feature of the disorder. Studies in animals have found similar affective biases related to reward. In this review we consider these affective biases in the context of other reward-related deficits and examine how affective biases associated with learning and memory may interact with the wider behavioural symptoms seen in MDD. We discuss recent developments in how analogues of affective biases and other aspects of reward processing can be assessed in rodents, as well as how these behaviours are influenced in models of MDD. We subsequently discuss evidence for the neurobiological mechanisms contributing to one or more reward-related deficits in preclinical models of MDD, identified using these behavioural assays. We consider how the relationships between these selective behavioural assays and the neurobiological mechanisms for affective bias and reward processing could be used to identify potential treatment strategies.

Time-dependent changes in cognitive flexibility performance during intermittent social stress: Relevance for motivation and reward-seeking behavior

Repeated exposure to stress produces cognitive impairments that can lead to psychiatric disorders. How and when these cognitive impairments occur during repeated exposure to stress is not well understood. The present study investigates the time course effects of the exposure to intermittent episodes of social stress on cognitive flexibility performance. Male rats were trained to perform a cognitive flexibility (set-shifting) task. Then they were submitted to intermittent social defeat stress, which consisted of exposing animals to social defeat once every three days for ten days (four stress episodes). Set-shifting performance was evaluated before and in between social stress episodes, and up to ten days after the end of the stress protocol. Plasma levels of corticosterone after tail-pinch were also measured after the last set-shifting session. Intermittent exposure to social stress did not impair cognitive flexibility but produced short-and long-term changes in set-shifting performance. After the third social defeat episode, stressed animals required significantly more time to respond to cues (instrumental action) and to poke in the food-trough when no food pellet was delivered. These effects were reversed ten days after stress and suggest a decrease in motivation to pursue rewards. In contrast, stressed animals responded more accurately to light cues that predicted rewards. This effect, which emerged ten days after stress, suggests an increase in the reactivity to salient cues in the long-term. These time-dependent behavioral changes might help to understand the transition from social stress to stress-related disorders including drug abuse.

The Novel Atypical Dopamine Uptake Inhibitor (S)-CE-123 Partially Reverses the Effort-Related Effects of the Dopamine Depleting Agent Tetrabenazine and Increases Progressive Ratio Responding

Animal studies of effort-based choice behavior are being used to model effort-related motivational dysfunctions in humans. With these procedures, animals are offered a choice between high-effort instrumental actions leading to highly valued reinforcers vs. low effort/low reward options. Several previous studies have shown that dopamine (DA) uptake inhibitors, including GBR12909, lisdexamfetamine, methylphenidate, and PRX-14040, can reverse the effort-related effects of the vesicular monoamine transport blocker tetrabenazine, which inhibits DA storage. Because many drugs that block DA transport act as major stimulants that also release DA, and produce a number of undesirable side effects, there is a need to develop and characterize novel atypical DA transport inhibitors. (S)-CE-123 ((S)-5-((benzhydrylsulfinyl) methyl)thiazole) is a recently developed analog of modafinil with the biochemical characteristics of an atypical DA transport blocker. The present paper describes the enantioselective synthesis and initial chemical characterization of (S)-CE-123, as well as behavioral experiments involving effort-based choice and microdialysis studies of extracellular DA. Rats were assessed using the fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg) shifted choice behavior, decreasing lever pressing and increasing chow intake. (S)-CE-123 was coadministered at doses ranging from 6.0 to 24.0 mg/kg, and the highest dose partially but significantly reversed the effects of tetrabenazine, although this dose had no effect on fixed ratio responding when administered alone. Additional experiments showed that (S)-CE-123 significantly increased lever pressing on a progressive ratio/chow feeding choice task and that the effective dose (24.0 mg/kg) increased extracellular DA in nucleus accumbens core. In summary, (S)-CE-123 has the behavioral and neurochemical profile of a compound that can block DA transport, reverse the effort-related effects of tetrabenazine, and increase selection of high-effort progressive ratio responding. This suggests that (S)-CE-123 or a similar compound could be useful as a treatment for effort-related motivational dysfunction in humans.

A comparison of implicit and explicit reward learning in low risk alcohol users versus people who binge drink and people with alcohol dependence

Chronic alcohol use leads to specific neurobiological alterations in the dopaminergic brain reward system, which probably are leading to a reward deficiency syndrome in alcohol dependence. The purpose of our study was to examine the effects of such hypothesized neurobiological alterations on the behavioral level, and more precisely on the implicit and explicit reward learning. Alcohol users were classified as dependent drinkers (using the DSM-IV criteria), binge drinkers (using criteria of the USA National Institute on Alcohol Abuse and Alcoholism) or low-risk drinkers (following recommendations of the Scientific board of trustees of the German Health Ministry). The final sample (n = 94) consisted of 36 low-risk alcohol users, 37 binge drinkers and 21 abstinent alcohol dependent patients. Participants were administered a probabilistic implicit reward learning task and an explicit reward- and punishment-based trial-and-error-learning task. Alcohol dependent patients showed a lower performance in implicit and explicit reward learning than low risk drinkers. Binge drinkers learned less than low-risk drinkers in the implicit learning task. The results support the assumption that binge drinking and alcohol dependence are related to a chronic reward deficit. Binge drinking accompanied by implicit reward learning deficits could increase the risk for the development of an alcohol dependence.

•

Alcohol dependent patients were impaired in implicit and explicit reward learning.

•

Alcohol dependence may lead to implicit and explicit reward learning deficits.

•

Binge drinkers learned less than low-risk drinkers in the implicit learning task.

•

Binge drinking is related to implicit reward learning deficits.

Sport Nutrigenomics: Personalized Nutrition for Athletic Performance

An individual's dietary and supplement strategies can influence markedly their physical performance. Personalized nutrition in athletic populations aims to optimize health, body composition, and exercise performance by targeting dietary recommendations to an individual's genetic profile. Sport dietitians and nutritionists have long been adept at placing additional scrutiny on the one-size-fits-all general population dietary guidelines to accommodate various sporting populations. However, generic "one-size-fits-all" recommendations still remain. Genetic differences are known to impact absorption, metabolism, uptake, utilization and excretion of nutrients and food bioactives, which ultimately affects a number of metabolic pathways. Nutrigenomics and nutrigenetics are experimental approaches that use genomic information and genetic testing technologies to examine the role of individual genetic differences in modifying an athlete's response to nutrients and other food components. Although there have been few randomized, controlled trials examining the effects of genetic variation on performance in response to an ergogenic aid, there is a growing foundation of research linking gene-diet interactions on biomarkers of nutritional status, which impact exercise and sport performance. This foundation forms the basis from which the field of sport nutrigenomics continues to develop. We review the science of genetic modifiers of various dietary factors that impact an athlete's nutritional status, body composition and, ultimately athletic performance.

New Developments on the Adenosine Mechanisms of the Central Effects of Caffeine and Their Implications for Neuropsychiatric Disorders

Recent studies on interactions between striatal adenosine and dopamine and one of its main targets, the adenosine A_2A receptor–dopamine D₂ receptor (A2AR–D2R) heteromer, have provided a better understanding of the mechanisms involved in the psychostimulant effects of caffeine and have brought forward new data on the mechanisms of operation of classical orthosteric ligands within G protein-coupled receptor heteromers. The striatal A2AR–D2R heteromer has a tetrameric structure and forms part of a signaling complex that includes a Gs and a Gi protein and the effector adenyl cyclase (subtype AC5). Another target of caffeine, the adenosine A₁ receptor–dopamine D₁ receptor (A1R–D1R) heteromer, seems to have a very similar structure. Initially suggested to be localized in the striatum, the A1R–D1R heteromer has now been identified in the spinal motoneuron and shown to mediate the spinally generated caffeine-induced locomotion. In this study, we review the recently discovered properties of A2AR–D2R and A1R–D1R heteromers. Our studies demonstrate that these complexes are a necessary condition to sustain the canonical antagonistic interaction between a Gs-coupled receptor (A2AR or D1R) and a Gi-coupled receptor (D2R or A1R) at the adenylyl cyclase level, which constitutes a new concept in the field of G protein-coupled receptor physiology and pharmacology. A2AR antagonists targeting the striatal A2AR–D2R heteromer are already being considered as therapeutic agents in Parkinson's disease. In this study, we review the preclinical evidence that indicates that caffeine and A2AR antagonists could be used to treat the motivational symptoms of depression and attention-deficit/hyperactivity disorder, while A1R antagonists selectively targeting the spinal A1R–D1R heteromer could be used in the recovery of spinal cord injury.

Animal models of fatigue in major depressive disorder

Fatigue is common in a host of neurological and psychiatric disorders including depression and often continues unabated even after primary symptoms of disease are treated. Its high estimated prevalence combined with the lack of effective medicines has engaged the preclinical research community to search for fatigue models. The present review briefly summarizes the most common animal models that have been brought forward along with some of the associated pharmacological validation data. Like all preclinical models, these models have issues that need to be appreciated in the generation and interpretation of data for the purposes of translation to human disease; specifically, there are deficiencies in construct validity, a lack of medicines that effectively address residual fatigue symptoms, and difficulties in defining specificity with respect to drug effects on fatigue per se. Nonetheless, existing animal models of fatigue arguably serve the valuable purpose of encouraging research in this large area of unmet medical need. Data from these models are predicted to engender human experimentation and the further development of improved model systems.