Cannabinoid CB1 antagonists and dopamine antagonists produce different effects on a task involving response allocation and effort-related choice in food-seeking behavior

Pharmacological characterization of sex differences in the effects of dopaminergic drugs on effort-based decision making in rats

RATIONALE

Motivational dysfunctions related to effort exertion are common in psychiatric disorders. Dopamine systems regulate exertion of effort and effort-based choice in humans and rodents.

OBJECTIVES

Previous rodent studies mainly employed male rats, and it is imperative to conduct studies in male and female rats.

METHODS

The present studies compared the effort-related effects of IP injections of the dopamine antagonists ecopipam and haloperidol, and the vesicular monoamine transport-2 inhibitor tetrabenazine (TBZ), in male and female rats using the fixed ratio 5/chow feeding choice task.

RESULTS

Ecopipam (0.05-0.2 mg/kg) and haloperidol (0.05-0.15 mg/kg) induced a low-effort bias, decreasing lever pressing and increasing chow intake in males and females in the same dose range. With lever pressing, there was a modest but significant dose x sex interaction after ecopipam injection, but there was no significant interaction after administration of haloperidol. In the first study with TBZ (0.25-1.0 mg/kg), there was a robust sex difference. TBZ shifted choice from lever pressing to chow intake in male rats, but was ineffective in females. In a second experiment, 2.0 mg/kg affected choice behavior in both males and females. TBZ increased accumbens c-Fos immunoreactivity in a sex-dependent manner, with males significantly increasing at 1.0 mg/kg, while females showed augmented immunoreactivity at 2.0 mg/kg.

CONCLUSIONS

The neural and behavioral effects of TBZ differed across sexes, emphasizing the importance of conducting studies in male and female rats. This research has implications for understanding the effort-related motivational dysfunctions seen in psychopathology.

Potential therapeutics for effort-related motivational dysfunction: assessing novel atypical dopamine transport inhibitors

People with depression and other neuropsychiatric disorders can experience motivational dysfunctions such as fatigue and anergia, which involve reduced exertion of effort in goal-directed activity. To model effort-related motivational dysfunction, effort-based choice tasks can be used, in which rats can select between obtaining a preferred reinforcer by high exertion of effort vs. a low effort/less preferred option. Preclinical data indicate that dopamine transport (DAT) inhibitors can reverse pharmacologically-induced low-effort biases and increase selection of high-effort options in effort-based choice tasks. Although classical DAT blockers like cocaine can produce undesirable effects such as liability for misuse and psychotic reactions, not all DAT inhibitors have the same neurochemical profile. The current study characterized the effort-related effects of novel DAT inhibitors that are modafinil analogs and have a range of binding profiles and neurochemical actions (JJC8-088, JJC8-089, RDS3-094, and JJC8-091) by using two different effort-related choice behavior tasks in male Sprague-Dawley rats. JJC8-088, JJC8-089, and RDS3-094 significantly reversed the low-effort bias induced by the VMAT-2 inhibitor tetrabenazine, increasing selection of high-effort fixed ratio 5 lever pressing vs. chow intake. In addition, JJC8-089 reversed the effects of tetrabenazine in female rats. JJC8-088 and JJC8-089 also increased selection of high-effort progressive ratio responding in a choice task. However, JJC8-091 failed to produce these outcomes, potentially due to its unique pharmacological profile (i.e., binding to an occluded conformation of DAT). Assessment of a broad range of DAT inhibitors with different neurochemical characteristics may lead to the identification of compounds that are useful for treating motivational dysfunction in humans.

Effort-related effects of chronic administration of the DA D2 receptor antagonist haloperidol via subcutaneous programmable minipumps: Reversal by co-administration of the adenosine A2A antagonist istradefylline

RATIONALE

Long-acting antipsychotics such as haloperidol decanoate are becoming more commonly used. Long-acting depot formulations have several advantages, but secondary negative effects of prolonged delivery, including motivational dysfunctions, could have debilitating effects. Assessing the behavioral changes that emerge during chronic antipsychotic administration in rats could provide insight regarding the development of motivational dysfunctions and drug tolerance.

OBJECTIVES

Acute administration of dopamine D2 antagonists such as haloperidol induce motivational deficits in rats, as marked by a shift towards a low-effort bias during effort-based choice tasks. In the present studies, programmable subcutaneous infusion pumps provided continuous and controlled drug delivery of haloperidol. Animals were assessed using a fixed ratio (FR) 5 lever pressing schedule and the FR5/chow feeding test of effort-based choice. The adenosine A2A antagonist istradefylline was studied for its ability to reverse the effects of chronic haloperidol.

RESULTS

Continuous chronic infusions of haloperidol produced significant reductions in FR5 performance and a shift from lever pressing to chow intake in rats tested on FR5/chow feeding choice, with no evidence of tolerance over the 4-week infusion period. Behavior returned to baseline during the vehicle-infusion washout period. Istradefylline significantly reversed the effects of haloperidol, increasing lever pressing and decreasing chow intake in haloperidol-treated rats.

CONCLUSIONS

These studies provide an important behavioral characterization of the effects of chronically infused haloperidol, and demonstrate that A2A antagonism reverses the effects of chronic haloperidol. This research could contribute to the understanding and treatment of motivational dysfunctions seen in schizophrenia, Parkinson's disease, and other disorders involving dopamine.

Effects of the atypical antipsychotic and D3/D2 dopamine partial agonist cariprazine on effort-based choice behavior: implications for modeling avolition

RATIONALE

Cariprazine is an atypical antipsychotic that acts as a D3/D2 receptor partial agonist. In addition to treating positive symptoms of schizophrenia, cariprazine may have utility for treating negative symptoms. Rodent studies have focused on the effects of cariprazine on cognitive functions and behaviors thought to be related to anhedonia. Avolition, which is characterized by reduced initiation and persistence of goal-directed behavior, is another important negative symptom.

OBJECTIVES

Effort-related choice tasks have been used as animal models of avolition. In these studies, cariprazine was assessed for its effects on effort-based choice in both rats and mice. Previous work has shown that D2 antagonists such as haloperidol and eticlopride produce a low-effort bias in rodents tested on effort-based choice tasks.

RESULTS

Low doses of cariprazine produced a low-effort bias in rats tested on the fixed ratio 5/chow feeding choice task, decreasing lever pressing for high carbohydrate pellets but increasing chow intake. Cariprazine did not alter preference or intake of these foods in free-feeding tests. The effort-related effects of cariprazine were reversed by co-administration of the adenosine A2A antagonist istradefylline, and cariprazine failed to reverse the effort-related effects of the dopamine-depleting agent tetrabenazine. In mouse touchscreen choice tests, low doses of cariprazine also produced a low-effort bias, shifting behavior away from panel pressing.

CONCLUSIONS

These results demonstrate that with these rodent models of avolition, cariprazine appears to act like a D2-family antagonist even at very low doses. Furthermore, the pharmacological regulation of avolition may differ from that of other negative symptoms.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Systemic D1-R and D2-R antagonists in Non-Human Primates Differentially Impact Learning and Memory While Impairing Motivation and Motor Performance

Dopamine (DA) modulates cognition in part via differential activation of D1 and D2 receptors within the striatum and prefrontal cortex, yet evidence for cognitive impairments stemming from DA blockade or deficiency is inconsistent. Given the predominance of D1 over D2 receptors (R) in the prefrontal cortex of primates, D1-R blockade should more strongly influence frontal executive function (including working memory), while D2-R blockade should impair processes more strongly associated with the dorsal striatum (including cognitive flexibility, and learning). To test how systemic DA blockade disrupts cognition, we administered D1-R and D2-R like antagonists to healthy monkeys while they performed a series of cognitive tasks. Two selective DA receptor antagonist drugs (SCH-23390 hydrochloride: D1/D5-R antagonist; or Eticlopride hydrochloride: D2/D3-R antagonist) or placebo (0.9% saline) were systemically administered. Four tasks were used: (1) 'visually guided reaching', to test response time and accuracy, (2) 'reversal learning', to test association learning and attention, (3) 'self-ordered sequential search' to test spatial working memory, and (4) 'delayed match to sample' to test object working memory. Increased reach response times and decreased motivation to work for liquid reward was observed with both the D1/D5-R and D2/D3-R antagonists at the maximum dosages that still enabled task performance. The D2/D3-R antagonist impaired performance in the reversal learning task, while object and spatial working memory performance was not consistently affected in the tested tasks for either drug. These results are consistent with the theory that systemic D2/D3-R antagonists preferentially influence striatum processes (cognitive flexibility) while systemic D1/D5-R administration is less detrimental to frontal executive function.

Effects of the dopamine depleting agent tetrabenazine on detailed temporal parameters of effort-related choice responding

The dopamine-depleting agent tetrabenazine alters effort-based choice, suppressing food-reinforced behaviors with high response requirements, while increasing selection of low-cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high-carbohydrate Bio-serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse-time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement-pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research.

Preference for vigorous exercise versus sedentary sucrose drinking: an animal model of anergia induced by dopamine receptor antagonism

Motivation has activational and directional components. Mesolimbic dopamine is critical for the regulation of behavioral activation and effort-related processes in motivated behaviors. Impairing mesolimbic dopamine function leads to fatigue and anergia, but leaves intact other aspects of reinforce seeking behaviors, such as the consummatory or hedonic component. In male Swiss mice, we characterized the impact of dopamine antagonism on the selection of concurrently presented stimuli that have different vigor requirements. We analyzed running wheel activity versus sucrose solution intake, typically used as a measure of anhedonia. Results are compared with data from nonconcurrent presentation to those stimuli. In the concurrent presentation experiment, control mice preferred to spend time running compared to sucrose intake. Dopamine antagonism shifted relative reinforcer preference, reducing time spent on the running wheel, but actually increasing time-consuming sucrose. Mice increased frequency of bouts for both reinforcers, suggesting that there was fatigue in the running wheel rather than aversion. Moreover, satiation or habituation by preexposing animals to both reinforcers did not shift preferences. In the nonconcurrent experiments, haloperidol reduced running wheel but had no impact on sucrose consumption. Dopamine antagonism did not change preference for sucrose or total volume consumed. Additional correlational analyses indicated that baseline differences in sucrose consumption were independent of baseline running or novelty exploration. Thus, dopamine antagonism seems to have anergic rather than anhedonic effects, and the concurrent presentation in this setting could be useful for assessing preferences based on effort requirements.

The effects of fatty acid amide hydrolase inhibition and monoacylglycerol lipase inhibition on habit formation in mice

Emerging data indicate that endocannabinoid signaling is critical to the formation of habitual behavior. Previous work demonstrated that antagonism of cannabinoid receptor type 1 (CB1R) with AM251 during operant training impairs habit formation, but it is not known if this behavioral effect is specific to disrupted signaling of the endocannabinoid ligands anandamide or 2-arachidonoyl glycerol (2-AG). Here, we used selective pharmacological compounds during operant training to determine the impact of fatty acid amide hydrolase (FAAH) inhibition to increase anandamide (and other n-acylethanolamines) or monoacylglycerol lipase (MAGL) inhibition to increase 2-AG levels on the formation of habitual behaviors in mice using a food-reinforced contingency degradation procedure. We found, contrary to our hypothesis, that inhibition of FAAH and of MAGL disrupted the formation of habits. Next, AM251 was administered during training to verify that impaired habit formation could be assessed using contingency degradation. AM251-exposed mice responded at lower rates during training and at higher rates in the test. To understand the inconsistency with published data, we performed a proof-of-principle dose-response experiment to compare AM251 in our vehicle-solution to the published vehicle-suspension on response rates. We found consistent reductions in response rate with increasing doses of AM251 in solution and an inconsistent dose-response relationship with AM251 in suspension. Together, our data suggest that further characterization of the role of CB1R signaling in the formation of habitual responding is warranted and that augmenting endocannabinoids may have clinical utility for prophylactically preventing aberrant habit formation such as that hypothesized to occur in substance use disorders.

Effects of systemic endocannabinoid manipulation on social and exploratory behavior in prairie voles (Microtus ochrogaster)

RATIONALE

Anandamide is an endocannabinoid that contributes to certain aspects of social behavior, like play and reward, by binding to cannabinoid receptor type 1 (CB1). Most interesting is the recent discovery that anandamide may be mobilized by oxytocin receptor activation under certain contexts, particularly in the nucleus accumbens.

OBJECTIVES

Given the established role of oxytocin and the nucleus accumbens in the neurobiology of pair-bonding, we investigated whether systemic administration of brain-permeable modulators of the endocannabinoid system could alter preferential partner contact in both male and female prairie voles.

METHODS

Specifically, we tested whether intraperitoneal administration of the neutral CB1 antagonist AM4113 (4.0-16.0 mg/kg) or the anandamide hydrolysis inhibitor URB597 (5.0-20.0 mg/kg) could prevent or facilitate partner preference formation, respectively. To further investigate the specificity of effects on partner preference, we repeated our URB597 dosing regimen on an additional group of females and tested their anxiety-related behavior in both an elevated-plus maze and a light/dark test.

RESULTS

AM4113 administration had no effect on partner preference. But while URB597 also had no effect on partner preference, low-dose females did increase absolute preferential contact with either the partner or the stranger; individual females spent significant contact time with either the partner or the stranger. None of our outcome measures in either anxiety test showed significant effects of treatment.

CONCLUSIONS

Our results reveal that experimentally increasing anandamide levels in female prairie voles can increase social contact with both a familiar and novel male via unknown mechanisms that are likely separate from anxiety reduction.

The novel atypical dopamine transport inhibitor CT-005404 has pro-motivational effects in neurochemical and inflammatory models of effort-based dysfunctions related to psychopathology

Depressed individuals suffer from effort-related motivational symptoms such as anergia and fatigue, which are resistant to treatment with many common antidepressants. While drugs that block dopamine transport (DAT) reportedly have positive motivational effects, DAT inhibitors such as cocaine and amphetamines produce undesirable side effects. Thus, there is a need to develop and characterize novel atypical DAT inhibitors with unique and selective binding profiles. Rodent effort-based choice tasks provide useful models of motivational dysfunctions. With these tasks, animals choose between a high-effort instrumental action leading to highly valued reinforcement vs. a low effort/low reward option. The present studies focused on the initial characterization of a novel atypical DAT inhibitor, CT-005404, which binds to DAT with high selectivity relative to serotonin and norepinephrine transport, and produces long-term elevations of extracellular DA. CT-005404 was assessed for its ability to attenuate the effort-related motivational effects of the DA depleting agent tetrabenazine and the pro-inflammatory cytokine interleukin-1β (IL-1β) using a fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg i.p.) shifted choice behavior, decreasing lever pressing and increasing chow intake. IL-1β (4.0 μg/kg i.p.) also decreased lever pressing. CT-005404 was co-administered (7.5-30.0 mg/kg p.o.) with either tetrabenazine or IL-1β, and the 15.0 and 30.0 mg/kg doses significantly reversed the effects of tetrabenazine and IL-1β. CT-005404 administered alone produced a dose-related increase in lever pressing in rats tested on a progressive ratio/chow feeding choice task. Atypical DAT inhibitors such as CT-005404 offer potential as a new avenue for drug treatment of motivational dysfunctions in humans.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Cannabinoids, Chemical Senses, and Regulation of Feeding Behavior

The herb Cannabis sativa has been traditionally used in many cultures and all over the world for thousands of years as medicine and recreation. However, because it was brought to the Western world in the late 19th century, its use has been a source of controversy with respect to its physiological effects as well as the generation of specific behaviors. In this regard, the CB1 receptor represents the most relevant target molecule of cannabinoid components on nervous system and whole-body energy homeostasis. Thus, the promotion of CB1 signaling can increase appetite and stimulate feeding, whereas blockade of CB1 suppresses hunger and induces hypophagia. Taste and flavor are sensory experiences involving the oral perception of food-derived chemicals and drive a primal sense of acceptable or unacceptable for what is sampled. Therefore, research within the last decades focused on deciphering the effect of cannabinoids on the chemical senses involved in food perception and consequently in the pattern of feeding. In this review, we summarize the data on the effect of cannabinoids on chemical senses and their influences on food intake control and feeding behavior.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

Synthesis and Pharmacological Evaluation of 1-Phenyl-3-Thiophenylurea Derivatives as Cannabinoid Type-1 Receptor Allosteric Modulators

We previously reported diarylurea derivatives as cannabinoid type-1 receptor (CB₁) allosteric modulators, which were effective in attenuating cocaine-seeking behavior. Herein, we extended the structure-activity relationships of PSNCBAM-1 (2) at the central phenyl ring directly connected to the urea moiety. Replacement with a thiophene ring led to 11 with improved or comparable potencies in calcium mobilization, [³⁵S]GTPγS binding, and cAMP assays, whereas substitution with nonaromatic rings led to significant attenuation of the modulatory activity. These compounds had no inverse agonism in [³⁵S]GTPγS binding, a characteristic that is often thought to contribute to adverse psychiatric effects. While 11 had good metabolic stability in rat liver microsomes, it showed modest solubility and blood-brain barrier permeability. Compound 11 showed an insignificant attenuation of cocaine seeking behavior in rats, most likely due to its limited CNS penetration, suggesting that pharmacokinetics and distribution play a role in translating the in vitro efficacy to in vivo behavior.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Food Intake and Eating Behavior After Bariatric Surgery

Obesity is an escalating global chronic disease. Bariatric surgery is a very efficacious treatment for obesity and its comorbidities. Alterations to gastrointestinal anatomy during bariatric surgery result in neurological and physiological changes affecting hypothalamic signaling, gut hormones, bile acids, and gut microbiota, which coalesce to exert a profound influence on eating behavior. A thorough understanding of the mechanisms underlying eating behavior is essential in the management of patients after bariatric surgery. Studies investigating candidate mechanisms have expanded dramatically in the last decade. Herein we review the proposed mechanisms governing changes in eating behavior, food intake, and body weight after bariatric surgery. Additive or synergistic effects of both conditioned and unconditioned factors likely account for the complete picture of changes in eating behavior. Considered application of strategies designed to support the underlying principles governing changes in eating behavior holds promise as a means of optimizing responses to surgery and long-term outcomes.

Differential effects of D1 and D2 dopamine agonists on memory, motivation, learning and response time in non-human primates

Dopamine (DA) plays a critical role in cognition, motivation and information processing. DA action has been shown to both improve and/or impair cognition across different receptor types, species, subjects and tasks. This complex relationship has been described as an inverted U-shaped function and may be due to the differential effects of DA receptor activation in the striatum and prefrontal cortex. We have investigated the effects of selective DA agonists on cognitive performance in healthy monkeys using a touch screen running tasks from the CAmbridge Neuropsychological Test Automated Battery (CANTAB). One of two DA agonist drugs or placebo was administered prior to each daily CANTAB session: Dihydrexidine hydrochloride (selective D1 agonist, 0.4-0.9 mg/kg), or sumanirole maleate (selective D2 agonist 0.05-0.3 mg/kg). Three CANTAB tasks were tested: (a) "self-ordered sequential search task" which tested spatial working memory, (b) "reversal learning task," which tested association learning, cognitive flexibility and attention and (c) "visually guided reaching task," which tested reaction time and accuracy. At high dosages, the D2 agonist improved spatial working memory performance, while impairing reversal learning and slowing reach response latency. No consistent cognitive effects were observed with the D1 agonist across the dosages tested. A significant decrease in trial completion rate was observed at the higher dosages of both the D1 and D2 agonists which were consistent with decreased motivation. These results are consistent with task-specific effects of a D2 agonist as well as dose specific insensitivities of a D1 agonist on cognitive and motor behaviors in a healthy monkey.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Considerations on nonclinical approaches to modeling risk factors of suicidal ideation and behavior

Given the serious nature of suicidal ideation and behavior (SIB) and the possibility of treatment-emergent SIB, pharmaceutical companies are now applying more proactive approaches in clinical trials and are considering the value of nonclinical models to predict SIB. The current review summarizes nonclinical approaches to modeling three common risk factors associated with SIB: aggression, impulsivity, and anhedonia. For each risk factor, a general description, advantages and disadvantages, species considerations, nonclinical to clinical translation, and pharmacological validation with respect to treatments associated with SIB are summarized. From this review, several gaps were identified that need to be addressed before use of these nonclinical models can be considered a viable option to predict the relative risk for SIB. Other future directions that may compliment these nonclinical approaches, including the use of selectively-bred or genetically-modified rodent models, transgenic models, gene expression profiling, and biomarker analysis, are discussed. This article was developed with the support of the DruSafe Leadership Group of the International Consortium for Innovation and Quality in Pharmaceutical Development (IQ, www.iqconsortium.org).

Assessment of a glycine uptake inhibitor in animal models of effort-related choice behavior: implications for motivational dysfunctions

RATIONALE

Motivated behavior can be characterized by a substantial exertion of effort, and organisms often make effort-related decisions based upon analyses of work-related response costs and reinforcement preference. Moreover, alterations in effort-based choice can be seen in people with major depression and schizophrenia. Effort-related decision making is studied using tasks offering choices between high effort options leading to highly valued reinforces vs low effort/low reward options. Interference with dopamine (DA) transmission by administration of the DA D2 family antagonist haloperidol biases behavior towards the lower effort option that can be obtained with minimal work, and previous research has shown that DA interacts with other transmitters, including adenosine and GABA, to regulate effort-based choice.

OBJECTIVES

The present studies focused upon the ability of the glycine transport inhibitor bitopertin to attenuate haloperidol-induced shifts in effort-related choice behavior.

METHODS

Effort-based choice in rats was assessed using the concurrent fixed ratio (FR) 5/chow feeding choice task and the T-maze barrier choice procedure.

RESULTS

Haloperidol shifted effort-based choice, biasing animals towards the low effort option in each task. Co-administration of bitopertin (1.0-10.0 mg/kg) significantly attenuated haloperidol-induced shifts in choice behavior, but the same doses of bitopertin had no effect when administered alone.

CONCLUSIONS

These results indicated that elevation of extracellular glycine via inhibition of glycine uptake was able to reverse the effects of D2 antagonism. Increases in extracellular glycine, possibly through actions on the glycine allosteric site on the NMDA receptor, may be a useful strategy for treating motivational dysfunctions in humans.

Effort-related motivational effects of the pro-inflammatory cytokine interleukin-6: pharmacological and neurochemical characterization

RATIONALE

Motivational dysfunctions such as anergia, fatigue, and reduced effort expenditure are common in patients with depression and other disorders. Pro-inflammatory cytokines are implicated in depression, and cytokine administration induces motivational deficits in humans.

OBJECTIVES

These studies focused on the effects of the cytokine interleukin-6 (IL-6) on effort-related decision-making.

METHODS

Rats were assessed using the concurrent fixed ratio 5-lever pressing/chow feeding choice procedure, which measures the tendency of rats to work for a preferred food (high carbohydrate pellets) in the presence of a concurrently available but less preferred substitute (lab chow).

RESULTS

IL-6 (2.0-8.0 μg/kg IP) shifted choice behavior, significantly decreasing lever pressing and increasing chow intake. Further experiments showed that the adenosine A2A antagonist MSX-3 and the stimulant methylphenidate attenuated the effort-related impairments produced by IL-6, increasing lever pressing and decreasing chow intake in IL-6 treated rats. The same doses of IL-6 did not alter food intake or preference in parallel free-feeding choice studies, demonstrating that these low doses were not altering preference for the high carbohydrate pellets or generally suppressing appetite. Also, IL-6 did not affect body temperature. Microdialysis studies showed that 8.0 μg/kg IL-6 significantly decreased extracellular dopamine in nucleus accumbens core.

CONCLUSIONS

In summary, IL-6 reduces the tendency to work for food, even at low doses that do not produce fever or loss of appetite. Dopaminergic mechanisms may be involved in these effort-related effects. This research has implications for the involvement of cytokines in motivational dysfunctions such as anergia and fatigue.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Behavioral representation of cost and benefit balance in rats

Decision making is dependent upon individual motivation. Previous studies showed that animals with higher levels of motivation are more likely to invest more time to acquire larger rewards rather than acquiring smaller rewards with less time to wait. However, little is known about how this motivation mediates the cognitive effort animals devote upon making said decisions in detail. In the present study, we investigated the behavioral response in a goal-directed action under a differential reward schedule by training rats to perform a "Do more, get more" (DM-GM) task using a nosepoke operandum when longer nosepoke durations resulted in correspondingly larger rewards. In general, the subjects learned this DM-GM rule and reached a steady behavioral state within 15days. During the training stage, the rats found the most cost-effective action choice and behaved according to that guideline more frequently than other possible actions. In addition, when the cost-benefit ratio changed, the rats again found a new most cost-effective choice to obtain maximum rewards. Our results demonstrate that there is a "balance point" of cost and benefit in rat valuation system and that this "balance point" not only guides the rats to make the appropriate decision, but that this point can be modified upon new situations to choose a newer optimum action plan.

Δ9-Tetrahydrocannabinol decreases willingness to exert cognitive effort in male rats

BACKGROUND

Acceptance of cannabis use is growing. However, prolonged use is associated with diminished psychosocial outcomes, potentially mediated by drug-induced cognitive impairments. Δ9-Tetrahydrocannabinol (THC) is the main psychoactive ingredient in cannabis, yet other phytocannabinoids in the plant, such as cannabidiol (CBD), have unique properties. Given that CBD can modulate the undesirable effects of THC, therapeutic agents, such as nabiximols, contain higher CBD:THC ratios than illicit marijuana. We tested the hypothesis that THC impairs a relevant cognitive function for long-term success, namely willingness to exert cognitive effort for greater rewards, and that CBD could attenuate such decision-making impairments.

METHODS

Male Long-Evans rats (n = 29) performing the rat cognitive effort task (rCET) received acute THC and CBD, independently and concurrently, in addition to other cannabinoids. Rats chose between 2 options differing in reward magnitude, but also in the cognitive effort (attentional load) required to obtain them.

RESULTS

We found that THC decreased choice of hard trials without impairing the animals' ability to accurately complete them. Strikingly, this impairment was correlated with CB1 receptor density in the medial prefrontal cortex - an area previously implicated in effortful decision-making. In contrast, CBD did not affect choice. Coadministration of 1:1 CBD:THC matching that in nabiximols modestly attenuated the deleterious effects of THC in "slacker" rats.

LIMITATIONS

Only male rats were investigated, and the THC/CBD coadministration experiment was carried out in a subset of individuals.

CONCLUSION

These findings confirm that THC, but not CBD, selectively impairs decision-making involving cognitive effort costs. However, coadministration of CBD only partially ameliorates such THC-induced dysfunction.

Blockade of Nicotine and Cannabinoid Reinforcement and Relapse by a Cannabinoid CB1-Receptor Neutral Antagonist AM4113 and Inverse Agonist Rimonabant in Squirrel Monkeys

Nicotine, the main psychoactive component of tobacco, and (-)-Δ(9)-tetrahydrocannabinol (THC), the main psychoactive ingredient in cannabis, play major roles in tobacco and marijuana dependence as reinforcers of drug-seeking and drug-taking behavior. Drugs that act as inverse agonists of cannabinoid CB1 receptors in the brain can attenuate the rewarding and abuse-related effects of nicotine and THC, but their clinical use is hindered by potentially serious side effects. The recently developed CB1-receptor neutral antagonists may provide an alternative therapeutic approach to nicotine and cannabinoid dependence. Here we compare attenuation of nicotine and THC reinforcement and reinstatement in squirrel monkeys by the CB1-receptor inverse agonist rimonabant and by the recently developed CB1-receptor neutral antagonist AM4113. Both rimonabant and AM4113 reduced two effects of nicotine and THC that play major roles in tobacco and marijuana dependence: (1) maintenance of high rates of drug-taking behavior, and (2) priming- or cue-induced reinstatement of drug-seeking behavior in abstinent subjects (models of relapse). In contrast, neither rimonabant nor AM4113 modified cocaine-reinforced or food-reinforced operant behavior under similar experimental conditions. However, both rimonabant and AM4113 reduced cue-induced reinstatement in monkeys trained to self-administer cocaine, suggesting the involvement of a common cannabinoid-mediated mechanism in the cue-induced reinstatement for different drugs of abuse. These findings point to CB1-receptor neutral antagonists as a new class of medications for treatment of both tobacco dependence and cannabis dependence.

Blockade of uptake for dopamine, but not norepinephrine or 5-HT, increases selection of high effort instrumental activity: Implications for treatment of effort-related motivational symptoms in psychopathology

Deficits in behavioral activation, exertion of effort, and other psychomotor/motivational symptoms are frequently seen in people with depression and other disorders. Depressed people show a decision bias towards selection of low effort activities, and animal tests of effort-related decision making are being used as models of motivational dysfunctions seen in psychopathology. The present studies investigated the ability of drugs that block dopamine transport (DAT), norepinephrine transport (NET), and serotonin transport (SERT) to modulate work output in rats responding on a test of effort-related decision making (i.e., a progressive ratio (PROG)/chow feeding choice task). With this task, rats choose between working for a preferred food (high carbohydrate pellets) by lever pressing on a PROG schedule vs. obtaining a less preferred lab chow that is freely available in the chamber. The present studies focused on the effects of the selective DAT inhibitor GBR12909, the selective SERT inhibitor fluoxetine, and the selective NET inhibitors desipramine and atomoxetine. Acute and repeated administration of GBR12909 shifted choice behavior, increasing measures of PROG lever pressing but decreasing chow intake. In contrast, fluoxetine, desipramine and atomoxetine failed to increase lever pressing output, and actually decreased it at higher doses. In the behaviorally effective dose range, GBR12909 elevated extracellular dopamine levels in accumbens core as measured by microdialysis, but fluoxetine, desipramine and atomoxetine decreased extracellular dopamine. Thus, blockade of DAT increases selection of the high effort instrumental activity, while inhibition of SERT or NET does not. These results have implications for the use of monoamine uptake inhibitors for the treatment of effort-related psychiatric symptoms in humans.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Not All Antidepressants Are Created Equal: Differential Effects of Monoamine Uptake Inhibitors on Effort-Related Choice Behavior

Motivated behavior can be characterized by behavioral activation and high work output. Moreover, people with depression and other disorders show effort-related motivational symptoms, such as anergia, psychomotor retardation, and fatigue. Effort-based decision making is studied using tasks offering choices between high effort options leading to highly valued reinforcers vs low effort/low reward options, and such tasks could be useful as animal models of motivational symptoms. In the present studies the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine (TBZ) were investigated. TBZ blocks vesicular storage and also produces depressive symptoms in humans. Moreover, TBZ alters effort-based choice in rats, biasing animals toward low effort alternatives. The present studies investigated the ability of acute administration of various monoamine uptake inhibitors to reverse the effects of TBZ. Effort-related effects of TBZ were attenuated by the catecholamine uptake inhibitor and antidepressant bupropion, and this effect of bupropion was reversed by either D1 or D2 family antagonism. The effort-related effects of TBZ were also attenuated by the selective dopamine uptake blocker GBR12909. The 5-HT uptake inhibitor fluoxetine and the norepinephrine uptake inhibitor desipramine failed to reverse the effects of TBZ, and higher doses of these drugs, given alone or in combination with TBZ, led to further behavioral impairments. These results indicate that drugs acting on dopamine transmission are relatively effective at reversing the effort-related effects of TBZ, and are consistent with the hypothesis that drugs that enhance dopamine transmission may be effective at treating effort-related psychiatric symptoms in humans.

Modulation of food consumption and sleep-wake cycle in mice by the neutral CB1 antagonist ABD459

The brain endocannabinoid system is a potential target for the treatment of psychiatric and metabolic conditions. Here, a novel CB1 receptor antagonist (ABD459) was synthesized and assayed for pharmacological efficacy in vitro and for modulation of food consumption, vigilance staging and cortical electroencephalography in the mouse. ABD459 completely displaced the CB1 agonist CP99540 at a Ki of 8.6 nmol/l, and did not affect basal, but antagonized CP55940-induced GTPγS binding with a KB of 7.7 nmol/l. Acute ABD459 (3-20 mg/kg) reliably inhibited food consumption in nonfasted mice, without affecting motor activity. Active food seeking was reduced for 5-6 h postdrug, with no rebound after washout. Epidural recording of electroencephalogram confirmed that ABD459 (3 mg/kg) robustly reduced rapid eye movement (REM) sleep, with no alterations of wakefulness or non-REM sleep. Effects were strongest during 3 h postdrug, followed by a progressive washout period. The CB1 antagonist AM251 (3 mg/kg) and agonist WIN-55,212-2 (WIN-2: 3 mg/kg) also reduced REM, but variously affected other vigilance stages. WIN-2 caused a global suppression of normalized spectral power. AM251 and ABD459 lowered delta power and increased power in the theta band in the hippocampus, but not the prefrontal cortex. The neutral antagonist ABD459 thus showed a specific role of endocannabinoid release in attention and arousal, possibly through modulation of cholinergic activity.

Neurobiological basis of motivational deficits in psychopathology

In recent years, there has been increasing emphasis on the importance of motivational symptoms in depression, schizophrenia and other disorders. The present review discusses the conceptual background related to the construct of motivation, and provides a framework that for research on both physiological and pathological aspects of motivation. Particular emphasis is placed on what is known about the neurobiological basis of activational aspects of motivation, including studies from animal models. The role of limbic/prefrontal/striatal circuitry in behavioral activation and effort-related functions is examined, and the utility of behavioral tasks of effort-based decision making as models of motivational symptoms is discussed. We also review the neurobiology of motivational symptoms in relation to psychopathology, and issues related to the language used to characterize motivational dysfunctions are considered. The literature suggests that research on the neurobiology of motivational dysfunction in psychopathology, at both clinical and preclinical levels, could inform the development of novel and more effective treatments for a range of CNS disorders.

Selection of sucrose concentration depends on the effort required to obtain it: studies using tetrabenazine, D1, D2, and D3 receptor antagonists

RATIONALE

Low doses of dopamine (DA) antagonists and accumbens DA depletions reduce food-reinforced instrumental behavior but do not impair primary food motivation, causing animals to reallocate behavior away from food-reinforced tasks with high response requirements and select less effortful alternatives. However, it is uncertain if this same pattern of effects would occur if sucrose was used as the reinforcer.

OBJECTIVES

These experiments studied the impact of DA depletion and antagonism on performance of an effort-related choice task using sucrose as the reinforcer, as well as sucrose consumption, preference, and taste reactivity tests.

METHODS

The effects of DA manipulations were assessed using a task in which rats chose between lever pressing on a fixed ratio 7 schedule for 5.0 % sucrose versus freely consuming a less concentrated solution (0.3 %).

RESULTS

The DA depleting agent tetrabenazine shifted effort-related choice, decreasing lever pressing for 5.0 % sucrose but increasing intake of the concurrently available 0.3 % sucrose. Tetrabenazine did not affect sucrose appetitive taste reactivity, or sucrose consumption or preference, in free consumption tests. The D1 antagonist ecopipam and the D2 antagonist haloperidol also shifted choice behavior at doses that did not alter sucrose consumption or preference. In contrast, sucrose pre-exposure reduced consumption across all conditions. D3 antagonism had no effects.

CONCLUSIONS

D1 and D2 receptor blockade and DA depletion reduce the tendency to work for sucrose under conditions that leave fundamental aspects of sucrose motivation (intake, preference, hedonic reactivity) intact. These findings have implications for studies employing sucrose intake or preference in animal models of depression.

Activation of cannabinoid system in anterior cingulate cortex and orbitofrontal cortex modulates cost-benefit decision making

Despite the evidence for altered decision making in cannabis abusers, the role of the cannabinoid system in decision-making circuits has not been studied. Here, we examined the effects of cannabinoid modulation during cost-benefit decision making in the anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC), key brain areas involved in decision making. We trained different groups of rats in a delay-based and an effort-based form of cost-benefit T-maze decision-making task. During test days, the rats received local injections of either vehicle or ACEA, a cannabinoid type-1 receptor (CB1R) agonist in the ACC or OFC. We measured spontaneous locomotor activity following the same treatments and characterized CB1Rs localization on different neuronal populations within these regions using immunohistochemistry. We showed that CB1R activation in the ACC impaired decision making such that rats were less willing to invest physical effort to gain high reward. Similarly, CB1R activation in the OFC induced impulsive pattern of choice such that rats preferred small immediate rewards to large delayed rewards. Control tasks ensured that the effects were specific for differential cost-benefit tasks. Furthermore, we characterized widespread colocalizations of CB1Rs on GABAergic axonal ends but few colocalizations on glutamatergic, dopaminergic, and serotonergic neuronal ends. These results provide first direct evidence that the cannabinoid system plays a critical role in regulating cost-benefit decision making in the ACC and OFC and implicate cannabinoid modulation of synaptic ends of predominantly interneurons and to a lesser degree other neuronal populations in these two frontal regions.

Bupropion increases selection of high effort activity in rats tested on a progressive ratio/chow feeding choice procedure: implications for treatment of effort-related motivational symptoms

BACKGROUND

Depression and related disorders are characterized by deficits in behavioral activation, exertion of effort, and other psychomotor/motivational dysfunctions. Depressed patients show alterations in effort-related decision making and a bias towards selection of low effort activities. It has been suggested that animal tests of effort-related decision making could be useful as models of motivational dysfunctions seen in psychopathology.

METHODS

Because clinical studies have suggested that inhibition of catecholamine uptake may be a useful strategy for treatment of effort-related motivational symptoms, the present research assessed the ability of bupropion to increase work output in rats responding on a test of effort-related decision-making (ie, a progressive ratio/chow feeding choice task). With this task, rats can choose between working for a preferred food (high-carbohydrate pellets) by lever pressing on a progressive ratio schedule vs obtaining a less preferred laboratory chow that is freely available in the chamber.

RESULTS

Bupropion (10.0-40.0 mg/kg intraperitoneal) significantly increased all measures of progressive ratio lever pressing, but decreased chow intake. These effects were greatest in animals with low baseline levels of work output on the progressive ratio schedule. Because accumbens dopamine is implicated in effort-related processes, the effects of bupropion on markers of accumbens dopamine transmission were examined. Bupropion elevated extracellular dopamine levels in accumbens core as measured by microdialysis and increased phosphorylated dopamine and cyclic-AMP related phosphoprotein 32 kDaltons (pDARPP-32) immunoreactivity in a manner consistent with D1 and D2 receptor stimulation.

CONCLUSION

The ability of bupropion to increase exertion of effort in instrumental behavior may have implications for the pathophysiology and treatment of effort-related motivational symptoms in humans.

Mesolimbic Dopamine and the Regulation of Motivated Behavior

It has been known for some time that nucleus accumbens dopamine (DA) is involved in aspects of motivation , but theoretical approaches to understanding the functions of DA have continued to evolve based upon emerging data and novel concepts. Although it has become traditional to label DA neurons as "reward" neurons, the actual findings are more complicated than that, because they indicate that DA neurons can respond to a variety of motivationally significant stimuli. Moreover, it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. Studies that involve nucleus accumbens DA antagonism or depletion indicate that accumbens DA does not mediate primary food motivation or appetite. Nevertheless, DA is involved in appetitive and aversive motivational processes including behavioral activation , exertion of effort, sustained task engagement, and Pavlovian-to-instrumental transfer. Interference with accumbens DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task and also shifts effort-related choice behavior, biasing animals toward low-effort alternatives. Dysfunctions of mesolimbic DA may contribute to motivational symptoms seen in various psychopathologies, including depression , schizophrenia, parkinsonism, and other disorders.

The VMAT-2 inhibitor tetrabenazine affects effort-related decision making in a progressive ratio/chow feeding choice task: reversal with antidepressant drugs

Behavioral activation is a fundamental feature of motivation, and organisms frequently make effort-related decisions based upon evaluations of reinforcement value and response costs. Furthermore, people with major depression and other disorders often show anergia, psychomotor retardation, fatigue, and alterations in effort-related decision making. Tasks measuring effort-based decision making can be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine induces depressive symptoms in humans, and also preferentially depletes dopamine (DA). Rats were assessed using a concurrent progressive ratio (PROG)/chow feeding task, in which they can either lever press on a PROG schedule for preferred high-carbohydrate food, or approach and consume a less-preferred lab chow that is freely available in the chamber. Previous work has shown that the DA antagonist haloperidol reduced PROG work output on this task, but did not reduce chow intake, effects that differed substantially from those of reinforcer devaluation or appetite suppressant drugs. The present work demonstrated that tetrabenazine produced an effort-related shift in responding on the PROG/chow procedure, reducing lever presses, highest ratio achieved and time spent responding, but not reducing chow intake. Similar effects were produced by administration of the subtype selective DA antagonists ecopipam (D1) and eticlopride (D2), but not by the cannabinoid CB1 receptor neutral antagonist and putative appetite suppressant AM 4413, which suppressed both lever pressing and chow intake. The adenosine A_2A antagonist MSX-3, the antidepressant and catecholamine uptake inhibitor bupropion, and the MAO-B inhibitor deprenyl, all reversed the impairments induced by tetrabenazine. This work demonstrates the potential utility of the PROG/chow procedure as a rodent model of the effort-related deficits observed in depressed patients.

Effort-related motivational effects of the pro-inflammatory cytokine interleukin 1-beta: studies with the concurrent fixed ratio 5/ chow feeding choice task

RATIONALE

Effort-related motivational symptoms such as anergia and fatigue are common in patients with depression and other disorders. Research implicates pro-inflammatory cytokines in depression, and administration of cytokines can induce effort-related motivational symptoms in humans.

OBJECTIVES

The present experiments focused on the effects of the pro-inflammatory cytokine interleukin 1-beta (IL-1β) on effort-related choice behavior.

METHODS

Rats were tested on a concurrent fixed ratio 5 lever pressing/chow feeding choice procedure, which assesses the tendency of rats to work for a preferred food (high carbohydrate pellets) in the presence of a concurrently available but less preferred substitute (laboratory chow).

RESULTS

IL-1β (1.0-4.0 μg/kg IP) shifted choice behavior, significantly decreasing lever pressing and increasing intake of the freely available chow. The second experiment assessed the ability of the adenosine A2A antagonist (E)-phosphoric acid mono-[3-[8-[2-(3-methoxyphenyl)vinyl]-7-methyl-2,6-dioxo-1-prop-2-ynyl-1,2,6,7-tetrahydropurin-3-yl] propyl] ester disodium salt (MSX-3) to reverse the behavioral effects of IL-1β. MSX-3 attenuated the effort-related impairments produced by IL-1β, increasing lever pressing and also decreasing chow intake. In the same dose range that shifted effort-related choice behavior, IL-1β did not alter food intake or preference in parallel free-feeding choice studies, indicating that these low doses were not generally suppressing appetite or altering preference for the high carbohydrate pellets. In addition, IL-1β did not affect core body temperature.

CONCLUSIONS

These results indicate that IL-1β can reduce the tendency to work for food, even at low doses that do not produce a general sickness, malaise, or loss of appetite. This research has implications for the involvement of cytokines in motivational symptoms such as anergia and fatigue.

The vital role of constitutive GPCR activity in the mesolimbic dopamine system

The midbrain dopamine system has an important role in processing rewards and the stimuli associated with them, and is implicated in various psychiatric disorders. This system is tightly regulated by various G protein-coupled receptors (GPCRs). It is becoming increasingly clear that these receptors are not only activated by (endogenous) agonists but that they also exhibit agonist-independent intrinsic constitutive activity. In this review we highlight the evidence for the physiological role of such constitutive GPCR activity (in particular for cannabinoid 1, serotonin 2C and mu-opioid receptors) in the ventral tegmental area and in its output regions like the nucleus accumbens. We also address the behavioral relevance of constitutive GPCR signaling and discuss the repercussions of its abolition in dopamine-related psychiatric diseases.

Effort-related motivational effects of the VMAT-2 inhibitor tetrabenazine: implications for animal models of the motivational symptoms of depression

Motivated behaviors are often characterized by a high degree of behavioral activation, and work output and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with major depression and other disorders often show effort-related motivational symptoms such as anergia, psychomotor retardation, and fatigue. It has been suggested that tasks measuring effort-related choice behavior could be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, because of its selective inhibition of VMAT-2, it preferentially depletes dopamine (DA). Rats were assessed using a concurrent fixed-ratio 5/chow feeding choice task that is known to be sensitive to dopaminergic manipulations. Tetrabenazine shifted response choice in rats, producing a dose-related decrease in lever pressing and a concomitant increase in chow intake. However, it did not alter food intake or preference in parallel free-feeding choice studies. The effects of tetrabenazine on effort-related choice were reversed by the adenosine A2A antagonist MSX-3 and the antidepressant bupropion. A behaviorally active dose of tetrabenazine decreased extracellular DA in nucleus accumbens and increased expression of DARPP-32 in accumbens medium spiny neurons in a pattern indicative of reduced transmission at both D1 and D2 DA receptors. These experiments demonstrate that tetrabenazine, which is used in animal models to produce depression-like effects, can alter effort-related choice behavior. These studies have implications for the development of animal models of the motivational symptoms of depression and related disorders.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits.