Selection of sucrose concentration depends on the effort required to obtain it: studies using tetrabenazine, D1, D2, and D3 receptor antagonists

Divergent Acute and Enduring Changes in 50-kHz Ultrasonic Vocalizations in Rats Repeatedly Treated With Amphetamine and Dopaminergic Antagonists: New Insights on the Role of Dopamine in Calling Behavior

BACKGROUND

Rats emit 50-kHz ultrasonic vocalizations (USVs) in response to nonpharmacological and pharmacological stimuli, with addictive psychostimulants being the most effective drugs that elicit calling behavior in rats. Earlier investigations found that dopamine D1-like and D2-like receptors modulate the emission of 50-kHz USVs stimulated in rats by the acute administration of addictive psychostimulants. Conversely, information is lacking on how dopamine D1-like and D2-like receptors modulate calling behavior in rats that are repeatedly treated with addictive psychostimulants.

METHODS

We evaluated the emission of 50-kHz USVs in rats repeatedly treated (×5 on alternate days) with amphetamine (1 mg/kg, i.p.) either alone or together with (1) SCH 23390 (0.1-1 mg/kg, s.c.), a dopamine D1 receptor antagonist; (2) raclopride (0.3-1 mg/kg, s.c.), a selective dopamine D2 receptor antagonist; or (3) a combination of SCH 23390 and raclopride (0.1 + 0.3 mg/kg, s.c.). Calling behavior of rats was recorded following pharmacological treatment, as well as in response to the presentation of amphetamine-paired cues and to amphetamine challenge (both performed 7 days after treatment discontinuation).

RESULTS

Amphetamine-treated rats displayed a sensitized 50-kHz USV emission during repeated treatment, as well as marked calling behavior in response to amphetamine-paired cues and to amphetamine challenge. Antagonism of D1 or D2 receptors either significantly suppressed or attenuated the emission of 50-kHz USVs in amphetamine-treated rats, with a maximal effect after synergistic antagonism of both receptors.

CONCLUSIONS

These results shed further light on how dopamine transmission modulates the emission of 50-kHz USVs in rats treated with psychoactive drugs.

Sex and age differences in mice models of effort-based decision-making and anergia in depression: the role of dopamine, and cerebral-dopamine-neurotrophic-factor

Mesolimbic dopamine (DA) regulates vigor in motivated behavior. While previous results have mainly been performed in male rodents, the present studies compared CD1 male and female mice in effort-based decision-making tests of motivation. These tests offered choices between several reinforcers that require different levels of effort (progressive ratio/choice task and 3-choice-T-maze task). Sweet reinforcers were used in both tasks. In the operant tasks, females worked harder as the task required more effort to access a 10% sucrose solution. Although males and females did not differ in preference for 10% vs 3% solutions under free concurrent presentation, females consumed more of the 10% solution when tested alone. The operant task requires a long period of training and changes in the DA system due to age can be mediating long-term changes in effort. Thus, age and sex factors were evaluated in the T-maze task, which requires only a short training period. Both sexes and ages were equally active when habituated to the running wheel (RW), but females consumed more sweet pellets than males, especially at an older age. Both sexes had a strong preference for the RW compared to more sedentary reinforcers in the 3-choice-T-maze test, but older animals spent less time running and ate more than the young ones. The DA-depleting agent tetrabenazine reduced time running in older mice but not in adolescents. Cerebral-dopamine-neurotrophic-factor was reduced in older mice of both sexes compared to adolescent mice. These results emphasize the importance of taking into account differences in sex and age when evaluating willingness to exert effort for specific reinforcers.

Effects of the dopamine depleting agent tetrabenazine in tests evaluating different components of depressive-like behavior in mice: sex-dependent response to antidepressant drugs with SERT and DAT blocker profiles

BACKGROUND

Depression is a disorder twice as common in women than in men. There are sex differences in the symptomatology and treatment response to this disorder. Impairments in behavioral activation (i.e. anergia, fatigue) are often seen in people with depression and are highly resistant to treatment. The role of mesolimbic dopamine (DA) in regulating behavioral activation has been extensively studied in male rodents, but little is known in female rodents.

OBJECTIVE

The present studies assessed potential sex differences in rodent paradigms used to study different components of depressive-like behavior, and in the treatment response to antidepressants with different mechanisms of action.

METHODS

Male and female CD1 mice received Tetrabenazine (TBZ), a VMAT-2 blocker that depletes DA and induces depressive symptoms in humans. Mice were tested on the Forced Swim Test, (FST), the Dark-Light box (DL), the elevated plus maze (EPM), Social Interaction (SI) test, and sucrose preference and consumption using the two bottles test. In addition, bupropion (a DA reuptake inhibitor) or fluoxetine (a serotonin reuptake inhibitor) were used to reverse TBZ-induced anergia.

RESULTS

In the FST, bupropion reversed TBZ effects in both sexes but fluoxetine was only effective in female mice. DA depletion did not affect other aspects of depression such as anxiety, sociability or sucrose consumption, and there was no interaction with bupropion on these parameters. In TBZ treated-females SERT-blockers may be effective at reversing anergia in aversive contexts (FST), and potentiating avoidance of anxiogenic stimuli.

CONCLUSIONS

Pro-dopaminergic antidepressants seem more efficacious at improving anergia in both sexes than SERT-blockers.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Anticipation: An Essential Feature of Anhedonia

The following essay addresses the evolution of the term "anhedonia" as a key construct in biological psychiatry, especially as it pertains to positive emotional and motivational states central to mental health and well-being. In its strictest definition, anhedonia was intended to convey an inability to experience "pleasure" derived from ingestion of sweet tastes or the experience of pleasant odors and tactile sensations, among a host of positive sensations. However, this definition has proved to be too restrictive to capture the complexity of key psychological factors linked to major depression, schizophrenia, and substance use disorders it was originally intended to address. Despite the appeal of the elegant simplicity of the term anhedonia, its limitations soon became apparent when used to explain psychological constructs including aspects of learning, memory, and incentive motivation that are major determinants of success in securing the necessities of life. Accordingly, the definition of anhedonia has morphed into a much broader term that includes key roles in the disturbance of motivation in the form of anergia, impaired incentive motivation, along with deficits in associative learning and key aspects of memory, on which the ability to predict the consequences of one's actions are based. Here we argue that it is this latter capacity, namely predicting the likely consequences of motivated behavior, which can be termed "anticipation," that is especially important in the key deficits implied by the general term anhedonia in the context of neuropsychiatric conditions.

Adolescent oxytocin administration reduces depression-like behaviour induced by early life stress in adult male and female rats

Early life stress (ELS) exposure alters brain development, increasing vulnerability for mental illness in adulthood, including depression. Despite this association, there are no approved pharmacotherapies to protect against the emergence of mental illness resulting from ELS. Recent preclinical work showed that oxytocin (OT) administration in adulthood reduced depressive-like behaviour in male rats with a history of ELS. However, the ability of an OT treatment regime in adolescence, a critical developmental window for the OT system, to prevent the expression of depressive-like behaviours following ELS has not been investigated. Therefore, the present study aimed to determine whether chronic OT administration can ameliorate the enduring effects of ELS on depressive-like behaviours in both male and female rats. Following birth, Long Evans rat pups (N = 107) underwent maternal separation (MS) for either 15 min (MS15) or 6 h (MS360) on postnatal days (PND) 1-21. During adolescence (PND 28-42), rats received a daily injection of either OT (1 mg/kg) or saline. During adulthood (PND 57 onwards), effort-related motivation was measured using a model of effortful choice (EC), while behavioural despair was measured using the forced swim test (FST). Lastly, body and organ weights were measured to examine the physiological impacts of ELS and chronic OT administration. Overall, in both sexes, MS360 increased behavioural despair yet had no impact on effort-related motivation. Importantly, adolescent OT administration prevented the MS360-induced increase in behavioural despair in both males and females. Additionally, MS360 resulted in persistent reductions in body weight in both sexes post-weaning and increased spleen weight in males and adrenal weight in females. OT treatment had no impact on body weight in either sex, but prevented the MS-induced increase in adrenal gland weight in females. Overall, these findings have important implications for using oxytocin as a preventative pharmacotherapy after ELS.

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence

Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has explored the neural basis of reward deficits in the context of depression, and has implicated mesocorticolimbic reward circuitry comprising the nucleus accumbens, ventral pallidum, ventral tegmental area, amygdala, hippocampus, anterior cingulate, insula, orbitofrontal cortex, and other prefrontal cortex regions. Dopamine modulates several reward facets including anticipation, motivation, effort, and learning. As well, serotonin, norepinephrine, opioids, glutamate, Gamma aminobutyric acid (GABA), and acetylcholine are also involved in anhedonia, and medications targeting these systems may also potentially normalize reward processing in depression. Unfortunately, whereas reward anticipation and reward outcome are extensively explored by both preclinical and clinical studies, translational gaps remain in reward motivation, effort, valuation, and learning, where clinical neuroimaging studies are in the early stages. This review aims to synthesize the neurobiological mechanisms underlying anhedonia in MDD uncovered by preclinical and clinical research. The translational difficulties in studying the neural basis of reward are also discussed.

Preference for vigorous exercise versus sedentary sucrose drinking: an animal model of anergia induced by dopamine receptor antagonism

Motivation has activational and directional components. Mesolimbic dopamine is critical for the regulation of behavioral activation and effort-related processes in motivated behaviors. Impairing mesolimbic dopamine function leads to fatigue and anergia, but leaves intact other aspects of reinforce seeking behaviors, such as the consummatory or hedonic component. In male Swiss mice, we characterized the impact of dopamine antagonism on the selection of concurrently presented stimuli that have different vigor requirements. We analyzed running wheel activity versus sucrose solution intake, typically used as a measure of anhedonia. Results are compared with data from nonconcurrent presentation to those stimuli. In the concurrent presentation experiment, control mice preferred to spend time running compared to sucrose intake. Dopamine antagonism shifted relative reinforcer preference, reducing time spent on the running wheel, but actually increasing time-consuming sucrose. Mice increased frequency of bouts for both reinforcers, suggesting that there was fatigue in the running wheel rather than aversion. Moreover, satiation or habituation by preexposing animals to both reinforcers did not shift preferences. In the nonconcurrent experiments, haloperidol reduced running wheel but had no impact on sucrose consumption. Dopamine antagonism did not change preference for sucrose or total volume consumed. Additional correlational analyses indicated that baseline differences in sucrose consumption were independent of baseline running or novelty exploration. Thus, dopamine antagonism seems to have anergic rather than anhedonic effects, and the concurrent presentation in this setting could be useful for assessing preferences based on effort requirements.

Impact of Fluoxetine on Behavioral Invigoration of Appetitive and Aversively Motivated Responses: Interaction With Dopamine Depletion

Impaired behavioral activation and effort-related motivational dysfunctions like fatigue and anergia are debilitating treatment-resistant symptoms of depression. Depressed people show a bias towards the selection of low effort activities. To determine if the broadly used antidepressant fluoxetine can improve behavioral activation and reverse dopamine (DA) depletion-induced anergia, male CD1 mice were evaluated for vigorous escape behaviors in an aversive context (forced swim test, FST), and also with an exercise preference choice task [running wheel (RW)-T-maze choice task]. In the FST, fluoxetine increased active behaviors (swimming, climbing) while reducing passive ones (immobility). However, fluoxetine was not effective at reducing anergia induced by the DA-depleting agent tetrabenazine, further decreasing vigorous climbing and increasing immobility. In the T-maze, fluoxetine alone produced the same pattern of effects as tetrabenazine. Moreover, fluoxetine did not reverse tetrabenazine-induced suppression of RW time but it reduced sucrose intake duration. This pattern of effects produced by fluoxetine in DA-depleted mice was dissimilar from devaluing food reinforcement by pre-feeding or making the food bitter since in both cases sucrose intake time was reduced but animals compensated by increasing time in the RW. Thus, fluoxetine improved escape in an aversive context but decreased relative preference for active reinforcement. Moreover, fluoxetine did not reverse the anergic effects of DA depletion. These results have implications for the use of fluoxetine for treating motivational symptoms such as anergia in depressed patients.

Energizing effects of bupropion on effortful behaviors in mice under positive and negative test conditions: modulation of DARPP-32 phosphorylation patterns

Motivational symptoms such as anergia, fatigue, and reduced exertion of effort are seen in depressed people. To model this, nucleus accumbens (Nacb) dopamine (DA) depletions are used to induce a low-effort bias in rodents tested on effort-based decision-making. We evaluated the effect of the catecholamine uptake blocker bupropion on its own, and after administration of tetrabenazine (TBZ), which blocks vesicular storage, depletes DA, and induces depressive symptoms in humans. Male CD1 mice were tested on a 3-choice-T-maze task that assessed preference between a reinforcer involving voluntary physical activity (running wheel, RW) vs. sedentary activities (sweet food pellet intake or a neutral non-social odor). Mice also were tested on the forced swim test (FST), two anxiety-related measures (dark-light box (DL), and elevated plus maze (EPM)). Expression of phosphorylated DARPP-32 (Thr34 and Thr75) was evaluated by immunohistochemistry as a marker of DA-related signal transduction. Bupropion increased selection of RW activity on the T-maze. TBZ reduced time running, but increased time-consuming sucrose, indicating an induction of a low-effort bias, but not an effect on primary sucrose motivation. In the FST, bupropion reduced immobility, increasing swimming and climbing, and TBZ produced the opposite effects. Bupropion reversed the effects of TBZ on the T-maze and the FST, and also on pDARPP32-Thr34 expression in Nacb core. None of these manipulations affected anxiety-related parameters. Thus, bupropion improved active behaviors, which were negatively motivated in the FST, and active behaviors that were positively motivated in the T-maze task, which has implications for using catecholamine uptake inhibitors for treating anergia and fatigue-like symptoms.

Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults

Dopamine (DA) plays a key role in reward processing and is implicated in psychological disorders such as depression, substance use, and schizophrenia. The role of DA in reward processing is an area of highly active research. One approach to this question is drug challenge studies with drugs known to alter DA function. These studies provide good experimental control and can be performed in parallel in laboratory animals and humans. This review aimed to summarize results of studies using pharmacological manipulations of DA in healthy adults. 'Reward' is a complex process, so we separated 'phases' of reward, including anticipation, evaluation of cost and benefits of upcoming reward, execution of actions to obtain reward, pleasure in response to receiving a reward, and reward learning. Results indicated that i) DAergic drugs have different effects on different phases of reward; ii) the relationship between DA and reward functioning appears unlikely to be linear; iii) our ability to detect the effects of DAergic drugs varies depending on whether subjective, behavioral, imaging measures are used.

Behavioral and dopamine transporter binding properties of the modafinil analog (S, S)-CE-158: reversal of the motivational effects of tetrabenazine and enhancement of progressive ratio responding

RATIONALE

Atypical dopamine (DA) transport blockers such as modafinil and its analogs may be useful for treating motivational symptoms of depression and other disorders. Previous research has shown that the DA depleting agent tetrabenazine can reliably induce motivational deficits in rats, as evidenced by a shift towards a low-effort bias in effort-based choice tasks. This is consistent with human studies showing that people with major depression show a bias towards low-effort activities.

OBJECTIVES

Recent studies demonstrated that the atypical DA transport (DAT) inhibitor (S)-CE-123 reversed tetrabenazine-induced motivational deficits, increased progressive ratio (PROG) lever pressing, and increased extracellular DA in the nucleus accumbens. In the present studies, a recently synthesized modafinil analog, (S, S)-CE-158, was assessed in a series of neurochemical and behavioral studies in rats.

RESULTS

(S, S)-CE-158 demonstrated the ability to reverse the effort-related effects of tetrabenazine and increase selection of high-effort PROG lever pressing in rats tested on PROG/chow feeding choice task. (S, S)-CE-158 showed a high selectivity for inhibiting DAT compared with other monoamine transporters, and systemic administration of (S, S)-CE-158 increased extracellular DA in the nucleus accumbens during the behaviorally active time course, which is consistent with the effects of (S)-CE-123 and other DAT inhibitors that enhance high-effort responding.

CONCLUSIONS

These studies provide an initial neurochemical characterization of a novel atypical DAT inhibitor, and demonstrate that this compound is active in models of effort-related choice. This research could contribute to the development of novel compounds for the treatment of motivational dysfunctions in humans.

Dissociating the effects of dopamine D2 receptors on effort-based versus value-based decision making using a novel behavioral approach

Cost-benefit decision making is essential for organisms to adapt to their ever-changing environment. Most studies of cost-benefit decision making involve choice conditions in which effort and value are varied simultaneously. This prevents identification of the aspects of cost-benefit decision making that are affected by experimental manipulations. We developed operant assays to isolate the individual impacts of effort and value manipulations on cost-benefit decision making. In the concurrent effort choice (CEC) task, mice choose between exerting two distinct types of effort: the number of responses and the duration of a response, to earn the same reward. By parametrically varying response cost, psychometric functions are obtained that reflect how the two types of effort scale against one another. Direct manipulations of effort shift the functions. Because reward value is held constant in this task, differences in scaling of the two response types must be related to the effort manipulations. In the concurrent value choice (CVC) task, mice make the same type of response to earn rewards of different value (e.g., pellets vs. sucrose solutions). Here the effort required to earn one reward type is parametrically varied to obtain the psychometric function that scales the value of the two rewards into the number of responses subjects will pay to earn one reward over the other. Direct value manipulations shift these functions. We tested the effect of the dopamine D2 receptor antagonist, haloperidol, on performance in the CEC and CVC assays and found that D2R signaling is important for effort-based, but not value-based decision making. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

The novel atypical dopamine transport inhibitor CT-005404 has pro-motivational effects in neurochemical and inflammatory models of effort-based dysfunctions related to psychopathology

Depressed individuals suffer from effort-related motivational symptoms such as anergia and fatigue, which are resistant to treatment with many common antidepressants. While drugs that block dopamine transport (DAT) reportedly have positive motivational effects, DAT inhibitors such as cocaine and amphetamines produce undesirable side effects. Thus, there is a need to develop and characterize novel atypical DAT inhibitors with unique and selective binding profiles. Rodent effort-based choice tasks provide useful models of motivational dysfunctions. With these tasks, animals choose between a high-effort instrumental action leading to highly valued reinforcement vs. a low effort/low reward option. The present studies focused on the initial characterization of a novel atypical DAT inhibitor, CT-005404, which binds to DAT with high selectivity relative to serotonin and norepinephrine transport, and produces long-term elevations of extracellular DA. CT-005404 was assessed for its ability to attenuate the effort-related motivational effects of the DA depleting agent tetrabenazine and the pro-inflammatory cytokine interleukin-1β (IL-1β) using a fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg i.p.) shifted choice behavior, decreasing lever pressing and increasing chow intake. IL-1β (4.0 μg/kg i.p.) also decreased lever pressing. CT-005404 was co-administered (7.5-30.0 mg/kg p.o.) with either tetrabenazine or IL-1β, and the 15.0 and 30.0 mg/kg doses significantly reversed the effects of tetrabenazine and IL-1β. CT-005404 administered alone produced a dose-related increase in lever pressing in rats tested on a progressive ratio/chow feeding choice task. Atypical DAT inhibitors such as CT-005404 offer potential as a new avenue for drug treatment of motivational dysfunctions in humans.

The non-selective adenosine antagonist theophylline reverses the effects of dopamine antagonism on tremor, motor activity and effort-based decision-making

Considerable evidence indicates that adenosine and dopamine systems interact in the regulation of basal ganglia function. Nonselective adenosine antagonists such as the methylxanthine caffeine as well as selective adenosine A_2A antagonists have been shown to produce antiparkinsonian and antidepressant effects in animal models. The present studies were conducted to assess if another methylxantine, theophylline, can reverse motor and motivational impairments induced by dopamine antagonism in rats. RESULTS: Theophylline (3.75-30.0 mg/kg, IP) reversed tremulous jaw movements (TJMs), catalepsy, and locomotor suppression induced by the dopamine D2 antagonist pimozide. It also reversed TJMs induced by the muscarinic receptor agonist pilocarpine, which is a well-known tremorogenic agent. Parallel studies assessed the ability of theophylline (5.0-20.0 mg/kg, IP) to reverse the changes in effort-related choice behavior induced by the dopamine D1 antagonist ecopipam (0.2 mg/kg, IP) and the D2 antagonist haloperidol (0.1 mg/kg, IP). Rats were tested on two different operant choice tasks which assess the tendency to work for a preferred reinforcer by lever pressing (for palatable pellets or a high 5% sucrose solution) vs. approaching and consuming a less preferred reinforcer (freely available lab chow or a less concentrated 0.3% sucrose solution). Theophylline restored food and sucrose-reinforced lever pressing in animals treated with the D2 antagonist. However, it was unable to reverse the effects of the D1 antagonist. Overall, the effects of theophylline resembled those previously reported for adenosine A_2A antagonists, and suggest that theophylline could be clinically useful for the treatment of motor and motivational symptoms in humans.

Kamikihito Enhances Cognitive Functions and Reward-Related Behaviors of Aged C57BL/6J Mice in an Automated Behavioral Assay System

The cognitive and psychological domains of frailty in the elderly have drawn increasing attention given the aging of society. However, therapeutics to treat minor deficits in cognition and mental state in the elderly remain an unmet need. Kamikihito (KKT), a traditional Japanese Kampo medicine indicated for neuroses, anxiety, and insomnia, is effective for treating cognitive dysfunction and depressive-like behaviors in animal models, suggesting that it may have therapeutic potential for treating cognitive and/or mental frailty. In this study, we first validated the known anxiolytic effects of KKT in a conventional maze test. We then introduced an automated behavioral assay system, IntelliCage, to evaluate the therapeutic potential of KKT for age-related and diverse central functions by performing sequential behavioral tasks in young and aged mice to assess basal activities, cognitive functions, perseveration, and hedonic-related behaviors. Although young mice treated with KKT did not exhibit changes in diurnal variation, KKT-administered aged mice exhibited an accelerated decline in voluntary activity during the early part of the light period, implying that KKT may promote sleep onset in aged mice. Neither place learning acquisition for gaining rewards nor subsequent behavioral flexibility performance was altered by KKT in the young group, whereas the aged KKT group exhibited significantly enhanced performance in both phases of learning relative to age-matched controls. Conversely, perseverative nose-pokes (NPs) to gain rewards observed during place learning, indicative of compulsivity, were attenuated by KKT in both age groups. Regarding hedonic processing, aged mice exhibited a decreased preference for sweet solutions compared to young mice, which was effectively reversed by KKT treatment. Furthermore, KKT elevated high-effort choices for high-value reward in an effort-based decision-making paradigm in both age groups, implying augmentation of motivational behaviors by KKT. Collectively, KKT exerted various beneficial effects in cognitive and emotional domains, several of which were more evident in aged mice than in young mice, suggesting the potential of KKT for treating cognitive and mental frailty.

Preference for Exercise vs. More Sedentary Reinforcers: Validation of an Animal Model of Tetrabenazine-Induced Anergia

Physical activities can have intrinsic motivational or reinforcing properties. The choice to engage in voluntary physical activity is undertaken in relation to the selection of other alternatives, such as sedentary behaviors, drugs, or food intake. The mesolimbic dopamine (DA) system plays a critical role in behavioral activation or exertion of effort, and DA antagonism or depletion induces anergia in effort-based decision-making tasks. However, little is known about the neural mechanisms underlying the decision-making processes that establish preferences for sedentary vs. activity-based reinforcers. In the present work with male CD1 mice, we evaluated the effect of tetrabenazine (TBZ), a DA-depleting agent, on a three-choice T-maze task developed to assess preference between reinforcers with different behavioral activation requirements and sensory properties [i.e., a running wheel (RW) vs. sweet pellets or a neutral nonsocial odor]. We also studied the effects of TBZ on the forced swim test (FST), which measures climbing and swimming in a stressful setting, and on anxiety tests [dark-light (DL) box and elevated plus maze (EPM)]. In the three-choice task, TBZ reduced time running in the wheel but increased time spent consuming sucrose, thus indicating reduced activation but relatively intact sucrose reinforcement. The effect of TBZ was not mimicked by motivational manipulations that change the value of the reinforcers, such as making the RW aversive or harder to move, food-restricting the animals, inducing a binge-like eating pattern, or introducing social odors. In the FST, TBZ decreased time climbing (most active behavior) and increased immobility but did not affect anxiety in the DL or EPM. These results indicate that the three-choice T-maze task could be useful for assessing DA modulation of preferences for exercise based on activation and effort requirements, differentiating those effects from changes in preference produced by altering physical requirements, food restriction state, and stress during testing.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

Role of Mesolimbic Brain-Derived Neurotrophic Factor in Depression

Brain-derived neurotrophic factor (BDNF) is widely accepted as being critical for neural and synaptic plasticity throughout the nervous system. Recent work has shown that BDNF in the mesolimbic dopamine (DA) circuit, originating in ventral tegmental area DA neurons that project to the nucleus accumbens, is crucial in the development of depressive-like behaviors following exposure to chronic social defeat stress in mice. Whereas BDNF modulates DA signaling in encoding responses to acute defeat stress, BDNF signaling alone appears to be responsible for the behavioral effects after chronic social defeat stress. Very different patterns are seen with another widely used chronic stress paradigm in mice, chronic mild stress (also known as chronic variable or unpredictable stress), where DA signaling, but not BDNF signaling, is primarily responsible for the behavioral effects observed. This review discusses the molecular, cellular, and circuit basis of this dramatic discrepancy, which appears to involve the nature of the stress, its severity and duration, and its effects on distinct cell types within the ventral tegmental area-to-nucleus accumbens mesolimbic circuit.

The Novel Atypical Dopamine Uptake Inhibitor (S)-CE-123 Partially Reverses the Effort-Related Effects of the Dopamine Depleting Agent Tetrabenazine and Increases Progressive Ratio Responding

Animal studies of effort-based choice behavior are being used to model effort-related motivational dysfunctions in humans. With these procedures, animals are offered a choice between high-effort instrumental actions leading to highly valued reinforcers vs. low effort/low reward options. Several previous studies have shown that dopamine (DA) uptake inhibitors, including GBR12909, lisdexamfetamine, methylphenidate, and PRX-14040, can reverse the effort-related effects of the vesicular monoamine transport blocker tetrabenazine, which inhibits DA storage. Because many drugs that block DA transport act as major stimulants that also release DA, and produce a number of undesirable side effects, there is a need to develop and characterize novel atypical DA transport inhibitors. (S)-CE-123 ((S)-5-((benzhydrylsulfinyl) methyl)thiazole) is a recently developed analog of modafinil with the biochemical characteristics of an atypical DA transport blocker. The present paper describes the enantioselective synthesis and initial chemical characterization of (S)-CE-123, as well as behavioral experiments involving effort-based choice and microdialysis studies of extracellular DA. Rats were assessed using the fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg) shifted choice behavior, decreasing lever pressing and increasing chow intake. (S)-CE-123 was coadministered at doses ranging from 6.0 to 24.0 mg/kg, and the highest dose partially but significantly reversed the effects of tetrabenazine, although this dose had no effect on fixed ratio responding when administered alone. Additional experiments showed that (S)-CE-123 significantly increased lever pressing on a progressive ratio/chow feeding choice task and that the effective dose (24.0 mg/kg) increased extracellular DA in nucleus accumbens core. In summary, (S)-CE-123 has the behavioral and neurochemical profile of a compound that can block DA transport, reverse the effort-related effects of tetrabenazine, and increase selection of high-effort progressive ratio responding. This suggests that (S)-CE-123 or a similar compound could be useful as a treatment for effort-related motivational dysfunction in humans.

Mir363-3p attenuates post-stroke depressive-like behaviors in middle-aged female rats

Women are more likely to develop Post Stroke Depression (PSD) than men and generally do not respond well to anti-depressants with age. This study investigated the effect of microRNA mir363-3p treatment on PSD using a physiologically-relevant animal model. Our previous work showed that mir363-3p treatment, delivered post-stroke, effectively reduces infarct volume in the acute phase of stroke in middle-aged females but not males. Middle-aged female Sprague Dawley rats were tested for baseline sensory motor function and depressive-like behaviors, and then subjected to ischemic stroke via middle cerebral artery occlusion (MCAo) or sham surgery. Animals received either control oligos (MCAo+scrambled, Sham+scrambled) or mir363-3p (MCAo+mir363-3p, Sham+mir363-3p) treatment 4 h later. Sensory motor function and depressive-like behaviors were reassessed up to 100 d after stroke, and circulating levels of IL-6, TNF-alpha and Brain-Derived Neurotrophic Factor (BDNF) were quantified at regular intervals. Prior to termination, Fluorogold was injected into the striatum to assess meso-striatal projections. MCAo+scrambled animals had impaired sensorimotor performance in the acute phase (5 days) of stroke and developed anhedonia, decreased sociability and increased helplessness in the chronic phase. MCAo+mir363-3p animals showed significantly less sensory motor impairment and fewer depressive-like behaviors. IL-6 and TNF-alpha were elevated transiently at 4 weeks after MCAo in both groups. BDNF levels decreased progressively after stroke in the MCAo+scrambled group, and this was attenuated in the mir363-3p group. The number of retrogradely-labeled SNc and VTA cells was reduced in the ischemic hemisphere of the MCAo+scrambled group. In contrast, there was no interhemispheric difference in the number of retrogradely-labeled SNc and VTA cells of MCAo+mir363-3p treated animals. Our results support a therapeutic role for mir363-3p for long-term stroke disability.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Translational tests involving non-reward: methodological considerations

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson's disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Animal models of fatigue in major depressive disorder

Fatigue is common in a host of neurological and psychiatric disorders including depression and often continues unabated even after primary symptoms of disease are treated. Its high estimated prevalence combined with the lack of effective medicines has engaged the preclinical research community to search for fatigue models. The present review briefly summarizes the most common animal models that have been brought forward along with some of the associated pharmacological validation data. Like all preclinical models, these models have issues that need to be appreciated in the generation and interpretation of data for the purposes of translation to human disease; specifically, there are deficiencies in construct validity, a lack of medicines that effectively address residual fatigue symptoms, and difficulties in defining specificity with respect to drug effects on fatigue per se. Nonetheless, existing animal models of fatigue arguably serve the valuable purpose of encouraging research in this large area of unmet medical need. Data from these models are predicted to engender human experimentation and the further development of improved model systems.

Making Sense of Rodent Models of Anhedonia

A markedly reduced interest or pleasure in activities previously considered pleasurable is a main symptom in mood disorder and psychosis and is often present in other psychiatric disorders and neurodegenerative diseases. This condition can be labeled as "anhedonia," although in its most rigorous connotation the term refers to the lost capacity to feel pleasure that is one aspect of the complex phenomenon of processing and responding to reward. The responses to rewarding stimuli are relatively easy to study in rodents, and the experimental conditions that consistently and persistently impair these responses are used to model anhedonia. To this end, long-term exposure to environmental aversive conditions is primarily used, and the resulting deficits in reward responses are often accompanied by other deficits that are mainly reminiscent of clinical depressive symptoms. The different components of impaired reward responses induced by environmental aversive events can be assessed by different tests or protocols that require different degrees of time allocation, technical resources, and equipment. Rodent models of anhedonia are valuable tools in the study of the neurobiological mechanisms underpinning impaired behavioral responses and in the screening and characterization of drugs that may reverse these behavioral deficits. In particular, the antianhedonic or promotivational effects are relevant features in the spectrum of activities of drugs used in mood disorders or psychosis. Thus, more than the model, it is the choice of tests that is crucial since it influences which facets of anhedonia will be detected and should be tuned to the purpose of the study.

Dopamine depletion shifts behavior from activity based reinforcers to more sedentary ones and adenosine receptor antagonism reverses that shift: Relation to ventral striatum DARPP32 phosphorylation patterns

The mesolimbic dopamine (DA) system plays a critical role in behavioral activation and effort-based decision-making. DA depletion produces anergia (shifts to low effort options) in animals tested on effort-based decision-making tasks. Caffeine, the most consumed stimulant in the world, acts as an adenosine A₁/A_2A receptor antagonist, and in striatal areas DA D₁ and D₂ receptors are co-localized with adenosine A₁ and A_2A receptors respectively. In the present work, we evaluated the effect of caffeine on anergia induced by the VMAT-2 inhibitor tetrabenazine (TBZ), which depletes DA. Anergia was evaluated in a three-chamber T-maze task in which animals can chose between running on a wheel (RW) vs. sedentary activities such as consuming sucrose or sniffing a neutral odor. TBZ-caffeine interactions in ventral striatum were evaluated using DARPP-32 phosphorylation patterns as an intracellular marker of DA-adenosine receptor interaction. In the T-maze, control mice spent more time running and much less consuming sucrose or sniffing. TBZ (4.0 mg/kg) reduced ventral striatal DA tissue levels as measured by HPLC, and also shifted preferences in the T-maze, reducing selection of the reinforcer that involved vigorous activity (RW), but increasing consumption of a reinforcer that required little effort (sucrose), at doses that had no effect on independent measures of appetite or locomotion in a RW. Caffeine at doses that had no effect on their own reversed the effects of TBZ on T-maze performance, and also suppressed TBZ-induced pDARPP-32(Thr34) expression as measured by western blot, suggesting a role for D₂-A_2A interactions. These results support the idea that DA depletion produces anergia, but does not affect the primary motivational effects of sucrose. Caffeine, possibly by acting on A_2A receptors in ventral striatum, reversed the DA depletion effects. It is possible that caffeine, like selective adenosine A2A antagonists, could have some therapeutic benefit for treating effort-related symptoms.

Caffeine and Selective Adenosine Receptor Antagonists as New Therapeutic Tools for the Motivational Symptoms of Depression

Major depressive disorder is one of the most common and debilitating psychiatric disorders. Some of the motivational symptoms of depression, such anergia (lack of self-reported energy) and fatigue are relatively resistant to traditional treatments such as serotonin uptake inhibitors. Thus, new pharmacological targets are being investigated. Epidemiological data suggest that caffeine consumption can have an impact on aspects of depressive symptomatology. Caffeine is a non-selective adenosine antagonist for A1/A2A receptors, and has been demonstrated to modulate behavior in classical animal models of depression. Moreover, selective adenosine receptor antagonists are being assessed for their antidepressant effects in animal studies. This review focuses on how caffeine and selective adenosine antagonists can improve different aspects of depression in humans, as well as in animal models. The effects on motivational symptoms of depression such as anergia, fatigue, and psychomotor slowing receive particular attention. Thus, the ability of adenosine receptor antagonists to reverse the anergia induced by dopamine antagonism or depletion is of special interest. In conclusion, although further studies are needed, it appears that caffeine and selective adenosine receptor antagonists could be therapeutic agents for the treatment of motivational dysfunction in depression.

Individual differences in the energizing effects of caffeine on effort-based decision-making tests in rats

Motivated behavior is characterized by activation and high work output. Nucleus accumbens (Nacb) modulates behavioral activation and effort-based decision-making. Caffeine is widely consumed because of its energizing properties. This methylxanthine is a non-selective adenosine A₁/A_2A receptor antagonist. Adenosine receptors are highly concentrated in Nacb. Adenosine agonists injected into Nacb, shift preference towards low effort alternatives. The present studies characterized effort-related effects of caffeine in a concurrent progressive ratio (PROG)/free reinforcer choice procedure that requires high levels of work output, and generates great variability among different animals. Male Sprague-Dawley rats received an acute dose of caffeine (2.5-20.0 mg/kg, IP) and 30 min later were tested in operant boxes. One group was food-restricted and had to lever pressed for high carbohydrate pellets, another group was non-food-restricted and lever pressed for a high sucrose solution. Caffeine (2.5 and 5.0 mg/kg) increased lever pressing in food-restricted animals that were already high responders. However, in non-restricted animals, caffeine (5.0 and 10.0 mg/kg) increased work output only among low responders. In fact, caffeine (10.0 and 20.0 mg/kg) in non-restricted animals, reduced lever pressing among high responders in the PROG task, and also in a different group of animals lever pressing in an easy task (fixed ratio 7 schedule) that uniformly generates high levels of responding. Caffeine did not modify sucrose preference or consumption under free access conditions. Thus, when animals do not have a homeostatic need, caffeine can help those not very intrinsically motivated to work harder for a more palatable reward. However, caffeine can disrupt performance of animals intrinsically motivated to work hard for a better reward.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Escitalopram and NHT normalized stress-induced anhedonia and molecular neuroadaptations in a mouse model of depression

Anhedonia is defined as a diminished ability to obtain pleasure from otherwise positive stimuli. Anxiety and mood disorders have been previously associated with dysregulation of the reward system, with anhedonia as a core element of major depressive disorder (MDD). The aim of the present study was to investigate whether stress-induced anhedonia could be prevented by treatments with escitalopram or novel herbal treatment (NHT) in an animal model of depression. Unpredictable chronic mild stress (UCMS) was administered for 4 weeks on ICR outbred mice. Following stress exposure, animals were randomly assigned to pharmacological treatment groups (i.e., saline, escitalopram or NHT). Treatments were delivered for 3 weeks. Hedonic tone was examined via ethanol and sucrose preferences. Biological indices pertinent to MDD and anhedonia were assessed: namely, hippocampal brain-derived neurotrophic factor (BDNF) and striatal dopamine receptor D2 (Drd2) mRNA expression levels. The results indicate that the UCMS-induced reductions in ethanol or sucrose preferences were normalized by escitalopram or NHT. This implies a resemblance between sucrose and ethanol in their hedonic-eliciting property. On a neurobiological aspect, UCMS-induced reduction in hippocampal BDNF levels was normalized by escitalopram or NHT, while UCMS-induced reduction in striatal Drd2 mRNA levels was normalized solely by NHT. The results accentuate the association of stress and anhedonia, and pinpoint a distinct effect for NHT on striatal Drd2 expression.

Oral Ingestion and Intraventricular Injection of Curcumin Attenuates the Effort-Related Effects of the VMAT-2 Inhibitor Tetrabenazine: Implications for Motivational Symptoms of Depression

Effort-related choice tasks are used for studying depressive motivational symptoms such as anergia/fatigue. These studies investigated the ability of the dietary supplement curcumin to reverse the low-effort bias induced by the monoamine storage blocker tetrabenazine. Tetrabenazine shifted effort-related choice in rats, decreasing high-effort lever pressing but increasing chow intake. The effects of tetrabenazine were reversed by oral ingestion of curcumin (80.0-160.0 mg/kg) and infusions of curcumin into the cerebral ventricles (2.0-8.0 μg). Curcumin attenuates the effort-related effects of tetrabenazine in this model via actions on the brain, suggesting that curcumin may be useful for treating human motivational symptoms.

Can We Selectively Reduce Appetite for Energy-Dense Foods? An Overview of Pharmacological Strategies for Modification of Food Preference Behavior

Excessive intake of food, especially palatable and energy-dense carbohydrates and fats, is largely responsible for the growing incidence of obesity worldwide. Although there are a number of candidate antiobesity drugs, only a few of them have been proven able to inhibit appetite for palatable foods without the concurrent reduction in regular food consumption. In this review, we discuss the interrelationships between homeostatic and hedonic food intake control mechanisms in promoting overeating with palatable foods and assess the potential usefulness of systemically administered pharmaceuticals that impinge on the endogenous cannabinoid, opioid, aminergic, cholinergic, and peptidergic systems in the modification of food preference behavior. Also, certain dietary supplements with the potency to reduce specifically palatable food intake are presented. Based on human and animal studies, we indicate the most promising therapies and agents that influence the effectiveness of appetite-modifying drugs. It should be stressed, however, that most of the data included in our review come from preclinical studies; therefore, further investigations aimed at confirming the effectiveness and safety of the aforementioned medications in the treatment of obese humans are necessary.

Blockade of uptake for dopamine, but not norepinephrine or 5-HT, increases selection of high effort instrumental activity: Implications for treatment of effort-related motivational symptoms in psychopathology

Deficits in behavioral activation, exertion of effort, and other psychomotor/motivational symptoms are frequently seen in people with depression and other disorders. Depressed people show a decision bias towards selection of low effort activities, and animal tests of effort-related decision making are being used as models of motivational dysfunctions seen in psychopathology. The present studies investigated the ability of drugs that block dopamine transport (DAT), norepinephrine transport (NET), and serotonin transport (SERT) to modulate work output in rats responding on a test of effort-related decision making (i.e., a progressive ratio (PROG)/chow feeding choice task). With this task, rats choose between working for a preferred food (high carbohydrate pellets) by lever pressing on a PROG schedule vs. obtaining a less preferred lab chow that is freely available in the chamber. The present studies focused on the effects of the selective DAT inhibitor GBR12909, the selective SERT inhibitor fluoxetine, and the selective NET inhibitors desipramine and atomoxetine. Acute and repeated administration of GBR12909 shifted choice behavior, increasing measures of PROG lever pressing but decreasing chow intake. In contrast, fluoxetine, desipramine and atomoxetine failed to increase lever pressing output, and actually decreased it at higher doses. In the behaviorally effective dose range, GBR12909 elevated extracellular dopamine levels in accumbens core as measured by microdialysis, but fluoxetine, desipramine and atomoxetine decreased extracellular dopamine. Thus, blockade of DAT increases selection of the high effort instrumental activity, while inhibition of SERT or NET does not. These results have implications for the use of monoamine uptake inhibitors for the treatment of effort-related psychiatric symptoms in humans.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

Effects of lisdexamfetamine and s-citalopram, alone and in combination, on effort-related choice behavior in the rat

RATIONALE

Effort-related motivational symptoms, such as anergia, psychomotor retardation, and fatigue, are an important aspect of depression and other disorders. Motivational symptoms are resistant to some treatments, including serotonin transport (SERT) inhibitors.

OBJECTIVES

Tests of effort-based choice using operant behavior tasks (e.g., concurrent lever pressing/ chow feeding tasks) can be used as animal models of motivational symptoms. Tests of effort-related choice allow animals to choose between high-effort actions that lead to more highly valued rewards vs. low-effort alternatives that lead to less valued rewards (i.e., less preferred or lower magnitude). Rats treated with the vesicular monoamine transport inhibitor tetrabenazine, or the cytokine interleukin-1β (IL-1β), which are associated with depressive symptoms in humans, can alter effort-related choice, reducing selection of the high effort alternative (lever pressing) while increasing intake of freely available chow.

METHODS

The present studies focused upon the ability of lisdexamfetamine (LDX) to increase exertion of effort in rats responding on effort-based choice tasks under several different conditions.

RESULTS

LDX attenuated the shift from fixed ratio 5 lever pressing to chow intake induced by tetrabenazine and IL-1β. In contrast, the SERT inhibitor s-citalopram failed to reverse the effects of tetrabenazine. When given in combination with tetrabenazine+s-citalopram, LDX significantly increased lever pressing output compared to tetrabenaine+citalopram alone. LDX also increased work output in rats responding on a progressive ratio/chow feeding choice task.

CONCLUSIONS

LDX can increase work output in rats responding on effort-based choice tasks, which may have implications for understanding the neurochemistry of motivational symptoms in humans.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Choosing voluntary exercise over sucrose consumption depends upon dopamine transmission: effects of haloperidol in wild type and adenosine A₂AKO mice

RATIONALE

Mesolimbic dopamine (DA) regulates behavioral activation and effort-related decision-making in motivated behaviors. Mesolimbic DA D2 receptors are co-localized with adenosine A2A receptors, and they interact in an antagonistic manner.

OBJECTIVES

A T-maze task was developed to assess dopaminergic involvement in preference between a reinforcer that involves vigorous voluntary activity (running wheel) and a reinforcer that requires minimal behavioral activation (sucrose pellets). Haloperidol (D2 antagonist) was administered to adenosine A2A receptor knockout (A2AKO) and wild-type (WT) littermate controls to assess the involvement of these two receptors in the selection of running wheel activity versus sucrose consumption.

RESULTS

Under control conditions, mice spent more time running and less time eating. In WT mice, haloperidol reduced time running but actually increased time-consuming sucrose. However, A2AKO mice did not show the haloperidol-induced shift from running wheel activity to sucrose intake. Prefeeding reduced sucrose consumption in the T-maze in both strains, indicating that this paradigm is sensitive to motivational devaluation. Haloperidol increased c-Fos immunoreactivity in anterior cingulate cortex (ACg) and nucleus accumbens (Acb) core of WT but not KO mice.

CONCLUSIONS

These results indicate that after DA antagonism, the preference for vigorous physical activity is reduced, while palatable food selection increases. Adenosine A2A receptor deletion provides resistance to these effects of D2 receptor antagonism. These two receptors in Acb core and ACg seem to be involved in the regulation of the intrinsic reinforcing characteristics of voluntary exercise but not in the regulation of the primary reinforcing characteristics of palatable sedentary reinforcers.

Not All Antidepressants Are Created Equal: Differential Effects of Monoamine Uptake Inhibitors on Effort-Related Choice Behavior

Motivated behavior can be characterized by behavioral activation and high work output. Moreover, people with depression and other disorders show effort-related motivational symptoms, such as anergia, psychomotor retardation, and fatigue. Effort-based decision making is studied using tasks offering choices between high effort options leading to highly valued reinforcers vs low effort/low reward options, and such tasks could be useful as animal models of motivational symptoms. In the present studies the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine (TBZ) were investigated. TBZ blocks vesicular storage and also produces depressive symptoms in humans. Moreover, TBZ alters effort-based choice in rats, biasing animals toward low effort alternatives. The present studies investigated the ability of acute administration of various monoamine uptake inhibitors to reverse the effects of TBZ. Effort-related effects of TBZ were attenuated by the catecholamine uptake inhibitor and antidepressant bupropion, and this effect of bupropion was reversed by either D1 or D2 family antagonism. The effort-related effects of TBZ were also attenuated by the selective dopamine uptake blocker GBR12909. The 5-HT uptake inhibitor fluoxetine and the norepinephrine uptake inhibitor desipramine failed to reverse the effects of TBZ, and higher doses of these drugs, given alone or in combination with TBZ, led to further behavioral impairments. These results indicate that drugs acting on dopamine transmission are relatively effective at reversing the effort-related effects of TBZ, and are consistent with the hypothesis that drugs that enhance dopamine transmission may be effective at treating effort-related psychiatric symptoms in humans.

Stress effects on the neural substrates of motivated behavior

Exposure to stress has profound, but complex, actions on motivated behavior and decision-making. These effects are central to core symptoms of a number of psychiatric disorders that are precipitated or augmented by stress, such as depressive disorders and substance use disorders. Studying the neural substrates of stress's effects on motivation has revealed that stress affects multiple targets on circuits throughout the brain using diverse molecular signaling processes. Moreover, stress does not have unitary effects on motivated behavior, but differences in the intensity, duration, intermittency, controllability and nature of the stressor produce qualitatively and quantitatively different behavioral endpoints. Unsurprisingly, the results of neuroscientific investigations into stress and motivation often open more questions than they resolve. Here we discuss contemporary results pertaining to the neural mechanisms by which stress alters motivation, identify points of contention and highlight integrative areas for continuing research into these multifaceted complexities.

Inflammatory Pain Promotes Increased Opioid Self-Administration: Role of Dysregulated Ventral Tegmental Area μ Opioid Receptors

Pain management in opioid abusers engenders ethical and practical difficulties for clinicians, often resulting in pain mismanagement. Although chronic opioid administration may alter pain states, the presence of pain itself may alter the propensity to self-administer opioids, and previous history of drug abuse comorbid with chronic pain promotes higher rates of opioid misuse. Here, we tested the hypothesis that inflammatory pain leads to increased heroin self-administration resulting from altered mu opioid receptor (MOR) regulation of mesolimbic dopamine (DA) transmission. To this end, the complete Freund's adjuvant (CFA) model of inflammation was used to assess the neurochemical and functional changes induced by inflammatory pain on MOR-mediated mesolimbic DA transmission and on rat intravenous heroin self-administration under fixed ratio (FR) and progressive ratio (PR) schedules of reinforcement. In the presence of inflammatory pain, heroin intake under an FR schedule was increased for high, but attenuated for low, heroin doses with concomitant alterations in mesolimbic MOR function suggested by DA microdialysis. Consistent with the reduction in low dose FR heroin self-administration, inflammatory pain reduced motivation for a low dose of heroin, as measured by responding under a PR schedule of reinforcement, an effect dissociable from high heroin dose PR responding. Together, these results identify a connection between inflammatory pain and loss of MOR function in the mesolimbic dopaminergic pathway that increases intake of high doses of heroin. These findings suggest that pain-induced loss of MOR function in the mesolimbic pathway may promote opioid dose escalation and contribute to opioid abuse-associated phenotypes.

SIGNIFICANCE STATEMENT

This study provides critical new insights that show that inflammatory pain alters heroin intake through a desensitization of MORs located within the VTA. These findings expand our knowledge of the interactions between inflammatory pain and opioid abuse liability, and should help to facilitate the development of novel and safer opioid-based strategies for treating chronic pain.

Mesolimbic Dopamine and the Regulation of Motivated Behavior

It has been known for some time that nucleus accumbens dopamine (DA) is involved in aspects of motivation , but theoretical approaches to understanding the functions of DA have continued to evolve based upon emerging data and novel concepts. Although it has become traditional to label DA neurons as "reward" neurons, the actual findings are more complicated than that, because they indicate that DA neurons can respond to a variety of motivationally significant stimuli. Moreover, it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. Studies that involve nucleus accumbens DA antagonism or depletion indicate that accumbens DA does not mediate primary food motivation or appetite. Nevertheless, DA is involved in appetitive and aversive motivational processes including behavioral activation , exertion of effort, sustained task engagement, and Pavlovian-to-instrumental transfer. Interference with accumbens DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task and also shifts effort-related choice behavior, biasing animals toward low-effort alternatives. Dysfunctions of mesolimbic DA may contribute to motivational symptoms seen in various psychopathologies, including depression , schizophrenia, parkinsonism, and other disorders.