The role of dopamine D1 receptor transmission in effort-related choice behavior: Effects of D1 agonists

Mechanisms Underlying Memory Impairment Induced by Fructose

Fructose consumption has increased over the years, especially in adolescents living in urban areas. Growing evidence indicates that daily fructose consumption leads to some pathological conditions, including memory impairment. This review summarizes relevant data describing cognitive deficits after fructose intake and analyzes the underlying neurobiological mechanisms. Preclinical experiments show sex-related deficits in spatial memory; that is, while males exhibit significant imbalances in spatial processing, females seem unaffected by dietary supplementation with fructose. Recognition memory has also been evaluated; however, only female rodents show a significant decline in the novel object recognition test performance. According to mechanistic evidence, fructose intake induces neuroinflammation, mitochondrial dysfunction, and oxidative stress in the short term. Subsequently, these mechanisms can trigger other long-term effects, such as inhibition of neurogenesis, downregulation of trophic factors and receptors, weakening of synaptic plasticity, and long-term potentiation decay. Integrating all these neurobiological mechanisms will help us understand the cellular and molecular processes that trigger the memory impairment induced by fructose.

Pharmacological characterization of sex differences in the effects of dopaminergic drugs on effort-based decision making in rats

RATIONALE

Motivational dysfunctions related to effort exertion are common in psychiatric disorders. Dopamine systems regulate exertion of effort and effort-based choice in humans and rodents.

OBJECTIVES

Previous rodent studies mainly employed male rats, and it is imperative to conduct studies in male and female rats.

METHODS

The present studies compared the effort-related effects of IP injections of the dopamine antagonists ecopipam and haloperidol, and the vesicular monoamine transport-2 inhibitor tetrabenazine (TBZ), in male and female rats using the fixed ratio 5/chow feeding choice task.

RESULTS

Ecopipam (0.05-0.2 mg/kg) and haloperidol (0.05-0.15 mg/kg) induced a low-effort bias, decreasing lever pressing and increasing chow intake in males and females in the same dose range. With lever pressing, there was a modest but significant dose x sex interaction after ecopipam injection, but there was no significant interaction after administration of haloperidol. In the first study with TBZ (0.25-1.0 mg/kg), there was a robust sex difference. TBZ shifted choice from lever pressing to chow intake in male rats, but was ineffective in females. In a second experiment, 2.0 mg/kg affected choice behavior in both males and females. TBZ increased accumbens c-Fos immunoreactivity in a sex-dependent manner, with males significantly increasing at 1.0 mg/kg, while females showed augmented immunoreactivity at 2.0 mg/kg.

CONCLUSIONS

The neural and behavioral effects of TBZ differed across sexes, emphasizing the importance of conducting studies in male and female rats. This research has implications for understanding the effort-related motivational dysfunctions seen in psychopathology.

Apathy and Motivation: Biological Basis and Drug Treatment

Apathy is a disabling syndrome associated with poor functional outcomes that is common across a broad range of neurological and psychiatric conditions. Currently, there are no established therapies specifically for the condition, and safe and effective treatments are urgently needed. Advances in the understanding of motivation and goal-directed behavior in humans and animals have shed light on the cognitive and neurobiological mechanisms contributing to apathy, providing an important foundation for the development of new treatments. Here, we review the cognitive components, neural circuitry, and pharmacology of apathy and motivation, highlighting converging evidence of shared transdiagnostic mechanisms. Though no pharmacological treatments have yet been licensed, we summarize trials of existing and novel compounds to date, identifying several promising candidates for clinical use and avenues of future drug development.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Effects of the atypical antipsychotic and D3/D2 dopamine partial agonist cariprazine on effort-based choice behavior: implications for modeling avolition

RATIONALE

Cariprazine is an atypical antipsychotic that acts as a D3/D2 receptor partial agonist. In addition to treating positive symptoms of schizophrenia, cariprazine may have utility for treating negative symptoms. Rodent studies have focused on the effects of cariprazine on cognitive functions and behaviors thought to be related to anhedonia. Avolition, which is characterized by reduced initiation and persistence of goal-directed behavior, is another important negative symptom.

OBJECTIVES

Effort-related choice tasks have been used as animal models of avolition. In these studies, cariprazine was assessed for its effects on effort-based choice in both rats and mice. Previous work has shown that D2 antagonists such as haloperidol and eticlopride produce a low-effort bias in rodents tested on effort-based choice tasks.

RESULTS

Low doses of cariprazine produced a low-effort bias in rats tested on the fixed ratio 5/chow feeding choice task, decreasing lever pressing for high carbohydrate pellets but increasing chow intake. Cariprazine did not alter preference or intake of these foods in free-feeding tests. The effort-related effects of cariprazine were reversed by co-administration of the adenosine A2A antagonist istradefylline, and cariprazine failed to reverse the effort-related effects of the dopamine-depleting agent tetrabenazine. In mouse touchscreen choice tests, low doses of cariprazine also produced a low-effort bias, shifting behavior away from panel pressing.

CONCLUSIONS

These results demonstrate that with these rodent models of avolition, cariprazine appears to act like a D2-family antagonist even at very low doses. Furthermore, the pharmacological regulation of avolition may differ from that of other negative symptoms.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Significance statement

Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.

Dopamine Transporter Deficient Rodents: Perspectives and Limitations for Neuroscience

The key element of dopamine (DA) neurotransmission is undoubtedly DA transporter (DAT), a transmembrane protein responsible for the synaptic reuptake of the mediator. Changes in DAT's function can be a key mechanism of pathological conditions associated with hyperdopaminergia. The first strain of gene-modified rodents with a lack of DAT were created more than 25 years ago. Such animals are characterized by increased levels of striatal DA, resulting in locomotor hyperactivity, increased levels of motor stereotypes, cognitive deficits, and other behavioral abnormalities. The administration of dopaminergic and pharmacological agents affecting other neurotransmitter systems can mitigate those abnormalities. The main purpose of this review is to systematize and analyze (1) known data on the consequences of changes in DAT expression in experimental animals, (2) results of pharmacological studies in these animals, and (3) to estimate the validity of animals lacking DAT as models for discovering new treatments of DA-related disorders.

Dopamine D1 receptor and effort-based decision making in rats: The moderating effect of sex

Dopamine is a modulating factor in effort-based decision-making, and emerging evidence from pharmacological research suggests that the dopamine D1 receptor is the primary regulator. Given the limited selectivity of pharmacological tools, we further explored this hypothesis using dopamine D1 mutant (DAD1^-/-) rats which have a specific genetic reduction in functional D1 receptors. Moreover, given the strong focus on males in neuroscience research in general and in the role of D1 receptors in effort-based learning, we compared both sexes in the present study. Adult male and female DAD1^-/- mutant rats and wild type controls were trained to press a lever for a reinforcer. Once trained, subjects completed multiple fixed ratio, progressive ratio, and operant effort-choice (concurrent progressive ratio/chow feeding task [PROG/chow]) experiments. We predicted that DAD1^-/- mutant rats would press the lever significantly less than controls across all experiments, have lower breakpoints, and consume more freely available food. As predicted, DAD1^-/- mutant rats (regardless of sex) pressed the lever significantly less than controls and had lower breakpoints. Interestingly, there was a sex * genotype interaction for acquisition rates of lever pressing and change in breakpoints with free food available. Only 31% of DAD1^-/- mutant males acquired lever pressing while 73% of DAD1^-/- mutant females acquired lever pressing. Additionally, DAD1^-/- mutant males had significantly larger decreases in breakpoints when free food was available. These findings extend the pharmacological research suggesting that the dopamine D1 receptor modulates decisions based on effort, which has implications for the development of treatment targeting amotivation in neuropsychiatric disorders. The sex * genotype interaction highlights the importance of including both sexes in future research, especially when there are sex differences in incidences and severity of neuropsychiatric disorders.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Systemic D1-R and D2-R antagonists in Non-Human Primates Differentially Impact Learning and Memory While Impairing Motivation and Motor Performance

Dopamine (DA) modulates cognition in part via differential activation of D1 and D2 receptors within the striatum and prefrontal cortex, yet evidence for cognitive impairments stemming from DA blockade or deficiency is inconsistent. Given the predominance of D1 over D2 receptors (R) in the prefrontal cortex of primates, D1-R blockade should more strongly influence frontal executive function (including working memory), while D2-R blockade should impair processes more strongly associated with the dorsal striatum (including cognitive flexibility, and learning). To test how systemic DA blockade disrupts cognition, we administered D1-R and D2-R like antagonists to healthy monkeys while they performed a series of cognitive tasks. Two selective DA receptor antagonist drugs (SCH-23390 hydrochloride: D1/D5-R antagonist; or Eticlopride hydrochloride: D2/D3-R antagonist) or placebo (0.9% saline) were systemically administered. Four tasks were used: (1) 'visually guided reaching', to test response time and accuracy, (2) 'reversal learning', to test association learning and attention, (3) 'self-ordered sequential search' to test spatial working memory, and (4) 'delayed match to sample' to test object working memory. Increased reach response times and decreased motivation to work for liquid reward was observed with both the D1/D5-R and D2/D3-R antagonists at the maximum dosages that still enabled task performance. The D2/D3-R antagonist impaired performance in the reversal learning task, while object and spatial working memory performance was not consistently affected in the tested tasks for either drug. These results are consistent with the theory that systemic D2/D3-R antagonists preferentially influence striatum processes (cognitive flexibility) while systemic D1/D5-R administration is less detrimental to frontal executive function.

Cholinergic and dopaminergic-mediated motivated behavior in healthy states and in substance use and mood disorders

Acetylcholine is an important neuromodulator of the mesolimbic dopamine (DA) system, which itself is a mediator of motivated behavior. Motivated behavior can be described by two primary components, termed directional and activational motivation, both of which can be examined and dissociated using effort-choice tasks. The directional component refers to motivated behavior directed towards reinforcing stimuli and away from aversive stimuli. Behaviors characterized by increased vigor, persistence, and work output are considered to reflect activational components of motivation. Disruption of DA signaling has been shown to decrease activational components of motivation, while leaving directional features intact. Facilitation of DA release promotes the activational aspects of motivated behavior. In this review, we discuss cholinergic and DA regulation of motivated behaviors. We place emphasis on effort-choice processes and the ability of effort-choice tasks to examine and dissociate changes of motivated behavior in the context of substance use and mood disorders. Furthermore, we consider how altered cholinergic transmission impacts motivated behavior across disease states, and the possible role of cholinergic dysregulation in the etiology of these illnesses. Finally, we suggest that treatments targeting cholinergic activity may be useful in ameliorating motivational disruptions associated with substance use and comorbid substance use and mood disorders.

Effects of the dopamine depleting agent tetrabenazine on detailed temporal parameters of effort-related choice responding

The dopamine-depleting agent tetrabenazine alters effort-based choice, suppressing food-reinforced behaviors with high response requirements, while increasing selection of low-cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high-carbohydrate Bio-serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse-time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement-pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research.

Adolescent high-fructose corn syrup consumption leads to dysfunction in adult affective behaviors and mesolimbic proteins in male Sprague-Dawley rats

Adolescence is a critical period of development, during which the brain undergoes rapid maturation. Problematically, adolescents are the top consumers of high fructose corn syrup (HFCS) sweetened beverages and snacks, which may have neurodevelopmental consequences. While HFCS consumption has been linked to an increased likelihood of obesity and other physical health impairments, the link between HFCS and persistent behavioral changes is not yet fully established. The present study aimed to assess whether adolescent HFCS consumption could lead to alterations in adult behaviors and protein expression, following cessation. Adolescent HFCS-exposure contributed to deficits in learning and motivation on an effort-related T-Maze procedure, as well as increased immobility time in the forced swim paradigm during adulthood. Molecularly, protracted decreases in accumbal dopamine D1 and D2 receptors and protein kinase G (PKG), as well as increases in tyrosine hydroxylase and GluA2 receptor subunits, were observed following HFCS-exposure. Taken together, these data suggest that adolescent HFCS-consumption leads to protracted dysfunction in affective behaviors and alterations in accumbal proteins which persist following cessation of HFCS-consumption.

The Effects of a Novel Non-catechol Dopamine Partial Agonist on Working Memory in the Aged Rhesus Monkey

Aged-related declines in cognition, especially working memory and executive function, begin in middle-age and these abilities are known to be mediated by the prefrontal cortex (PFC) and more specifically the dopamine (DA) system within the PFC. In both humans and monkeys, there is significant evidence that the PFC is the first cortical region to change with age and the PFC appears to be particularly vulnerable to age-related loss of dopamine (DA). Therefore, the DA system is a strong candidate for therapeutic intervention to slow or reverse age related declines in cognition. In the present study, we administered a novel selective, potent, non-catechol DA D1 R agonist PF-6294 (Pfizer, Inc.) to aged female rhesus monkeys and assessed their performance on two benchmark tasks of working memory - the Delayed Non-match to Sample Task (DNMS) and Delayed Recognition Span Task (DRST). The DNMS task was administered first with the standard 10 s delay and then with 5 min delays, with and without distractors. The DRST was administered each day with four trials with unique sequences and one trial of a repeated sequence to assess evidence learning and retention. Overall, there was no significant effect of drug on performance on any aspect of the DNMS task. In contrast, we demonstrated that a middle range dose of PF-6294 significantly increased memory span on the DRST on the first and last days of testing and by the last day of testing the increased memory span was driven by the performance on the repeated trials.

Perinatal interference with the serotonergic system affects VTA function in the adult via glutamate co-transmission

Serotonin and dopamine are associated with multiple psychiatric disorders. How they interact during development to affect subsequent behavior remains unknown. Knockout of the serotonin transporter or postnatal blockade with selective serotonin reuptake inhibitors (SSRIs) leads to novelty-induced exploration deficits in adulthood, potentially involving the dopamine system. Here, we show in the mouse that raphe nucleus serotonin neurons activate ventral tegmental area dopamine neurons via glutamate co-transmission and that this co-transmission is reduced in animals exposed postnatally to SSRIs. Blocking serotonin neuron glutamate co-transmission mimics this SSRI-induced hypolocomotion, while optogenetic activation of dopamine neurons reverses this hypolocomotor phenotype. Our data demonstrate that serotonin neurons modulate dopamine neuron activity via glutamate co-transmission and that this pathway is developmentally malleable, with high serotonin levels during early life reducing co-transmission, revealing the basis for the reduced novelty-induced exploration in adulthood due to postnatal SSRI exposure.

Impact of Fluoxetine on Behavioral Invigoration of Appetitive and Aversively Motivated Responses: Interaction With Dopamine Depletion

Impaired behavioral activation and effort-related motivational dysfunctions like fatigue and anergia are debilitating treatment-resistant symptoms of depression. Depressed people show a bias towards the selection of low effort activities. To determine if the broadly used antidepressant fluoxetine can improve behavioral activation and reverse dopamine (DA) depletion-induced anergia, male CD1 mice were evaluated for vigorous escape behaviors in an aversive context (forced swim test, FST), and also with an exercise preference choice task [running wheel (RW)-T-maze choice task]. In the FST, fluoxetine increased active behaviors (swimming, climbing) while reducing passive ones (immobility). However, fluoxetine was not effective at reducing anergia induced by the DA-depleting agent tetrabenazine, further decreasing vigorous climbing and increasing immobility. In the T-maze, fluoxetine alone produced the same pattern of effects as tetrabenazine. Moreover, fluoxetine did not reverse tetrabenazine-induced suppression of RW time but it reduced sucrose intake duration. This pattern of effects produced by fluoxetine in DA-depleted mice was dissimilar from devaluing food reinforcement by pre-feeding or making the food bitter since in both cases sucrose intake time was reduced but animals compensated by increasing time in the RW. Thus, fluoxetine improved escape in an aversive context but decreased relative preference for active reinforcement. Moreover, fluoxetine did not reverse the anergic effects of DA depletion. These results have implications for the use of fluoxetine for treating motivational symptoms such as anergia in depressed patients.

D1- and D2-like receptors differentially mediate the effects of dopaminergic transmission on cost-benefit evaluation and motivation in monkeys

It has been widely accepted that dopamine (DA) plays a major role in motivation, yet the specific contribution of DA signaling at D₁-like receptor (D₁R) and D₂-like receptor (D₂R) to cost–benefit trade-off remains unclear. Here, by combining pharmacological manipulation of DA receptors (DARs) and positron emission tomography (PET) imaging, we assessed the relationship between the degree of D₁R/D₂R blockade and changes in benefit- and cost-based motivation for goal-directed behavior of macaque monkeys. We found that the degree of blockade of either D₁R or D₂R was associated with a reduction of the positive impact of reward amount and increasing delay discounting. Workload discounting was selectively increased by D₂R antagonism. In addition, blocking both D₁R and D₂R had a synergistic effect on delay discounting but an antagonist effect on workload discounting. These results provide fundamental insight into the distinct mechanisms of DA action in the regulation of the benefit- and cost-based motivation, which have important implications for motivational alterations in both neurological and psychiatric disorders.

Using quantitatively controlled pharmacological manipulations, this study teases apart the role of D1- and D2-like dopamine receptors in motivation and goal-directed behavior in monkeys, revealing complementary roles of two dopamine receptor subtypes in the computation of the cost/benefit trade-off to guide action.

Sex differences in effort-related decision-making: role of dopamine D2 receptor antagonism

RATIONALE

Depressed individuals demonstrate debilitating symptoms, including depressed mood, anhedonia, and effort-related deficits. Effort-related decision-making can be measured through providing subjects with a choice between high effort/reward and low effort/reward options, which is a dopamine (DA)-dependent behavior. While previous research has shown sex differences in depression rates, this has not been examined within operant-based effort-related decision-making tasks nor has DA been shown to underlie this behavior in female rats.

OBJECTIVES

The current study investigated sex differences in an effort-related decision-making task prior to and following administration of the DA D2 receptor antagonist haloperidol (HAL).

METHODS

Adult rats were food restricted or fed freely and trained in an effort-related progressive ratio choice task. After stable responding, HAL was administered acutely (0.05-0.2 mg/kg) prior to testing.

RESULTS

Results indicate a significant effect of sex on training variables, with males having a greater number of lever presses, higher ratios, and longer active lever times. Pretreatment with HAL significantly reduced the same measures in both sexes for the high-valued reward, while increasing chow consumption in the food restricted males. Food restricted rats showed a greater number of total lever presses and achieved higher ratios; however, the effect in male food restricted rats was greatest.

CONCLUSIONS

These data suggest that, although there are sex differences in training, HAL decreases behavior across sexes, demonstrating that the D2 mechanism is similar in both sexes. These findings provide a better understanding of motivational dysfunction in both sexes and potential treatment targets for depression.

Dopamine receptors regulate preference between high-effort and high-risk rewards

RATIONALE

Optimal decision-making necessitates evaluation of multiple rewards that are each offset by distinct costs, such as high effort requirement or high risk of failure. The neurotransmitter dopamine is fundamental toward these cost-benefit analyses, and D1-like and D2-like dopamine receptors differently modulate the reward-discounting effects of both effort and risk. However, measuring the role of dopamine in regulating decision-making between options associated with distinct costs exceeds the scope of traditional rodent economic decision-making paradigms.

OBJECTIVES

We developed the effort vs probability economic conflict task (EvP) to model multimodal economic decision-making in rats. This task measures choice between two rewards of uniform magnitude associated with either a high effort requirement or risk of reward omission. We then tested the modulatory effects of systemic cocaine and D1/D2 blockade or activation on the preference between high-effort and high-risk alternatives.

METHODS

In the EvP, two reinforcers of equal magnitude are associated with either (1) an effort requirement that increases throughout the session (1, 5, 10, and 20 lever presses), or (2) a low probability of reward receipt (25% of probabilistic choices). Critically, the reinforcer for each choice is comparable (one pellet), which eliminates the influence of magnitude discrimination on the decision-making process. After establishing the task, the dopamine transporter blocker cocaine and D1/D2 antagonists and agonists were administered prior to EvP performance.

RESULTS

Preference shifted away from either effortful or probabilistic choice when either option became more costly, and this preference was highly variable between subjects and stable over time. Cocaine, D1 activation, and D2 blockade produced limited, dose-dependent shifts in choice preference contingent on high or low effort conditions. In contrast, D2 activation across multiple doses evoked a robust shift from effortful to risky choice that was evident even when clearly disadvantageous.

CONCLUSIONS

The EvP clearly demonstrates that rats can evaluate distinct effortful or risky costs associated with rewards of comparable magnitude, and shift preference away from either option with increasing cost. This preference is more tightly linked to D2 than D1 receptor manipulation, suggesting D2-like receptors as a possible therapeutic target for maladaptive biases toward risk-taking over effort.

A novel phosphodiesterase 1 inhibitor reverses L-dopa-induced dyskinesia, but not motivation deficits, in monkeys

The enzyme phosphodiesterase 1 (PDE1) is highly expressed in the striatum and cortex. However, its role in corticostriatal function has not been fully investigated. The present study was aimed at evaluating the therapeutic potential of PDE1 inhibitors in treating motivation deficits and 3,4-dihydroxy-L-phenylalanine (L-dopa)-induced dyskinesia, which are pathological conditions of the corticostriatal system. We used a novel PDE1 inhibitor 3-ethyl-2-{[trans-4-(methoxymethyl)cyclohexyl]oxy}-7-(tetrahydro-2H-pyran-4-yl)-imidazo[5,1-f][1,2,4]triazin-4(3H)-one (DSR-143136), which was identified in our drug discovery program. Motivation in monkeys was measured using a progressive ratio task. L-Dopa-induced dyskinesia and disability scores were measured in 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP)-treated monkeys. DSR-143136 had a high selectivity for PDE1 over other PDE families and 67 other biologic targets. A dopamine D₁ receptor antagonist SCH-39166 at 0.01, 0.03 and 0.1 mg/kg potently decreased motivation in monkeys. However, DSR-143136 at 0.3 and 3 mg/kg did not affect motivation deficits induced by low-dose SCH-39166 (0.01 mg/kg). On the other hand, DSR-143136 at 3 mg/kg potently decreased L-dopa-induced dyskinesia in the Parkinsonian monkey model. Importantly, this antidyskinesic efficacy was NOT accompanied by detrimental effects on motor function. Further, this compound decreased on-time with marked or severe dyskinesia, without affecting on-time itself. These findings suggest that PDE1 inhibitor could be a therapeutic candidate for treating L-dopa-induced dyskinesia in Parkinson's disease, but not for motivation deficits.

Sex differences in lever pressing and running wheel tasks of effort-based choice behavior in rats: Suppression of high effort activity by the serotonin transport inhibitor fluoxetine

Selective serotonin transport (SERT) inhibitors such as fluoxetine are the most commonly prescribed treatments for depression. Although efficacious for many symptoms of depression, motivational impairments such as psychomotor retardation, anergia, fatigue and amotivation are relatively resistant to treatment with SERT inhibitors, and these drugs have been reported to exacerbate motivational deficits in some people. In order to study motivational dysfunctions in animal models, procedures have been developed to measure effort-related decision making, which offer animals a choice between high effort actions leading to highly valued reinforcers, or low effort/low reward options. In the present studies, male and female rats were tested on two different tests of effort-based choice: a fixed ratio 5 (FR5)/chow feeding choice procedure and a running wheel (RW)/chow feeding choice task. The baseline pattern of choice differed across tasks for males and females, with males pressing the lever more than females on the operant task, and females running more than males on the RW task. Administration of the SERT inhibitor and antidepressant fluoxetine suppressed the higher effort activity on each task (lever pressing and wheel running) in both males and females. The serotonin receptor mediating the suppressive effects of fluoxetine is uncertain, because serotonin antagonists with different patterns of receptor selectivity failed to reverse the effects of fluoxetine. Nevertheless, these studies uncovered important sex differences, and demonstrated that the suppressive effects of fluoxetine on high effort activities are not limited to tasks involving food reinforced behavior or appetite suppressive effects. It is possible that this line of research will contribute to an understanding of the neurochemical factors regulating selection of voluntary physical activity vs. sedentary behaviors, which could be relevant for understanding the role of physical activity in psychiatric disorders.

Energizing effects of bupropion on effortful behaviors in mice under positive and negative test conditions: modulation of DARPP-32 phosphorylation patterns

Motivational symptoms such as anergia, fatigue, and reduced exertion of effort are seen in depressed people. To model this, nucleus accumbens (Nacb) dopamine (DA) depletions are used to induce a low-effort bias in rodents tested on effort-based decision-making. We evaluated the effect of the catecholamine uptake blocker bupropion on its own, and after administration of tetrabenazine (TBZ), which blocks vesicular storage, depletes DA, and induces depressive symptoms in humans. Male CD1 mice were tested on a 3-choice-T-maze task that assessed preference between a reinforcer involving voluntary physical activity (running wheel, RW) vs. sedentary activities (sweet food pellet intake or a neutral non-social odor). Mice also were tested on the forced swim test (FST), two anxiety-related measures (dark-light box (DL), and elevated plus maze (EPM)). Expression of phosphorylated DARPP-32 (Thr34 and Thr75) was evaluated by immunohistochemistry as a marker of DA-related signal transduction. Bupropion increased selection of RW activity on the T-maze. TBZ reduced time running, but increased time-consuming sucrose, indicating an induction of a low-effort bias, but not an effect on primary sucrose motivation. In the FST, bupropion reduced immobility, increasing swimming and climbing, and TBZ produced the opposite effects. Bupropion reversed the effects of TBZ on the T-maze and the FST, and also on pDARPP32-Thr34 expression in Nacb core. None of these manipulations affected anxiety-related parameters. Thus, bupropion improved active behaviors, which were negatively motivated in the FST, and active behaviors that were positively motivated in the T-maze task, which has implications for using catecholamine uptake inhibitors for treating anergia and fatigue-like symptoms.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

Behavioral and dopamine transporter binding properties of the modafinil analog (S, S)-CE-158: reversal of the motivational effects of tetrabenazine and enhancement of progressive ratio responding

RATIONALE

Atypical dopamine (DA) transport blockers such as modafinil and its analogs may be useful for treating motivational symptoms of depression and other disorders. Previous research has shown that the DA depleting agent tetrabenazine can reliably induce motivational deficits in rats, as evidenced by a shift towards a low-effort bias in effort-based choice tasks. This is consistent with human studies showing that people with major depression show a bias towards low-effort activities.

OBJECTIVES

Recent studies demonstrated that the atypical DA transport (DAT) inhibitor (S)-CE-123 reversed tetrabenazine-induced motivational deficits, increased progressive ratio (PROG) lever pressing, and increased extracellular DA in the nucleus accumbens. In the present studies, a recently synthesized modafinil analog, (S, S)-CE-158, was assessed in a series of neurochemical and behavioral studies in rats.

RESULTS

(S, S)-CE-158 demonstrated the ability to reverse the effort-related effects of tetrabenazine and increase selection of high-effort PROG lever pressing in rats tested on PROG/chow feeding choice task. (S, S)-CE-158 showed a high selectivity for inhibiting DAT compared with other monoamine transporters, and systemic administration of (S, S)-CE-158 increased extracellular DA in the nucleus accumbens during the behaviorally active time course, which is consistent with the effects of (S)-CE-123 and other DAT inhibitors that enhance high-effort responding.

CONCLUSIONS

These studies provide an initial neurochemical characterization of a novel atypical DAT inhibitor, and demonstrate that this compound is active in models of effort-related choice. This research could contribute to the development of novel compounds for the treatment of motivational dysfunctions in humans.

Dissociating the effects of dopamine D2 receptors on effort-based versus value-based decision making using a novel behavioral approach

Cost-benefit decision making is essential for organisms to adapt to their ever-changing environment. Most studies of cost-benefit decision making involve choice conditions in which effort and value are varied simultaneously. This prevents identification of the aspects of cost-benefit decision making that are affected by experimental manipulations. We developed operant assays to isolate the individual impacts of effort and value manipulations on cost-benefit decision making. In the concurrent effort choice (CEC) task, mice choose between exerting two distinct types of effort: the number of responses and the duration of a response, to earn the same reward. By parametrically varying response cost, psychometric functions are obtained that reflect how the two types of effort scale against one another. Direct manipulations of effort shift the functions. Because reward value is held constant in this task, differences in scaling of the two response types must be related to the effort manipulations. In the concurrent value choice (CVC) task, mice make the same type of response to earn rewards of different value (e.g., pellets vs. sucrose solutions). Here the effort required to earn one reward type is parametrically varied to obtain the psychometric function that scales the value of the two rewards into the number of responses subjects will pay to earn one reward over the other. Direct value manipulations shift these functions. We tested the effect of the dopamine D2 receptor antagonist, haloperidol, on performance in the CEC and CVC assays and found that D2R signaling is important for effort-based, but not value-based decision making. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Effort-reward balance and work motivation in rats: Effects of context and order of experience

Being motivated means exerting effort toward a goal. The 'law of least work' emphasizes a preference for exerting relatively less effort. The law crosses boundaries among species and between physical and mental work. Organisms should be highly sensitive to shifts in effort-reward balance (ERB) in order to make optimal choices. We used a free operant-foraging task to investigate changes in ERB on choice between options requiring more or less effort. Results showed a consistent preference for the option with less effort and insensitivity to shifts in ERB. A second aim explored the influence of order of experience on effort choice. Choice for the more effortful option significantly increased after experiencing an equal effort-reward relationship during the initial free operant-foraging session. This relative increase in choice for the effortful option persisted even after effort-reward imbalance. The findings highlight the importance of contextual factors such as order of experience when examining the impact of shifting effort-reward associations. Instead of ignoring or reducing order effects, the sequence of experience (e.g. for shifts in ERB) could be manipulated to enhance or reduce value of outcomes or effort itself.

The novel atypical dopamine transport inhibitor CT-005404 has pro-motivational effects in neurochemical and inflammatory models of effort-based dysfunctions related to psychopathology

Depressed individuals suffer from effort-related motivational symptoms such as anergia and fatigue, which are resistant to treatment with many common antidepressants. While drugs that block dopamine transport (DAT) reportedly have positive motivational effects, DAT inhibitors such as cocaine and amphetamines produce undesirable side effects. Thus, there is a need to develop and characterize novel atypical DAT inhibitors with unique and selective binding profiles. Rodent effort-based choice tasks provide useful models of motivational dysfunctions. With these tasks, animals choose between a high-effort instrumental action leading to highly valued reinforcement vs. a low effort/low reward option. The present studies focused on the initial characterization of a novel atypical DAT inhibitor, CT-005404, which binds to DAT with high selectivity relative to serotonin and norepinephrine transport, and produces long-term elevations of extracellular DA. CT-005404 was assessed for its ability to attenuate the effort-related motivational effects of the DA depleting agent tetrabenazine and the pro-inflammatory cytokine interleukin-1β (IL-1β) using a fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg i.p.) shifted choice behavior, decreasing lever pressing and increasing chow intake. IL-1β (4.0 μg/kg i.p.) also decreased lever pressing. CT-005404 was co-administered (7.5-30.0 mg/kg p.o.) with either tetrabenazine or IL-1β, and the 15.0 and 30.0 mg/kg doses significantly reversed the effects of tetrabenazine and IL-1β. CT-005404 administered alone produced a dose-related increase in lever pressing in rats tested on a progressive ratio/chow feeding choice task. Atypical DAT inhibitors such as CT-005404 offer potential as a new avenue for drug treatment of motivational dysfunctions in humans.

Non-action Learning: Saving Action-Associated Cost Serves as a Covert Reward

“To do or not to do” is a fundamental decision that has to be made in daily life. Behaviors related to multiple “to do” choice tasks have long been explained by reinforcement learning, and “to do or not to do” tasks such as the go/no-go task have also been recently discussed within the framework of reinforcement learning. In this learning framework, alternative actions and/or the non-action to take are determined by evaluating explicitly given (overt) reward and punishment. However, we assume that there are real life cases in which an action/non-action is repeated, even though there is no obvious reward or punishment, because implicitly given outcomes such as saving physical energy and regret (we refer to this as “covert reward”) can affect the decision-making. In the current task, mice chose to pull a lever or not according to two tone cues assigned with different water reward probabilities (70% and 30% in condition 1, and 30% and 10% in condition 2). As the mice learned, the probability that they would choose to pull the lever decreased (<0.25) in trials with a 30% reward probability cue (30% cue) in condition 1, and in trials with a 10% cue in condition 2, but increased (>0.8) in trials with a 70% cue in condition 1 and a 30% cue in condition 2, even though a non-pull was followed by neither an overt reward nor avoidance of overt punishment in any trial. This behavioral tendency was not well explained by a combination of commonly used Q-learning models, which take only the action choice with an overt reward outcome into account. Instead, we found that the non-action preference of the mice was best explained by Q-learning models, which regarded the non-action as the other choice, and updated non-action values with a covert reward. We propose that “doing nothing” can be actively chosen as an alternative to “doing something,” and that a covert reward could serve as a reinforcer of “doing nothing.”

Risk-based decision making in rats: Modulation by sex and amphetamine

Decision-making is a complex process essential to daily adaptation in many species. Risk is an inherent aspect of decision-making and it is influenced by gonadal hormones. Testosterone and 17β-estradiol may modulate decision making and impact the mesocorticolimbic dopamine pathway. Here, we explored sex differences, the effect of gonadal hormones and the dopamine agonist amphetamine on risk-based decision making. Intact or gonadectomised (GDX) male and female rats underwent to a probabilistic discounting task. High and low doses of testosterone propionate (1.0 or 0.2 mg) and 17β-estradiol benzoate (0.3 μg) were administered to assess acute effects on risk-based decision making. After 3-days of washout period, intact and GDX rats received high or low (0.5 or 0.125 mg/kg) doses of amphetamine and re-tested in the probabilistic discounting task. Under baseline conditions, males made more risky choices during probability discounting compared to female rats, particularly in the lower probability blocks, but GDX did not influence risky choice. The high, but not the low dose, of testosterone modestly reduced risky decision making in GDX male rats. Conversely, 17β-estradiol had no significant effect on risky choice regardless of GDX status in either sex. Lastly, a higher dose of amphetamine increased risky decision making in both intact males and females, but had no effect in GDX rats. These findings demonstrated sex differences in risk-based decision making, with males showing a stronger bias toward larger, uncertain rewards. GDX status influenced the effects of amphetamine, suggesting different dopaminergic regulation in risk-based choices among males and females.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Comparison of acute treatment with delayed-onset versus rapid-acting antidepressants on effort-related choice behaviour

RATIONALE

Reward-related impairments are common in major depressive disorder (MDD) and may contribute to the loss of interest in pleasurable activities. A novel approach to studying reward-related decision-making are effort-based tasks; however, direct comparisons between delayed-onset and rapid-acting antidepressants (ADs) have not yet been carried out.

OBJECTIVES

To investigate the effects of conventional delayed-onset ADs versus rapid-acting ADs, ketamine and scopolamine, on effort-related choice behaviour.

METHODS

Female Lister hooded rats were trained in an operant effort for reward task (EfRT) where animals choose between working for a high value-high effort reward and consuming low value-low effort chow. Using a within-subject study design, animals were then tested following acute treatment with different monoaminergic ADs, and the rapid-acting ADs ketamine or scopolamine.

RESULTS

Consistent with previous findings, we found choice behaviour was sensitive to dopaminergic manipulations. We observed that pre-feeding altered choice behaviour and that the use of high or low value reward differentially affected behaviour. Monoamine re-uptake inhibitors and rapid-acting ADs resulted in similar, general patterns of reduced motivation without any evidence for specific effects, and we did not observe any clear differences between these classes of antidepressant.

CONCLUSIONS

Motivational changes induced by dopaminergic manipulations and pre-feeding differentially affect effort choice behaviour. However, both conventional delayed-onset ADs and ketamine and scopolamine appear to have detrimental effects on motivation in this task at the higher doses tested without any evidence of specificity for effort-related choice behaviour, in contrast to their specificity in tasks which look at more cognitive aspects of reward processing.

Chemogenetic Modulation and Single-Photon Calcium Imaging in Anterior Cingulate Cortex Reveal a Mechanism for Effort-Based Decisions

The ACC is implicated in effort exertion and choices based on effort cost, but it is still unclear how it mediates this cost-benefit evaluation. Here, male rats were trained to exert effort for a high-value reward (sucrose pellets) in a progressive ratio lever-pressing task. Trained rats were then tested in two conditions: a no-choice condition where lever-pressing for sucrose was the only available food option, and a choice condition where a low-value reward (lab chow) was freely available as an alternative to pressing for sucrose. Disruption of ACC, via either chemogenetic inhibition or excitation, reduced lever-pressing in the choice, but not in the no-choice, condition. We next looked for value coding cells in ACC during effortful behavior and reward consumption phases during choice and no-choice conditions. For this, we used in vivo miniaturized fluorescence microscopy to reliably track responses of the same cells and compare how ACC neurons respond during the same effortful behavior where there was a choice versus when there was no-choice. We found that lever-press and sucrose-evoked responses were significantly weaker during choice compared with no-choice sessions, which may have rendered them more susceptible to chemogenetic disruption. Together, findings from our interference experiments and neural recordings suggest that a mechanism by which ACC mediates effortful decisions is in the discrimination of the utility of available options. ACC regulates these choices by providing a stable population code for the relative value of different options.

SIGNIFICANCE STATEMENT The ACC is implicated in effort-based decision-making. Here, we used chemogenetics and in vivo calcium imaging to explore its mechanism. Rats were trained to lever press for a high-value reward and tested in two conditions: a no-choice condition where lever-pressing for the high-value reward was the only option, and a choice condition where a low-value reward was also available. Inhibition or excitation of ACC reduced effort toward the high-value option, but only in the choice condition. Neural responses in ACC were weaker in the choice compared with the no-choice condition. A mechanism by which ACC regulates effortful decisions is in providing a stable population code for the discrimination of the utility of available options.

Inhibition of Catechol-O-methyltransferase Does Not Alter Effort-Related Choice Behavior in a Fixed Ratio/Concurrent Chow Task in Male Mice

Effort-related choice (ERC) tasks allow animals to choose between high-value reinforcers that require high effort to obtain and low-value/low-effort reinforcers. Dopaminergic neuromodulation regulates ERC behavior. The enzyme catechol-O-methyltransferase (COMT) metabolizes synaptically-released dopamine. COMT is the predominant regulator of dopamine turnover in regions of the brain with low levels of dopamine transporters (DATs), including the prefrontal cortex (PFC). Here, we evaluated the effects of the COMT inhibitor tolcapone on ERC performance in a touchscreen-based fixed-ratio/concurrent chow task in male mice. In this task, mice were given the choice between engaging in a fixed number of instrumental responses to acquire a strawberry milk reward and consuming standard lab chow concurrently available on the chamber floor. We found no significant effects of tolcapone treatment on either strawberry milk earned or chow consumed compared to vehicle treatment. In contrast, we found that haloperidol decreased instrumental responding for strawberry milk and increased chow consumption as seen in previously published studies. These data suggest that COMT inhibition does not significantly affect effort-related decision making in a fixed-ratio/concurrent chow task in male mice.

Dopaminergic D1 Receptor Stimulation Affects Effort and Risk Preferences

BACKGROUND

Activation of D₁ receptors has been related to successful goal-directed behavior, but it remains unclear whether D₁ receptor activation causally tips the balance of weighing costs and benefits in humans. Here, we tested the impact of pharmacologically stimulated D₁ receptors on sensitivity to risk, delay, and effort costs in economic choice and investigated whether D₁ receptor stimulation would bias preferences toward options with increased costs in a cost-specific manner.

METHODS

In a randomized, double-blind, placebo-controlled, parallel-group phase 1 study, 120 healthy young volunteers received either placebo or 1 of 3 doses (6 mg, 15 mg, or 30 mg) of a novel, selective D₁ agonist (PF-06412562). After drug administration, participants performed decision tasks measuring their preferences for risky, delayed, and effortful outcomes.

RESULTS

Higher doses of the D₁ agonist increased the willingness to exert physical effort for reward as well as reduced the preference for risky outcomes. We observed no effects on preferences for delayed rewards.

CONCLUSIONS

The current results provide evidence that D₁ receptor stimulation causally affects core aspects of cost-benefit decision making in humans.

Effort-based decision making varies by smoking status

RATIONALE

A reduced willingness to perform effort based on the magnitude and probability of potential rewards has been associated with diminished dopamine function and may be relevant to chronic drug use.

OBJECTIVES

Here, we investigated the influence of smoking status on effort-based decisions. We hypothesized that smokers would make fewer high-effort selections than ex-smokers and never-smokers.

METHODS

Current smokers (n = 25), ex-smokers (≥ 1 year quit, n = 23), and never-smokers (n = 19) completed the Effort Expenditure for Rewards Task in which participants select between low-effort and high-effort options to receive monetary rewards at varying levels of reward magnitude, probability and expected value.

RESULTS

Overall, participants selected more high-effort options as potential reward magnitude and expected value increased. Smokers did not make fewer high-effort selections overall, but smokers were less sensitive to the changes in magnitude, probability, and expected value compared to never-smokers. Smokers were also less sensitive to the changes in probability and expected value, but not magnitude, compared to ex-smokers. Among smokers and ex-smokers, less nicotine dependence was associated with an increased likelihood of high-effort selections.

CONCLUSIONS

These results demonstrate the relevance of smoking status to effort-based decisions and suggest that smokers have diminished sensitivity to nondrug reward value. Among ex-smokers, greater pre-existing sensitivity to reward value may have been conducive to smoking cessation, or sensitivity was improved by smoking cessation. Future prospective studies can investigate whether effort-related decision making is predictive of smoking initiation or cessation success.

IMPLICATIONS

Willingness to perform effort to achieve a goal and sensitivity to changes in reward value are important aspects of motivation. These results showed that smokers have decreased sensitivity to changes in effort-related reward probability and expected value compared to ex-smokers and never-smokers. Potentially, improved sensitivity to rewards among ex-smokers may be a cause or consequence of smoking cessation. These findings may help explain why some smokers are able to achieve long-term abstinence.

Preference for Exercise vs. More Sedentary Reinforcers: Validation of an Animal Model of Tetrabenazine-Induced Anergia

Physical activities can have intrinsic motivational or reinforcing properties. The choice to engage in voluntary physical activity is undertaken in relation to the selection of other alternatives, such as sedentary behaviors, drugs, or food intake. The mesolimbic dopamine (DA) system plays a critical role in behavioral activation or exertion of effort, and DA antagonism or depletion induces anergia in effort-based decision-making tasks. However, little is known about the neural mechanisms underlying the decision-making processes that establish preferences for sedentary vs. activity-based reinforcers. In the present work with male CD1 mice, we evaluated the effect of tetrabenazine (TBZ), a DA-depleting agent, on a three-choice T-maze task developed to assess preference between reinforcers with different behavioral activation requirements and sensory properties [i.e., a running wheel (RW) vs. sweet pellets or a neutral nonsocial odor]. We also studied the effects of TBZ on the forced swim test (FST), which measures climbing and swimming in a stressful setting, and on anxiety tests [dark-light (DL) box and elevated plus maze (EPM)]. In the three-choice task, TBZ reduced time running in the wheel but increased time spent consuming sucrose, thus indicating reduced activation but relatively intact sucrose reinforcement. The effect of TBZ was not mimicked by motivational manipulations that change the value of the reinforcers, such as making the RW aversive or harder to move, food-restricting the animals, inducing a binge-like eating pattern, or introducing social odors. In the FST, TBZ decreased time climbing (most active behavior) and increased immobility but did not affect anxiety in the DL or EPM. These results indicate that the three-choice T-maze task could be useful for assessing DA modulation of preferences for exercise based on activation and effort requirements, differentiating those effects from changes in preference produced by altering physical requirements, food restriction state, and stress during testing.

Activation of the mGlu1 metabotropic glutamate receptor has antipsychotic-like effects and is required for efficacy of M4 muscarinic receptor allosteric modulators

Recent clinical and preclinical studies suggest that selective activators of the M₄ muscarinic acetylcholine receptor have potential as a novel treatment for schizophrenia. M₄ activation inhibits striatal dopamine release by mobilizing endocannabinoids, providing a mechanism for local effects on dopamine signaling in the striatum but not in extrastriatal areas. G protein-coupled receptors (GPCRs) typically induce endocannabinoid release through activation of Gα_q/11-type G proteins whereas M₄ transduction occurs through Gα_i/o-type G proteins. We now report that the ability of M₄ to inhibit dopamine release and induce antipsychotic-like effects in animal models is dependent on co-activation of the Gα_q/11-coupled mGlu₁ subtype of metabotropic glutamate (mGlu) receptor. This is especially interesting in light of recent findings that multiple loss of function single nucleotide polymorphisms (SNPs) in the human gene encoding mGlu₁ (GRM1) are associated with schizophrenia, and points to GRM1/mGlu₁ as a gene within the "druggable genome" that could be targeted for the treatment of schizophrenia. Herein, we report that potentiation of mGlu₁ signaling following thalamo-striatal stimulation is sufficient to inhibit striatal dopamine release, and that a novel mGlu₁ positive allosteric modulator (PAM) exerts robust antipsychotic-like effects through an endocannabinoid-dependent mechanism. However, unlike M₄, mGlu₁ does not directly inhibit dopamine D₁ receptor signaling and does not reduce motivational responding. Taken together, these findings highlight a novel mechanism of cross talk between mGlu₁ and M₄ and demonstrate that highly selective mGlu₁ PAMs may provide a novel strategy for the treatment of positive symptoms associated with schizophrenia.

A Novel Weight Lifting Task for Investigating Effort and Persistence in Rats

Here we present a novel effort-based task for laboratory rats: the weight lifting task (WLT). Studies of effort expenditure in rodents have typically involved climbing barriers within T-mazes or operant lever pressing paradigms. These task designs have been successful for neuropharmacological and neurophysiological investigations, but both tasks involve simple action patterns. High climbing barriers may also present risk of injury to animals and/or issues with tethered recording equipment. In the WLT, a rat is placed in a large rectangular arena and tasked with pulling a rope 30 cm to trigger food delivery at a nearby spout; weights can be added to the rope in 45 g increments to increase the intensity of effort. As compared to lever pressing and barrier jumping, 30 cm of rope pulling is a multi-step action sequence requiring sustained effort. The actions are carried out on the single plane of the arena floor, making it safer for the animal and more suitable for tethered equipment and video tracking. A microcontroller and associated sensors enable precise timestamping of specific behaviors to synchronize with electrophysiological recordings. The rope and reward spout are spatially segregated to allow for spatial discrimination of the effort zone and the reward zone. We validated the task across five cohorts of rats (total n = 35) and report consistent behavioral metrics. The WLT is well-suited for neuropharmacological and/or in vivo neurophysiological investigations surrounding effortful behaviors, particularly when wanting to probe different aspects of effort expenditure (intensity vs. duration).

The Novel Atypical Dopamine Uptake Inhibitor (S)-CE-123 Partially Reverses the Effort-Related Effects of the Dopamine Depleting Agent Tetrabenazine and Increases Progressive Ratio Responding

Animal studies of effort-based choice behavior are being used to model effort-related motivational dysfunctions in humans. With these procedures, animals are offered a choice between high-effort instrumental actions leading to highly valued reinforcers vs. low effort/low reward options. Several previous studies have shown that dopamine (DA) uptake inhibitors, including GBR12909, lisdexamfetamine, methylphenidate, and PRX-14040, can reverse the effort-related effects of the vesicular monoamine transport blocker tetrabenazine, which inhibits DA storage. Because many drugs that block DA transport act as major stimulants that also release DA, and produce a number of undesirable side effects, there is a need to develop and characterize novel atypical DA transport inhibitors. (S)-CE-123 ((S)-5-((benzhydrylsulfinyl) methyl)thiazole) is a recently developed analog of modafinil with the biochemical characteristics of an atypical DA transport blocker. The present paper describes the enantioselective synthesis and initial chemical characterization of (S)-CE-123, as well as behavioral experiments involving effort-based choice and microdialysis studies of extracellular DA. Rats were assessed using the fixed ratio 5/chow feeding choice test. Tetrabenazine (1.0 mg/kg) shifted choice behavior, decreasing lever pressing and increasing chow intake. (S)-CE-123 was coadministered at doses ranging from 6.0 to 24.0 mg/kg, and the highest dose partially but significantly reversed the effects of tetrabenazine, although this dose had no effect on fixed ratio responding when administered alone. Additional experiments showed that (S)-CE-123 significantly increased lever pressing on a progressive ratio/chow feeding choice task and that the effective dose (24.0 mg/kg) increased extracellular DA in nucleus accumbens core. In summary, (S)-CE-123 has the behavioral and neurochemical profile of a compound that can block DA transport, reverse the effort-related effects of tetrabenazine, and increase selection of high-effort progressive ratio responding. This suggests that (S)-CE-123 or a similar compound could be useful as a treatment for effort-related motivational dysfunction in humans.

Neuropharmacological Insight from Allosteric Modulation of mGlu Receptors

The metabotropic glutamate (mGlu) receptors are a family of G-protein-coupled receptors (GPCRs) that regulate cell physiology throughout the nervous system. The potential of mGlu receptors as therapeutic targets has been bolstered by current research that has provided insight into the diverse modes of mGlu activation and signaling. In particular, the allosteric modulation of mGlu receptors represents a major area of focus in studies of basic pharmacology as well as drug development, largely due to the high subtype specificity achievable by targeting allosteric sites on mGlu receptors. These provide sophisticated regulation of neuronal excitability and synaptic transmission to influence behavioral output. Here, we review how these allosteric mechanisms have been leveraged preclinically to demonstrate the therapeutic potential of allosteric modulators for neurological and neuropsychiatric disorders, such as autism, cognitive impairment, Parkinson's disease (PD), stress, and schizophrenia.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Animal models of fatigue in major depressive disorder

Fatigue is common in a host of neurological and psychiatric disorders including depression and often continues unabated even after primary symptoms of disease are treated. Its high estimated prevalence combined with the lack of effective medicines has engaged the preclinical research community to search for fatigue models. The present review briefly summarizes the most common animal models that have been brought forward along with some of the associated pharmacological validation data. Like all preclinical models, these models have issues that need to be appreciated in the generation and interpretation of data for the purposes of translation to human disease; specifically, there are deficiencies in construct validity, a lack of medicines that effectively address residual fatigue symptoms, and difficulties in defining specificity with respect to drug effects on fatigue per se. Nonetheless, existing animal models of fatigue arguably serve the valuable purpose of encouraging research in this large area of unmet medical need. Data from these models are predicted to engender human experimentation and the further development of improved model systems.

Differential effects of D1 and D2 dopamine agonists on memory, motivation, learning and response time in non-human primates

Dopamine (DA) plays a critical role in cognition, motivation and information processing. DA action has been shown to both improve and/or impair cognition across different receptor types, species, subjects and tasks. This complex relationship has been described as an inverted U-shaped function and may be due to the differential effects of DA receptor activation in the striatum and prefrontal cortex. We have investigated the effects of selective DA agonists on cognitive performance in healthy monkeys using a touch screen running tasks from the CAmbridge Neuropsychological Test Automated Battery (CANTAB). One of two DA agonist drugs or placebo was administered prior to each daily CANTAB session: Dihydrexidine hydrochloride (selective D1 agonist, 0.4-0.9 mg/kg), or sumanirole maleate (selective D2 agonist 0.05-0.3 mg/kg). Three CANTAB tasks were tested: (a) "self-ordered sequential search task" which tested spatial working memory, (b) "reversal learning task," which tested association learning, cognitive flexibility and attention and (c) "visually guided reaching task," which tested reaction time and accuracy. At high dosages, the D2 agonist improved spatial working memory performance, while impairing reversal learning and slowing reach response latency. No consistent cognitive effects were observed with the D1 agonist across the dosages tested. A significant decrease in trial completion rate was observed at the higher dosages of both the D1 and D2 agonists which were consistent with decreased motivation. These results are consistent with task-specific effects of a D2 agonist as well as dose specific insensitivities of a D1 agonist on cognitive and motor behaviors in a healthy monkey.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.