The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Mild exogenous inflammation blunts neural signatures of bounded evidence accumulation and reward prediction error processing in healthy male participants

BACKGROUND

Altered neural haemodynamic activity during decision making and learning has been linked to the effects of inflammation on mood and motivated behaviours. So far, it has been reported that blunted mesolimbic dopamine reward signals are associated with inflammation-induced anhedonia and apathy. Nonetheless, it is still unclear whether inflammation impacts neural activity underpinning decision dynamics. The process of decision making involves integration of noisy evidence from the environment until a critical threshold of evidence is reached. There is growing empirical evidence that such process, which is usually referred to as bounded accumulation of decision evidence, is affected in the context of mental illness.

METHODS

In a randomised, placebo-controlled, crossover study, 19 healthy male participants were allocated to placebo and typhoid vaccination. Three to four hours post-injection, participants performed a probabilistic reversal-learning task during functional magnetic resonance imaging. To capture the hidden neurocognitive operations underpinning decision-making, we devised a hybrid sequential sampling and reinforcement learning computational model. We conducted whole brain analyses informed by the modelling results to investigate the effects of inflammation on the efficiency of decision dynamics and reward learning.

RESULTS

We found that during the decision phase of the task, typhoid vaccination attenuated neural signatures of bounded evidence accumulation in the dorsomedial prefrontal cortex, only for decisions requiring short integration time. Consistent with prior work, we showed that, in the outcome phase, mild acute inflammation blunted the reward prediction error in the bilateral ventral striatum and amygdala.

CONCLUSIONS

Our study extends current insights into the effects of inflammation on the neural mechanisms of decision making and shows that exogenous inflammation alters neural activity indexing efficiency of evidence integration, as a function of choice discriminability. Moreover, we replicate previous findings that inflammation blunts striatal reward prediction error signals.

Validation of a non-food or water motivated effort-based foraging task as a measure of motivational state in male mice

Disorders of motivation such as apathy syndrome are highly prevalent across neurological disorders but do not yet have an agreed treatment approach. The use of translational behavioural models can provide a route through which to meaningfully screen novel drug targets. Methods that utilise food deprivation in contrived environments may lack the sensitivity to detect deficits in self-initiated behaviour, and may have limited translation to normal behaviour. Animals monitored in more naturalistic environments may display more ethologically-relevant behaviours of greater translational value. Here, we aimed to validate a novel, non-food or water motivated effort-based foraging task as a measure of motivational state in mice. In this task, the mouse can freely choose to exert effort to forage nesting material and shuttle it back to a safe and enclosed environment. The amount of nesting material foraged is used as a readout of motivational state. Acute dopaminergic modulation with haloperidol, amphetamine and methylphenidate, and two phenotypic models known to induce motivational deficits (healthy ageing and chronic administration of corticosterone) were used to validate this task. Consistent with other effort-based decision-making tasks we find that foraging behaviour is sensitive to acute modulation of dopaminergic transmission. We find that both phenotypic models induce differing deficits in various aspects of foraging behaviour suggesting that the task may be used to parse different behavioural profiles from distinct disease phenotypes. Thus, without requiring extended training periods or physiological deprivation, this task may represent a refined and translational preclinical measure of motivation.

Methylphenidate, but not citalopram, decreases impulsive choice in rats performing a temporal discounting task

Introduction

Drugs targeting monoamine systems remain the most common treatment for disorders with impulse control impairments. There is a body of literature suggesting that drugs affecting serotonin reuptake and dopamine reuptake can modulate distinct aspects of impulsivity - though such tests are often performed using distinct behavioral tasks prohibiting easy comparisons.

Methods

Here, we directly compare pharmacologic agents that affect dopamine (methylphenidate) vs serotonin (citalopram) manipulations on choice impulsivity in a temporal discounting task where rats could choose between a small, immediate reward or a large reward delayed at either 2 or 10s. In control conditions, rats preferred the large reward at a small (2s) delay and discounted the large reward at a long (10s) delay.

Results

Methylphenidate, a dopamine transport inhibitor that blocks reuptake of dopamine, dose-dependently increased large reward preference in the long delay (10s) block. Citalopram, a selective serotonin reuptake inhibitor, had no effect on temporal discounting behavior. Impulsive behavior on the temporal discounting task was at least partially mediated by the nucleus accumbens shell. Bilateral lesions to the nucleus accumbens shell reduced choice impulsivity during the long delay (10s) block. Following lesions, methylphenidate did not impact impulsivity.

Discussion

Our results suggest that striatal dopaminergic systems modulate choice impulsivity via actions within the nucleus accumbens shell, whereas serotonin systems may regulate different aspects of behavioral inhibition/impulsivity.

Repeated binge-like eating episodes in female rats alter adenosine A2A and dopamine D2 receptor genes regulation in the brain reward system

OBJECTIVE

Binge-eating disorder is an eating disorder characterized by recurrent binge-eating episodes, during which individuals consume excessive amounts of highly palatable food (HPF) in a short time. This study investigates the intricate relationship between repeated binge-eating episode and the transcriptional regulation of two key genes, adenosine A2A receptor (A2AAR) and dopamine D2 receptor (D2R), in selected brain regions of rats.

METHOD

Binge-like eating behavior on HPF was induced through the combination of food restrictions and frustration stress (15 min exposure to HPF without access to it) in female rats, compared to control rats subjected to only restriction or only stress or none of these two conditions. After chronic binge-eating episodes, nucleic acids were extracted from different brain regions, and gene expression levels were assessed through real-time quantitative PCR. The methylation pattern on genes' promoters was investigated using pyrosequencing.

RESULTS

The analysis revealed A2AAR upregulation in the amygdala and in the ventral tegmental area (VTA), and D2R downregulation in the nucleus accumbens in binge-eating rats. Concurrently, site-specific DNA methylation alterations at gene promoters were identified in the VTA for A2AAR and in the amygdala and caudate putamen for D2R.

DISCUSSION

The alterations on A2AAR and D2R genes regulation highlight the significance of epigenetic mechanisms in the etiology of binge-eating behavior, and underscore the potential for targeted therapeutic interventions, to prevent the development of this maladaptive feeding behavior. These findings provide valuable insights for future research in the field of eating disorders.

PUBLIC SIGNIFICANCE

Using an animal model with face, construct, and predictive validity, in which cycles of food restriction and frustration stress evoke binge-eating behavior, we highlight the significance of epigenetic mechanisms on adenosine A2A receptor (A2AAR) and dopamine D2 receptor (D2R) genes regulation. They could represent new potential targets for the pharmacological management of eating disorders characterized by this maladaptive feeding behavior.

Effort-based decision making and motivational deficits in stroke patients

Motivational deficits in patients recovering from stroke are common and can reduce active participation in rehabilitation and thereby impede functional recovery. We investigated whether stroke patients with clinically reduced drive, initiation, and endurance during functional rehabilitative training (n = 30) display systematic alterations in effort-based decision making compared to age, sex, and severity-matched stroke patients (n = 30) whose drive appeared unaffected. Notably, the two groups did not differ in self-reported ratings of apathy and depression. However, on an effort-based decision-making task, stroke patients with clinically apparent drive impairment showed intact willingness to accept effort for reward, but were more likely to fail to execute the required effort compared to patients without apparent drive impairments. In other words, the decision behavioural assessment revealed that stroke patients that displayed reduced drive, initiation, and endurance during inpatient neurorehabilitation failed to persist in goal-directed effort production, even over very short periods. These findings indicate that reduced drive during rehabilitative therapy in post-stroke patients is not due to a diminished motivation to invest physical effort, but instead is related to a reduced persistence with effortful behaviour.

Apathy-like behaviour in tau mouse models of Alzheimer's disease and frontotemporal dementia

Apathy is the most common behavioural and psychological symptom in Alzheimer's disease (AD) and other neurodegenerative diseases including frontotemporal dementia (FTD) and Parkinson's disease (PD). In patients, apathy can include symptoms of loss of motivation, initiative, and interest, listlessness, and indifference, flattening of emotions, absence of drive and passion. Researchers have later refined this to a reduction in goal direct behaviours. In animals, specific symptoms of apathy-like behaviour have been modelled including goal directed or nest-building behaviour which are seen as indicative of proxies for motivation and daily activities. In the present study a nest-building protocol was established using four different inbred mouse strains (CD1, BALB/c, C57Bl/6J, C3H) before assessing AD and FTD tau transgenic mice of Line 1 (L1) and Line 66 (L66) in this paradigm. Female mice aged 5 - 6 months were assessed in the home cage over a period of 7 days with nest-building behaviour scored by three independent experimenters at intervals of 1-, 2- and 7-days post nestlet introduction. Inbred mouse strains displayed different levels of nesting behaviour. BALB/c mice were more proficient than CD1 and C3H mice, while all strains displayed similar nest-building behaviour by day 7. In the tau mouse models, L66 presented with impaired nesting compared to wild-type on days 1 and 2 (not day 7), whereas L1 performed like wild-type on all days. Anhedonia measured in a sucrose preference test was only observed in L66. Anhedonia and low nesting scores in L66 mice are indicative of apathy-like phenotypes. Differences evident between the L1 and L66 tau transgenic mouse models are likely due to the different human tau species expressed in these mice.

Chemogenetic activation of corticotropin-releasing factor-expressing neurons in the anterior bed nucleus of the stria terminalis reduces effortful motivation behaviors

Corticotropin-releasing factor (CRF) in the anterior bed nucleus of the stria terminalis (aBNST) is associated with chronic stress and avoidance behavior. However, CRF + BNST neurons project to reward- and motivation-related brain regions, suggesting a potential role in motivated behavior. We used chemogenetics to selectively activate CRF+ aBNST neurons in male and female CRF-ires-Cre mice during an effort-related choice task and a concurrent choice task. In both tasks, mice were given the option either to exert effort for high value rewards or to choose freely available low value rewards. Acute chemogenetic activation of CRF+ aBNST neurons reduced barrier climbing for a high value reward in the effort-related choice task in both males and females. Furthermore, acute chemogenetic activation of CRF+ aBNST neurons also reduced effortful lever pressing in high-performing males in the concurrent choice task. These data suggest a novel role for CRF+ aBNST neurons in effort-based decision and motivation behaviors.

Involvement of A13 dopaminergic neurons in prehensile movements but not reward in the rat

Tyrosine hydroxylase (TH)-containing neurons of the dopamine (DA) cell group A13 are well positioned to impact known DA-related functions as their descending projections innervate target regions that regulate vigilance, sensory integration, and motor execution. Despite this connectivity, little is known regarding the functionality of A13-DA circuits. Using TH-specific loss-of-function methodology and techniques to monitor population activity in transgenic rats in vivo, we investigated the contribution of A13-DA neurons in reward and movement-related actions. Our work demonstrates a role for A13-DA neurons in grasping and handling of objects but not reward. A13-DA neurons responded strongly when animals grab and manipulate food items, whereas their inactivation or degeneration prevented animals from successfully doing so-a deficit partially attributed to a reduction in grip strength. By contrast, there was no relation between A13-DA activity and food-seeking behavior when animals were tested on a reward-based task that did not include a reaching/grasping response. Motivation for food was unaffected, as goal-directed behavior for food items was in general intact following A13 neuronal inactivation/degeneration. An anatomical investigation confirmed that A13-DA neurons project to the superior colliculus (SC) and also demonstrated a novel A13-DA projection to the reticular formation (RF). These results establish a functional role for A13-DA neurons in prehensile actions that are uncoupled from the motivational factors that contribute to the initiation of forelimb movements and help position A13-DA circuits into the functional framework regarding centrally located DA populations and their ability to coordinate movement.

Sex and age differences in mice models of effort-based decision-making and anergia in depression: the role of dopamine, and cerebral-dopamine-neurotrophic-factor

Mesolimbic dopamine (DA) regulates vigor in motivated behavior. While previous results have mainly been performed in male rodents, the present studies compared CD1 male and female mice in effort-based decision-making tests of motivation. These tests offered choices between several reinforcers that require different levels of effort (progressive ratio/choice task and 3-choice-T-maze task). Sweet reinforcers were used in both tasks. In the operant tasks, females worked harder as the task required more effort to access a 10% sucrose solution. Although males and females did not differ in preference for 10% vs 3% solutions under free concurrent presentation, females consumed more of the 10% solution when tested alone. The operant task requires a long period of training and changes in the DA system due to age can be mediating long-term changes in effort. Thus, age and sex factors were evaluated in the T-maze task, which requires only a short training period. Both sexes and ages were equally active when habituated to the running wheel (RW), but females consumed more sweet pellets than males, especially at an older age. Both sexes had a strong preference for the RW compared to more sedentary reinforcers in the 3-choice-T-maze test, but older animals spent less time running and ate more than the young ones. The DA-depleting agent tetrabenazine reduced time running in older mice but not in adolescents. Cerebral-dopamine-neurotrophic-factor was reduced in older mice of both sexes compared to adolescent mice. These results emphasize the importance of taking into account differences in sex and age when evaluating willingness to exert effort for specific reinforcers.

Methylliberine Ingestion Improves Various Indices of Affect but Not Cognitive Function in Healthy Men and Women

This study assessed the acute effects of oral methylliberine (DynamineTM) supplementation on cognitive function and indices of well-being. This was a double-blind, randomized, within-subject crossover trial. In total, 25 healthy men and women (33.5 ± 10.7 yr, 172.7 ± 8.6 cm, 73.3 ± 11.0 kg) underwent pretesting before ingesting methylliberine (100 mg) or a placebo (PLA) for 3 days. On the fourth day, the participants were tested before their fourth dose (baseline) and every hour post-ingestion for 3 h. After a one-week washout period, the participants repeated testing with the alternate investigational product. The testing battery consisted of vitals, Stroop test, Trail Making Test-B, and visual analog scales that assessed various indices of well-being. Mixed factorial ANOVAs with repeated measures were used to assess all variables. There were significant (p ≤ 0.050) interactions in terms of concentration, motivation, and mood. Methylliberine improved concentration at 1 and 3 h, motivation at 3 h, and mood at 1, 2, and 3 h (p ≤ 0.050). Methylliberine improved energy, sustained energy, and mood in all participants to a greater extent than PLA at 1 h and 3 h relative to baseline (p ≤ 0.050). PLA improved motivation at 1 and 2 h and mood at 2 h (p ≤ 0.050). Methylliberine improved concentration, well-being, and the ability to tolerate stress to a greater extent than PLA at 3 h relative to baseline (p ≤ 0.050). Women observed elevations in sustained energy at 1 and 3 h (p ≤ 0.050) with methylliberine vs. PLA. Methylliberine had a negligible influence on cognitive function and vitals (p > 0.050), and no adverse events were reported. Methylliberine significantly improved subjective feelings of energy, concentration, motivation, and mood, but not cognitive function. PLA improved motivation and mood at hours 1 and 2, while methylliberine sustained these benefits for longer. Methylliberine also improved concentration, well-being, and the ability to tolerate stress to a greater degree than PLA, while having no detrimental effects on vital signs. Methylliberine also seemed to have a positive impact on sustained energy in women.

Effort-related effects of chronic administration of the DA D2 receptor antagonist haloperidol via subcutaneous programmable minipumps: Reversal by co-administration of the adenosine A2A antagonist istradefylline

RATIONALE

Long-acting antipsychotics such as haloperidol decanoate are becoming more commonly used. Long-acting depot formulations have several advantages, but secondary negative effects of prolonged delivery, including motivational dysfunctions, could have debilitating effects. Assessing the behavioral changes that emerge during chronic antipsychotic administration in rats could provide insight regarding the development of motivational dysfunctions and drug tolerance.

OBJECTIVES

Acute administration of dopamine D2 antagonists such as haloperidol induce motivational deficits in rats, as marked by a shift towards a low-effort bias during effort-based choice tasks. In the present studies, programmable subcutaneous infusion pumps provided continuous and controlled drug delivery of haloperidol. Animals were assessed using a fixed ratio (FR) 5 lever pressing schedule and the FR5/chow feeding test of effort-based choice. The adenosine A2A antagonist istradefylline was studied for its ability to reverse the effects of chronic haloperidol.

RESULTS

Continuous chronic infusions of haloperidol produced significant reductions in FR5 performance and a shift from lever pressing to chow intake in rats tested on FR5/chow feeding choice, with no evidence of tolerance over the 4-week infusion period. Behavior returned to baseline during the vehicle-infusion washout period. Istradefylline significantly reversed the effects of haloperidol, increasing lever pressing and decreasing chow intake in haloperidol-treated rats.

CONCLUSIONS

These studies provide an important behavioral characterization of the effects of chronically infused haloperidol, and demonstrate that A2A antagonism reverses the effects of chronic haloperidol. This research could contribute to the understanding and treatment of motivational dysfunctions seen in schizophrenia, Parkinson's disease, and other disorders involving dopamine.

Beyond the symptom: the biology of fatigue

A workshop titled "Beyond the Symptom: The Biology of Fatigue" was held virtually September 27-28, 2021. It was jointly organized by the Sleep Research Society and the Neurobiology of Fatigue Working Group of the NIH Blueprint Neuroscience Research Program. For access to the presentations and video recordings, see: https://neuroscienceblueprint.nih.gov/about/event/beyond-symptom-biology-fatigue. The goals of this workshop were to bring together clinicians and scientists who use a variety of research approaches to understand fatigue in multiple conditions and to identify key gaps in our understanding of the biology of fatigue. This workshop summary distills key issues discussed in this workshop and provides a list of promising directions for future research on this topic. We do not attempt to provide a comprehensive review of the state of our understanding of fatigue, nor to provide a comprehensive reprise of the many excellent presentations. Rather, our goal is to highlight key advances and to focus on questions and future approaches to answering them.

How and why the adenosine A2A receptor became a target for Parkinson's disease therapy

Dopaminergic therapy for Parkinson's disease has revolutionised the treatment of the motor symptoms of the illness. However, it does not alleviate all components of the motor deficits and has only limited effects on non-motor symptoms. For this reason, alternative non-dopaminergic approaches to treatment have been sought and the adenosine A2A receptor provided a novel target for symptomatic therapy both within the basal ganglia and elsewhere in the brain. Despite an impressive preclinical profile that would indicate a clear role for adenosine A2A antagonists in the treatment of Parkinson's disease, the road to clinical use has been long and full of difficulties. Some aspects of the drugs preclinical profile have not translated into clinical effectiveness and not all the clinical studies undertaken have had a positive outcome. The reasons for this will be explored and suggestions made for the further development of this drug class in the treatment of Parkinson's disease. However, one adenosine A2A antagonist, namely istradefylline has been introduced successfully for the treatment of late-stage Parkinson's disease in two major areas of the world and has become a commercial success through offering the first non-dopaminergic approach to the treatment of unmet need to be introduced in several decades.

Ventral Tegmental Area M5 Muscarinic Receptors Mediate Effort-Choice Responding and Nucleus Accumbens Dopamine in a Sex-Specific Manner

Optimization of effort-related choices is impaired in depressive disorders. Acetylcholine (ACh) and dopamine (DA) are linked to depressive disorders, and modulation of ACh tone in the ventral tegmental area (VTA) affects mood-related behavioral responses in rats. However, it is unknown if VTA ACh mediates effort-choice behaviors. Using a task of effort-choice, rats can choose to lever press on a fixed-ratio 5 (FR5) schedule for a more-preferred food or consume freely available, less-preferred food. VTA administration of physostigmine (1 μg and 2 μg/side), a cholinesterase inhibitor, reduced FR5 responding for the more-preferred food while leaving consumption of the less-preferred food intact. VTA infusion of the M5 muscarinic receptor negative allosteric modulator VU6000181 (3 μM, 10 μM, 30 μM/side) did not affect lever pressing or chow consumption. However, VU6000181 (30 μM/side) coadministration with physostigmine (2 μg/side) attenuated physostigmine-induced decrease in lever pressing in female and male rats and significantly elevated lever pressing above vehicle baseline levels in male rats. In in vivo voltammetry experiments, VTA infusion of combined physostigmine and VU6000181 did not significantly alter evoked phasic DA release in the nucleus accumbens core (NAc) in female rats. In male rats, combined VTA infusion of physostigmine and VU6000181 increased phasic evoked DA release in the NAc compared with vehicle, physostigmine, or VU6000181 infusion alone. These data indicate a critical role and potential sex differences of VTA M5 receptors in mediating VTA cholinergic effects on effort choice behavior and regulation of DA release. SIGNIFICANCE STATEMENT: Effort-choice impairments are observed in depressive disorders, which are often treatment resistant to currently available thymoleptics. The role of ventral tegmental area (VTA) acetylcholine muscarinic M5 receptors, in a preclinical model of effort-choice behavior, is examined. Using the selective negative allosteric modulator of the M5 receptor VU6000181, we show the role of VTA M5 receptors on effort-choice and regulation of dopamine release in the nucleus accumbens core. This study supports M5 receptors as therapeutic targets for depression.

Use of experimental medicine approaches for the development of novel psychiatric treatments based on orexin receptor modulation

Despite progress in understanding the pathological mechanisms underlying psychiatric disorders, translation from animal models into clinical use remains a significant bottleneck. Preclinical studies have implicated the orexin neuropeptide system as a potential target for psychiatric disorders through its role in regulating emotional, cognitive, and behavioral processes. Clinical studies are investigating orexin modulation in addiction and mood disorders. Here we review performance-outcome measures (POMs) arising from experimental medicine research methods which may show promise as markers of efficacy of orexin receptor modulators in humans. POMs provide objective measures of brain function, complementing patient-reported or clinician-observed symptom evaluation, and aid the translation from preclinical to clinical research. Significant challenges include the development, validation, and operationalization of these measures. We suggest that collaborative networks comprising clinical practitioners, academics, individuals working in the pharmaceutical industry, drug regulators, patients, patient advocacy groups, and other relevant stakeholders may provide infrastructure to facilitate validation of experimental medicine approaches in translational research and in the implementation of these approaches in real-world clinical practice.

"Ten euros now" temporal discounting in Huntington disease

BACKGROUND

When making decisions, one often faces a trade-off between immediate and long-term rewards. In these situations, people may prefer immediate over later rewards, even if immediate rewards are smaller than later ones; a phenomenon known as temporal discounting. In this study, we, for the first time, assessed temporal discounting in three populations: participants with manifest Huntington disease (HD), participants with premanifest HD, and control participants.

METHODS

Using the temporal discounting task, we invited participants to choose between small immediate amount of money vs. delayed, but larger amount of money (e.g., "Which do you prefer: you get 10 euros right now or 50 euros in a month?"). We also measured inhibition in order to test if it impacts discounting performance.

RESULTS

Analysis demonstrated higher temporal discounting (i.e., a preference for the immediate rewards) in participants with manifest HD compared to those with premanifest HD or control participants, but no significant differences were observed in participants with premanifest HD and control participants. Analysis also demonstrated significant correlations between temporal discounting and scores on an inhibition test in participants with manifest HD, but not in those with premanifest HD or in control participants.

DISCUSSION

We suggest that, when making decisions, patients with manifest HD may have difficulties with suppressing the temptation of smaller, but immediate, rewards.

Administration of neuropeptide Y into the rat nucleus accumbens shell, but not core, attenuates the motivational impairment from systemic dopamine receptor antagonism by α-flupenthixol

Previous research has demonstrated that dopamine and Neuropeptide Y (NPY) promote motivated behavior, and there is evidence to suggest that they interact within neural circuitry involved in motivation. NPY and dopamine both modulate appetitive motivation towards food through direct actions in the nucleus accumbens (NAc), although how they interact in this region to promote motivation is presently unclear. In this study, we sought to further elucidate the relationship between NAc NPY and dopamine and their effects on motivated behavior. Specifically, we examined whether NAc injections of NPY might reverse behavioral deficits caused by reduced dopamine signaling due to systemic dopamine receptor antagonism. Appetitive motivation was measured using a progressive ratio-2 paradigm. Male Sprague Dawley rats were treated with systemic injections of the dopamine antagonist, α-flupenthixol or a saline vehicle. Two hours following injections, they were administered infusions of NPY (at 0, 156, or 235 pmol) into either the NAc shell (n = 12) or the NAc core (n = 10) and were placed in operant chambers. In both groups, α-flupenthixol impaired performance on the PR-2 task. NPY receptor stimulation of the NAc shell significantly increased both breakpoint and active lever presses during the PR-2 task, and dose-dependently increased responding following systemic dopamine receptor blockade. NPY did not affect appetitive motivation when injected into the NAc core. These data demonstrate that NPY in the NAc shell can improve motivational impairments that result from dopamine antagonism, and that these effects are site specific. These results also suggest that upregulation of NPY in neurodegenerative diseases may possibly buffer early motivational deficits caused by dopamine depletion in Parkinson's and Huntington's disease patients, both of which show increased NPY expression after disease onset.

Neural representation and modulation of volitional motivation in response to escalating efforts

Task-dependent volitional control of the selected neural activity in the cortex is critical to neuroprosthetic learning to achieve reliable and robust control of the external device. The volitional control of neural activity is driven by a motivational factor (volitional motivation), which directly reinforces the target neurons via real-time biofeedback. However, in the absence of motor behaviour, how do we evaluate volitional motivation? Here, we defined the criterion (ΔF/F) of the calcium fluorescence signal in a volitionally controlled neural task, then escalated the efforts by progressively increasing the number of reaching the criterion or holding time after reaching the criterion. We devised calcium-based progressive threshold-crossing events (termed 'Calcium PTE') and calcium-based progressive threshold-crossing holding-time (termed 'Calcium PTH') for quantitative assessment of volitional motivation in response to progressively escalating efforts. Furthermore, we used this novel neural representation of volitional motivation to explore the neural circuit and neuromodulator bases for volitional motivation. As with behavioural motivation, chemogenetic activation and pharmacological blockade of the striatopallidal pathway decreased and increased, respectively, the breakpoints of the 'Calcium PTE' and 'Calcium PTH' in response to escalating efforts. Furthermore, volitional and behavioural motivation shared similar dopamine dynamics in the nucleus accumbens in response to trial-by-trial escalating efforts. In general, the development of a neural representation of volitional motivation may open a new avenue for smooth and effective control of brain-machine interface tasks. KEY POINTS: Volitional motivation is quantitatively evaluated by M1 neural activity in response to progressively escalating volitional efforts. The striatopallidal pathway and adenosine A_2A receptor modulate volitional motivation in response to escalating efforts. Dopamine dynamics encode prediction signal for reward in response to repeated escalating efforts during motor and volitional conditioning. Mice learn to modulate neural activity to compensate for repeated escalating efforts in volitional control.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Importin α3 (KPNA3) Deficiency Augments Effortful Reward-Seeking Behavior in Mice

Importin α3 (Gene: Kpna3, the ortholog of human Importin α4) is a member of the importin α family and participates in nucleocytoplasmic transport by forming trimeric complexes between cargo proteins and importin β1. Evidence from human studies has indicated that single nucleotide polymorphisms (SNP) in the KPNA3 gene are associated with the occurrence of several psychiatric disorders accompanied by abnormal reward-related behavior, including schizophrenia, major depression, and substance addiction. However, the precise roles of importin α3 in controlling reward processing and motivation are still unclear. In this study, we evaluated the behavioral effects of Kpna3 knockout (KO) in mice on performance in touchscreen operant chamber-based tasks evaluating simple (fixed-ratio) and effortful (progressive-ratio) reward-seeking behaviors. While Kpna3 KO mice showed no significant differences in operant reward learning on a fixed-ratio schedule, they demonstrated significantly increased motivation (increased break point) to instrumentally respond for sucrose on a progressive-ratio schedule. We additionally measured the number of c-Fos-positive cells, a marker of neural activity, in 20 regions of the brain and identified a network of brain regions based on their interregional correlation coefficients. Network and graph-theoretic analyses suggested that Kpna3 deficiency enhanced overall interregional functional connectivity. These findings suggest the importance of Kpna3 in motivational control and indicate that Kpna3 KO mice may be an attractive line for modeling motivational abnormalities associated with several psychiatric disorders.

A spatiotemporal increase of neuronal activity accompanies the motivational effect of wheel running in mice

Spatiotemporal patterns of neuronal activity underlying the motivational effect of rotating running wheels (RWs) in rodents remain largely undetermined. Here, we investigated changes of neuronal activity among brain regions associated with motivation across different intensities of motivation for RWs in mice. Daily exposure to RWs gradually increased rotation number, then became stable after approximately 3 weeks. Immunohistochemical analyses revealed that the number of c-Fos (a neuronal activity marker)-positive cells increased in the medial prefrontal cortex (mPFC), core and shell of the nucleus accumbens (NAc), dorsal striatum (Str), and lateral septum (LS) at day 1, day 9, and days 20-24, in a time-dependent manner. Additionally, despite exposure to locked RWs for over 7 days after establishing stable rotation with 3-week RW access, increased c-Fos expression was still observed in most of these brain areas. Furthermore, daily overnight RW access developed stable rotation by day 6, with high and low rotation numbers at the start and end of the overnight session, respectively. The number of c-Fos-positive cells at the start of RW rotation was significantly higher than at the end of RW rotation in most brain regions. Furthermore, after establishing stable rotation, the number of c-Fos-positive cells increased in the mPFC and shell of the NAc of mice that only observed RWs. These findings suggest that the subareas of the mPFC and NAc may be critically involved in the motivational effects of RW rotations.

Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington's Disease

A caregiver's all‐too‐familiar narrative ‐ “He doesn't think through what he does, but mostly he does nothing.” Apathy and impulsivity, debilitating and poorly understood, commonly co‐occur in Huntington's disease (HD). HD is a neurodegenerative disease with manifestations bridging clinical neurology and psychiatry. In addition to movement and cognitive symptoms, neurobehavioral disturbances, particularly apathy and impulsivity, are prevalent features of HD, occurring early in the disease course, often worsening with disease progression, and substantially reducing quality of life. Treatments remain limited, in part because of limited mechanistic understanding of these behavioral disturbances. However, emerging work within the field of decision‐making neuroscience and beyond points to common neurobiological mechanisms underpinning these seemingly disparate problems. These insights bridge the gap between underlying disease pathology and clinical phenotype, offering new treatment strategies, novel behavioral and physiological biomarkers of HD, and deeper understanding of human behavior. In this review, we apply the neurobiological framework of cost‐benefit decision making to the problems of apathy and impulsivity in HD. Through this decision‐making lens, we develop a mechanistic model that elucidates the occurrence of these behavioral disturbances and points to potential treatment strategies and crucial research priorities. © 2022 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson Movement Disorder Society.

Cholinergic and dopaminergic-mediated motivated behavior in healthy states and in substance use and mood disorders

Acetylcholine is an important neuromodulator of the mesolimbic dopamine (DA) system, which itself is a mediator of motivated behavior. Motivated behavior can be described by two primary components, termed directional and activational motivation, both of which can be examined and dissociated using effort-choice tasks. The directional component refers to motivated behavior directed towards reinforcing stimuli and away from aversive stimuli. Behaviors characterized by increased vigor, persistence, and work output are considered to reflect activational components of motivation. Disruption of DA signaling has been shown to decrease activational components of motivation, while leaving directional features intact. Facilitation of DA release promotes the activational aspects of motivated behavior. In this review, we discuss cholinergic and DA regulation of motivated behaviors. We place emphasis on effort-choice processes and the ability of effort-choice tasks to examine and dissociate changes of motivated behavior in the context of substance use and mood disorders. Furthermore, we consider how altered cholinergic transmission impacts motivated behavior across disease states, and the possible role of cholinergic dysregulation in the etiology of these illnesses. Finally, we suggest that treatments targeting cholinergic activity may be useful in ameliorating motivational disruptions associated with substance use and comorbid substance use and mood disorders.

The Cost of Imagined Actions in a Reward-Valuation Task

Growing evidence suggests that humans and other animals assign value to a stimulus based not only on its inherent rewarding properties, but also on the costs of the action required to obtain it, such as the cost of time. Here, we examined whether such cost also occurs for mentally simulated actions. Healthy volunteers indicated their subjective value for snack foods while the time to imagine performing the action to obtain the different stimuli was manipulated. In each trial, the picture of one food item and a home position connected through a path were displayed on a computer screen. The path could be either large or thin. Participants first rated the stimulus, and then imagined moving the mouse cursor along the path from the starting position to the food location. They reported the onset and offset of the imagined movements with a button press. Two main results emerged. First, imagery times were significantly longer for the thin than the large path. Second, participants liked significantly less the snack foods associated with the thin path (i.e., with longer imagery time), possibly because the passage of time strictly associated with action imagery discounts the value of the reward. Importantly, such effects were absent in a control group of participants who performed an identical valuation task, except that no action imagery was required. Our findings hint at the idea that imagined actions, like real actions, carry a cost that affects deeply how people assign value to the stimuli in their environment.

Training Willpower: Reducing Costs and Valuing Effort

The integrative model of effortful control presented in a previous article aimed to specify the neurophysiological bases of mental effort. This model assumes that effort reflects three different inter-related aspects of the same adaptive function. First, a mechanism anchored in the salience network that makes decisions about the effort that should be engaged in the current task in view of costs and benefits associated with the achievement of the task goal. Second, a top-down control signal generated by the mechanism of effort that modulates neuronal activity in brain regions involved in the current task to filter pertinent information. Third, a feeling that emerges in awareness during effortful tasks and reflects the costs associated with goal-directed behavior. The aim of the present article is to complete this model by proposing that the capacity to exert effortful control can be improved through training programs. Two main questions relative to this possible strengthening of willpower are addressed in this paper. The first question concerns the existence of empirical evidence that supports gains in effortful control capacity through training. We conducted a review of 63 meta-analyses that shows training programs are effective in improving performance in effortful tasks tapping executive functions and/or self-control with a small to large effect size. Moreover, physical and mindfulness exercises could be two promising training methods that would deserve to be included in training programs aiming to strengthen willpower. The second question concerns the neural mechanisms that could explain these gains in effortful control capacity. Two plausible brain mechanisms are proposed: (1) a decrease in effort costs combined with a greater efficiency of brain regions involved in the task and (2) an increase in the value of effort through operant conditioning in the context of high effort and high reward. The first mechanism supports the hypothesis of a strengthening of the capacity to exert effortful control whereas the second mechanism supports the hypothesis of an increase in the motivation to exert this control. In the last part of the article, we made several recommendations to improve the effectiveness of interventional studies aiming to train this adaptive function."Keep the faculty of effort alive in you by a little gratuitous exercise every day."James (1918, p. 127).

The physiological control of eating: signals, neurons, and networks

During the past 30 yr, investigating the physiology of eating behaviors has generated a truly vast literature. This is fueled in part by a dramatic increase in obesity and its comorbidities that has coincided with an ever increasing sophistication of genetically based manipulations. These techniques have produced results with a remarkable degree of cell specificity, particularly at the cell signaling level, and have played a lead role in advancing the field. However, putting these findings into a brain-wide context that connects physiological signals and neurons to behavior and somatic physiology requires a thorough consideration of neuronal connections: a field that has also seen an extraordinary technological revolution. Our goal is to present a comprehensive and balanced assessment of how physiological signals associated with energy homeostasis interact at many brain levels to control eating behaviors. A major theme is that these signals engage sets of interacting neural networks throughout the brain that are defined by specific neural connections. We begin by discussing some fundamental concepts, including ones that still engender vigorous debate, that provide the necessary frameworks for understanding how the brain controls meal initiation and termination. These include key word definitions, ATP availability as the pivotal regulated variable in energy homeostasis, neuropeptide signaling, homeostatic and hedonic eating, and meal structure. Within this context, we discuss network models of how key regions in the endbrain (or telencephalon), hypothalamus, hindbrain, medulla, vagus nerve, and spinal cord work together with the gastrointestinal tract to enable the complex motor events that permit animals to eat in diverse situations.

Effects of the dopamine depleting agent tetrabenazine on detailed temporal parameters of effort-related choice responding

The dopamine-depleting agent tetrabenazine alters effort-based choice, suppressing food-reinforced behaviors with high response requirements, while increasing selection of low-cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high-carbohydrate Bio-serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse-time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement-pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research.

Adolescent high-fructose corn syrup consumption leads to dysfunction in adult affective behaviors and mesolimbic proteins in male Sprague-Dawley rats

Adolescence is a critical period of development, during which the brain undergoes rapid maturation. Problematically, adolescents are the top consumers of high fructose corn syrup (HFCS) sweetened beverages and snacks, which may have neurodevelopmental consequences. While HFCS consumption has been linked to an increased likelihood of obesity and other physical health impairments, the link between HFCS and persistent behavioral changes is not yet fully established. The present study aimed to assess whether adolescent HFCS consumption could lead to alterations in adult behaviors and protein expression, following cessation. Adolescent HFCS-exposure contributed to deficits in learning and motivation on an effort-related T-Maze procedure, as well as increased immobility time in the forced swim paradigm during adulthood. Molecularly, protracted decreases in accumbal dopamine D1 and D2 receptors and protein kinase G (PKG), as well as increases in tyrosine hydroxylase and GluA2 receptor subunits, were observed following HFCS-exposure. Taken together, these data suggest that adolescent HFCS-consumption leads to protracted dysfunction in affective behaviors and alterations in accumbal proteins which persist following cessation of HFCS-consumption.

Intermittent social stress produces different short- and long-term effects on effort-based reward-seeking behavior

Previous studies show that intermittent social defeat (ISD) stress increases self-administration of psychostimulants, which suggests that ISD promotes reward-seeking behavior and, ultimately, increases vulnerability to develop drug abuse. The present study investigates whether ISD alters cost/benefit evaluations to promote reward-seeking behavior and whether these alterations are time-dependent. Male rats performed two different tasks that assessed their motivation to seek and consume food rewards. An effort-discounting task in which rats chose between less and more effortful options (i.e., 1 lever-press versus 2, 5, 10 or 20 lever-presses) associated with low- and high-reward (i.e., 1 sugar pellet versus 3 sugar pellets), respectively; and a progressive ratio task in which rats had to increase their effort (more lever presses) to obtain a sugar pellet. ISD consisted of exposing animals to social defeat once every three days for ten days (4 stress episodes). Rats were tested 24-48 h after stress episodes, and 1 week and 6 weeks after the last stress episode. In the effort-discounting task, stressed animals showed a decrease in their preference for high rewards associated with more effort (i.e., 10 and 20 lever-presses). These effects were transient and not maintained one week after stress. In the progressive ratio task, stressed animals showed an increase in the number of lever presses to obtain rewards that emerged six weeks after the last stress episode. These results suggest different short- and long-term effects on the motivation for rewards after ISD and indicate temporal dynamic adaptations in the function of the brain reward system.

Adenosine Receptors in Neuropsychiatric Disorders: Fine Regulators of Neurotransmission and Potential Therapeutic Targets

Adenosine exerts an important role in the modulation of central nervous system (CNS) activity. Through the interaction with four G-protein coupled receptor (GPCR) subtypes, adenosine subtly regulates neurotransmission, interfering with the dopaminergic, glutamatergic, noradrenergic, serotoninergic, and endocannabinoid systems. The inhibitory and facilitating actions of adenosine on neurotransmission are mainly mediated by A₁ and A_2A adenosine receptors (ARs), respectively. Given their role in the CNS, ARs are promising therapeutic targets for neuropsychiatric disorders where altered neurotransmission represents the most likely etiological hypothesis. Activating or blocking ARs with specific pharmacological agents could therefore restore the balance of altered neurotransmitter systems, providing the rationale for the potential treatment of these highly debilitating conditions. In this review, we summarize and discuss the most relevant studies concerning AR modulation in psychotic and mood disorders such as schizophrenia, bipolar disorders, depression, and anxiety, as well as neurodevelopment disorders such as autism spectrum disorder (ASD), fragile X syndrome (FXS), attention-deficit hyperactivity disorder (ADHD), and neuropsychiatric aspects of neurodegenerative disorders.

Chronic Distress in Male Mice Impairs Motivation Compromising Both Effort and Reward Processing With Altered Anterior Insular Cortex and Basolateral Amygdala Neural Activation

In humans and mammals, effort-based decision-making for monetary or food rewards paradigms contributes to the study of adaptive goal-directed behaviours acquired through reinforcement learning. Chronic distress modelled by repeated exposure to glucocorticoids in rodents induces suboptimal decision-making under uncertainty by impinging on instrumental acquisition and prompting negative valence behaviours. In order to further disentangle the motivational tenets of adaptive decision-making, this study addressed the consequences of enduring distress on relevant effort and reward-processing dimensions. Experimentally, appetitive and consummatory components of motivation were evaluated in adult C57BL/6JRj male mice experiencing chronic distress induced by oral corticosterone (CORT), using multiple complementary discrete behavioural tests. Behavioural data (from novelty suppressed feeding, operant effort-based choice, free feeding, and sucrose preference tasks) collectively show that behavioural initiation, effort allocation, and hedonic appreciation and valuation are altered in mice exposed to several weeks of oral CORT treatment. Additionally, data analysis from FosB immunohistochemical processing of postmortem brain samples highlights CORT-dependent dampening of neural activation in the anterior insular cortex (aIC) and basolateral amygdala (BLA), key telencephalic brain regions involved in appetitive and consummatory motivational processing. Combined, these results suggest that chronic distress-induced irregular aIC and BLA neural activations with reduced effort production and attenuated reward value processing during reinforcement-based instrumental learning could result in maladaptive decision-making under uncertainty. The current study further illustrates how effort and reward processing contribute to adjust the motivational threshold triggering goal-directed behaviours in versatile environments.

Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence

Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has explored the neural basis of reward deficits in the context of depression, and has implicated mesocorticolimbic reward circuitry comprising the nucleus accumbens, ventral pallidum, ventral tegmental area, amygdala, hippocampus, anterior cingulate, insula, orbitofrontal cortex, and other prefrontal cortex regions. Dopamine modulates several reward facets including anticipation, motivation, effort, and learning. As well, serotonin, norepinephrine, opioids, glutamate, Gamma aminobutyric acid (GABA), and acetylcholine are also involved in anhedonia, and medications targeting these systems may also potentially normalize reward processing in depression. Unfortunately, whereas reward anticipation and reward outcome are extensively explored by both preclinical and clinical studies, translational gaps remain in reward motivation, effort, valuation, and learning, where clinical neuroimaging studies are in the early stages. This review aims to synthesize the neurobiological mechanisms underlying anhedonia in MDD uncovered by preclinical and clinical research. The translational difficulties in studying the neural basis of reward are also discussed.

Binge eating behavior and incentive motivation with a cafeteria diet

Binge-like eating behavior (BLE) has been characterized as an eating disorder in which subjects have an enhanced intake of food, mainly fats. However, intake of fats and carbohydrates may have differential effects on motivation. Previously it was shown that BLE produces an increase in operant responding for vegetable shortening, but others were unable to replicate the finding using sucrose as the reinforcer. Our aim was to determine if BLE behavior induced with a cafeteria-like diet (CaLD) with several options with fat content would produce an increment in performance. Male Wistar rats were trained under an exponential progressive ratio schedule of sucrose reinforcement; thereafter, the limited access model was used to induce BLE using CaLD options. Finally, subjects were tested for increments in break points (BPs) in the progressive ratio schedule. Rats with intermittent access to CaLD options showed a clear BLE with an escalation in their intake; however they showed compensatory decrements of chow intake that rendered a similar body weight gain to a continuous access group. Although we were unable to observe an increase in BPs after BLE we were able to observe a protection against the decrements of BP previously observed with sugar. Different mechanisms for processing high fat and high carbohydrate reinforcers are variables worth exploring to gain a better understanding of BLE behavior in rodent models.

Striatal Astrocytes Shape Behavioral Flexibility via Regulation of the Glutamate Transporter EAAT2

BACKGROUND

Striatal circuits must be modulated for behavioral flexibility, the ability to adapt to environmental changes. Striatal astrocytes contribute to circuit neuromodulation by controlling the activity of ambient neurotransmitters. In particular, extracellular glutamate levels are tightly controlled by the astrocytic glutamate transporter EAAT2, influencing synaptic functioning and neural network activity. However, it remains unclear if EAAT2 responds to environmental cues to specifically shape action control.

METHODS

To investigate the relationship between behavioral flexibility and experience-dependent regulation of EAAT2 expression in the dorsal striatum, mice were trained on an instrumental task. We manipulated EAAT2 expression using chemogenetic activation of astrocytic Gq signaling or in vivo morpholinos and determined the ability to adapt to novel environmental contingencies.

RESULTS

The loss of behavioral flexibility with task overtraining is associated with the upregulation of EAAT2, which results in enhanced glutamate clearance and altered modulation of glutamatergic neurotransmission in the lateral part of the dorsal striatum. Interfering with EAAT2 upregulation in this striatal area preserves behavioral flexibility.

CONCLUSIONS

Astrocytes are emerging as critical regulators of striatal functions. This work demonstrates that plasticity of EAAT2 expression in the lateral part of the dorsal striatum shapes behavior, thus providing novel mechanistic insights into how flexibility in action control is regulated.

Sex differences in effort-related decision-making: role of dopamine D2 receptor antagonism

RATIONALE

Depressed individuals demonstrate debilitating symptoms, including depressed mood, anhedonia, and effort-related deficits. Effort-related decision-making can be measured through providing subjects with a choice between high effort/reward and low effort/reward options, which is a dopamine (DA)-dependent behavior. While previous research has shown sex differences in depression rates, this has not been examined within operant-based effort-related decision-making tasks nor has DA been shown to underlie this behavior in female rats.

OBJECTIVES

The current study investigated sex differences in an effort-related decision-making task prior to and following administration of the DA D2 receptor antagonist haloperidol (HAL).

METHODS

Adult rats were food restricted or fed freely and trained in an effort-related progressive ratio choice task. After stable responding, HAL was administered acutely (0.05-0.2 mg/kg) prior to testing.

RESULTS

Results indicate a significant effect of sex on training variables, with males having a greater number of lever presses, higher ratios, and longer active lever times. Pretreatment with HAL significantly reduced the same measures in both sexes for the high-valued reward, while increasing chow consumption in the food restricted males. Food restricted rats showed a greater number of total lever presses and achieved higher ratios; however, the effect in male food restricted rats was greatest.

CONCLUSIONS

These data suggest that, although there are sex differences in training, HAL decreases behavior across sexes, demonstrating that the D2 mechanism is similar in both sexes. These findings provide a better understanding of motivational dysfunction in both sexes and potential treatment targets for depression.

Not Just a Bystander: The Emerging Role of Astrocytes and Research Tools in Studying Cognitive Dysfunctions in Schizophrenia

Cognitive dysfunction is one of the core symptoms in schizophrenia, and it is predictive of functional outcomes and therefore useful for treatment targets. Rather than improving cognitive deficits, currently available antipsychotics mainly focus on positive symptoms, targeting dopaminergic/serotoninergic neurons and receptors in the brain. Apart from investigating the neural mechanisms underlying schizophrenia, emerging evidence indicates the importance of glial cells in brain structure development and their involvement in cognitive functions. Although the etiopathology of astrocytes in schizophrenia remains unclear, accumulated evidence reveals that alterations in gene expression and astrocyte products have been reported in schizophrenic patients. To further investigate the role of astrocytes in schizophrenia, we highlighted recent progress in the investigation of the effect of astrocytes on abnormalities in glutamate transmission and impairments in the blood–brain barrier. Recent advances in animal models and behavioral methods were introduced to examine schizophrenia-related cognitive deficits and negative symptoms. We also highlighted several experimental tools that further elucidate the role of astrocytes. Instead of focusing on schizophrenia as a neuron-specific disorder, an additional astrocytic perspective provides novel and promising insight into its causal mechanisms and treatment. The involvement of astrocytes in the pathogenesis of schizophrenia and other brain disorders is worth further investigation.

Dopaminergic Modulation of Forced Running Performance in Adolescent Rats: Role of Striatal D1 and Extra-striatal D2 Dopamine Receptors

Improving exercise capacity during adolescence impacts positively on cognitive and motor functions. However, the neural mechanisms contributing to enhance physical performance during this sensitive period remain poorly understood. Such knowledge could help to optimize exercise programs and promote a healthy physical and cognitive development in youth athletes. The central dopamine system is of great interest because of its role in regulating motor behavior through the activation of D1 and D2 receptors. Thus, the aim of the present study is to determine whether D1 or D2 receptor signaling contributes to modulate the exercise capacity during adolescence and if this modulation takes place through the striatum. To test this, we used a rodent model of forced running wheel that we implemented recently to assess the exercise capacity. Briefly, rats were exposed to an 8-day period of habituation in the running wheel before assessing their locomotor performance in response to an incremental exercise test, in which the speed was gradually increased until exhaustion. We found that systemic administration of D1-like (SCH23390) and/or D2-like (raclopride) receptor antagonists prior to the incremental test reduced the duration of forced running in a dose-dependent manner. Similarly, locomotor activity in the open field was decreased by the dopamine antagonists. Interestingly, this was not the case following intrastriatal infusion of an effective dose of SCH23390, which decreased motor performance during the incremental test without disrupting the behavioral response in the open field. Surprisingly, intrastriatal delivery of raclopride failed to impact the duration of forced running. Altogether, these results indicate that the level of locomotor response to incremental loads of forced running in adolescent rats is dopamine dependent and mechanistically linked to the activation of striatal D1 and extra-striatal D2 receptors.

Noradrenergic correlates of chronic cocaine craving: neuromelanin and functional brain imaging

Preclinical studies have implicated noradrenergic (NA) dysfunction in cocaine addiction. In particular, the NA system plays a central role in motivated behavior and may partake in the regulation of craving and drug use. Yet, human studies of the NA system are scarce, likely hampered by the difficulty in precisely localizing the locus coeruleus (LC). Here, we used neuromelanin imaging to localize the LC and quantified LC neuromelanin signal (NMS) intensity in 44 current cocaine users (CU; 37 men) and 59 nondrug users (NU; 44 men). We also employed fMRI to investigate cue-induced regional responses and LC functional connectivities, as quantified by generalized psychophysiological interaction (gPPI), in CU. Imaging data were processed by published routines and the findings were evaluated with a corrected threshold. We examined how these neural measures were associated with chronic cocaine craving, as assessed by the Cocaine Craving Questionnaire (CCQ). Compared to NU, CU demonstrated higher LC NMS for all probabilistic thresholds defined of 50-90% of the peak. In contrast, NMS of the ventral tegmental area/substantia nigra (VTA/SN) did not show significant group differences. Drug as compared to neutral cues elicited higher activations of many cortical and subcortical regions, none of which were significantly correlated with CCQ score. Drug vs. neutral cues also elicited "deactivation" of bilateral parahippocampal gyri (PHG) and PHG gPPI with a wide array of cortical and subcortical regions, including the ventral striatum and, with small volume correction, the LC. Less deactivation of the PHG (r = 0.40, p = 0.008) and higher PHG-LC gPPI (r = 0.44, p = 0.003) were positively correlated with the CCQ score. In contrast, PHG-VTA/SN connectivity did not correlate with the CCQ score. Together, chronic cocaine exposure may induce higher NMS intensity, suggesting neurotoxic effects on the LC. The correlation of cue-elicited PHG LC connectivity with CCQ score suggests a noradrenergic correlate of chronic cocaine craving. Potentially compensating for memory functions as in neurodegenerative conditions, cue-elicited PHG LC circuit connectivity plays an ill-adaptive role in supporting cocaine craving.

Chronic non-discriminatory social defeat stress reduces effort-related motivated behaviors in male and female mice

Reward and motivation deficits are prominent symptoms in many mood disorders, including depression. Similar reward and effort-related choice behavioral tasks can be used to study aspects of motivation in both rodents and humans. Chronic stress can precipitate mood disorders in humans and maladaptive reward and motivation behaviors in male rodents. However, while depression is more prevalent in women, there is relatively little known about whether chronic stress elicits maladaptive behaviors in female rodents in effort-related motivated tasks and whether there are any behavioral sex differences. Chronic nondiscriminatory social defeat stress (CNSDS) is a variation of chronic social defeat stress that is effective in both male and female mice. We hypothesized that CNSDS would reduce effort-related motivated and reward behaviors, including reducing sensitivity to a devalued outcome, reducing breakpoint in progressive ratio, and shifting effort-related choice behavior. Separate cohorts of adult male and female C57BL/6 J mice were divided into Control or CNSDS groups, exposed to the 10-day CNSDS paradigm, and then trained and tested in instrumental reward or effort-related behaviors. CNSDS reduced motivation to lever press in progressive ratio and shifted effort-related choice behavior from a high reward to a more easily attainable low reward in both sexes. CNSDS caused more nuanced impairments in outcome devaluation. Taken together, CNSDS induces maladaptive shifts in effort-related choice and reduces motivated lever pressing in both sexes.

Sex differences in lever pressing and running wheel tasks of effort-based choice behavior in rats: Suppression of high effort activity by the serotonin transport inhibitor fluoxetine

Selective serotonin transport (SERT) inhibitors such as fluoxetine are the most commonly prescribed treatments for depression. Although efficacious for many symptoms of depression, motivational impairments such as psychomotor retardation, anergia, fatigue and amotivation are relatively resistant to treatment with SERT inhibitors, and these drugs have been reported to exacerbate motivational deficits in some people. In order to study motivational dysfunctions in animal models, procedures have been developed to measure effort-related decision making, which offer animals a choice between high effort actions leading to highly valued reinforcers, or low effort/low reward options. In the present studies, male and female rats were tested on two different tests of effort-based choice: a fixed ratio 5 (FR5)/chow feeding choice procedure and a running wheel (RW)/chow feeding choice task. The baseline pattern of choice differed across tasks for males and females, with males pressing the lever more than females on the operant task, and females running more than males on the RW task. Administration of the SERT inhibitor and antidepressant fluoxetine suppressed the higher effort activity on each task (lever pressing and wheel running) in both males and females. The serotonin receptor mediating the suppressive effects of fluoxetine is uncertain, because serotonin antagonists with different patterns of receptor selectivity failed to reverse the effects of fluoxetine. Nevertheless, these studies uncovered important sex differences, and demonstrated that the suppressive effects of fluoxetine on high effort activities are not limited to tasks involving food reinforced behavior or appetite suppressive effects. It is possible that this line of research will contribute to an understanding of the neurochemical factors regulating selection of voluntary physical activity vs. sedentary behaviors, which could be relevant for understanding the role of physical activity in psychiatric disorders.

International society of sports nutrition position stand: caffeine and exercise performance

Following critical evaluation of the available literature to date, The International Society of Sports Nutrition (ISSN) position regarding caffeine intake is as follows: 1. Supplementation with caffeine has been shown to acutely enhance various aspects of exercise performance in many but not all studies. Small to moderate benefits of caffeine use include, but are not limited to: muscular endurance, movement velocity and muscular strength, sprinting, jumping, and throwing performance, as well as a wide range of aerobic and anaerobic sport-specific actions. 2. Aerobic endurance appears to be the form of exercise with the most consistent moderate-to-large benefits from caffeine use, although the magnitude of its effects differs between individuals. 3. Caffeine has consistently been shown to improve exercise performance when consumed in doses of 3-6 mg/kg body mass. Minimal effective doses of caffeine currently remain unclear but they may be as low as 2 mg/kg body mass. Very high doses of caffeine (e.g. 9 mg/kg) are associated with a high incidence of side-effects and do not seem to be required to elicit an ergogenic effect. 4. The most commonly used timing of caffeine supplementation is 60 min pre-exercise. Optimal timing of caffeine ingestion likely depends on the source of caffeine. For example, as compared to caffeine capsules, caffeine chewing gums may require a shorter waiting time from consumption to the start of the exercise session. 5. Caffeine appears to improve physical performance in both trained and untrained individuals. 6. Inter-individual differences in sport and exercise performance as well as adverse effects on sleep or feelings of anxiety following caffeine ingestion may be attributed to genetic variation associated with caffeine metabolism, and physical and psychological response. Other factors such as habitual caffeine intake also may play a role in between-individual response variation. 7. Caffeine has been shown to be ergogenic for cognitive function, including attention and vigilance, in most individuals. 8. Caffeine may improve cognitive and physical performance in some individuals under conditions of sleep deprivation. 9. The use of caffeine in conjunction with endurance exercise in the heat and at altitude is well supported when dosages range from 3 to 6 mg/kg and 4-6 mg/kg, respectively. 10. Alternative sources of caffeine such as caffeinated chewing gum, mouth rinses, energy gels and chews have been shown to improve performance, primarily in aerobic exercise. 11. Energy drinks and pre-workout supplements containing caffeine have been demonstrated to enhance both anaerobic and aerobic performance.

Secondary motor cortex: Broadcasting and biasing animal's decisions through long-range circuits

Medial secondary motor cortex (MOs or M2) constitutes the dorsal aspect of the rodent medial frontal cortex. We previously proposed that the function of MOs is to link antecedent conditions, including sensory stimuli and prior choices, to impending actions. In this review, we focus on the long-range pathways between MOs and other cortical and subcortical regions. We highlight three circuits: (1) connections with visual and auditory cortices that are essential for predictive coding of perceptual inputs; (2) connections with motor cortex and brainstem that are responsible for top-down, context-dependent modulation of movements; (3) connections with retrosplenial cortex, orbitofrontal cortex, and basal ganglia that facilitate reward-based learning. Together, these long-range circuits allow MOs to broadcast choice signals for feedback and to bias decision-making processes.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

Behavioral and dopamine transporter binding properties of the modafinil analog (S, S)-CE-158: reversal of the motivational effects of tetrabenazine and enhancement of progressive ratio responding

RATIONALE

Atypical dopamine (DA) transport blockers such as modafinil and its analogs may be useful for treating motivational symptoms of depression and other disorders. Previous research has shown that the DA depleting agent tetrabenazine can reliably induce motivational deficits in rats, as evidenced by a shift towards a low-effort bias in effort-based choice tasks. This is consistent with human studies showing that people with major depression show a bias towards low-effort activities.

OBJECTIVES

Recent studies demonstrated that the atypical DA transport (DAT) inhibitor (S)-CE-123 reversed tetrabenazine-induced motivational deficits, increased progressive ratio (PROG) lever pressing, and increased extracellular DA in the nucleus accumbens. In the present studies, a recently synthesized modafinil analog, (S, S)-CE-158, was assessed in a series of neurochemical and behavioral studies in rats.

RESULTS

(S, S)-CE-158 demonstrated the ability to reverse the effort-related effects of tetrabenazine and increase selection of high-effort PROG lever pressing in rats tested on PROG/chow feeding choice task. (S, S)-CE-158 showed a high selectivity for inhibiting DAT compared with other monoamine transporters, and systemic administration of (S, S)-CE-158 increased extracellular DA in the nucleus accumbens during the behaviorally active time course, which is consistent with the effects of (S)-CE-123 and other DAT inhibitors that enhance high-effort responding.

CONCLUSIONS

These studies provide an initial neurochemical characterization of a novel atypical DAT inhibitor, and demonstrate that this compound is active in models of effort-related choice. This research could contribute to the development of novel compounds for the treatment of motivational dysfunctions in humans.