Nucleus accumbens adenosine A2A receptors regulate exertion of effort by acting on the ventral striatopallidal pathway

Ventral Pallidum and Amygdala Cooperate to Restrain Reward Approach under Threat

Foraging decisions involve assessing potential risks and prioritizing food sources, which can be challenging when confronted with changing and conflicting circumstances. A crucial aspect of this decision-making process is the ability to actively overcome defensive reactions to threats and focus on achieving specific goals. The ventral pallidum (VP) and basolateral amygdala (BLA) are two brain regions that play key roles in regulating behavior motivated by either rewards or threats. However, it is unclear whether these regions are necessary in decision-making processes involving competing motivational drives during conflict. Our aim was to investigate the requirements of the VP and BLA for foraging choices in conflicts involving overcoming defensive responses. Here, we used a novel foraging task and pharmacological techniques to inactivate either the VP or BLA or to disconnect these brain regions before conducting a conflict test in male rats. Our findings showed that BLA is necessary for making risky choices during conflicts, whereas VP is necessary for invigorating the drive to obtain food, regardless of the presence of conflict. Importantly, our research revealed that the connection between VP and BLA is critical in controlling risky food-seeking choices during conflict situations. This study provides a new perspective on the collaborative function of VP and BLA in driving behavior, aimed at achieving goals in the face of dangers.

Targeting the adenosine A2A receptor for neuroprotection and cognitive improvement in traumatic brain injury and Parkinson's disease

Adenosine exerts its dual functions of homeostasis and neuromodulation in the brain by acting at mainly 2 G-protein coupled receptors, called A1 and A2A receptors. The adenosine A2A receptor (A2AR) antagonists have been clinically pursued for the last 2 decades, leading to final approval of the istradefylline, an A2AR antagonist, for the treatment of OFF-Parkinson's disease (PD) patients. The approval paves the way to develop novel therapeutic methods for A2AR antagonists to address 2 major unmet medical needs in PD and traumatic brain injury (TBI), namely neuroprotection or improving cognition. In this review, we first consider the evidence for aberrantly increased adenosine signaling in PD and TBI and the sufficiency of the increased A2AR signaling to trigger neurotoxicity and cognitive impairment. We further discuss the increasing preclinical data on the reversal of cognitive deficits in PD and TBI by A2AR antagonists through control of degenerative proteins and synaptotoxicity, and on protection against TBI and PD pathologies by A2AR antagonists through control of neuroinflammation. Moreover, we provide the supporting evidence from multiple human prospective epidemiological studies which revealed an inverse relation between the consumption of caffeine and the risk of developing PD and cognitive decline in aging population and Alzheimer's disease patients. Collectively, the convergence of clinical, epidemiological and experimental evidence supports the validity of A2AR as a new therapeutic target and facilitates the design of A2AR antagonists in clinical trials for disease-modifying and cognitive benefit in PD and TBI patients.

The striatum drives the ergogenic effects of caffeine

Caffeine is one of the main ergogenic resources used in exercise and sports. Previously, we reported the ergogenic mechanism of caffeine through neuronal A2AR antagonism in the central nervous system [1]. We now demonstrate that the striatum rules the ergogenic effects of caffeine through neuroplasticity changes. Thirty-four Swiss (8-10 weeks, 47 ± 1.5 g) and twenty-four C57BL/6J (8-10 weeks, 23.9 ± 0.4 g) adult male mice were studied behaviorly and electrophysiologically using caffeine and energy metabolism was studied in SH-SY5Y cells. Systemic (15 mg/kg, i.p.) or striatal (bilateral, 15 μg) caffeine was psychostimulant in the open field (p < 0.05) and increased grip efficiency (p < 0.05). Caffeine also shifted long-term depression (LTD) to potentiation (LTP) in striatal slices and increased the mitochondrial mass (p < 0.05) and membrane potential (p < 0.05) in SH-SY5Y dopaminergic cells. Our results demonstrate the role of the striatum in the ergogenic effects of caffeine, with changes in neuroplasticity and mitochondrial metabolism.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Effects of adenosine A2A receptors on cognitive function in health and disease

Adenosine A2A receptors have been studied extensively in the context of motor function and movement disorders such as Parkinson's disease. In addition to these roles, A2A receptors have also been increasingly implicated in cognitive function and cognitive impairments in diverse conditions, including Alzheimer's disease, schizophrenia, acute brain injury, and stress. We review the roles of A2A receptors in cognitive processes in health and disease, focusing primarily on the effects of reducing or enhancing A2A expression levels or activities in animal models. Studies reveal that A2A receptors in neurons and astrocytes modulate multiple aspects of cognitive function, including memory and motivation. Converging evidence also indicates that A2A receptor levels and activities are aberrantly increased in aging, acute brain injury, and chronic disorders, and these increases contribute to neurocognitive impairments. Therapeutically targeting A2A receptors with selective modulators may alleviate cognitive deficits in diverse neurological and neuropsychiatric conditions. Further research on the exact neural mechanisms of these effects as well as the efficacy of selective A2A modulators on cognitive alterations in humans are important areas for future investigation.

Striatopallidal adenosine A2A receptor modulation of goal-directed behavior: Homeostatic control with cognitive flexibility

Dysfunction of goal-directed behaviors under stressful or pathological conditions results in impaired decision-making and loss of flexibility of thoughts and behaviors, which underlie behavioral deficits ranging from depression, obsessive-compulsive disorders and drug addiction. Tackling the neuromodulators fine-tuning this core behavioral element may facilitate the development of effective strategies to control these deficits present in multiple psychiatric disorders. The current investigation of goal-directed behaviors has concentrated on dopamine and glutamate signaling in the corticostriatal pathway. In accordance with the beneficial effects of caffeine intake on mood and cognitive dysfunction, we now propose that caffeine's main site of action - adenosine A2A receptors (A2AR) - represent a novel target to homeostatically control goal-directed behavior and cognitive flexibility. A2AR are abundantly expressed in striatopallidal neurons and colocalize and interact with dopamine D2, NMDA and metabotropic glutamate 5 receptors to integrate dopamine and glutamate signaling. Specifically, striatopallidal A2AR (i) exert an overall "break" control of a variety of cognitive processes, making A2AR antagonists a novel strategy for improving goal-directed behavior; (ii) confer homeostatic control of goal-directed behavior by acting at multiple sites with often opposite effects, to enhance cognitive flexibility; (iii) integrate dopamine and adenosine signaling through multimeric A2AR-D2R heterocomplexes allowing a temporally precise fine-tuning in response to local signaling changes. As the U.S. Food and Drug Administration recently approved the A2AR antagonist Nourianz® (istradefylline) to treat Parkinson's disease, striatal A2AR-mediated control of goal-directed behavior may offer a new and real opportunity for improving deficits of goal-directed behavior and enhance cognitive flexibility under various neuropsychiatric conditions. This article is part of the Special Issue on "Purinergic Signaling: 50 years".

The adenosine hypothesis of schizophrenia into its third decade: From neurochemical imbalance to early life etiological risks

The adenosine hypothesis of schizophrenia was conceptualized about two decades ago in an attempt to integrate two prominent theories of neurochemical imbalance that attribute the pathogenesis of schizophrenia to hyperfunction of the mesocorticolimbic dopamine neurotransmission and hypofunction of cortical glutamate neurotransmission. Given its unique position as an endogenous modulator of both dopamine and glutamate signaling in the brain, adenosine was postulated as a potential new drug target to achieve multiple antipsychotic actions. This new strategy may offer hope for improving treatment, especially in alleviating negative symptoms and cognitive deficits of schizophrenia that do not respond to current medications. To date, however, the adenosine hypothesis has yet led to any significant therapeutic breakthroughs. Here, we address two possible reasons for the impasse. First, neither the presence of adenosine functional deficiency in people with schizophrenia nor its causal relationship to symptom production has been satisfactorily examined. Second, the lack of novel adenosine-based drugs also impedes progress. This review updates the latest preclinical and clinical data pertinent to the construct validity of the adenosine hypothesis and explores novel molecular processes whereby dysregulation of adenosine signaling could be linked to the etiology of schizophrenia. It is intended to stimulate and revitalize research into the adenosine hypothesis towards the development of a new and improved generation of antipsychotic drugs that has eluded us for decades.

Accumbal adenosine A2A receptor inactivation biases for large and costly rewards in the effort- but not delay-based decision making

The cost-benefit decision-making (CBDM) is critical to normal human activity and a diminished willingness to expend effort to obtain rewards is a prevalent/noted characteristic of neuropsychiatric disorders such as schizophrenia, Parkinson's disease. Numerous studies have identified nucleus accumbens (NAc) as an important locus for CBDM control but their neuromodulatory and behavioral mechanisms remain largely under-explored. Adenosine A_2A receptors (A_2ARs), which are highly concentrated in the striatopallidal neurons, can integrate glutamate and dopamine signals for controlling effort-related choice behaviors. While the involvement of A_2ARs in effort-based decision making is well documented, the role of other decision variables (reward discrimination) in effort-based decision making and the role of A_2AR in delay-based decision making are less clear. In this study, we have developed a well-controlled CBDM behavioral paradigm to manipulate effort/cost and reward independently or in combination, allowing a dissection of four behavioral elements: effort-based CBDM (E-CBDM), delay-based CBDM (D-CBDM), reward discrimination (RD), effort discrimination (ED), and determined the effect of genetic knockdown (KD) of NAc A_2AR on the four behavioral elements. We found that A_2AR KD in NAc increased the choice for larger, more costly reward in the E-CBDM, but not D-CBDM. Furthermore, this high-effort/high-reward bias was attributable to the increased willingness to engage in effort but not the effect of discrimination of reward magnitude. Our findings substantiate an important role of the NAc A_2AR in control of E-CBDM and support that pharmacologically targeting NAc A_2ARs would be a useful strategy for treating the aberrant effort-based decision making in neuropsychiatric disorders.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

The Arousal-motor Hypothesis of Dopamine Function: Evidence that Dopamine Facilitates Reward Seeking in Part by Maintaining Arousal

Dopamine facilitates approach to reward via its actions on dopamine receptors in the nucleus accumbens. For example, blocking either D1 or D2 dopamine receptors in the accumbens reduces the proportion of reward-predictive cues to which rats respond with cued approach. Recent evidence indicates that accumbens dopamine also promotes wakefulness and arousal, but the relationship between dopamine's roles in arousal and reward seeking remains unexplored. Here, we show that the ability of systemic or intra-accumbens injections of the D1 antagonist SCH23390 to reduce cued approach to reward depends on the animal's state of arousal. Handling the animal, a manipulation known to increase arousal, was sufficient to reverse the behavioral effects of the antagonist. In addition, SCH23390 reduced spontaneous locomotion and increased time spent in sleep postures, both consistent with reduced arousal, but also increased time spent immobile in postures inconsistent with sleep. In contrast, the ability of the D2 antagonist haloperidol to reduce cued approach was not reversible by handling. Haloperidol reduced spontaneous locomotion but did not increase sleep postures, instead increasing immobility in non-sleep postures. We place these results in the context of the extensive literature on dopamine's contributions to behavior, and propose the arousal-motor hypothesis. This novel synthesis, which proposes that two main functions of dopamine are to promote arousal and facilitate motor behavior, accounts both for our findings and many previous behavioral observations that have led to disparate and conflicting conclusions.

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Brain structural and functional connectivity alterations are associated with fatigue in neuromyelitis optica spectrum disorder

Background

Many patients with neurological disorders experience chronic fatigue, but the neural mechanisms involved are unclear.

Objective

Here we investigated whether the brain structural and functional connectivity alterations were involved in fatigue related to neuromyelitis optica spectrum disorder (NMOSD).

Methods

This prospective pilot study used structural and resting-state functional brain magnetic resonance imaging to compare total cortical thickness, cortical surface area, deep gray matter volume and functional connectivity (FC) between 33 patients with NMOSD and 20 healthy controls (HCs). Patients were subgrouped as low fatigue (LF) and high fatigue (HF).

Results

HF patients scored higher on the Hamilton Anxiety Rating Scale and Hamilton Rating Scale for Depression than LF patients and HCs. The two patient subgroups and HC group did not differ significantly in cortical thickness, cortical surface area and volumes of the bilateral caudate nucleus, bilateral putamen, bilateral amygdala, bilateral hippocampus, bilateral thalamus proper or right nucleus accumbens (p > 0.05). However, after correcting for age, sex, years of education, anxiety and depression, HF patients showed larger left pallidum than HCs (0.1573 ± 0.0214 vs 0.1372 ± 0.0145, p = 0.009). Meanwhile, both LF patients (0.0377 ± 0.0052 vs 0.0417 ± 0.0052, p = 0.009) and HF patients (0.0361 ± 0.0071 vs 0.0417 ± 0.0052, p = 0.013) showed smaller left nucleus accumbens than HCs.. Compared with LF patients, HF patients showed significantly decreased FC between the left pallidum and bilateral cerebellar posterior lobes.

Conclusions

This was the first evidence linking structural and functional alterations in the brain to fatigue in NMOSD, and in the future, long term follow-up was necessary.

The Pharmacological Potential of Adenosine A2A Receptor Antagonists for Treating Parkinson's Disease

The adenosine A_2A receptor subtype is recognized as a non-dopaminergic pharmacological target for the treatment of neurodegenerative disorders, notably Parkinson’s disease (PD). The selective A_2A receptor antagonist istradefylline is approved in the US and Japan as an adjunctive treatment to levodopa/decarboxylase inhibitors in adults with PD experiencing OFF episodes or a wearing-off phenomenon; however, the full potential of this drug class remains to be explored. In this article, we review the pharmacology of adenosine A_2A receptor antagonists from the perspective of the treatment of both motor and non-motor symptoms of PD and their potential for disease modification.

Influence of istradefylline on non-motor symptoms of Parkinson's disease: A subanalysis of a 1-year observational study in Japan (J-FIRST)

INTRODUCTION

The non-motor symptoms (NMSs) of Parkinson's disease (PD) significantly impact the patient's health-related quality of life. This subanalysis of the J-FIRST study evaluated the effect of istradefylline, a selective adenosine A_2A receptor antagonist, on NMSs in istradefylline-naïve Japanese patients with PD.

METHODS

Patients with PD and ≥1 NMS and 'wearing-off' with their current antiparkinsonian treatment were observed for up to 52 weeks. The effect of istradefylline on NMSs was measured in terms of changes in the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) Part 1 total, individual sub-items scores and the 8 item PD questionnaire (PDQ-8) estimated by the marginal structural model.

RESULTS

Overall, 732 patients were istradefylline-naïve prior to the study, of whom 171 were treated with istradefylline for ≥8 weeks during the observation period (istradefylline-treated patients). At baseline, istradefylline-treated patients were more likely to have a dyskinesia (49.7% vs 40.8%) and received a significantly higher daily dose of levodopa (462.8 mg vs 413.0 mg) than those who did not receive istradefylline (n = 561). MDS-UPDRS Part 1 total score at the end of the 52-week observational period slightly increased in patients who received istradefylline and those who did not (0.49 ± 0.41 vs 0.07 ± 0.20; P = 0.36). There were no statistically significant differences between the two groups of patients in terms of changes in the MDS-UPDRS Part 1 total score or any sub-items, or in the PDQ-8 total score.

CONCLUSION

NMSs remained generally controlled in istradefylline-treated Japanese patients with PD who exhibited wearing-off with their current antiparkinsonian treatment. Istradefylline could be a feasible treatment option for patients with advanced PD, without worsening existing NMSs.

α-Synuclein Selectively Impairs Motor Sequence Learning and Value Sensitivity: Reversal by the Adenosine A2A Receptor Antagonists

Parkinson's disease (PD) is characterized pathologically by alpha-synuclein (α-Syn) aggregates and clinically by the motor as well as cognitive deficits, including impairments in sequence learning and habit learning. Using intracerebral injection of WT and A53T mutant α-Syn fibrils, we investigate the behavioral mechanism of α-Syn for procedure-learning deficit in PD by critically determining the α-Syn-induced effects on model-based goal-directed behavior, model-free (probability-based) habit learning, and hierarchically organized sequence learning. 1) Contrary to the widely held view of habit-learning deficit in early PD, α-Syn aggregates in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) did not affect acquisition of habit learning, but selectively impaired goal-directed behavior with reduced value sensitivity. 2) α-Syn in the DLS (but not DMS) and SNc selectively impaired the sequence learning by affecting sequence initiation with the reduced first-step accuracy. 3) Adenosine A2A receptor (A2AR) antagonist KW6002 selectively improved sequence learning by preferentially improving sequence initiation and shift of sequence learning as well as behavioral reactivity. These findings established a casual role of α-Syn in the SN-DLS pathway in sequence-learning deficit and DMS α-Syn in goal-directed behavior deficit and suggest a novel therapeutic strategy to improve sequence-learning deficit in PD with enhanced sequence initiation by A2AR antagonists.

Striatopallidal Pathway Distinctly Modulates Goal-Directed Valuation and Acquisition of Instrumental Behavior via Striatopallidal Output Projections

The striatopallidal pathway is specialized for control of motor and motivational behaviors, but its causal role in striatal control of instrumental learning remains undefined (partly due to the confounding motor effects). Here, we leveraged the transient and "time-locked" optogenetic manipulations with the reward delivery to minimize motor confounding effect, to better define the striatopallidal control of instrumental behaviors. Optogenetic (Arch) silencing of the striatopallidal pathway in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) promoted goal-directed and habitual behaviors, respectively, without affecting acquisition of instrumental behaviors, indicating striatopallidal pathway suppression of instrumental behaviors under physiological condition. Conversely, striatopallidal pathway activation mainly affected the acquisition of instrumental behaviors with the acquisition suppression achieved by either optogenetic (ChR2) or chemicogenetic (hM3q) activation, by strong (10 mW, but not weak 1 mW) optogenetic activation, by the time-locked (but not random) optogenetic activation with the reward and by the DMS (but not DLS) striatopallidal pathway. Lastly, striatopallidal pathway modulated instrumental behaviors through striatopallidal output projections into the external globus pallidus (GPe) since optogenetic activation of the striatopallidal pathway in the DMS and of the striatopallidal output projections in the GPe similarly suppressed goal-directed behavior. Thus, the striatopallidal pathway confers distinctive and inhibitory controls of animal's sensitivity to goal-directed valuation and acquisition of instrumental behaviors under normal and over-activation conditions, through the output projections into GPe.

International society of sports nutrition position stand: caffeine and exercise performance

Following critical evaluation of the available literature to date, The International Society of Sports Nutrition (ISSN) position regarding caffeine intake is as follows: 1. Supplementation with caffeine has been shown to acutely enhance various aspects of exercise performance in many but not all studies. Small to moderate benefits of caffeine use include, but are not limited to: muscular endurance, movement velocity and muscular strength, sprinting, jumping, and throwing performance, as well as a wide range of aerobic and anaerobic sport-specific actions. 2. Aerobic endurance appears to be the form of exercise with the most consistent moderate-to-large benefits from caffeine use, although the magnitude of its effects differs between individuals. 3. Caffeine has consistently been shown to improve exercise performance when consumed in doses of 3-6 mg/kg body mass. Minimal effective doses of caffeine currently remain unclear but they may be as low as 2 mg/kg body mass. Very high doses of caffeine (e.g. 9 mg/kg) are associated with a high incidence of side-effects and do not seem to be required to elicit an ergogenic effect. 4. The most commonly used timing of caffeine supplementation is 60 min pre-exercise. Optimal timing of caffeine ingestion likely depends on the source of caffeine. For example, as compared to caffeine capsules, caffeine chewing gums may require a shorter waiting time from consumption to the start of the exercise session. 5. Caffeine appears to improve physical performance in both trained and untrained individuals. 6. Inter-individual differences in sport and exercise performance as well as adverse effects on sleep or feelings of anxiety following caffeine ingestion may be attributed to genetic variation associated with caffeine metabolism, and physical and psychological response. Other factors such as habitual caffeine intake also may play a role in between-individual response variation. 7. Caffeine has been shown to be ergogenic for cognitive function, including attention and vigilance, in most individuals. 8. Caffeine may improve cognitive and physical performance in some individuals under conditions of sleep deprivation. 9. The use of caffeine in conjunction with endurance exercise in the heat and at altitude is well supported when dosages range from 3 to 6 mg/kg and 4-6 mg/kg, respectively. 10. Alternative sources of caffeine such as caffeinated chewing gum, mouth rinses, energy gels and chews have been shown to improve performance, primarily in aerobic exercise. 11. Energy drinks and pre-workout supplements containing caffeine have been demonstrated to enhance both anaerobic and aerobic performance.

Caffeine and Parkinson's Disease: Multiple Benefits and Emerging Mechanisms

Parkinson’s disease (PD) is the second most common neurodegenerative disorder, characterized by dopaminergic neurodegeneration, motor impairment and non-motor symptoms. Epidemiological and experimental investigations into potential risk factors have firmly established that dietary factor caffeine, the most-widely consumed psychoactive substance, may exerts not only neuroprotective but a motor and non-motor (cognitive) benefits in PD. These multi-benefits of caffeine in PD are supported by convergence of epidemiological and animal evidence. At least six large prospective epidemiological studies have firmly established a relationship between increased caffeine consumption and decreased risk of developing PD. In addition, animal studies have also demonstrated that caffeine confers neuroprotection against dopaminergic neurodegeneration using PD models of mitochondrial toxins (MPTP, 6-OHDA, and rotenone) and expression of α-synuclein (α-Syn). While caffeine has complex pharmacological profiles, studies with genetic knockout mice have clearly revealed that caffeine’s action is largely mediated by the brain adenosine A_2A receptor (A_2AR) and confer neuroprotection by modulating neuroinflammation and excitotoxicity and mitochondrial function. Interestingly, recent studies have highlighted emerging new mechanisms including caffeine modulation of α-Syn degradation with enhanced autophagy and caffeine modulation of gut microbiota and gut-brain axis in PD models. Importantly, since the first clinical trial in 2003, United States FDA has finally approved clinical use of the A_2AR antagonist istradefylline for the treatment of PD with OFF-time in Sept. 2019. To realize therapeutic potential of caffeine in PD, genetic study of caffeine and risk genes in human population may identify useful pharmacogenetic markers for predicting individual responses to caffeine in PD clinical trials and thus offer a unique opportunity for “personalized medicine” in PD.

The belated US FDA approval of the adenosine A2A receptor antagonist istradefylline for treatment of Parkinson's disease

After more than two decades of preclinical and clinical studies, on August 27, 2019, the US Food and Drug Administration (FDA) approved the adenosine A_2A receptor antagonist Nourianz® (istradefylline) developed by Kyowa Hakko Kirin Inc., Japan, as an add-on treatment to levodopa in Parkinson's disease (PD) with "OFF" episodes. This milestone achievement is the culmination of the decade-long clinical studies of the effects of istradefylline in more than 4000 PD patients. Istradefylline is the first non-dopaminergic drug approved by FDA for PD in the last two decades. This approval also provides some important lessons to be remembered, namely, concerning disease-specific adenosine signaling and targeting subpopulation of PD patients. Importantly, this approval paves the way to foster entirely novel therapeutic opportunities for adenosine A_2A receptor antagonists, such as neuroprotection or reversal of mood and cognitive deficits in PD and other neuropsychiatric diseases.

Pharmacological studies of effort-related decision making using mouse touchscreen procedures: effects of dopamine antagonism do not resemble reinforcer devaluation by removal of food restriction

RATIONALE

Effort-based decision-making tasks offer animals choices between preferred reinforcers that require high effort to obtain vs. low effort/low reward options. The neural mechanisms of effort-based choice are widely studied in rats, and evidence indicates that mesolimbic dopamine (DA) and related neural systems play a key role. Fewer studies of effort-based choice have been performed in mice.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida boxes) to assess effort-based choice in mice.

METHODS

CD1 mice were assessed on a concurrent fixed ratio 1 panel pressing/choice procedure. Mice were allowed to choose between rearing to press an elevated panel on the touchscreen for a preferred food (strawberry milkshake) vs. consuming a concurrently available less preferred alternative (high carbohydrate pellets).

RESULTS

The DA D₂ antagonist haloperidol (0.05-0.15 mg/kg IP) produced a dose-related decrease in panel pressing. Intake of food pellets was not reduced by haloperidol, and in fact, there was a significant quadratic trend, indicating a tendency for pellet intake to increase at low/moderate doses. In contrast, reinforcer devaluation by removing food restriction substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred milkshake vs. pellets. Haloperidol did not affect food intake or preference.

CONCLUSION

Haloperidol reduced the tendency to work for food, but this reduction was not due to decreases in primary food motivation or preference. Mouse touchscreen procedures demonstrate effects of haloperidol that are similar but not identical to those shown in rats. These rodent studies may be relevant for understanding motivational dysfunctions in humans.

Affective biases and their interaction with other reward-related deficits in rodent models of psychiatric disorders

Major depressive disorder (MDD) is one of the leading global causes of disability. Symptoms of MDD can vary person to person, and current treatments often fail to alleviate the poor quality of life that patients experience. One of the two core diagnostic criteria for MDD is the loss of interest in previously pleasurable activities, which suggests a link between the disease aetiology and reward processing. Cognitive impairments are also common in patients with MDD, and more recently, emotional processing deficits known as affective biases have been recognised as a key feature of the disorder. Studies in animals have found similar affective biases related to reward. In this review we consider these affective biases in the context of other reward-related deficits and examine how affective biases associated with learning and memory may interact with the wider behavioural symptoms seen in MDD. We discuss recent developments in how analogues of affective biases and other aspects of reward processing can be assessed in rodents, as well as how these behaviours are influenced in models of MDD. We subsequently discuss evidence for the neurobiological mechanisms contributing to one or more reward-related deficits in preclinical models of MDD, identified using these behavioural assays. We consider how the relationships between these selective behavioural assays and the neurobiological mechanisms for affective bias and reward processing could be used to identify potential treatment strategies.

Mental Fatigue Impairs Endurance Performance: A Physiological Explanation

Mental fatigue reflects a change in psychobiological state, caused by prolonged periods of demanding cognitive activity. It has been well documented that mental fatigue impairs cognitive performance; however, more recently, it has been demonstrated that endurance performance is also impaired by mental fatigue. The mechanism behind the detrimental effect of mental fatigue on endurance performance is poorly understood. Variables traditionally believed to limit endurance performance, such as heart rate, lactate accumulation and neuromuscular function, are unaffected by mental fatigue. Rather, it has been suggested that the negative impact of mental fatigue on endurance performance is primarily mediated by the greater perception of effort experienced by mentally fatigued participants. Pageaux et al. (Eur J Appl Physiol 114(5):1095-1105, 2014) first proposed that prolonged performance of a demanding cognitive task increases cerebral adenosine accumulation and that this accumulation may lead to the higher perception of effort experienced during subsequent endurance performance. This theoretical review looks at evidence to support and extend this hypothesis.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Adenosine A2A Receptors in the Rat Prelimbic Medial Prefrontal Cortex Control Delay-Based Cost-Benefit Decision Making

Adenosine A_2A receptors (A_2ARs) were recently described to control synaptic plasticity and network activity in the prefrontal cortex (PFC). We now probed the role of these PFC A_2AR by evaluating the behavioral performance (locomotor activity, anxiety-related behavior, cost-benefit decision making and working memory) of rats upon downregulation of A_2AR selectively in the prelimbic medial PFC (PLmPFC) via viral small hairpin RNA targeting the A_2AR (shA_2AR). The most evident alteration observed in shA_2AR-treated rats, when compared to sh-control (shCTRL)-treated rats, was a decrease in the choice of the large reward upon an imposed delay of 15 s assessed in a T-maze-based cost-benefit decision-making paradigm, suggestive of impulsive decision making. Spontaneous locomotion in the open field was not altered, suggesting no changes in exploratory behavior. Furthermore, rats treated with shA_2AR in the PLmPFC also displayed a tendency for higher anxiety levels in the elevated plus maze (less entries in the open arms), but not in the open field test (time spent in the center was not affected). Finally, working memory performance was not significantly altered, as revealed by the spontaneous alternation in the Y-maze test and the latency to reach the platform in the repeated trial Morris water maze. These findings constitute the first direct demonstration of a role of PFC A_2AR in the control of behavior in physiological conditions, showing their major contribution for the control of delay-based cost-benefit decisions.

New Developments on the Adenosine Mechanisms of the Central Effects of Caffeine and Their Implications for Neuropsychiatric Disorders

Recent studies on interactions between striatal adenosine and dopamine and one of its main targets, the adenosine A_2A receptor–dopamine D₂ receptor (A2AR–D2R) heteromer, have provided a better understanding of the mechanisms involved in the psychostimulant effects of caffeine and have brought forward new data on the mechanisms of operation of classical orthosteric ligands within G protein-coupled receptor heteromers. The striatal A2AR–D2R heteromer has a tetrameric structure and forms part of a signaling complex that includes a Gs and a Gi protein and the effector adenyl cyclase (subtype AC5). Another target of caffeine, the adenosine A₁ receptor–dopamine D₁ receptor (A1R–D1R) heteromer, seems to have a very similar structure. Initially suggested to be localized in the striatum, the A1R–D1R heteromer has now been identified in the spinal motoneuron and shown to mediate the spinally generated caffeine-induced locomotion. In this study, we review the recently discovered properties of A2AR–D2R and A1R–D1R heteromers. Our studies demonstrate that these complexes are a necessary condition to sustain the canonical antagonistic interaction between a Gs-coupled receptor (A2AR or D1R) and a Gi-coupled receptor (D2R or A1R) at the adenylyl cyclase level, which constitutes a new concept in the field of G protein-coupled receptor physiology and pharmacology. A2AR antagonists targeting the striatal A2AR–D2R heteromer are already being considered as therapeutic agents in Parkinson's disease. In this study, we review the preclinical evidence that indicates that caffeine and A2AR antagonists could be used to treat the motivational symptoms of depression and attention-deficit/hyperactivity disorder, while A1R antagonists selectively targeting the spinal A1R–D1R heteromer could be used in the recovery of spinal cord injury.

Caffeine and Selective Adenosine Receptor Antagonists as New Therapeutic Tools for the Motivational Symptoms of Depression

Major depressive disorder is one of the most common and debilitating psychiatric disorders. Some of the motivational symptoms of depression, such anergia (lack of self-reported energy) and fatigue are relatively resistant to traditional treatments such as serotonin uptake inhibitors. Thus, new pharmacological targets are being investigated. Epidemiological data suggest that caffeine consumption can have an impact on aspects of depressive symptomatology. Caffeine is a non-selective adenosine antagonist for A1/A2A receptors, and has been demonstrated to modulate behavior in classical animal models of depression. Moreover, selective adenosine receptor antagonists are being assessed for their antidepressant effects in animal studies. This review focuses on how caffeine and selective adenosine antagonists can improve different aspects of depression in humans, as well as in animal models. The effects on motivational symptoms of depression such as anergia, fatigue, and psychomotor slowing receive particular attention. Thus, the ability of adenosine receptor antagonists to reverse the anergia induced by dopamine antagonism or depletion is of special interest. In conclusion, although further studies are needed, it appears that caffeine and selective adenosine receptor antagonists could be therapeutic agents for the treatment of motivational dysfunction in depression.

Pharmacological Blockade of Adenosine A2A but Not A1 Receptors Enhances Goal-Directed Valuation in Satiety-Based Instrumental Behavior

The balance and smooth shift between flexible, goal-directed behaviors and repetitive, habitual actions are critical to optimal performance of behavioral tasks. The striatum plays an essential role in control of goal-directed versus habitual behaviors through a rich interplay of the numerous neurotransmitters and neuromodulators to modify the input, processing and output functions of the striatum. The adenosine receptors (namely A_2AR and A₁R), with their high expression pattern in the striatum and abilities to interact and integrate dopamine, glutamate and cannabinoid signals in the striatum, may represent novel therapeutic targets for modulating instrumental behavior. In this study, we examined the effects of pharmacological blockade of the A_2ARs and A₁Rs on goal-directed versus habitual behaviors in different information processing phases of instrumental learning using a satiety-based instrumental behavior procedure. We found that A_2AR antagonist acts at the coding, consolidation and expression phases of instrumental learning to modulate animals’ sensitivity to goal-directed valuation without modifying action-outcome contingency. However, pharmacological blockade and genetic knockout of A₁Rs did not affect acquisition or sensitivity to goal-valuation of instrumental behavior. These findings provide pharmacological evidence for a potential therapeutic strategy to control abnormal instrumental behaviors associated with drug addiction and obsessive-compulsive disorder by targeting the A_2AR.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Accumbens dopamine D2 receptors increase motivation by decreasing inhibitory transmission to the ventral pallidum

Dopamine D2 receptors (D2Rs) in the nucleus accumbens (NAc) regulate motivated behavior, but the underlying neurobiological mechanisms remain unresolved. Here, we show that selective upregulation of D2Rs in the indirect pathway of the adult NAc enhances the willingness to work for food. Mechanistic studies in brain slices reveal that D2R upregulation attenuates inhibitory transmission at two main output projections of the indirect pathway, the classical long-range projections to the ventral pallidum (VP), as well as local collaterals to direct pathway medium spiny neurons. In vivo physiology confirms the reduction in indirect pathway inhibitory transmission to the VP, and inhibition of indirect pathway terminals to VP is sufficient to enhance motivation. In contrast, D2R upregulation in the indirect pathway does not disinhibit neuronal activity of the direct pathway in vivo. These data suggest that D2Rs in ventral striatal projection neurons promote motivation by weakening the canonical output to the ventral pallidum.

Effects of intra-accumbal or intra-prefrontal cortex microinjections of adenosine 2A receptor ligands on responses to cocaine reward and seeking in rats

RATIONALE AND OBJECTIVES

Many studies indicated that adenosine via its A_2A receptors influences the behavioral effects of cocaine by modulating dopamine neurotransmission. The hypothesis was tested that A_2A receptors in the nucleus accumbens (NAc) or the prefrontral cortex (PFc) may modulate cocaine reward and/or cocaine seeking behavior in rats.

METHODS

The effects of local bilateral microinjections of the selective A_2A receptor agonist CGS 21680 or the A_2A receptor antagonists KW 6002 and SCH 58261 were investigated on cocaine self-administration on reinstatement of cocaine seeking.

RESULTS

The intra-NAc shell, but not intra-infralimbic PFc, administration of CGS 21680 significantly reduced the number of active lever presses and the number of cocaine (0.25 mg/kg) infusions. However, tonic activation of A_2A receptors located in the NAc or PFc did not play a role in modulating the rewarding actions of cocaine since neither KW 6002 nor SCH 58261 microinjections altered the cocaine (0.5 mg/kg) infusions. The intra-NAc but not intra-PFc microinjections of CGS 21680 dose- dependently attenuated the reinstatement of active lever presses induced by cocaine (10 mg/kg, i.p.) and the drug-associated combined conditioned stimuli using the subthreshold dose of cocaine (2.5 mg/kg, i.p.). On the other hand, the intra-NAc pretreatment with SCH 58261, but not with KW 6002, given alone evoked reinstatement of cocaine seeking behavior.

CONCLUSION

The results strongly support the involvement of accumbal shell A_2A receptors as a target, the activation of which exerts an inhibitory control over cocaine reward and cocaine seeking.

The role of sleep deprivation and fatigue in the perception of task difficulty and use of heuristics

This study investigated the effects of sleep deprivation on perception of task difficulty and use of heuristics (mental shortcuts) compared to naturally-experienced sleep at home. Methods: Undergraduate students were screened and assigned through block-random assignment to Naturally-Experienced Sleep (NES; n=19) or Total Sleep Deprivation (TSD; n=20). The next morning, reported fatigue, perception of task difficulty, and use of “what-is-beautiful-is-good,” “greedy algorithm,” and “speed-accuracy trade-off” heuristics were assessed. Results: NES slept for an average of 354.74 minutes (SD=72.84), or 5.91 hours. TSD rated a reading task as significantly more difficult and requiring more time than NES. TSD was significantly more likely to use the greedy algorithm heuristic by skipping instructions and the what-is-beautiful-is-good heuristic by rating an unattractive consumer item with a favorable review as poor quality. Those in Total Sleep Deprivation who chose more difficult math problems made this selection to finish the task more quickly in findings approaching significance, indicating use of the speed-accuracy trade-off heuristic. Collapsed across conditions, self-reported fatigue predicted greater perceived difficulty in both the reading task and a visuo-motor task, higher quality rating for the attractive consumer item, and lower quality rating for the unattractive consumer item. Conclusions: Findings indicate sleep deprivation and fatigue increase perceptions of task difficulty, promote skipping instructions, and impair systematic evaluation of unappealing stimuli compared to naturally-experienced sleep.

Assessment of a glycine uptake inhibitor in animal models of effort-related choice behavior: implications for motivational dysfunctions

RATIONALE

Motivated behavior can be characterized by a substantial exertion of effort, and organisms often make effort-related decisions based upon analyses of work-related response costs and reinforcement preference. Moreover, alterations in effort-based choice can be seen in people with major depression and schizophrenia. Effort-related decision making is studied using tasks offering choices between high effort options leading to highly valued reinforces vs low effort/low reward options. Interference with dopamine (DA) transmission by administration of the DA D2 family antagonist haloperidol biases behavior towards the lower effort option that can be obtained with minimal work, and previous research has shown that DA interacts with other transmitters, including adenosine and GABA, to regulate effort-based choice.

OBJECTIVES

The present studies focused upon the ability of the glycine transport inhibitor bitopertin to attenuate haloperidol-induced shifts in effort-related choice behavior.

METHODS

Effort-based choice in rats was assessed using the concurrent fixed ratio (FR) 5/chow feeding choice task and the T-maze barrier choice procedure.

RESULTS

Haloperidol shifted effort-based choice, biasing animals towards the low effort option in each task. Co-administration of bitopertin (1.0-10.0 mg/kg) significantly attenuated haloperidol-induced shifts in choice behavior, but the same doses of bitopertin had no effect when administered alone.

CONCLUSIONS

These results indicated that elevation of extracellular glycine via inhibition of glycine uptake was able to reverse the effects of D2 antagonism. Increases in extracellular glycine, possibly through actions on the glycine allosteric site on the NMDA receptor, may be a useful strategy for treating motivational dysfunctions in humans.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

To work or not to work: Neural representation of cost and benefit of instrumental action

By definition, instrumental actions are performed in order to obtain certain goals. Nevertheless, the attainment of goals typically implies obstacles, and response vigor is known to reflect an integration of subjective benefit and cost. Whereas several brain regions have been associated with cost/benefit ratio decision-making, trial-by-trial fluctuations in motivation are not well understood. We review recent evidence supporting the motivational implications of signal fluctuations in the mesocorticolimbic system. As an extension of "set-point" theories of instrumental action, we propose that response vigor is determined by a rapid integration of brain signals that reflect value and cost on a trial-by-trial basis giving rise to an online estimate of utility. Critically, we posit that fluctuations in key nodes of the network can predict deviations in response vigor and that variability in instrumental behavior can be accounted for by models devised from optimal control theory, which incorporate the effortful control of noise. Notwithstanding, the post hoc analysis of signaling dynamics has caveats that can effectively be addressed in future research with the help of two novel fMRI imaging techniques. First, adaptive fMRI paradigms can be used to establish a time-order relationship, which is a prerequisite for causality, by using observed signal fluctuations as triggers for stimulus presentation. Second, real-time fMRI neurofeedback can be employed to induce predefined brain states that may facilitate benefit or cost aspects of instrumental actions. Ultimately, understanding temporal dynamics in brain networks subserving response vigor holds the promise for targeted interventions that could help to readjust the motivational balance of behavior.

Protective Effects of Adenosine Receptor Agonist in a Cirrhotic Liver Resection Model

OBJECTIVES

To investigate the role of CGS21680, a selective adenosine A2A receptor agonist, on a bile-duct-ligated cirrhotic liver resection model in rats.

METHODS

Male Wistar rats were allotted into 3 groups (n = 7 per time-point): the control group, the bile duct ligation + CGS21680 group (BDL + CGS), and the bile duct ligation group (BDL). Biliary cirrhosis had been previously induced by ligature of the common bile duct in the BDL + CGS and BDL groups. After 2 weeks, the animals underwent partial hepatectomy (50%). The BDL + CGS group received a single dose of CGS21680 15 minutes prior to hepatectomy. Blood samples were collected and analyzed.

RESULTS

Aspartate transaminase levels were found to be lower in the control vs BDL groups (1, 3, and 24 h) (P < 0.01) and the BDL + CGS (1 and 3 hours) (P < 0.01) and BDL + CGS vs BDL (24 hours) (P < 0.05) groups. Hepatic flow was measured and BDL showed significantly lower values at the 3, 24, and 168 h time-points compared to the control (P < 0.01) and BDL + CGS groups (P < 0.05 at 3 and 168 hours; P < 0.01 at 24 h). O2C velocity was reduced in the BDL compared to the control group (P < 0.001 at 3 hours; P < 0.01 at 24 and 168 hours) and the BDL + CGS group (P < 0.01 at 24 hours). Interleukin-6 levels were abrogated in the BDL + CGS (P < 0.05) and control (P < 0.01) groups versus BDL. Histone-bound low-molecular-weight DNA fragments in the BDL + CGS (P < 0.01) and control (P < 0.05) groups were low compared to the BDL group.

CONCLUSIONS

Administration of CGS21680, an adenosine receptor agonist, after the resection of bile-duct-ligated cirrhotic livers led to improved liver function, regeneration, and microcirculation.

Quantifying motivation with effort-based decision-making paradigms in health and disease

Motivation can be characterized as a series of cost-benefit valuations, in which we weigh the amount of effort we are willing to expend (the cost of an action) in return for particular rewards (its benefits). Human motivation has traditionally been measured with self-report and questionnaire-based tools, but an inherent limitation of these methods is that they are unable to provide a mechanistic explanation of the processes underlying motivated behavior. A major goal of current research is to quantify motivation objectively with effort-based decision-making paradigms, by drawing on a rich literature from nonhuman animals. Here, we review this approach by considering the development of these paradigms in the laboratory setting over the last three decades, and their more recent translation to understanding choice behavior in humans. A strength of this effort-based approach to motivation is that it is capable of capturing the wide range of individual differences, and offers the potential to dissect motivation into its component elements, thus providing the basis for more accurate taxonomic classifications. Clinically, modeling approaches might provide greater sensitivity and specificity to diagnosing disorders of motivation, for example, in being able to detect subclinical disorders of motivation, or distinguish a disorder of motivation from related but separate syndromes, such as depression. Despite the great potential in applying effort-based paradigms to index human motivation, we discuss several caveats to interpreting current and future studies, and the challenges in translating these approaches to the clinical setting.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

Optogenetic Activation of Adenosine A2A Receptor Signaling in the Dorsomedial Striatopallidal Neurons Suppresses Goal-Directed Behavior

The striatum has an essential role in neural control of instrumental behaviors by reinforcement learning. Adenosine A(2A) receptors (A(2A)Rs) are highly enriched in the striatopallidal neurons and are implicated in instrumental behavior control. However, the temporal importance of the A(2A)R signaling in relation to the reward and specific contributions of the striatopallidal A(2A)Rs in the dorsolateral striatum (DLS) and the dorsomedial striatum (DMS) to the control of instrumental learning are not defined. Here, we addressed temporal relationship and sufficiency of transient activation of optoA(2A)R signaling precisely at the time of the reward to the control of instrumental learning, using our newly developed rhodopsin-A2AR chimeras (optoA(2A)R). We demonstrated that transient light activation of optoA(2A)R signaling in the striatopallidal neurons in 'time-locked' manner with the reward delivery (but not random optoA(2A)R activation) was sufficient to change the animal's sensitivity to outcome devaluation without affecting the acquisition or extinction phases of instrumental learning. We further demonstrated that optogenetic activation of striatopallidal A(2A)R signaling in the DMS suppressed goal-directed behaviors, as focally genetic knockdown of striatopallidal A(2A)Rs in the DMS enhanced goal-directed behavior by the devaluation test. By contrast, optogenetic activation or focal AAV-Cre-mediated knockdown of striatopallidal A(2A)R in the DLS had relatively limited effects on instrumental learning. Thus, the striatopallidal A(2A)R signaling in the DMS exerts inhibitory and predominant control of goal-directed behavior by acting precisely at the time of reward, and may represent a therapeutic target to reverse abnormal habit formation that is associated with compulsive obsessive disorder and drug addiction.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Effort cost computation in schizophrenia: a commentary on the recent literature

The cognitive and affective factors implicated in the motivational impairments seen in many people with schizophrenia remain poorly understood. Many research groups have done studies in the past 2 years examining the role of effort-cost computations driven by the hypothesis that overestimation of the cost of effort involved in volitional behavior might underlie the reduction in goal-directed behavior seen in some people with schizophrenia. The goal of this review is to assess the available evidence and the interpretative ambiguities that remain to be addressed by further studies. There is a clear preponderance of evidence suggesting that people with schizophrenia demonstrate altered effort allocation by failing to make high-effort response choices to maximize reward. The evidence relating altered effort allocation to the severity of negative symptoms is mixed. It remains for future work to determine the precise mechanisms implicated in altered effort allocation with two prominent possibilities: that patients 1) overestimate the cost of effort or 2) underestimate the value of potential awards. Other mechanisms that need to be investigated include the potential contributions of other impairments associated with the illness that increase the cost of effort. Furthermore, it is possible that accurate value representations fail to invigorate behavior. Although questions remain, evidence available to date suggests that the study of cost/benefit decision making may shed new light on the motivational impairments seen in many people with schizophrenia.

Changes in D1 but not D2 dopamine or mu-opioid receptor expression in limbic and motor structures after lateral hypothalamus electrical self-stimulation: A quantitative autoradiographic study

Intracranial self-stimulation (ICSS) of the lateral hypothalamus (LH) is involved in the activation of neuroanatomical systems that are also associated with the processing of natural and other artificial rewarding stimuli. Specific components of this behavior (hedonic impact, learning, and motor behavior) may involve changes in different neurotransmitters, such as dopamine and opioids. In this study, quantitative autoradiography was used to examine changes in mu-opioid and D1/D2-dopamine receptor expression in various anatomical regions related to the motor and mesolimbic reward systems after intracranial self-stimulation of the LH. Results of the behavioral procedure and subsequent radiochemical assays show selective changes in D1 but not D2 or mu receptors in Accumbens-Shell, Ventral Pallidum, Caudate-Putamen, and Medial Globus Pallidus. These findings are discussed in relation to the different psychobiological components of the appetitive motivational system, identifying some dissociation among them, particularly with respect to the involvement of the D1-dopamine subsystem (but not D2 or mu receptors) in goal-directed behaviors.

Purinergic receptors in psychiatric disorders

Psychiatric disorders describe different mental or behavioral patterns, causing suffering or poor coping of ordinary life with manifold presentations. Multifactorial processes can contribute to their development and progression. Purinergic neurotransmission and neuromodulation in the brain have attracted increasing therapeutic interest in the field of psychiatry. Purine nucleotides and nucleosides are well recognized as signaling molecules mediating cell to cell communication. The actions of ATP are mediated by ionotropic P2X and metabotropic P2Y receptor subfamilies, whilst the actions of adenosine are mediated by P1 (A1 or A2) adenosine receptors. Purinergic mechanisms and specific receptor subtypes have been shown to be linked to the regulation of many aspects of behavior and mood and to dysregulation in pathological processes of brain function. In this review the recent knowledge on the role of purinergic receptors in the two most frequent psychiatric diseases, major depression and schizophrenia, as well as on related animal models is summarized. At present the most promising data for therapeutic strategies derive from investigations of the adenosine system emphasizing a unique function of A2A receptors at neurons and astrocytes in these disorders. Among the P2 receptor family, in particular P2X7 and P2Y1 receptors were related to disturbances in major depression and schizophrenia, respectively. This article is part of the Special Issue entitled 'Purines in Neurodegeneration and Neuroregeneration'.

Neurobiological basis of motivational deficits in psychopathology

In recent years, there has been increasing emphasis on the importance of motivational symptoms in depression, schizophrenia and other disorders. The present review discusses the conceptual background related to the construct of motivation, and provides a framework that for research on both physiological and pathological aspects of motivation. Particular emphasis is placed on what is known about the neurobiological basis of activational aspects of motivation, including studies from animal models. The role of limbic/prefrontal/striatal circuitry in behavioral activation and effort-related functions is examined, and the utility of behavioral tasks of effort-based decision making as models of motivational symptoms is discussed. We also review the neurobiology of motivational symptoms in relation to psychopathology, and issues related to the language used to characterize motivational dysfunctions are considered. The literature suggests that research on the neurobiology of motivational dysfunction in psychopathology, at both clinical and preclinical levels, could inform the development of novel and more effective treatments for a range of CNS disorders.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.