Dopamine enhances willingness to exert effort for reward in Parkinson's disease

Putaminal dopamine modulates movement motivation in Parkinson's disease

The relative inability to produce effortful movements is the most specific motor sign of Parkinson's disease, which is primarily characterized by loss of dopaminergic terminals in the putamen. The motor motivation hypothesis suggests that this motor deficit may not reflect a deficiency in motor control per se, but a deficiency in cost-benefit considerations for motor effort. For the first time, we investigated the quantitative effect of dopamine depletion on the motivation of motor effort in Parkinson's disease. A total of 21 early-stage, unmedicated patients with Parkinson's disease and 26 healthy controls were included. An incentivized force task was used to capture the amount of effort participants were willing to invest for different monetary incentive levels and dopamine transporter depletion in the bilateral putamen was assessed. Our results demonstrate that patients with Parkinson's disease applied significantly less grip force than healthy controls, especially for low incentive levels. Congruously, decrease of motor effort with greater loss of putaminal dopaminergic terminals was most pronounced for low incentive levels. This signifies that putaminal dopamine is most critical to motor effort when the trade-off with the benefit is poor. Taken together, we provide direct evidence that the reduction of effortful movements in Parkinson's disease depends on motivation and that this effect is associated with putaminal dopaminergic degeneration.

Motivation in Parkinson's disease: apathetic before you know it

This scientific commentary refers to ‘Putaminal dopamine modulates movement motivation in Parkinson’s disease’ by Banwinkler et al. (https://doi.org/10.1093/brain/awae214).

Pharmacological characterization of sex differences in the effects of dopaminergic drugs on effort-based decision making in rats

RATIONALE

Motivational dysfunctions related to effort exertion are common in psychiatric disorders. Dopamine systems regulate exertion of effort and effort-based choice in humans and rodents.

OBJECTIVES

Previous rodent studies mainly employed male rats, and it is imperative to conduct studies in male and female rats.

METHODS

The present studies compared the effort-related effects of IP injections of the dopamine antagonists ecopipam and haloperidol, and the vesicular monoamine transport-2 inhibitor tetrabenazine (TBZ), in male and female rats using the fixed ratio 5/chow feeding choice task.

RESULTS

Ecopipam (0.05-0.2 mg/kg) and haloperidol (0.05-0.15 mg/kg) induced a low-effort bias, decreasing lever pressing and increasing chow intake in males and females in the same dose range. With lever pressing, there was a modest but significant dose x sex interaction after ecopipam injection, but there was no significant interaction after administration of haloperidol. In the first study with TBZ (0.25-1.0 mg/kg), there was a robust sex difference. TBZ shifted choice from lever pressing to chow intake in male rats, but was ineffective in females. In a second experiment, 2.0 mg/kg affected choice behavior in both males and females. TBZ increased accumbens c-Fos immunoreactivity in a sex-dependent manner, with males significantly increasing at 1.0 mg/kg, while females showed augmented immunoreactivity at 2.0 mg/kg.

CONCLUSIONS

The neural and behavioral effects of TBZ differed across sexes, emphasizing the importance of conducting studies in male and female rats. This research has implications for understanding the effort-related motivational dysfunctions seen in psychopathology.

Beta and theta oscillations track effort and previous reward in the human basal ganglia and prefrontal cortex during decision making

Choosing whether to exert effort to obtain rewards is fundamental to human motivated behavior. However, the neural dynamics underlying the evaluation of reward and effort in humans is poorly understood. Here, we report an exploratory investigation into this with chronic intracranial recordings from the prefrontal cortex (PFC) and basal ganglia (BG; subthalamic nuclei and globus pallidus) in people with Parkinson's disease performing a decision-making task with offers that varied in levels of reward and physical effort required. This revealed dissociable neural signatures of reward and effort, with BG beta (12 to 20 Hz) oscillations tracking effort on a single-trial basis and PFC theta (4 to 7 Hz) signaling previous trial reward, with no effects of net subjective value. Stimulation of PFC increased overall acceptance of offers and sensitivity to reward while decreasing the impact of effort on choices. This work uncovers oscillatory mechanisms that guide fundamental decisions to exert effort for reward across BG and PFC, supports a causal role of PFC for such choices, and seeds hypotheses for future studies.

The effect of Huntington's disease on cognitive and physical motivation

Apathy is one of the most common neuropsychiatric features of Huntington's disease. A hallmark of apathy is diminished goal-directed behaviour, which is characterized by a lower motivation to engage in cognitively or physically effortful actions. However, it remains unclear whether this reduction in goal-directed behaviour is driven primarily by a motivational deficit and/or is secondary to the progressive cognitive and physical deficits that accompany more advanced disease. We addressed this question by testing 17 individuals with manifest Huntington's disease and 22 age-matched controls on an effort-based decision-making paradigm. Participants were first trained on separate cognitively and physically effortful tasks and provided explicit feedback about their performance. Next, they chose on separate trials how much effort they were willing to exert in each domain in return for varying reward. At the conclusion of the experiment, participants were asked to rate their subjective perception of task load. In the cognitive task, the Huntington's disease group were more averse to cognitive effort than controls. Although the Huntington's disease group were more impaired than controls on the task itself, their greater aversion to cognitive effort persisted even after controlling for task performance. This suggests that the lower levels of cognitive motivation in the Huntington's disease group relative to controls was most likely driven by a primary motivational deficit. In contrast, both groups expressed a similar preference for physical effort. Importantly, the similar levels of physical motivation across both groups occurred even though participants with Huntington's disease performed objectively worse than controls on the physical effort task, and were aware of their performance through explicit feedback on each trial. This indicates that the seemingly preserved level of physical motivation in Huntington's disease was driven by a willingness to engage in physically effortful actions despite a reduced capacity to do so. Finally, the Huntington's disease group provided higher ratings of subjective task demand than controls for the cognitive (but not physical) effort task and when assessing the mental (but not the physical) load of each task. Together, these results revealed a dissociation in cognitive and physical motivation deficits between Huntington's disease and controls, which were accompanied by differences in how effort was subjectively perceived by the two groups. This highlights that motivation is the final manifestation of a complex set of mechanisms involved in effort processing, which are separable across different domains of behaviour. These findings have important clinical implications for the day-to-day management of apathy in Huntington's disease.

From movement to motivation: a proposed framework to understand the antidepressant effect of exercise

Depression is the leading cause of disability worldwide, exerting a profound negative impact on quality of life in those who experience it. Depression is associated with disruptions to several closely related neural and cognitive processes, including dopamine transmission, fronto-striatal brain activity and connectivity, reward processing and motivation. Physical activity, especially aerobic exercise, reduces depressive symptoms, but the mechanisms driving its antidepressant effects are poorly understood. Here we propose a novel hypothesis for understanding the antidepressant effects of exercise, centred on motivation, across different levels of explanation. There is robust evidence that aerobic exercise decreases systemic inflammation. Inflammation is known to reduce dopamine transmission, which in turn is strongly implicated in effort-based decision making for reward. Drawing on a broad range of research in humans and animals, we propose that by reducing inflammation and boosting dopamine transmission, with consequent effects on effort-based decision making for reward, exercise initially specifically improves 'interest-activity' symptoms of depression-namely anhedonia, fatigue and subjective cognitive impairment - by increasing propensity to exert effort. Extending this framework to the topic of cognitive control, we explain how cognitive impairment in depression may also be conceptualised through an effort-based decision-making framework, which may help to explain the impact of exercise on cognitive impairment. Understanding the mechanisms underlying the antidepressant effects of exercise could inform the development of novel intervention strategies, in particular personalised interventions and boost social prescribing.

Motivational Modulation Enhances Movement Performance in Parkinson's Disease: A Systematic Review

Background

The assessment of motivation and its modulation during treatment are essential aspects of physical therapy practice. However, the modulation of motivation has been sparsely investigated in persons with Parkinson's disease (PD) and at present no studies have synthesized its effects on movement performance.

Objectives

4The purpose of this study was to systematically examine the efficacy of motivational modulation on movement performance in PD and to provide recommendations for its role in physical therapy practice.

Methods

Systematic identification of published literature was performed adhering to PRISMA guidelines, from January 2005 to March 2023. Keywords were used in the following electronic databases: PubMed, Academic Search Complete, the Cochrane Database, Google Scholar, and the Physiotherapy Evidence Database (PEDro). A level of evidence rating was completed according to the scale provided by the American Academy of Cerebral Palsy and Development Medicine. Quality assessments were performed using the Modified Downs and Black checklist.

Results

Eight studies were included in this review, all achieving level III evidence. The methodological quality of studies was varied, with most studies attaining a fair rating. Persons with PD performed upper extremity movement tasks with greater intensity when incentivized with larger rewards compared to smaller incentives. Dopamine replacement medication, Deep Brain Stimulation, and a history of depression, had mediating effects on the response to motivational modulation.

Conclusions

Our findings suggest that it is plausible to improve adherence to exercise when physical therapists modulate motivation through computerized game achievements, gamification of tasks, or other forms of reward and non-rewarding stimuli.

Disentangling effort from probability of success: Temporal dynamics of frontal midline theta in effort-based reward processing

The ability to weigh a reward against the effort required to acquire it is critical for decision-making. However, extant experimental paradigms oftentimes confound increased effort demand with decreased reward probability, thereby obscuring neural correlates underlying these cognitive processes. To resolve this issue, we designed novel tasks that disentangled probability of success - and therefore reward probability - from effort demand. In Experiment 1, reward magnitude and effort demand were varied while reward probability was kept constant. In Experiment 2, effort demand and reward probability were varied while reward magnitude remained fixed. Electroencephalogram (EEG) data was recorded to explore how frontal midline theta (FMT; an electrophysiological index of mPFC function) and component P3 (an index of incentive salience) respond to effort demand, and reward magnitude and probability. We found no evidence that FMT tracked effort demands or net value during cue evaluation. At feedback, however, FMT power was enhanced for high compared to low effort trials, but not modulated by reward magnitude or probability. Conversely, P3 was sensitive to reward magnitude and probability at both cue and feedback phases and only integrated expended effort costs at feedback, such that P3 amplitudes continued to scale with reward magnitude and probability but were also increased for high compared to low effort reward feedback. These findings suggest that, when likelihood of success is equal, FMT power does not track net value of prospective effort-based rewards. Instead, expended cognitive effort potentiates FMT power and enhances the saliency of rewards at feedback. SIGNIFICANCE STATEMENT: The way the brain weighs rewards against the effort required to achieve them is critical for understanding motivational disorders. Current paradigms confound increased effort demand with decreased reward probability, making it difficult to disentangle neural activity associated with effort costs from those associated with reward likelihood. Here, we explored the temporal dynamics of effort-based reward (via frontal midline theta (FMT) and component P3) while participants underwent a novel paradigm that kept probability of reward constant between mental effort demand conditions. Our findings suggest that the FMT does not track net value and that expended effort enhances, instead of attenuates, the saliency of rewards.

A computational approach to understanding effort-based decision-making in depression

Background

Motivational dysfunction is a core feature of depression, and can have debilitating effects on everyday function. However, it is unclear which disrupted cognitive processes underlie impaired motivation, and whether impairments persist following remission. Decision-making concerning exerting effort to collect rewards offers a promising framework for understanding motivation, especially when examined with computational tools which can offer precise quantification of latent processes.

Methods

Effort-based decision-making was assessed using the Apple Gathering Task, in which participants decide whether to exert effort via a grip-force device to obtain varying levels of reward; effort levels were individually calibrated and varied parametrically. We present a comprehensive computational analysis of decision-making, initially validating our model in healthy volunteers (N=67), before applying it in a case-control study including current (N=41) and remitted (N=46) unmedicated depressed individuals, and healthy volunteers with (N=36) and without (N=57) a family history of depression.

Results

Four fundamental computational mechanisms that drive patterns of effort-based decisions, which replicated across samples, were identified: an overall bias to accept effort challenges; reward sensitivity; and linear and quadratic effort sensitivity. Traditional model-agnostic analyses showed that both depressed groups showed lower willingness to exert effort. In contrast with previous findings, computational analysis revealed that this difference was driven by lower effort acceptance bias, but not altered effort or reward sensitivity.

Conclusions

This work provides insight into the computational mechanisms underlying motivational dysfunction in depression. Lower willingness to exert effort could represent a trait-like factor contributing to symptoms, and might represent a fruitful target for treatment and prevention.

Slowing of Movements in Healthy Aging as a Rational Economic Response to an Elevated Effort Landscape

Why do we move slower as we grow older? The reward circuits of the brain, which tend to invigorate movements, decline with aging, raising the possibility that reduced vigor is due to the diminishing value that our brain assigns to movements. However, as we grow older, it also becomes more effortful to make movements. Is age-related slowing principally a consequence of increased effort costs from the muscles, or reduced valuation of reward by the brain? Here, we first quantified the cost of reaching via metabolic energy expenditure in human participants (male and female), and found that older adults consumed more energy than the young at a given speed. Thus, movements are objectively more costly for older adults. Next, we observed that when reward increased, older adults, like the young, responded by initiating their movements earlier. Yet, unlike the young, they were unwilling to increase their movement speed. Was their reluctance to reach quicker for rewards due to the increased effort costs, or because they ascribed less value to the movement? Motivated by a mathematical model, we next made the young experience a component of aging by making their movements more effortful. Now the young responded to reward by reacting faster but chose not to increase their movement speed. This suggests that slower movements in older adults are partly driven by an adaptive response to an elevated effort landscape. Moving slower may be a rational economic response the brain is making to mitigate the elevated effort costs that accompany aging.

Remotely prescribed and monitored home-based gait-and-balance therapeutic exergaming using augmented reality (AR) glasses: protocol for a clinical feasibility study in people with Parkinson's disease

BACKGROUND

Clinical guidelines for people with Parkinson's disease (pwPD) stress that, complementary to pharmacological treatment, exercise and physiotherapy should be given a central role in disease management. Adhering to regular exercise of the right type, and with high repetition, remains a challenge for pwPD. Exergaming has the potential to increase adherence through play and personalised interventions, both in clinic and at home. Reality DTx® is an augmented-reality (AR) home-based gait-and-balance exergaming intervention specifically designed for pwPD as an extension of supervised physiotherapy. The primary objective of this study is to evaluate the feasibility and potential efficacy of Reality DTx®.

METHODS

Twenty-four pwPD (Hoehn and Yahr stages 2-4) with self-reported gait and/or balance impairments will participate in this study. The study comprises a 6-week waitlist-controlled AR home-based therapeutic gait-and-balance exergaming intervention. Reality DTx® will initially be prescribed remotely for a minimum of 5 days a week for 30 min per day. We will remotely set and adjust the frequency, difficulty, type of games, and/or duration weekly, based on objective and subjective data from the AR glasses and participant, respectively. In addition to the home-based gait-and-balance exergaming intervention, the study comprises three laboratory visits: before the 6-week waitlist period (t0; baseline), before the 6-week intervention period (t1; pre-intervention), and after the 6-week intervention period (t2; post-intervention). The primary study parameters are feasibility (in terms of safety, adherence, and user experience) and potential efficacy for improving gait and balance (using standard clinical gait-and-balance tests and a targeted walking-related fall-risk assessment). Recruitment started in December 2022 and the final post-intervention assessment will be according to planning in July 2023.

CONCLUSIONS

This clinical feasibility trial is the first remotely prescribed and monitored home-based AR gait-and-balance exergaming intervention for pwPD. The results in terms of clinical feasibility (i.e. safety, adherence, and user experience) and potential efficacy (gait, balance, and fall-risk outcomes) form the basis for future randomised controlled studies on the effectiveness of home-based AR gait-and-balance exergaming interventions for pwPD.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT05605249 . Registered on 4 November 2022.

Separate gut-brain circuits for fat and sugar reinforcement combine to promote overeating

Food is a powerful natural reinforcer that guides feeding decisions. The vagus nerve conveys internal sensory information from the gut to the brain about nutritional value; however, the cellular and molecular basis of macronutrient-specific reward circuits is poorly understood. Here, we monitor in vivo calcium dynamics to provide direct evidence of independent vagal sensing pathways for the detection of dietary fats and sugars. Using activity-dependent genetic capture of vagal neurons activated in response to gut infusions of nutrients, we demonstrate the existence of separate gut-brain circuits for fat and sugar sensing that are necessary and sufficient for nutrient-specific reinforcement. Even when controlling for calories, combined activation of fat and sugar circuits increases nigrostriatal dopamine release and overeating compared with fat or sugar alone. This work provides new insights into the complex sensory circuitry that mediates motivated behavior and suggests that a subconscious internal drive to consume obesogenic diets (e.g., those high in both fat and sugar) may impede conscious dieting efforts.

Double dissociation of dopamine and subthalamic nucleus stimulation on effortful cost/benefit decision making

Deep brain stimulation (DBS) and dopaminergic therapy (DA) are common interventions for Parkinson's disease (PD). Both treatments typically improve patient outcomes, and both can have adverse side effects on decision making (e.g., impulsivity).1,2 Nevertheless, they are thought to act via different mechanisms within basal ganglia circuits.3 Here, we developed and formally evaluated their dissociable predictions within a single cost/benefit effort-based decision-making task. In the same patients, we manipulated DA medication status and subthalamic nucleus (STN) DBS status within and across sessions. Using a series of descriptive and computational modeling analyses of participant choices and their dynamics, we confirm a double dissociation: DA medication asymmetrically altered participants' sensitivities to benefits vs. effort costs of alternative choices (boosting the sensitivity to benefits while simultaneously lowering sensitivity to costs); whereas STN DBS lowered the decision threshold of such choices. To our knowledge, this is the first study to show, using a common modeling framework, a dissociation of DA and DBS within the same participants. As such, this work offers a comprehensive account for how different mechanisms impact decision making, and how impulsive behavior (present in DA-treated patients with PD and DBS patients) may emerge from separate physiological mechanisms.

Apathy and Motivation: Biological Basis and Drug Treatment

Apathy is a disabling syndrome associated with poor functional outcomes that is common across a broad range of neurological and psychiatric conditions. Currently, there are no established therapies specifically for the condition, and safe and effective treatments are urgently needed. Advances in the understanding of motivation and goal-directed behavior in humans and animals have shed light on the cognitive and neurobiological mechanisms contributing to apathy, providing an important foundation for the development of new treatments. Here, we review the cognitive components, neural circuitry, and pharmacology of apathy and motivation, highlighting converging evidence of shared transdiagnostic mechanisms. Though no pharmacological treatments have yet been licensed, we summarize trials of existing and novel compounds to date, identifying several promising candidates for clinical use and avenues of future drug development.

Dopamine Increases Accuracy and Lengthens Deliberation Time in Explicit Motor Skill Learning

Although animal research implicates a central role for dopamine in motor skill learning, a direct causal link has yet to be established in neurotypical humans. Here, we tested if a pharmacological manipulation of dopamine alters motor learning, using a paradigm which engaged explicit, goal-directed strategies. Participants (27 females; 11 males; aged 18-29 years) first consumed either 100 mg of levodopa (n = 19), a dopamine precursor that increases dopamine availability, or placebo (n = 19). Then, during training, participants learnt the explicit strategy of aiming away from presented targets by instructed angles of varying sizes. Targets jumped mid-movement by the instructed aiming angle. Task success was thus contingent upon aiming accuracy and not speed. The effect of the dopamine manipulations on skill learning was assessed during training and after an overnight follow-up. Increasing dopamine availability at training improved aiming accuracy and lengthened reaction times, particularly for larger, more difficult aiming angles, both at training and, importantly, at follow-up, despite prominent session-by-session performance improvements in both accuracy and speed. Exogenous dopamine thus seems to result in a learnt, persistent propensity to better adhere to task goals. Results support the proposal that dopamine is important in engagement of instrumental motivation to optimize adherence to task goals, particularly when learning to execute goal-directed strategies in motor skill learning.

Motivational Vigor in Parkinson's Disease Requires the Short and Long Duration Response to Levodopa

BACKGROUND

Impaired movement vigor (bradykinesia) is a cardinal feature of Parkinson's disease (PD) and hypothesized to result from abnormal motivational processes-impaired motivation-vigor coupling. Dopamine replacement therapy (DRT) improves bradykinesia, but the response to DRT is multifaceted, comprising a short-duration response (SDR) and a long-duration response (LDR) only manifesting with chronic treatment. Prior experiments assessing motivation-vigor coupling in PD used chronically treated subjects, obscuring the roles of the SDR and LDR.

METHODS

To disambiguate the SDR and LDR, 11 de novo PD subjects (6 male [M]:5 female [F]; mean age, 67) were studied before treatment, after an acute levodopa (l-dopa) dose, and in both the practical "off" (LDR) and "on" (LDR + SDR) states after chronic stable treatment. At each visit, subjects were characterized with a standard battery including the Movement Disorder Society-Sponsored Revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS) and an incentivized joystick task to assess motor performance in response to varying rewards.

RESULTS

l-Dopa induced a robust SDR and LDR, with further improvement in the combined SDR + LDR state. At baseline, after acute treatment (SDR), and after LDR induction, subjects did not exhibit the normal increase in movement speed with increasing reward. Only in the combined SDR + LDR state was there restoration of motivation-vigor coupling.

CONCLUSIONS

Although consistent with prior results in chronically treated PD subjects, the significant improvement in motor performance observed with the SDR and LDR suggests that bradykinesia is not solely secondary to deficient modulation of motivational processes. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Beta and theta oscillations track effort and previous reward in human basal ganglia and prefrontal cortex during decision making

Choosing whether to exert effort to obtain rewards is fundamental to human motivated behavior. However, the neural dynamics underlying the evaluation of reward and effort in humans is poorly understood. Here, we investigate this with chronic intracranial recordings from prefrontal cortex (PFC) and basal ganglia (BG; subthalamic nuclei and globus pallidus) in people with Parkinson's disease performing a decision-making task with offers that varied in levels of reward and physical effort required. This revealed dissociable neural signatures of reward and effort, with BG beta (12-20 Hz) oscillations tracking subjective effort on a single trial basis and PFC theta (4-7 Hz) signaling previous trial reward. Stimulation of PFC increased overall acceptance of offers in addition to increasing the impact of reward on choices. This work uncovers oscillatory mechanisms that guide fundamental decisions to exert effort for reward across BG and PFC, as well as supporting a causal role of PFC for such choices.

Amphetamines Improve the Motivation to Invest Effort in Attention-Deficit/Hyperactivity Disorder

Prevailing frameworks propose that a key feature of attention-deficit/hyperactivity disorder (ADHD) is lower motivation. An important component of motivation is the willingness to engage in cognitively or physically effortful behavior. However, the degree to which effort sensitivity is impaired in ADHD has rarely been tested, and the efficacy of stimulant medication in ameliorating any such impairments is unclear. Here, we tested 20 individuals with ADHD (11 males, 9 females) who were managed with amphetamine-based medication (dexamfetamine, lisdexamfetamine), and 24 controls (8 males, 16 females). Individuals with ADHD were tested over two counterbalanced sessions, ON and OFF their usual amphetamine-based medication. In each session, participants performed an effort-based decision-making task, in which they were required to choose how much cognitive or physical effort they were willing to engage in return for reward. Our results revealed three main findings. First, individuals with ADHD had lower motivation relative to controls to invest effort in both the cognitive and physical domains. Second, amphetamine increased motivation uniformly across both domains. Finally, the net effect of amphetamine treatment was to mostly restore motivation across both domains of effort relative to healthy controls. These data provide clear evidence for a heightened sensitivity to both cognitive and physical effort in ADHD, and reveal the efficacy of amphetamine-based drugs in restoring effort sensitivity to levels similar to controls. These findings confirm the existence of reduced motivational drive in ADHD, and more broadly provide direct causal evidence for a domain-general role of catecholamines in motivating effortful behavior.SIGNIFICANCE STATEMENT A core feature of attention-deficit/hyperactivity disorder (ADHD) is thought to be a heightened aversion to effort. Surprisingly, however, the degree to which effort sensitivity is impaired in ADHD has rarely been tested. More broadly, the relative efficacy of catecholamines in motivating the investment of cognitive and physical effort is unclear. We tested 20 individuals with ADHD ON and OFF amphetamines, and compared their behavior on an effort-based decision-making task to 24 controls. When tested OFF medication, the ADHD group was less cognitively and physically motivated than controls. However, amphetamines led to a comparable increase in motivation across both domains. This demonstrates the efficacy of catecholamines in facilitating domain-general effort, and highlights the broader potential of such drugs to treat disorders of motivation.

Uncovering the neurophysiology of mood, motivation and behavioral symptoms in Parkinson's disease through intracranial recordings

Neuropsychiatric mood and motivation symptoms (depression, anxiety, apathy, impulse control disorders) in Parkinson's disease (PD) are highly disabling, difficult to treat and exacerbated by current medications and deep brain stimulation therapies. High-resolution intracranial recording techniques have the potential to undercover the network dysfunction and cognitive processes that drive these symptoms, towards a principled re-tuning of circuits. We highlight intracranial recording as a valuable tool for mapping and desegregating neural networks and their contribution to mood, motivation and behavioral symptoms, via the ability to dissect multiplexed overlapping spatial and temporal neural components. This technique can be powerfully combined with behavioral paradigms and emerging computational techniques to model underlying latent behavioral states. We review the literature of intracranial recording studies investigating mood, motivation and behavioral symptomatology with reference to 1) emotional processing, 2) executive control 3) subjective valuation (reward & cost evaluation) 4) motor control and 5) learning and updating. This reveals associations between different frequency specific network activities and underlying cognitive processes of reward decision making and action control. If validated, these signals represent potential computational biomarkers of motivational and behavioural states and could lead to principled therapy development for mood, motivation and behavioral symptoms in PD.

Bilateral arm movements are coordinated via task-dependent negotiations between independent and codependent control, but not by a "coupling" control policy

Prior research has shown that coordination of bilateral arm movements might be attributed to either control policies that minimize performance and control costs regardless of bilateral symmetry or by control coupling, which activates bilaterally homologous muscles as a single unit to achieve symmetric performance. We hypothesize that independent bimanual control (movements of one arm are performed without influence on the other) and codependent bimanual control (two arms are constrained to move together with high spatiotemporal symmetry) are two extremes on a coordination spectrum that can be negotiated to meet infinite variations in task demands. To better understand and distinguish between these views, we designed a task where minimization of either control costs or asymmetry would yield different patterns of coordination. Participants made bilateral reaches with a shared visual cursor to a midline target. We then covertly varied the gain contribution of either hand to the shared cursor's horizontal position. Across two experiments, we show that bilateral coordination retains high task-dependent sensitivity to subtle visual feedback gain asymmetries applied to the shared cursor. Specifically, we found a change from strong spatial covariation between hands during equal gains to more independent control during asymmetric gains, which occurred rapidly and with high specificity to the dimension of gain manipulation. Furthermore, the extent of spatial covariation was graded to the magnitude of perpendicular gain asymmetry between hands. These findings suggest coordination of bilateral arm movements flexibly maneuvers along a continuous coordination spectrum in a task-dependent manner that cannot be explained by bilateral control coupling.NEW & NOTEWORTHY Minimization of performance and control costs and efferent coupling between bilaterally homologous muscle groups have been separately hypothesized to describe patterns of bimanual coordination. Here, we address whether the mechanisms mediating independent and codependent control between limbs can be weighted for successful task performance. Using bilaterally asymmetric visuomotor gain perturbations, we show bimanual coordination can be characterized as a negotiation along a spectrum between extremes of independent and codependent control, but not efferent control coupling.

Moving, fast and slow: behavioural insights into bradykinesia in Parkinson's disease

The debilitating symptoms of Parkinson's disease, including the hallmark slowness of movement, termed bradykinesia, were described more than 100 years ago. Despite significant advances in elucidating the genetic, molecular and neurobiological changes in Parkinson's disease, it remains conceptually unclear exactly why patients with Parkinson's disease move slowly. To address this, we summarize behavioural observations of movement slowness in Parkinson's disease and discuss these findings in a behavioural framework of optimal control. In this framework, agents optimize the time it takes to gather and harvest rewards by adapting their movement vigour according to the reward that is at stake and the effort that needs to be expended. Thus, slow movements can be favourable when the reward is deemed unappealing or the movement very costly. While reduced reward sensitivity, which makes patients less inclined to work for reward, has been reported in Parkinson's disease, this appears to be related mainly to motivational deficits (apathy) rather than bradykinesia. Increased effort sensitivity has been proposed to underlie movement slowness in Parkinson's disease. However, careful behavioural observations of bradykinesia are inconsistent with abnormal computations of effort costs due to accuracy constraints or movement energetic expenditure. These inconsistencies can be resolved when considering that a general disability to switch between stable and dynamic movement states can contribute to an abnormal composite effort cost related to movement in Parkinson's disease. This can account for paradoxical observations such as the abnormally slow relaxation of isometric contractions or difficulties in halting a movement in Parkinson's disease, both of which increase movement energy expenditure. A sound understanding of the abnormal behavioural computations mediating motor impairment in Parkinson's disease will be vital for linking them to their underlying neural dynamics in distributed brain networks and for grounding future experimental studies in well-defined behavioural frameworks.

Effort cost of reaching prompts vigor reduction in older adults

As people age, they move slower. Is age-related reduction in vigor a reflection of a reduced valuation of reward by the brain, or a consequence of increased effort costs by the muscles? Here, we quantified cost of movements objectively via the metabolic energy that young and old participants consumed during reaching and found that in order reach at a given speed, older adults expended more energy than the young. We next quantified how reward modulated movements in the same populations and found that like the young, older adults responded to increased reward by initiating their movements earlier. Yet, their movements were less sensitive to increased reward, resulting in little or no modulation of reach speed. Lastly, we quantified the effect of increased effort on how reward modulated movements in young adults. Like the effects of aging, when faced with increased effort the young adults responded to reward primarily by reacting faster, with little change in movement speed. Therefore, reaching required greater energetic expenditure in the elderly, suggesting that the slower movements and reactions exhibited in aging are partly driven by an adaptive response to an elevation in the energetic landscape of effort. That is, moving slower appears to be a rational economic consequence of aging.

Significance statement

Healthy aging coincides with a reduction in speed, or vigor, of walking, reaching, and eye movements. Here we focused on disentangling two opposing sources of aging-related movement slowing: reduced reward sensitivity due to loss of dopaminergic tone, or increased energy expenditure movements related to mitochondrial or muscular inefficiencies. Through a series of three experiments and construction of a computational model, here we demonstrate that transient changes in reaction time and movement speed together offer a quantifiable metric to differentiate between reward- and effort-based alterations in movement vigor. Further, we suggest that objective increases in the metabolic cost of moving, not reductions in reward valuation, are driving much of the movement slowing occurring alongside healthy aging.

Apathy in Parkinson's Disease: Clinical Patterns and Neurobiological Basis

Apathy is commonly defined as a loss of motivation leading to a reduction in goal-directed behaviors. This multidimensional syndrome, which includes cognitive, emotional and behavioral components, is one of the most prevalent neuropsychiatric features of Parkinson's disease (PD). It has been established that the prevalence of apathy increases as PD progresses. However, the pathophysiology and anatomic substrate of this syndrome remain unclear. Apathy seems to be underpinned by impaired anatomical structures that link the prefrontal cortex with the limbic system. It can be encountered in the prodromal stage of the disease and in fluctuating PD patients receiving bilateral chronic subthalamic nucleus stimulation. In these stages, apathy may be considered as a disorder of motivation that embodies amotivational behavioral syndrome, is underpinned by combined dopaminergic and serotonergic denervation and is dopa-responsive. In contrast, in advanced PD patients, apathy may be considered as cognitive apathy that announces cognitive decline and PD dementia, is underpinned by diffuse neurotransmitter system dysfunction and Lewy pathology spreading and is no longer dopa-responsive. In this review, we discuss the clinical patterns of apathy and their treatment, the neurobiological basis of apathy, the potential role of the anatomical structures involved and the pathways in motivational and cognitive apathy.

Reward insensitivity is associated with dopaminergic deficit in rapid eye movement sleep behaviour disorder

Idiopathic rapid eye movement sleep behaviour disorder (iRBD) has now been established as an important marker of the prodromal stage of Parkinson's disease and related synucleinopathies. However, although dopamine transporter single photon emission computed tomography (SPECT) has been used to demonstrate the presence of nigro-striatal deficit in iRBD, quantifiable correlates of this are currently lacking. Sensitivity to rewarding stimuli is reduced in some people with Parkinson's disease, potentially contributing to aspects of the neuropsychiatric phenotype in these individuals. Furthermore, a role for dopaminergic degeneration is suggested by the fact that reward insensitivity can be improved by dopaminergic medications. Patients with iRBD present a unique opportunity to study the relationship between reward sensitivity and early dopaminergic deficit in the unmedicated state. Here, we investigate whether a non-invasive, objective measure of reward sensitivity might be a marker of dopaminergic status in prodromal Parkinson's disease by comparing with SPECT/CT measurement of dopaminergic loss in the basal ganglia. Striatal dopaminergic deficits in iRBD are associated with progression to Parkinsonian disorders. Therefore, identification of a clinically measurable correlate of this degenerative process might provide a basis for the development of novel risk stratification tools. Using a recently developed incentivized eye-tracking task, we quantified reward sensitivity in a cohort of 41 patients with iRBD and compared this with data from 40 patients with Parkinson's disease and 41 healthy controls. Patients with iRBD also underwent neuroimaging with dopamine transporter SPECT/CT. Overall, reward sensitivity, indexed by pupillary response to monetary incentives, was reduced in iRBD cases compared with controls and was not significantly different to that in patients with Parkinson's disease. However, in iRBD patients with normal dopamine transporter SPECT/CT imaging, reward sensitivity was not significantly different from healthy controls. Across all iRBD cases, a positive association was observed between reward sensitivity and dopaminergic SPECT/CT signal in the putamen. These findings demonstrate a direct relationship between dopaminergic deficit and reward sensitivity in patients with iRBD and suggest that measurement of pupillary responses could be of value in models of risk stratification and disease progression in these individuals.

Fatigue during acute systemic inflammation is associated with reduced mental effort expenditure while task accuracy is preserved

BACKGROUND

Earlier work within the physical domain showed that acute inflammation changes motivational prioritization and effort allocation rather than physical abilities. It is currently unclear whether a similar motivational framework accounts for the mental fatigue and cognitive symptoms of acute sickness. Accordingly, this study aimed to assess the relationship between fatigue, cytokines and mental effort-based decision making during acute systemic inflammation.

METHODS

Eighty-five participants (41 males; 18-30 years (M=23.0, SD=2.4)) performed a mental effort-based decision-making task before, 2 hours after, and 5 hours after intravenous administration of 1 ng/kg bacterial lipopolysaccharide (LPS) to induce systemic inflammation. Plasma concentrations of cytokines (interleukin (IL)-6, IL-8 and tumor necrosis factor (TNF)) and fatigue levels were assessed at similar timepoints. In the task, participants decided whether they wanted to perform (i.e., 'accepted') arithmetic calculations of varying difficulty (3 levels: easy, medium, hard) in order to obtain rewards (3 levels: 5, 6 or 7 points). Acceptance rates were analyzed using a binomial generalized estimated equation (GEE) approach with effort, reward and time as independent variables. Arithmetic performance was measured per effort level prior to the decisions and included as a covariate. Associations between acceptance rates, fatigue (self-reported) and cytokine concentrations levels were analyzed using partial correlation analyses.

RESULTS

Plasma cytokine concentrations and fatigue were increased at 2 hours post-LPS compared to baseline and 5 hours post-LPS administration. Acceptance rates decreased for medium, but not for easy or hard effort levels at 2 hours post-LPS versus baseline and 5 hours post-LPS administration, irrespective of reward level. This reduction in acceptance rates occurred despite improved accuracy on the arithmetic calculations itself. Reduced acceptance rates for medium effort were associated with increased fatigue, but not with increased cytokines.

CONCLUSION

Fatigue during acute systemic inflammation is associated with alterations in mental effort allocation, similarly as observed previously for physical effort-based choice. Specifically, willingness to exert mental effort depended on effort and not reward information, while task accuracy was preserved. These results extend the motivational account of inflammation to the mental domain and suggest that inflammation may not necessarily affect domain-specific mental abilities, but rather affects domain-general effort-allocation processes.

Dopamine facilitates the translation of physical exertion into assessments of effort

Our assessments of effort are critically shaped by experiences of exertion. However, it is unclear how the nervous system transforms physical exertion into assessments of effort. Availability of the neuromodulator dopamine influences features of motor performance and effort-based decision-making. To test dopamine's role in the translation of effortful exertion into assessments of effort, we had participants with Parkinson's disease, in dopamine depleted (OFF dopaminergic medication) and elevated (ON dopaminergic medication) states, exert levels of physical exertion and retrospectively assess how much effort they exerted. In a dopamine-depleted state, participants exhibited increased exertion variability and over-reported their levels of exertion, compared to the dopamine-supplemented state. Increased exertion variability was associated with less accurate effort assessment and dopamine had a protective influence on this effect, reducing the extent to which exertion variability corrupted assessments of effort. Our findings provide an account of dopamine's role in the translation of features of motor performance into judgments of effort, and a potential therapeutic target for the increased sense of effort observed across a range of neurologic and psychiatric conditions.

Metabolic costs of walking and arm reaching in persons with mild multiple sclerosis

Movement slowness is a common and disruptive symptom of multiple sclerosis (MS). A potential cause is that individuals with MS slow down to conserve energy as a behavioral adjustment to heightened metabolic costs of movement. To investigate this prospect, we measured the metabolic costs of both walking and seated arm reaching at five speeds in persons with mild MS (pwMS; n = 13; 46.0 ± 7.7 yr) and sex- and age-matched controls (HCs; n = 13; 45.8 ± 7.8 yr). Notably, the cohort of pwMS was highly mobile and no individuals required a cane or aid when walking. We found that the net metabolic power of walking was approximately 20% higher for pwMS across all speeds (P = 0.0185). In contrast, we found no differences in the gross power of reaching between pwMS and HCs (P = 0.492). Collectively, our results suggest that abnormal slowness of movement in MS-particularly reaching-is not the consequence of heightened effort costs and that other sensorimotor mechanisms are playing a considerable role in slowing.NEW & NOTEWORTHY Individuals with multiple sclerosis (MS) often move more slowly than those without the disease. A possible cause is that movements in MS are more energetically expensive and slowing is an adaptation to conserve metabolic resources. Here, we find that while walking is more costly for persons with MS, arm-reaching movements are not. These results bring into question the driving force of movement slowness in MS and implicate other motor-related networks contributing to slowing.

Effort avoidance as a core mechanism of apathy in frontotemporal dementia

Apathy is a core symptom in patients with behavioural variant frontotemporal dementia (bvFTD). It is defined by the observable reduction in goal-directed behaviour, but the underlying mechanisms are poorly understood. According to decision theory, engagement in goal-directed behaviour depends on a cost-benefit optimization trading off the estimated effort (related to the behaviour) against the expected reward (related to the goal). In this framework, apathy would thus result from either a decreased appetence for reward, or from an increased aversion to effort. Here, we phenotyped the motivational state of 21 patients with bvFTD and 40 matched healthy controls using computational analyses of behavioural responses in a comprehensive series of behavioural tasks, involving both expression of preference (comparing reward value and effort cost) and optimization of performance (adjusting effort production to the reward at stake). The primary finding was an elevated aversion to effort, consistent across preference and performance tasks in patients with bvFTD compared to controls. Within the bvFTD group, effort avoidance was correlated to cortical atrophy in the dorsal anterior cingulate cortex and to apathy score measured on a clinical scale. Thus, our results highlight elevated effort aversion (not reduced reward appetence) as a core dysfunction that might generate apathy in patients with bvFTD. More broadly, they provide novel behavioural tests and computational tools to identify the dysfunctional mechanisms producing motivation deficits in patients with brain damage.

Role of serotonin in modulation of decision-making in Parkinson's disease

BACKGROUND

Dysfunction of dopaminergic pathways has been considered to play a pivotal role in Parkinson's disease (PD), affecting the processing of emotional and rewarding information, and potentially leading to symptoms of depression or apathy. However, some aspects of motivation in PD might be affected by non-dopaminergic mechanisms.

AIM AND METHOD

The objective of this experimental medicine study was to investigate the contribution of serotonergic modulation via administration of citalopram (20 mg) for 7 days on motivated decision-making in twenty PD patients, measured using several different computerised tasks and clinical questionnaires that probe different aspects of decision-making. Twenty healthy controls were additionally tested without medication to assess any baseline differences between the two groups.

RESULTS

Results indicated that PD patients were overall less motivated than controls on an effort- and reward-based decision-making task. Citalopram increased or decreased willingness to exert effort for reward, depending on whether baseline motivation was high or low, respectively. A task assessing decision-making under risk revealed higher levels of risk aversion for potential losses in PD patients, which neither serotonin nor the patient's regular dopaminergic medication seemed to restore. However, citalopram in PD was associated with more risk-seeking choices for gains, although patients and controls did not differ on this at baseline.

CONCLUSION

The results provide evidence for a role of the serotonergic system in influencing some aspects of motivated decision-making in PD processes.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson’s disease

Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson’s disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.

Elevated Effort Cost Identified by Computational Modeling as a Distinctive Feature Explaining Multiple Behaviors in Patients With Depression

BACKGROUND

Motivational deficit is a core clinical manifestation of depression and a strong predictor of treatment failure. However, the underlying mechanisms, which cannot be accessed through conventional questionnaire-based scoring, remain largely unknown. According to decision theory, apathy could result either from biased subjective estimates (of action costs or outcomes) or from dysfunctional processes (in making decisions or allocating resources).

METHODS

Here, we combined a series of behavioral tasks with computational modeling to elucidate the motivational deficits of 35 patients with unipolar or bipolar depression under various treatments compared with 35 matched healthy control subjects.

RESULTS

The most striking feature, which was observed independent of medication across preference tasks (likeability ratings and binary decisions), performance tasks (physical and mental effort exertion), and instrumental learning tasks (updating choices to maximize outcomes), was an elevated sensitivity to effort cost. By contrast, sensitivity to action outcomes (reward and punishment) and task-specific processes were relatively spared.

CONCLUSIONS

These results highlight effort cost as a critical dimension that might explain multiple behavioral changes in patients with depression. More generally, they validate a test battery for computational phenotyping of motivational states, which could orientate toward specific medication or rehabilitation therapy, and thereby help pave the way for more personalized medicine in psychiatry.

Combination of gait speed and grip strength to predict cognitive decline and dementia

Introduction

To determine whether slowed gait and weakened grip strength independently, or together, better identify risk of cognitive decline or dementia.

Methods

Time to walk 3 meters and grip strength were measured in a randomized placebo-controlled clinical trial involving community-dwelling, initially cognitively healthy older adults (N = 19,114).

Results

Over a median 4.7 years follow-up, slow gait and weak grip strength at baseline were independently associated with risk of incident dementia (hazard ratio [HR] = 1.44, 95% confidence interval [CI]: 1.19-1.73; and 1.24, 95% CI: 1.04-1.50, respectively) and cognitive decline (HR = 1.38, 95% CI: 1.26-1.51; and 1.04, 95% CI: 0.95-1.14, respectively) and when combined, were associated with 79% and 43% increase in risk of dementia and cognitive decline, respectively. Annual declines in gait and in grip over time showed similar results.

Discussion

Gait speed and grip strength are low-cost markers that may be useful in the clinical setting to help identify and manage individuals at greater risk, or with early signs, of dementia, particularly when measured together.

Highlights

Grip strength and gait speed are effective predictors and markers of dementia.Dementia risk is greater than cognitive decline risk with declines in gait or grip.Decline in gait speed, more so than in grip strength, predicts greater dementia risk.Greater risk prediction results from combining grip strength and gait speed.

Contribution of the sensorimotor beta oscillations and the cortico-basal ganglia-thalamic circuitry during value-based decision making: A simultaneous EEG-fMRI investigation

In decision neuroscience, the motor system has primarily been considered to be involved in executing choice actions. However, a competing perspective suggests its engagement in the evaluation of options, traditionally considered to be performed by the brain's valuation system. Here, we investigate the role of the motor system in value-based decision making by determining the neural circuitries associated with the sensorimotor beta oscillations previously identified to encode decision options. In a simultaneous EEG-fMRI study, participants evaluated reward and risk associated with a forthcoming action. A significant sensorimotor beta desynchronization was identified prior to and independent of response. The level of beta desynchronization showed evidence of encoding the reward levels. This beta desynchronization covaried, on a trial-by-trial level, with BOLD activity in the cortico-basal ganglia-thalamic circuitry. In contrast, there was only a weak covariation within the valuation network, despite significant modulation of its BOLD activity by reward levels. These results suggest that the way in which decision variables are processed differs in the valuation network and in the cortico-basal ganglia-thalamic circuitry. We propose that sensorimotor beta oscillations indicate incentive motivational drive towards a choice action computed from the decision variables even prior to making a response, and it arises from the cortico-basal ganglia-thalamic circuitry.

Dopaminergic medication increases motivation to exert cognitive control by reducing subjective effort costs in Parkinson's patients

Engaging in demanding mental activities requires the allocation of cognitive control, which can be effortful and aversive. Individuals thus tend to avoid exerting cognitive effort if less demanding behavioral options are available. Recent accounts propose a key role for dopamine in motivating behavior by increasing the sensitivity to rewards associated with effort exertion. Whether dopamine additionally plays a specific role in modulating the sensitivity to the costs of cognitive effort, even in the absence of any incentives, is much less clear. To address this question, we assessed cognitive effort avoidance in patients (n = 38) with Parkinson's disease, a condition characterized by loss of midbrain dopaminergic neurons, both ON and OFF dopaminergic medication and compared them to healthy controls (n = 24). Effort avoidance was assessed using the Demand Selection Task (DST), in which participants could freely choose between performing a high-demand or a low-demand version of a task-switching paradigm. Critically, participants were not offered any incentives to choose the more effortful option, nor for good performance. While healthy controls and patients OFF their dopaminergic medications consistently preferred the low-demand option, effort avoidance in patients ON dopaminergic medications was reduced compared to patients OFF, a difference which seems to lessen over trials. These differences in preference could not be explained by altered task-switching performance. Although patients ON were less accurate at detecting the different effort levels, as measured during instructed forced-choice blocks, their detection ability was not associated with effort avoidance, unlike in the healthy controls and the patients OFF. Our findings provide evidence that dopamine replacement in Parkinson's patients increases the willingness to engage in cognitively demanding behavior, and that this cannot be explained by possible effects of dopamine replacement on performance nor on the ability to detect effort demands. These results suggest that dopamine plays a role in reducing the sensitivity to effort costs that is independent of its role in enhancing the sensitivity to the benefits of effort exertion.

Motor response vigour and visual fixation patterns reflect subjective valuation during intertemporal choice

Value-based decision-making is of central interest in cognitive neuroscience and psychology, as well as in the context of neuropsychiatric disorders characterised by decision-making impairments. Studies examining (neuro-)computational mechanisms underlying choice behaviour typically focus on participants’ decisions. However, there is increasing evidence that option valuation might also be reflected in motor response vigour and eye movements, implicit measures of subjective utility. To examine motor response vigour and visual fixation correlates of option valuation in intertemporal choice, we set up a task where the participants selected an option by pressing a grip force transducer, simultaneously tracking fixation shifts between options. As outlined in our preregistration (https://osf.io/k6jct), we used hierarchical Bayesian parameter estimation to model the choices assuming hyperbolic discounting, compared variants of the softmax and drift diffusion model, and assessed the relationship between response vigour and the estimated model parameters. The behavioural data were best explained by a drift diffusion model specifying a non-linear scaling of the drift rate by the subjective value differences. Replicating previous findings, we found a magnitude effect for temporal discounting, such that higher rewards were discounted less. This magnitude effect was further reflected in motor response vigour, such that stronger forces were exerted in the high vs. the low magnitude condition. Bayesian hierarchical linear regression further revealed higher grip forces, faster response times and a lower number of fixation shifts for trials with higher subjective value differences. An exploratory analysis revealed that subjective value sums across options showed an even more pronounced association with trial-wise grip force amplitudes. Our data suggest that subjective utility or implicit valuation is reflected in motor response vigour and visual fixation patterns during intertemporal choice. Taking into account response vigour might thus provide deeper insight into decision-making, reward valuation and maladaptive changes in these processes, e.g. in the context of neuropsychiatric disorders.

Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington's Disease

A caregiver's all‐too‐familiar narrative ‐ “He doesn't think through what he does, but mostly he does nothing.” Apathy and impulsivity, debilitating and poorly understood, commonly co‐occur in Huntington's disease (HD). HD is a neurodegenerative disease with manifestations bridging clinical neurology and psychiatry. In addition to movement and cognitive symptoms, neurobehavioral disturbances, particularly apathy and impulsivity, are prevalent features of HD, occurring early in the disease course, often worsening with disease progression, and substantially reducing quality of life. Treatments remain limited, in part because of limited mechanistic understanding of these behavioral disturbances. However, emerging work within the field of decision‐making neuroscience and beyond points to common neurobiological mechanisms underpinning these seemingly disparate problems. These insights bridge the gap between underlying disease pathology and clinical phenotype, offering new treatment strategies, novel behavioral and physiological biomarkers of HD, and deeper understanding of human behavior. In this review, we apply the neurobiological framework of cost‐benefit decision making to the problems of apathy and impulsivity in HD. Through this decision‐making lens, we develop a mechanistic model that elucidates the occurrence of these behavioral disturbances and points to potential treatment strategies and crucial research priorities. © 2022 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson Movement Disorder Society.

Noradrenergic deficits contribute to apathy in Parkinson's disease through the precision of expected outcomes

Apathy is a debilitating feature of many neuropsychiatric diseases, that is typically described as a reduction of goal-directed behaviour. Despite its prevalence and prognostic importance, the mechanisms underlying apathy remain controversial. Degeneration of the locus coeruleus-noradrenaline system is known to contribute to motivational deficits, including apathy. In healthy people, noradrenaline has been implicated in signalling the uncertainty of expectations about the environment. We proposed that noradrenergic deficits contribute to apathy by modulating the relative weighting of prior beliefs about action outcomes. We tested this hypothesis in the clinical context of Parkinson's disease, given its associations with apathy and noradrenergic dysfunction. Participants with mild-to-moderate Parkinson's disease (N = 17) completed a randomised double-blind, placebo-controlled, crossover study with 40 mg of the noradrenaline reuptake inhibitor atomoxetine. Prior weighting was inferred from psychophysical analysis of performance in an effort-based visuomotor task, and was confirmed as negatively correlated with apathy. Locus coeruleus integrity was assessed in vivo using magnetisation transfer imaging at ultra-high field 7T. The effect of atomoxetine depended on locus coeruleus integrity: participants with a more degenerate locus coeruleus showed a greater increase in prior weighting on atomoxetine versus placebo. The results indicate a contribution of the noradrenergic system to apathy and potential benefit from noradrenergic treatment of people with Parkinson's disease, subject to stratification according to locus coeruleus integrity. More broadly, these results reconcile emerging predictive processing accounts of the role of noradrenaline in goal-directed behaviour with the clinical symptom of apathy and its potential pharmacological treatment.

Altered reward and effort processing in children with maltreatment experience: a potential indicator of mental health vulnerability

In this longitudinal study of children and adolescents with a documented history of maltreatment, we investigated the impact of maltreatment on behavioral and neural indices of effort-based decision making for reward and examined their associations with future internalizing symptoms. Thirty-seven children with a documented history of maltreatment (MT group) and a carefully matched group of 33 non-maltreated children (NMT group) aged 10-16, completed an effort-based decision-making task during functional magnetic resonance imaging (fMRI). Internalizing symptoms were assessed at baseline and again 18 months later. Computational models were implemented to extract individual estimates of reward and effort sensitivity, and neural signals during decision-making about different levels of reward and effort were analyzed. These were used to predict internalizing symptoms at follow-up. We identified lower effort-related activation in the anterior cingulate cortex (ACC), a prespecified region-of-interest, in the MT relative to the NMT group. No group differences were observed in the striatum, or in behavioral indices of reward and effort processing. Lower effort-related ACC activation significantly predicted elevated internalizing symptoms at follow-up in the MT group. These findings suggest that disrupted effort-related activation may index latent vulnerability to mental illness in children who have experienced maltreatment.

Does effort-cost decision-making relate to real-world motivation in people living with HIV?

INTRODUCTION

Low motivation is frequent in older people with HIV, yet poorly understood. Effort-cost decision-making (ECDM) tasks inspired by behavioral economics have shown promise as indicators of motivation or apathy. These tasks assess the willingness to exert effort to earn a monetary reward, providing an estimate of the subjective "cost" of effort for each participant. Here we sought evidence for a relationship between ECDM task performance and self-reported motivation in a cross-sectional study involving 80 middle-aged and older people with well-controlled HIV infection, a chronic health condition with a high burden of mental and cognitive health challenges.

METHODS

Participants attending a regular follow-up visit for a Canadian longitudinal study of brain health in HIV completed a computerized ECDM task and a self-report measure of motivation. Other brain health measures were available, collected for the parent study (cognition, depression, anxiety, and vitality, as well as self-reported time spent on real-world leisure activities).

RESULTS

Contrary to our hypothesis, we found no relationship between ECDM performance and self-reported motivation. However, those willing to accept higher effort in the ECDM task also reported more time engaged in real-world activities. This association had a small-to-moderate effect size.

CONCLUSIONS

The behavioral economics construct of subjective cost of effort, measured with a laboratory ECDM task, does not relate to motivation in people living with chronic HIV. However, the task shows some relationship with real-world goal-directed behavior, suggesting this construct has potential clinical relevance. More work is needed to understand how the subjective cost of effort plays out in clinical symptoms and everyday activities.

Cognitive control in Parkinson's disease

Cognitive control is the ability to act according to plan. Problems with cognitive control are a primary symptom and a major decrement of quality of life in Parkinson's disease (PD). Individuals with PD have problems with seemingly different controlled processes (e.g., task switching, impulsivity, gait disturbance, apathetic motivation). We review how these varied processes all rely upon disease-related alteration of common neural substrates, particularly due to dopaminergic imbalance. A comprehensive understanding of the neural systems underlying cognitive control will hopefully lead to more concise and reliable explanations of distributed deficits. However, high levels of clinical heterogeneity and medication-invariant control deficiencies suggest the need for increasingly detailed elaboration of the neural systems underlying control in PD.

Deficiency in RCAT-1 Function Causes Dopamine Metabolism Related Behavioral Disorders in Caenorhabditis elegans

When animals are faced with food depletion, food search-associated locomotion is crucial for their survival. Although food search-associated locomotion is known to be regulated by dopamine, it has yet to investigate the potential molecular mechanisms governing the regulation of genes involved in dopamine metabolism (e.g., cat-1, cat-2) and related behavioral disorders. During the studies of the pheromone ascaroside, a signal of starvation stress in C. elegans, we identified R02D3.7, renamed rcat-1 (regulator of cat genes-1), which had previously been shown to bind to regulatory sequences of both cat-1 and cat-2 genes. It was found that RCAT-1 (R02D3.7) is expressed in dopaminergic neurons and functions as a novel negative transcriptional regulator for cat-1 and cat-2 genes. When a food source becomes depleted, the null mutant, rcat-1(ok1745), exhibited an increased frequency of high-angled turns and intensified area restricted search behavior compared to the wild-type animals. Moreover, rcat-1(ok1745) also showed defects in state-dependent olfactory adaptation and basal slowing response, suggesting that the mutants are deficient in either sensing food or locomotion toward food. However, rcat-1(ok1745) has normal cuticular structures and locomotion genes. The discovery of rcat-1 not only identifies a new subtype of dopamine-related behaviors but also provides a potential therapeutic target in Parkinson’s disease.

Obesity - A Matter of Motivation?

Excessive food intake and reduced physical activity have long been established as primary causes of obesity. However, the underlying mechanisms causing this unhealthy behavior characterized by heightened motivation for food but not for physical effort are unclear. Despite the common unjustified stigmatization that obesity is a result of laziness and lack of discipline, it is becoming increasingly clear that high-fat diet feeding and obesity cause alterations in brain circuits that are critical for the control of motivational behavior.

In this mini-review, we provide a comprehensive overview of incentive motivation, its neural encoding in the dopaminergic mesolimbic system as well as its metabolic modulation with a focus on derangements of incentive motivation in obesity. We further discuss the emerging field of metabolic interventions to counteract motivational deficits and their potential clinical implications.

Cognitive Effort Exertion Enhances Electrophysiological Responses to Rewarding Outcomes

Recent work has highlighted neural mechanisms underlying cognitive effort-related discounting of anticipated rewards. However, findings on whether effort exertion alters the subjective value of obtained rewards are inconsistent. Here, we provide a more nuanced account of how cognitive effort affects subsequent reward processing in a novel task designed to assess effort-induced modulations of the Reward Positivity, an event-related potential indexing reward-related neural activity. We found that neural responses to both gains and losses were significantly elevated in trials requiring more versus less cognitive effort. Moreover, time-frequency analysis revealed that these effects were mirrored in gain-related delta, but not in loss-related theta band activity, suggesting that people ascribed more value to high-effort outcomes. In addition, we also explored whether individual differences in behavioral effort discounting rates and reward sensitivity in the absence of effort may affect the relationship between effort exertion and subsequent reward processing. Together, our findings provide evidence that cognitive effort exertion can increase the subjective value of subsequent outcomes and that this effect may primarily rely on modulations of delta band activity.

A multisynaptic pathway from the ventral midbrain toward spinal motoneurons in monkeys

Abstract

Motivation boosts motor performance. Activity of the ventral midbrain (VM), consisting of the ventral tegmental area (VTA), the substantia nigra pars compacta (SNc) and the retrorubral field (RRF), plays an important role in processing motivation. However, little is known about the neural substrate bridging the VM and the spinal motor output. We hypothesized that the VM might exert a modulatory influence over the descending motor pathways. By retrograde transneuronal labelling with rabies virus, we demonstrated the existence of multisynaptic projections from the VM to the cervical enlargement in monkeys. The distribution pattern of spinal projection neurons in the VM exhibited a caudorostral gradient, in that the RRF and the caudal part of the SNc contained more retrogradely labelled neurons than the VTA and the rostral part of the SNc. Electrical stimulation of the VM induced muscle responses in the contralateral forelimb with a delay of a few milliseconds following the responses of the ipsilateral primary motor cortex (M1). The magnitude and number of evoked muscle responses were associated with the stimulus intensity and number of pulses. The muscle responses were diminished during M1 inactivation. Thus, the present study has identified a multisynaptic VM–spinal pathway that is mediated, at least in part, by the M1 and might play a pivotal role in modulatory control of the spinal motor output.

Key points

Motivation to obtain reward is thought to boost motor performance, and activity in the ventral midbrain is important to the motivational process.

Little is known about a neural substrate bridging the ventral midbrain and the spinal motor output.

Retrograde trans‐synaptic experiments revealed that the ventral midbrain projects multisynaptically to the spinal cord in macaque monkeys.

Ventral midbrain activation by electrical stimulation generated cortical activity in the motor cortex and forelimb muscle activity.

A multisynaptic ventral midbrain–spinal pathway most probably plays a pivotal role in modulatory control of the spinal motor output.

Calycosin Alleviates Paraquat-Induced Neurodegeneration by Improving Mitochondrial Functions and Regulating Autophagy in a Drosophila Model of Parkinson's Disease

Parkinson's disease (PD) is the second most common age-related neurodegenerative disorder with limited clinical treatments. The occurrence of PD includes both genetic and environmental toxins, such as the pesticides paraquat (PQ), as major contributors to PD pathology in both invertebrate and mammalian models. Calycosin, an isoflavone phytoestrogen, has multiple pharmacological properties, including neuroprotective activity. However, the paucity of information regarding the neuroprotective potential of calycosin on PQ-induced neurodegeneration led us to explore whether calycosin can mitigate PD-like phenotypes and the underlying molecular mechanisms. We used a PQ-induced PD model in Drosophila as a cost-effective in vivo screening platform to investigate the neuroprotective efficacy of natural compounds on PD. We reported that calycosin shows a protective role in preventing dopaminergic (DA) neuronal cell death in PQ-exposed Canton S flies. Calycosin-fed PQ-exposed flies exhibit significant resistance against PQ-induced mortality and locomotor deficits in terms of reduced oxidative stress, loss of DA neurons, the depletion of dopamine content, and phosphorylated JNK-caspase-3 levels. Additionally, mechanistic studies show that calycosin administration improves PQ-induced mitochondrial dysfunction and stimulates mitophagy and general autophagy with reduced pS6K and p4EBP1 levels, suggestive of a maintained energy balance between anabolic and catabolic processes, resulting in the inhibition of neuronal cell death. Collectively, this study substantiates the protective effect of calycosin against PQ-induced neurodegeneration by improving DA neurons' survival and reducing apoptosis, likely via autophagy induction, and it is implicated as a novel therapeutic application against toxin-induced PD pathogenesis.

Sleep Restriction Reduces Cognitive but Not Physical Motivation

PURPOSE

Motivation is an important driver of behaviour, and several frameworks distinguish the willingness of individuals to invest cognitive versus physical effort to achieve a goal. One outstanding question is whether sleep loss lowers motivation within specific domains of effort, or has a global effect on motivation across multiple domains. Here, we investigated the effects of sleep restriction on the motivation to invest cognitive or physical effort in return for reward.

MATERIALS AND METHODS

24 healthy young adults (11 females) completed an effort-based decision-making task over two laboratory sessions - once while sleep restricted (three consecutive nights with a three-hour sleep opportunity), and the other while fully rested (nine-hour sleep opportunity on each night). In an initial reinforcement phase, participants were trained to ceiling performance across six levels of effort on separate cognitively and physically demanding tasks. Then, in the critical decision-making phase, participants revealed their preference for how much cognitive or physical effort they would be willing to invest for reward.

RESULTS

Sleep restriction reduced the willingness to exert cognitive effort, but spared motivation in the physical domain. Furthermore, the reduction in cognitive motivation appeared to be a primary motivational deficit, which could not be attributed to differences in reward-likelihood of different levels of effort or the temporal structure of the task.

CONCLUSION

The results suggest that sleep restriction has a selective effect on cognitive over physical motivation, which has significant implications for real-world settings in which individuals must maintain high levels of cognitive motivation in the face of chronic sleep loss.

Anhedonia and Suicide

Suicide is a leading cause of death, and presently, there is no definitive clinical indicator of future suicide behaviors. Anhedonia, a transdiagnostic symptom reflecting diminished ability to experience pleasure, has recently emerged as a risk factor for suicidal thoughts and behaviors (STBs). This overview, therefore, has the following aims. First, prior research relating anhedonia to STBs will be reviewed, with a particular focus on clarifying whether anhedonia is more closely associated with suicidal thoughts versus behaviors. Second, the National Institute of Mental Health's Research Domain Criteria Positive Valence Systems provide a useful heuristic to probe anhedonia across different units of analysis, including clinical symptoms, behaviors, neural mechanisms, and molecular targets. Accordingly, anhedonia-related constructs linked to STBs will be detailed as well as promising next steps for future research. Third, although anhedonia is not directly addressed in leading suicide theories, this review will provide potential inroads to explore anhedonia within diathesis-stress and interpersonal suicide frameworks. Last, novel approaches to treat anhedonia as a means of reducing STBs will be examined.

Influences of dopaminergic system dysfunction on late-life depression

Deficits in cognition, reward processing, and motor function are clinical features relevant to both aging and depression. Individuals with late-life depression often show impairment across these domains, all of which are moderated by the functioning of dopaminergic circuits. As dopaminergic function declines with normal aging and increased inflammatory burden, the role of dopamine may be particularly salient for late-life depression. We review the literature examining the role of dopamine in the pathogenesis of depression, as well as how dopamine function changes with aging and is influenced by inflammation. Applying a Research Domain Criteria (RDoC) Initiative perspective, we then review work examining how dopaminergic signaling affects these domains, specifically focusing on Cognitive, Positive Valence, and Sensorimotor Systems. We propose a unified model incorporating the effects of aging and low-grade inflammation on dopaminergic functioning, with a resulting negative effect on cognition, reward processing, and motor function. Interplay between these systems may influence development of a depressive phenotype, with an initial deficit in one domain reinforcing decline in others. This model extends RDoC concepts into late-life depression while also providing opportunities for novel and personalized interventions.