Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, we exploited a recently developed non-invasive deep brain stimulation technique called transcranial temporal interference stimulation (tTIS) during reinforcement motor learning with concurrent neuroimaging, in a randomized, sham-controlled, double-blind study. Striatal tTIS applied at 80 Hz, but not at 20 Hz, abolished the benefits of reinforcement on motor learning. This effect was related to a selective modulation of neural activity within the striatum. Moreover, 80 Hz, but not 20 Hz, tTIS increased the neuromodulatory influence of the striatum on frontal areas involved in reinforcement motor learning. These results show that tTIS can non-invasively and selectively modulate a striatal mechanism involved in reinforcement learning, expanding our tools for the study of causal relationships between deep brain structures and human behaviour.

Motivational Modulation Enhances Movement Performance in Parkinson's Disease: A Systematic Review

Background

The assessment of motivation and its modulation during treatment are essential aspects of physical therapy practice. However, the modulation of motivation has been sparsely investigated in persons with Parkinson's disease (PD) and at present no studies have synthesized its effects on movement performance.

Objectives

4The purpose of this study was to systematically examine the efficacy of motivational modulation on movement performance in PD and to provide recommendations for its role in physical therapy practice.

Methods

Systematic identification of published literature was performed adhering to PRISMA guidelines, from January 2005 to March 2023. Keywords were used in the following electronic databases: PubMed, Academic Search Complete, the Cochrane Database, Google Scholar, and the Physiotherapy Evidence Database (PEDro). A level of evidence rating was completed according to the scale provided by the American Academy of Cerebral Palsy and Development Medicine. Quality assessments were performed using the Modified Downs and Black checklist.

Results

Eight studies were included in this review, all achieving level III evidence. The methodological quality of studies was varied, with most studies attaining a fair rating. Persons with PD performed upper extremity movement tasks with greater intensity when incentivized with larger rewards compared to smaller incentives. Dopamine replacement medication, Deep Brain Stimulation, and a history of depression, had mediating effects on the response to motivational modulation.

Conclusions

Our findings suggest that it is plausible to improve adherence to exercise when physical therapists modulate motivation through computerized game achievements, gamification of tasks, or other forms of reward and non-rewarding stimuli.

Putaminal dopamine modulates movement motivation in Parkinson's disease

The relative inability to produce effortful movements is the most specific motor sign of Parkinson's disease, which is primarily characterized by loss of dopaminergic terminals in the putamen. The motor motivation hypothesis suggests that this motor deficit may not reflect a deficiency in motor control per se, but a deficiency in cost-benefit considerations for motor effort. For the first time, we investigated the quantitative effect of dopamine depletion on the motivation of motor effort in Parkinson's disease. A total of 21 early-stage, unmedicated patients with Parkinson's disease and 26 healthy controls were included. An incentivized force task was used to capture the amount of effort participants were willing to invest for different monetary incentive levels and dopamine transporter depletion in the bilateral putamen was assessed. Our results demonstrate that patients with Parkinson's disease applied significantly less grip force than healthy controls, especially for low incentive levels. Congruously, decrease of motor effort with greater loss of putaminal dopaminergic terminals was most pronounced for low incentive levels. This signifies that putaminal dopamine is most critical to motor effort when the trade-off with the benefit is poor. Taken together, we provide direct evidence that the reduction of effortful movements in Parkinson's disease depends on motivation and that this effect is associated with putaminal dopaminergic degeneration.

Slowing of Movements in Healthy Aging as a Rational Economic Response to an Elevated Effort Landscape

Why do we move slower as we grow older? The reward circuits of the brain, which tend to invigorate movements, decline with aging, raising the possibility that reduced vigor is due to the diminishing value that our brain assigns to movements. However, as we grow older, it also becomes more effortful to make movements. Is age-related slowing principally a consequence of increased effort costs from the muscles, or reduced valuation of reward by the brain? Here, we first quantified the cost of reaching via metabolic energy expenditure in human participants (male and female), and found that older adults consumed more energy than the young at a given speed. Thus, movements are objectively more costly for older adults. Next, we observed that when reward increased, older adults, like the young, responded by initiating their movements earlier. Yet, unlike the young, they were unwilling to increase their movement speed. Was their reluctance to reach quicker for rewards due to the increased effort costs, or because they ascribed less value to the movement? Motivated by a mathematical model, we next made the young experience a component of aging by making their movements more effortful. Now the young responded to reward by reacting faster but chose not to increase their movement speed. This suggests that slower movements in older adults are partly driven by an adaptive response to an elevated effort landscape. Moving slower may be a rational economic response the brain is making to mitigate the elevated effort costs that accompany aging.

Neuroanatomy of post-stroke depression: the association between symptom clusters and lesion location

Post-stroke depression affects about 30% of stroke patients and often hampers functional recovery. The diagnosis of depression encompasses heterogeneous symptoms at emotional, motivational, cognitive, behavioural or somatic levels. Evidence indicates that depression is caused by disruption of bio-aminergic fibre tracts between prefrontal and limbic or striatal brain regions comprising different functional networks. Voxel-based lesion-symptom mapping studies reported discrepant findings regarding the association between infarct locations and depression. Inconsistencies may be due to the usage of sum scores, thereby mixing different symptoms of depression. In this cross-sectional study, we used multivariate support vector regression for lesion-symptom mapping to identify regions significantly involved in distinct depressive symptom domains and global depression. MRI lesion data were included from 200 patients with acute first-ever ischaemic stroke (mean 0.9 ± 1.5 days of post-stroke). The Montgomery-Åsberg Depression Rating interview assessed depression severity in five symptom domains encompassing motivational, emotional and cognitive symptoms deficits, anxiety and somatic symptoms and was examined 8.4 days of post-stroke (±4.3). We found that global depression severity, irrespective of individual symptom domains, was primarily linked to right hemispheric lesions in the dorsolateral prefrontal cortex and inferior frontal gyrus. In contrast, when considering distinct symptom domains individually, the analyses yielded much more sensitive results in regions where the correlations with the global depression score yielded no effects. Accordingly, motivational deficits were associated with lesions in orbitofrontal cortex, dorsolateral prefrontal cortex, pre- and post-central gyri and basal ganglia, including putamen and pallidum. Lesions affecting the dorsal thalamus, anterior insula and somatosensory cortex were significantly associated with emotional symptoms such as sadness. Damage to the dorsolateral prefrontal cortex was associated with concentration deficits, cognitive symptoms of guilt and self-reproach. Furthermore, somatic symptoms, including loss of appetite and sleep disturbances, were linked to the insula, parietal operculum and amygdala lesions. Likewise, anxiety was associated with lesions impacting the central operculum, insula and inferior frontal gyrus. Interestingly, symptoms of anxiety were exclusively left hemispheric, whereas the lesion-symptom associations of the other domains were lateralized to the right hemisphere. In conclusion, this large-scale study shows that in acute stroke patients, differential post-stroke depression symptom domains are associated with specific structural correlates. Our findings extend existing concepts on the neural underpinnings of depressive symptoms, indicating that differential lesion patterns lead to distinct depressive symptoms in the first weeks of post-stroke. These findings may facilitate the development of personalized treatments to improve post-stroke rehabilitation.

Economic and social values in the brain: evidence from lesions to the human ventromedial prefrontal cortex

Making good economic and social decisions is essential for individual and social welfare. Decades of research have provided compelling evidence that damage to the ventromedial prefrontal cortex (vmPFC) is associated with dramatic personality changes and impairments in economic and social decision-making. However, whether the vmPFC subserves a unified mechanism in the social and non-social domains remains unclear. When choosing between economic options, the vmPFC is thought to guide decision by encoding value signals that reflect the motivational relevance of the options on a common scale. A recent framework, the "extended common neural currency" hypothesis, suggests that the vmPFC may also assign values to social factors and principles, thereby guiding social decision-making. Although neural value signals have been observed in the vmPFC in both social and non-social studies, it is yet to be determined whether they have a causal influence on behavior or merely correlate with decision-making. In this review, we assess whether lesion studies of patients with vmPFC damage offer evidence for such a causal role of the vmPFC in shaping economic and social behavior.

Moving, fast and slow: behavioural insights into bradykinesia in Parkinson's disease

The debilitating symptoms of Parkinson's disease, including the hallmark slowness of movement, termed bradykinesia, were described more than 100 years ago. Despite significant advances in elucidating the genetic, molecular and neurobiological changes in Parkinson's disease, it remains conceptually unclear exactly why patients with Parkinson's disease move slowly. To address this, we summarize behavioural observations of movement slowness in Parkinson's disease and discuss these findings in a behavioural framework of optimal control. In this framework, agents optimize the time it takes to gather and harvest rewards by adapting their movement vigour according to the reward that is at stake and the effort that needs to be expended. Thus, slow movements can be favourable when the reward is deemed unappealing or the movement very costly. While reduced reward sensitivity, which makes patients less inclined to work for reward, has been reported in Parkinson's disease, this appears to be related mainly to motivational deficits (apathy) rather than bradykinesia. Increased effort sensitivity has been proposed to underlie movement slowness in Parkinson's disease. However, careful behavioural observations of bradykinesia are inconsistent with abnormal computations of effort costs due to accuracy constraints or movement energetic expenditure. These inconsistencies can be resolved when considering that a general disability to switch between stable and dynamic movement states can contribute to an abnormal composite effort cost related to movement in Parkinson's disease. This can account for paradoxical observations such as the abnormally slow relaxation of isometric contractions or difficulties in halting a movement in Parkinson's disease, both of which increase movement energy expenditure. A sound understanding of the abnormal behavioural computations mediating motor impairment in Parkinson's disease will be vital for linking them to their underlying neural dynamics in distributed brain networks and for grounding future experimental studies in well-defined behavioural frameworks.

Effort cost of reaching prompts vigor reduction in older adults

As people age, they move slower. Is age-related reduction in vigor a reflection of a reduced valuation of reward by the brain, or a consequence of increased effort costs by the muscles? Here, we quantified cost of movements objectively via the metabolic energy that young and old participants consumed during reaching and found that in order reach at a given speed, older adults expended more energy than the young. We next quantified how reward modulated movements in the same populations and found that like the young, older adults responded to increased reward by initiating their movements earlier. Yet, their movements were less sensitive to increased reward, resulting in little or no modulation of reach speed. Lastly, we quantified the effect of increased effort on how reward modulated movements in young adults. Like the effects of aging, when faced with increased effort the young adults responded to reward primarily by reacting faster, with little change in movement speed. Therefore, reaching required greater energetic expenditure in the elderly, suggesting that the slower movements and reactions exhibited in aging are partly driven by an adaptive response to an elevation in the energetic landscape of effort. That is, moving slower appears to be a rational economic consequence of aging.

Significance statement

Healthy aging coincides with a reduction in speed, or vigor, of walking, reaching, and eye movements. Here we focused on disentangling two opposing sources of aging-related movement slowing: reduced reward sensitivity due to loss of dopaminergic tone, or increased energy expenditure movements related to mitochondrial or muscular inefficiencies. Through a series of three experiments and construction of a computational model, here we demonstrate that transient changes in reaction time and movement speed together offer a quantifiable metric to differentiate between reward- and effort-based alterations in movement vigor. Further, we suggest that objective increases in the metabolic cost of moving, not reductions in reward valuation, are driving much of the movement slowing occurring alongside healthy aging.

Cerebello-basal Ganglia Networks and Cortical Network Global Efficiency

The cerebellum (CB) and basal ganglia (BG) each have topographically distinct functional subregions that are functionally and anatomically interconnected with cortical regions through discrete thalamic loops and with each other via disynaptic connections, with previous work detailing high levels of functional connectivity between these phylogenetically ancient regions. It was posited that this CB-BG network provides support for cortical systems processing, spanning cognitive, emotional, and motor domains, implying that subcortical network measures are strongly related to cortical network measures (Bostan & Strick, 2018); however, it is currently unknown how network measures within distinct CB-BG networks relate to cortical network measures. Here, 122 regions of interest comprising cognitive and motor CB-BG networks and 7 canonical cortical resting-state were used to investigate whether the integration (quantified using global efficiency, GE) of cognitive CB-BG network (CCBN) nodes and their segregation from motor CB-BG network (MCBN) nodes is related to cortical network GE and segregation in 233 non-related, right-handed participants (Human Connectome Project-1200). CCBN GE positively correlated with GE in the default mode, motor, and auditory networks and MCBN GE positively correlated with GE in all networks, except the default mode and emotional. MCBN segregation was related to motor network segregation. These findings highlight the CB-BG network's potential role in cortical networks associated with executive function, task switching, and verbal working memory. This work has implications for understanding cortical network organization and cortical-subcortical interactions in healthy adults and may help in determining biomarkers and deciphering subcortical differences seen in disease states.

Apathy in Parkinson's Disease: Clinical Patterns and Neurobiological Basis

Apathy is commonly defined as a loss of motivation leading to a reduction in goal-directed behaviors. This multidimensional syndrome, which includes cognitive, emotional and behavioral components, is one of the most prevalent neuropsychiatric features of Parkinson's disease (PD). It has been established that the prevalence of apathy increases as PD progresses. However, the pathophysiology and anatomic substrate of this syndrome remain unclear. Apathy seems to be underpinned by impaired anatomical structures that link the prefrontal cortex with the limbic system. It can be encountered in the prodromal stage of the disease and in fluctuating PD patients receiving bilateral chronic subthalamic nucleus stimulation. In these stages, apathy may be considered as a disorder of motivation that embodies amotivational behavioral syndrome, is underpinned by combined dopaminergic and serotonergic denervation and is dopa-responsive. In contrast, in advanced PD patients, apathy may be considered as cognitive apathy that announces cognitive decline and PD dementia, is underpinned by diffuse neurotransmitter system dysfunction and Lewy pathology spreading and is no longer dopa-responsive. In this review, we discuss the clinical patterns of apathy and their treatment, the neurobiological basis of apathy, the potential role of the anatomical structures involved and the pathways in motivational and cognitive apathy.

Reward network dysfunction is associated with cognitive impairment after stroke

Stroke survivors not only suffer from severe motor, speech and neurocognitive deficits, but in many cases also from a "lack of pleasure" and a reduced motivational level. Especially apathy and anhedonic symptoms can be linked to a dysfunction of the reward system. Rewards are considered as important co-factor for learning, so the question arises as to why and how this affects the rehabilitation of stroke patients. We investigated reward behaviour, learning ability and brain network connectivity in acute (3-7d) mild to moderate stroke patients (n = 28) and age-matched healthy controls (n = 26). Reward system activity was assessed using the Monetary Incentive Delay task (MID) during magnetoencephalography (MEG). Coherence analyses were used to demonstrate reward effects on brain functional network connectivity. The MID-task showed that stroke survivors had lower reward sensitivity and required greater monetary incentives to improve performance and showed deficits in learning improvement. MEG-analyses showed a reduced network connectivity in frontal and temporoparietal regions. All three effects (reduced reward sensitivity, reduced learning ability and altered cerebral connectivity) were found to be closely related and differed strongly from the healthy group. Our results reinforce the notion that acute stroke induces reward network dysfunction, leading to functional impairment of behavioural systems. These findings are representative of a general pattern in mild strokes and are independent of the specific lesion localisation. For stroke rehabilitation, these results represent an important point to identify the reduced learning capacity after stroke and to implement individualised recovery exercises accordingly.

Effort avoidance as a core mechanism of apathy in frontotemporal dementia

Apathy is a core symptom in patients with behavioural variant frontotemporal dementia (bvFTD). It is defined by the observable reduction in goal-directed behaviour, but the underlying mechanisms are poorly understood. According to decision theory, engagement in goal-directed behaviour depends on a cost-benefit optimization trading off the estimated effort (related to the behaviour) against the expected reward (related to the goal). In this framework, apathy would thus result from either a decreased appetence for reward, or from an increased aversion to effort. Here, we phenotyped the motivational state of 21 patients with bvFTD and 40 matched healthy controls using computational analyses of behavioural responses in a comprehensive series of behavioural tasks, involving both expression of preference (comparing reward value and effort cost) and optimization of performance (adjusting effort production to the reward at stake). The primary finding was an elevated aversion to effort, consistent across preference and performance tasks in patients with bvFTD compared to controls. Within the bvFTD group, effort avoidance was correlated to cortical atrophy in the dorsal anterior cingulate cortex and to apathy score measured on a clinical scale. Thus, our results highlight elevated effort aversion (not reduced reward appetence) as a core dysfunction that might generate apathy in patients with bvFTD. More broadly, they provide novel behavioural tests and computational tools to identify the dysfunctional mechanisms producing motivation deficits in patients with brain damage.

To engage or not engage: Early incentive motivation prevents symptoms of chronic post-stroke depression - A longitudinal study

BACKGROUND

Although post-stroke depression (PSD) is known to disrupt motor rehabilitation after stroke, PSD is often undertreated and its relationship with motor impairment remains poorly understood.

METHODS

In a longitudinal study design we investigated, which factors at the early post-acute stage may increase the risk for PSD symptoms. We were especially interested in whether interindividual differences in the motivational drive to engage in physically demanding tasks indicate PSD development in patients suffering from motor impairments. Accordingly, we used a monetary incentive grip force task where participants were asked to hold their grip force for high and low rewards at stake to maximize their monetary outcome. Individual grip force was normalized according to the maximal force prior to the experiment. Experimental data, depression, and motor impairment were assessed from 20 stroke patients (12 male; 7.7 ± 6.78 days post-stroke) with mild-to-moderate hand motor impairment and 24 age-matched healthy participants (12 male).

RESULTS

Both groups showed incentive motivation as indicated by stronger grip force for high versus low reward trials and the overall monetary outcome in the task. In stroke patients, severely impaired patients showed stronger incentive motivation, whereas early PSD symptoms were associated with reduced incentive motivation in the task. Larger lesions in corticostriatal tracts correlated with reduced incentive motivation. Importantly, chronic motivational deficits were preceded by initially reduced incentive motivation and larger corticostriatal lesions in the early stage post-stroke.

CONCLUSIONS

More severe motor impairment motivates reward-dependent motor engagement, whereas PSD and corticostriatal lesions potentially disturb incentive motivational behavior, thereby increasing the risk of chronic motivational PSD symptoms. Acute interventions should address motivational aspects of behavior to improve motor rehabilitation post-stroke.

Cerebellar and basal ganglia motor network predicts trait depression and hyperactivity

In the human brain, the cerebellum (CB) and basal ganglia (BG) are implicated in cognition-, emotion-, and motor-related cortical processes and are highly interconnected, both to cortical regions via separate, trans-thalamic pathways and to each other via subcortical disynaptic pathways. We previously demonstrated a distinction between cognitive and motor CB-BG networks (CCBN, MCBN, respectively) as it relates to cortical network integration in healthy young adults, suggesting the subcortical networks separately support cortical networks. The CB and BG are also implicated in the pathophysiology of schizophrenia, Parkinson's, and compulsive behavior; thus, integration within subcortical CB-BG networks may be related to transdiagnostic symptomology. Here, we asked whether CCBN or MCBN integration predicted Achenbach Self-Report scores for anxiety, depression, intrusive thoughts, hyperactivity and inactivity, and cognitive performance in a community sample of young adults. We computed global efficiency for each CB-BG network and 7 canonical resting-state networks for all right-handed participants in the Human Connectome Project 1200 release with a complete set of preprocessed resting-state functional MRI data (N = 783). We used multivariate regression to control for substance abuse and age, and permutation testing with exchangeability blocks to control for family relationships. MCBN integration negatively predicted depression and hyperactivity, and positively predicted cortical network integration. CCBN integration predicted cortical network integration (except for the emotional network) and marginally predicted a positive relationship with hyperactivity, indicating a potential dichotomy between cognitive and motor CB-BG networks and hyperactivity. These results highlight the importance of CB-BG interactions as they relate to motivation and symptoms of depression.

Apathy in Parkinson's Disease: Defining the Park Apathy Subtype

Apathy is a neurobehavioural symptom affecting Parkinson's disease patients of all disease stages. Apathy seems to be associated with a specific underlying non-motor disease subtype and reflects dysfunction of separate neural networks with distinct neurotransmitter systems. Due to the complicated neuropsychiatric aetiology of apathy, clinical assessment of this invalidating non-motor symptom remains challenging. We aim to summarize the current findings on apathy in Parkinson's disease and highlight knowledge gaps. We will discuss the prevalence rates across the different disease stages and suggest screening tools for clinically relevant apathetic symptoms. We will approach the fundamental knowledge on the neural networks implicated in apathy in a practical manner and formulate recommendations on patient-tailored treatment. We will discuss the Park apathy phenotype in detail, shedding light on different clinical manifestations and implications for prognosis. With this review, we strive to distil the vast available theoretical knowledge into a clinical and patient-oriented perspective.

Functional connectivity correlates of reduced goal-directed behaviors in behavioural variant frontotemporal dementia

We explored the resting state functional connectivity correlates of apathy assessed as a multidimensional construct, using behavioral metrics, in behavioral variant frontotemporal dementia (bvFTD). We recorded the behavior of 20 bvFTD patients and 16 healthy controls in a close-to-real-life situation including a free phase (FP-in which actions were self-initiated) and a guided phase (GP-in which initiation of actions was facilitated by external guidance). We investigated the activity time and walking episode features as quantifiers of apathy. We used the means ((FP + GP)/2) and the differences (FP-GP) calculated for these metrics as well as measures by questionnaires to extract apathy dimensions by factor analysis. We assessed two types of fMRI-based resting state connectivity measures (local activity and seed-based connectivity) and explored their relationship with extracted apathy dimensions. Apathy in bvFTD was associated with lower time spent in activity combined with walking episodes of higher frequency, lower acceleration and higher duration. Using these behavioral metrics and apathy measures by questionnaires, we disentangled two dimensions: the global reduction of goal-directed behaviors and the specific deficit of self-initiation. Global apathy was associated with lower resting state activity within prefrontal cortex and lower connectivity of salience network hubs while the decrease in self-initiation was related to increased connectivity of parietal default-mode network hubs. Through a novel dimensional approach, we dissociated the functional connectivity correlates of global apathy and self-initiation deficit. We discussed in particular the role of the modified connectivity of lateral parietal cortex in the volitional process.

Identifying control ensembles for information processing within the cortico-basal ganglia-thalamic circuit

In situations featuring uncertainty about action-reward contingencies, mammals can flexibly adopt strategies for decision-making that are tuned in response to environmental changes. Although the cortico-basal ganglia thalamic (CBGT) network has been identified as contributing to the decision-making process, it features a complex synaptic architecture, comprised of multiple feed-forward, reciprocal, and feedback pathways, that complicate efforts to elucidate the roles of specific CBGT populations in the process by which evidence is accumulated and influences behavior. In this paper we apply a strategic sampling approach, based on Latin hypercube sampling, to explore how variations in CBGT network properties, including subpopulation firing rates and synaptic weights, map to variability of parameters in a normative drift diffusion model (DDM), representing algorithmic aspects of information processing during decision-making. Through the application of canonical correlation analysis, we find that this relationship can be characterized in terms of three low-dimensional control ensembles within the CBGT network that impact specific qualities of the emergent decision policy: responsiveness (a measure of how quickly evidence evaluation gets underway, associated with overall activity in corticothalamic and direct pathways), pliancy (a measure of the standard of evidence needed to commit to a decision, associated largely with overall activity in components of the indirect pathway of the basal ganglia), and choice (a measure of commitment toward one available option, associated with differences in direct and indirect pathways across action channels). These analyses provide mechanistic predictions about the roles of specific CBGT network elements in tuning the way that information is accumulated and translated into decision-related behavior.

Reaching and Grasping Movements in Parkinson's Disease: A Review

Parkinson's disease (PD) is known to affect the brain motor circuits involving the basal ganglia (BG) and to induce, among other signs, general slowness and paucity of movements. In upper limb movements, PD patients show a systematic prolongation of movement duration while maintaining a sufficient level of endpoint accuracy. PD appears to cause impairments not only in movement execution, but also in movement initiation and planning, as revealed by abnormal preparatory activity of motor-related brain areas. Grasping movement is affected as well, particularly in the coordination of the hand aperture with the transport phase. In the last fifty years, numerous behavioral studies attempted to clarify the mechanisms underlying these anomalies, speculating on the plausible role that the BG-thalamo-cortical circuitry may play in normal and pathological motor control. Still, many questions remain open, especially concerning the management of the speed-accuracy tradeoff and the online feedback control. In this review, we summarize the literature results on reaching and grasping in parkinsonian patients. We analyze the relevant hypotheses on the origins of dysfunction, by focusing on the motor control aspects involved in the different movement phases and the corresponding role played by the BG. We conclude with an insight into the innovative stimulation techniques and computational models recently proposed, which might be helpful in further clarifying the mechanisms through which PD affects reaching and grasping movements.

Dopamine D3 Receptors: A Potential Target to Treat Motivational Deficits in Parkinson's Disease

Parkinson's disease (PD), which is traditionally viewed as a motor disorder involving the degeneration of dopaminergic (DA) neurons, has recently been identified as a quintessential neuropsychiatric condition. Indeed, a plethora of non-motor symptoms may occur in PD, including apathy. Apathy can be defined as a lack of motivation or a deficit of goal-directed behaviors and results in a pathological decrease of self-initiated voluntary behavior. Apathy in PD appears to fluctuate with the DA state of the patients, suggesting a critical role of DA neurotransmission in the pathophysiology of this neuropsychiatric syndrome. Using a lesion-based approach, we developed a rodent model which exhibits specific alteration in the preparatory component of motivational processes, reminiscent to apathy in PD. We found a selective decrease of DA D₃ receptors (D₃R) expression in the dorsal striatum of lesioned rats. Next, we showed that inhibition of D₃R neurotransmission in non-lesioned animals was sufficient to reproduce the motivational deficit observed in our model. Interestingly, we also found that pharmacologically targeting D₃R efficiently reversed the motivational deficit induced by the lesion. Our findings, among other recent data, suggest a critical role of D₃R in parkinsonian apathy and highlight this receptor as a promising target for treating motivational deficits.

Using metabolic energy to quantify the subjective value of physical effort

Economists have known for centuries that to understand an individual's decisions, we must consider not only the objective value of the goal at stake, but its subjective value as well. However, achieving that goal ultimately requires expenditure of effort. Surprisingly, despite the ubiquitous role of effort in decision-making and movement, we currently do not understand how effort is subjectively valued in daily movements. Part of the difficulty arises from the lack of an objective measure of effort. Here, we use a physiological approach to address this knowledge gap. We quantified objective effort costs by measuring metabolic cost via expired gas analysis as participants performed a reaching task against increasing resistance. We then used neuroeconomic methods to quantify each individual's subjective valuation of effort. Rather than the diminishing sensitivity observed in reward valuation, effort was valued objectively, on average. This is significantly less than the near-quadratic sensitivity to effort observed previously in force-based motor tasks. Moreover, there was significant inter-individual variability with many participants undervaluing or overvaluing effort. These findings demonstrate that in contrast with monetary decisions in which subjective value exhibits diminishing marginal returns, effort costs are valued more objectively in low-effort reaching movements common in daily life.

Interactive effects of incentive value and valence on the performance of discrete action sequences

Incentives can be used to increase motivation, leading to better learning and performance on skilled motor tasks. Prior work has shown that monetary punishments enhance on-line performance while equivalent monetary rewards enhance off-line skill retention. However, a large body of literature on loss aversion has shown that losses are treated as larger than equivalent gains. The divergence between the effects of punishments and reward on motor learning could be due to perceived differences in incentive value rather than valence per se. We test this hypothesis by manipulating incentive value and valence while participants trained to perform motor sequences. Consistent with our hypothesis, we found that large reward enhanced on-line performance but impaired the ability to retain the level of performance achieved during training. However, we also found that on-line performance was better with reward than punishment and that the effect of increasing incentive value was more linear with reward (small, medium, large) while the effect of value was more binary with punishment (large vs not large). These results suggest that there are differential effects of punishment and reward on motor learning and that these effects of valence are unlikely to be driven by differences in the subjective magnitude of gains and losses.

Dissociable Motivational Deficits in Pre-manifest Huntington's Disease

Motivation is characterized by a willingness to overcome both cognitive and physical effort costs. Impairments in motivation are common in striatal disorders, such as Huntington’s disease (HD), but whether these impairments are isolated to particular domains of behavior is controversial. We ask whether HD differentially affects the willingness of individuals to overcome cognitive versus physical effort. We tested 20 individuals with pre-manifest HD and compared their behavior to 20 controls. Across separate trials, participants made choices about how much cognitive or physical effort they were willing to invest for reward. Our key results were that individuals with pre-manifest HD were less willing than controls to invest cognitive effort but were no different in their overall preference for physical effort. These results cannot be explained by group differences in neuropsychological or psychiatric profiles. This dissociation of cognitive- and physical-effort-based decisions provides important evidence for separable, domain-specific mechanisms of motivation.

We examine cognitive and physical effort discounting in pre-manifest HD

Individuals with pre-manifest HD are less cognitively motivated than controls

There are no differences in physical motivation between the two groups

This dissociation is not confounded by neuropsychological or psychiatric factors

Resting EEG Asymmetry Markers of Multiple Facets of the Behavioral Approach System: A LORETA Analysis

Previously published models of frontal activity linked high relative left frontal activity to the behavioral approach system (BAS) and impulsivity. Additionally, these models did not account for BAS facets encompassing the anticipation of reward, i.e., goal-driven persistence (BAS–GDP) and reward interest (BAS–RI), from those that deal with the actual hedonic experience of reward, i.e., reward reactivity (BAS–RR) and impulsivity (BAS–I). Using resting electroencephalographic (EEG) recordings, the source localization (LORETA) method allowed us to calculate the hemispheric asymmetry of the current density within the alpha band (7.5–13 Hz) in ten regions of interest. Compared to low BAS subtrait scorers, high BAS subtrait scorers (except for BAS–I) were correlated with greater relative left-sided activity in the superior frontal gyrus (BA10). Further, an isolated effective coherence (iCOH) analysis of the beta activity (21 Hz) disclosed that high impulsive scorers as compared to low impulsive ones had higher connectivity between the superior frontal gyrus and middle temporal gyrus, which was not compensated for by enhanced inhibitory alpha (11 Hz) connectivity between these regions. For the beta frequency, we also found in highly impulsive individuals that (i) both left and right middle temporal lobes directly influenced the activity of the left and right superior frontal lobes, and (ii) a clear decoupling between left and right superior frontal lobes. These findings could indicate reduced control by the supervisory system in more impulsive individuals.

Neuroanatomical Abnormalities in Older Depressed Adults With Apathy: A Systematic Review

OBJECTIVE

Apathy is a common phenomenon in late-life depression and is associated with poor outcomes. Apathy is often unrecognized in older depressed adults, and efficacious treatment options are lacking. This review provides a systematic review of the neuroanatomical abnormalities associated with apathy in late-life depression. In addition, the review summarizes the neuroimaging findings from studies of neurodegenerative and focal brain injury conditions that frequently present with apathy. The goal is to elucidate cerebral network abnormalities that give rise to apathy in older adults with mood disturbances and to inform future treatment targets.

METHOD

Systematic literature review.

RESULTS

The few studies that have directly examined the neuroanatomical abnormalities of apathy in late-life depression suggest disturbances in the anterior cingulate cortex, insula, orbital and dorsal prefrontal cortex, striatum, and limbic structures (ie, amygdala, thalamus, and hippocampus). Studies examining the neuroanatomical correlates of apathy in other aging populations are consistent with the pattern observed in late-life depression.

CONCLUSIONS

Apathy in late-life depression appears to be accompanied by neuroanatomical abnormalities in the salience and reward networks. These network findings are consistent with that observed in individuals presenting with apathy in other aging-related conditions. These findings may inform future treatments that target apathy.

Acetylcholine acts on songbird premotor circuitry to invigorate vocal output

Acetylcholine is well-understood to enhance cortical sensory responses and perceptual sensitivity in aroused or attentive states. Yet little is known about cholinergic influences on motor cortical regions. Here we use the quantifiable nature of birdsong to investigate how acetylcholine modulates the cortical (pallial) premotor nucleus HVC and shapes vocal output. We found that dialyzing the cholinergic agonist carbachol into HVC increased the pitch, amplitude, tempo and stereotypy of song, similar to the natural invigoration of song that occurs when males direct their songs to females. These carbachol-induced effects were associated with increased neural activity in HVC and occurred independently of basal ganglia circuitry. Moreover, we discovered that the normal invigoration of female-directed song was also accompanied by increased HVC activity and was attenuated by blocking muscarinic acetylcholine receptors. These results indicate that, analogous to its influence on sensory systems, acetylcholine can act directly on cortical premotor circuitry to adaptively shape behavior.

Modeling Dynamic Allocation of Effort in a Sequential Task Using Discounting Models

Most rewards in our lives require effort to obtain them. It is known that effort is seen by humans as carrying an intrinsic disutility which devalues the obtainable reward. Established models for effort discounting account for this by using participant-specific discounting parameters inferred from experiments. These parameters offer only a static glance into the bigger picture of effort exertion. The mechanism underlying the dynamic changes in a participant's willingness to exert effort is still unclear and an active topic of research. Here, we modeled dynamic effort exertion as a consequence of effort- and probability-discounting mechanisms during goal reaching, sequential behavior. To do this, we developed a novel sequential decision-making task in which participants made binary choices to reach a minimum number of points. Importantly, the time points and circumstances of effort allocation were decided by participants according to their own preferences and not imposed directly by the task. Using the computational model to analyze participants' choices, we show that the dynamics of effort exertion arise from a combination of changing task needs and forward planning. In other words, the interplay between a participant's inferred discounting parameters is sufficient to explain the dynamic allocation of effort during goal reaching. Using formal model comparison, we also inferred the forward-planning strategy used by participants. The model allowed us to characterize a participant's effort exertion in terms of only a few parameters. Moreover, the model can be adapted to a number of tasks used in establishing the neural underpinnings of forward-planning behavior and meta-control, allowing for the characterization of behavior in terms of model parameters.

Neurobehavioral Initiation and Motivation Problems After Acquired Brain Injury

Motivation is a primary and permanent source of human behavior and adaptation. Motivational deficits, along with deficiencies in initiation, frequently occur in individuals with acquired brain injury (ABI). These neurobehavioral problems are associated with consequences at the participation level: patients are reluctant to engage in rehabilitation, and their subsequent social reintegration is often at risk. The same problems may also become a heavy burden for the families of individuals with ABI. In the present paper, we will critically review both the current definitions and the instruments used to measure motivational disorders following ABI. We will also describe the neural system underlying motivation and its impairments. What emerges is the need to develop specific rehabilitative treatments, still absent at the moment, with the ultimate aim of ensuring a better quality of life for both the patients and their proxies.

Dopamine restores cognitive motivation in Parkinson's disease

Disorders of motivation, such as apathy, are common in Parkinson's disease, and a key feature of such disorders is a greater aversion to effort. In humans, the experience of cognitive effort is ubiquitous, and cognitive apathy has traditionally been considered distinct and separable from other subtypes. Surprisingly, however, the neurobiology of cognitive motivation is poorly understood. In particular, although dopamine has a well-characterized role in incentivizing physically effortful behaviour, a critical, unresolved issue is whether its facilitatory role generalizes to other domains. Here, we asked how dopamine modulates the willingness of patients with Parkinson's disease to invest cognitive effort in return for reward. We tested 20 patients with idiopathic Parkinson's disease across two counterbalanced sessions-ON and OFF their usual dopaminergic medication-and compared their performance to 20 healthy age-matched controls. We applied a novel task in which we manipulated cognitive effort as the number of rapid serial visual presentation streams to which participants had to attend. After training participants to ceiling performance, we then asked them to choose between a low-effort/low-reward baseline option, and a higher-effort/higher-reward offer. Computational models of choice behaviour revealed four key results. First, patients OFF medication were significantly less cognitively motivated than controls, as manifest by steeper cognitive effort discounting functions in the former group. Second, dopaminergic therapy improved this deficit, such that choices in patients ON medication were indistinguishable from controls. Third, differences in motivation were also accompanied by independent changes in the stochasticity of individuals' decisions, such that dopamine reduced the variability in choice behaviour. Finally, choices on our task correlated uniquely with the subscale of the Dimensional Apathy Scale that specifically indexes cognitive motivation, which suggests a close relationship between our laboratory measure of cognitive effort discounting and subjective reports of day-to-day cognitive apathy. Importantly, participants' choices were not confounded by temporal discounting, probability discounting, physical demand, or varying task performance. These results are the first to reveal the central role of dopamine in overcoming cognitive effort costs. They provide an insight into the computational mechanisms underlying cognitive apathy in Parkinson's disease, and demonstrate its amenability to dopaminergic therapy. More broadly, they offer important empirical support for prominent frameworks proposing a domain-general role for dopamine in value-based decision-making, and provide a critical link between dopamine and multidimensional theories of apathy.

Reward sensitivity predicts dopaminergic response in spatial neglect

It has recently been revealed that spatial neglect can be modulated by motivational factors including anticipated monetary reward. A number of dopaminergic agents have been evaluated as treatments for neglect, but the results have been mixed, with no clear anatomical or cognitive predictors of dopaminergic responsiveness. Given that the effects of incentive motivation are mediated by dopaminergic pathways that are variably damaged in stroke, we tested the hypothesis that the modulatory influences of reward and dopaminergic drugs on neglect are themselves related. We employed a single-dose, double-blind, crossover design to compare the effects of Co-careldopa and placebo on a modified visual cancellation task in patients with neglect secondary to right hemisphere stroke. Whilst confirming that reward improved visual search in this group, we showed that dopaminergic stimulation only enhances visual search in the absence of reward. When patients were divided into REWARD-RESPONDERs and REWARD-NON-RESPONDERs, we found an interaction, such that only REWARD-NON-RESPONDERs showed a positive response to reward after receiving Co-careldopa, whereas REWARD-RESPONDERs were not influenced by drug. At a neuroanatomical level, responsiveness to incentive motivation was most associated with intact dorsal striatum. These findings suggest that dopaminergic modulation of neglect follows an 'inverted U' function, is dependent on integrity of the reward system, and can be measured as a behavioural response to anticipated reward.

Activity in the dorsal ACC causes deterioration of sequential motor performance due to anxiety

Performance anxiety can profoundly affect motor performance, even in experts such as professional athletes and musicians. Previously, the neural mechanisms underlying anxiety-induced performance deterioration have predominantly been investigated for individual one-shot actions. Sports and music, however, are characterized by action sequences, where many individual actions are assembled to develop a performance. Here, utilizing a novel differential sequential motor learning paradigm, we first show that performance at the junctions between pre-learnt action sequences is particularly prone to anxiety. Next, utilizing functional magnetic resonance imaging (fMRI), we reveal that performance deterioration at the junctions is parametrically correlated with activity in the dorsal anterior cingulate cortex (dACC). Finally, we show that 1 Hz repetitive transcranial magnetic stimulation of the dACC attenuates the performance deterioration at the junctions. These results demonstrate causality between dACC activity and impairment of sequential motor performance due to anxiety, and suggest new intervention techniques against the deterioration.

Effort Allocation in Children With ADHD: Abnormal Decision-Making or Poor Execution?

Objective: Effort allocation is a multi-faceted process driving both the decision to choose a high effort-high reward alternative over a low effort-low reward alternative, and the execution of this decision by recruiting sufficient effort. The objectives of our study were to examine whether children with ADHD would (a) show different reward-effort cost trade-off, and (b) have difficulty executing their decision. Method: 50 children, aged 9 to 15, with and without ADHD, had to choose between high effort-high reward and low effort-low reward alternatives using a handheld dynamometer and to execute their choice. Results: Children with ADHD and controls made similar number of high-effort choices (p = .806). However, children with ADHD executed their high-effort choices less frequently compared with controls (p = .029). Conclusion: These findings suggest that children with ADHD are not characterized by different effort-reward trade-off but rather by difficulties in recruiting effort for their preferences implementation.

Exploration Deficits Under Ecological Conditions as a Marker of Apathy in Frontotemporal Dementia

Apathy is one of the six clinical criteria for the behavioral variant of frontotemporal dementia (bvFTD), and it is almost universal in this disease. Although its consequences in everyday life are debilitating, its underlying mechanisms are poorly known, its assessment is biased by subjectivity and its care management is very limited. In this context, we have developed "ECOCAPTURE," a method aimed at providing quantifiable and objective signature(s) of apathy in order to assess it and identify its precise underlying mechanisms. ECOCAPTURE consists of the observation and recording of the patient's behavior when the participant is being submitted to a multiple-phase scenario reproducing a brief real-life situation. It is performed in a functional exploration platform transformed into a fully furnished waiting room equipped with a video and sensor-based data acquisition system. This multimodal method allowed video-based behavior analyses according to predefined behavioral categories (exploration behavior, sustained activities or inactivity) and actigraphy analyses from a 3D accelerometer. The data obtained were also correlated with behavioral/cognitive tests and scales assessing global cognitive efficiency, apathy, cognitive disinhibition, frontal syndrome, depression and anxiety. Here, bvFTD patients (n = 14) were compared to healthy participants (n = 14) during the very first minutes of the scenario, when the participants discovered the room and were encouraged to explore it. We showed that, in the context of facing a new environment, healthy participants first explored it and then engaged in sustained activities. By contrast, bvFTD patients were mostly inactive and eventually explored this new place, but in a more irregular and less efficient mode than normal subjects. This exploration deficit was correlated with apathy, disinhibition and cognitive and behavioral dysexecutive syndromes. These findings led us to discuss the presumed underlying mechanisms responsible for the exploration deficit (an inability to self-initiate actions, to integrate reward valuation and to inhibit involuntary behavior). Altogether, these results pave the way for simple and objective assessment of behavioral changes that represents a critical step for the evaluation of disease progression and efficacy of treatment in bvFTD.

Altered EEG alpha and theta oscillations characterize apathy in Parkinson's disease during incentivized movement

Apathy is a common non-motor symptom of Parkinson's disease (PD) that is difficult to quantify and poorly understood. Some studies have used incentivized motor tasks to assess apathy, as the condition is often associated with a reduction in motivated behavior. Normally event-related desynchronization, a reduction of power in specific frequency bands, is observed in the motor cortex during the peri-movement period. Also, alpha (8–12 Hz) and theta (4–7 Hz) oscillations are sensitive to rewards that are closely related to motivational states however these oscillations have not been widely investigated in relation to apathy in PD. Using EEG recordings, we investigated the neural oscillatory characteristics of apathy in PD during an incentivized motor task with interleaved rest periods. Apathetic and non-apathetic PD subjects on dopaminergic medication and healthy control subjects were instructed to squeeze a hand grip device for a monetary reward proportional to the subject's grip force and the monetary value attributed to that trial. Apathetic PD subjects exhibited higher alpha and theta powers in the pre-trial baseline rest period compared to non-apathetic PD subjects and healthy subjects. Further, we found that both resting power and relative power in alpha and theta bands during incentivized movement predicted PD subjects' apathy scores. Our results suggest that apathetic PD patients may need to overcome greater baseline alpha and theta oscillatory activity in order to facilitate incentivized movement. Clinically, resting alpha and theta power as well as alpha and theta event-related desynchronization during movement may serve as potential neural markers for apathy severity in PD.

•

Apathetic patients with Parkinson's disease on dopaminergic medication have distinct neural oscillatory characteristics.

•

Apathetic patients exhibit a higher resting EEG theta and alpha power compared to non-apathetic patients.

•

Both resting power and relative event-related theta and alpha desynchronization during squeezing are able to predict patient apathy scores.

Why not try harder? Computational approach to motivation deficits in neuro-psychiatric diseases

Motivation deficits, such as apathy, are pervasive in both neurological and psychiatric diseases. Even when they are not the core symptom, they reduce quality of life, compromise functional outcome and increase the burden for caregivers. They are currently assessed with clinical scales that do not give any mechanistic insight susceptible to guide therapeutic intervention. Here, we present another approach that consists of phenotyping the behaviour of patients in motivation tests, using computational models. These formal models impose a precise and operational definition of motivation that is embedded in decision theory. Motivation can be defined as the function that orients and activates the behaviour according to two attributes: a content (the goal) and a quantity (the goal value). Decision theory offers a way to quantify motivation, as the cost that patients would accept to endure in order to get the benefit of achieving their goal. We then review basic and clinical studies that have investigated the trade-off between the expected cost entailed by potential actions and the expected benefit associated with potential rewards. These studies have shown that the trade-off between effort and reward involves specific cortical, subcortical and neuromodulatory systems, such that it may be shifted in particular clinical conditions, and reinstated by appropriate treatments. Finally, we emphasize the promises of computational phenotyping for clinical purposes. Ideally, there would be a one-to-one mapping between specific neural components and distinct computational variables and processes of the decision model. Thus, fitting computational models to patients' behaviour would allow inferring of the dysfunctional mechanism in both cognitive terms (e.g. hyposensitivity to reward) and neural terms (e.g. lack of dopamine). This computational approach may therefore not only give insight into the motivation deficit but also help personalize treatment.

A Pavlovian account for paradoxical effects of motivation on controlling response vigour

In high stakes situations, people sometimes choke under pressure, performing below their abilities. Here, we suggest a novel mechanism to account for this paradoxical effect of motivation: the automatic adjustment of action vigour to potential reward. Although adaptive on average, this mechanism may impede fine motor control. Such detrimental effect was observed in three studies (n = 74 in total), using behavioural tasks where payoff depended on the precision of handgrip squeezing or golf putting. Participants produced more force for higher incentives, which aggravated their systematic overshooting of low-force targets. This reward bias was specific to action vigour, as reward did not alter action timing, direction or variability across trials. Although participants could report their reward bias, they somehow failed to limit their produced force. Such an automatic link between incentive and force level might correspond to a Pavlovian response that is counterproductive when action vigour is not instrumental for maximizing reward.

Reward systems and cognitions in Major Depressive Disorder

A lack of motivation and anhedonia represent frequent and pervasive symptoms in depression, although with poor specificity. Historically described as a response bias, reward-related impairments in depression may account for the important aspects of the cognitive impairments associated with diagnosis of major depressive disorder. Reward processing is a broad psychological construct that can be parsed into 3 distinct components known as "reinforcement learning" (learning), "reward responsiveness" (liking), and "motivation to obtain a reward" (wanting). Depressed patients respond hyposensitively to reward and maladaptively to punishment: this pattern is related to a dysfunction in the frontostriatal systems modulated by the monoamine systems; seems to be observed in medicated and unmedicated patients with depression and in healthy individuals with high levels of anhedonia; and could be observed in patients with a history of depression, even when in full remission. Considered to be cognitive impairments, reward-related-impairments may also constitute part of an underlying neurobiological vulnerability to major depressive disorder (MDD). For example, the reward-related impairment is state dependent and, more or less, correlated with symptom severity in some studies but has also been proposed as being trait like, with endophenotype characteristics, possibly contributing to the persistence of the disease or treatment resistance. The 3 core aspects of reward processing have specific neurobiological correlates that involve the ventral and dorsal striatum, lateral habenula, ventral tegmental area, orbitofrontal cortex, anterior cingulate cortex, and ventromedial and dorsolateral prefrontal cortex. These structures underline the important role of the dopaminergic mesolimbic pathway, but glutamate and serotonin could also have an important role, at least in some aspects of reward-related impairments.

Fronto-Subcortical Circuits for Cognition and Motivation: Dissociated Recovery in a Case of Loss of Psychic Self-Activation

In humans and non-humans primates, extensive evidence supports the existence of subcortico-cortical circuits for cognition and behavior. Lesions studies are critical to understand the clinical significance of these functionally segregated circuits. Mapping these circuits from lesion studies is difficult given the heterogeneous etiology of the lesions, the lack of long-term and systematic testing of cognitive and behavioral disturbances, as well as the scarcity of neuroimaging data for identifying the precise location and extent of subcortical lesions. Here, we report the long-term follow-up study of a patient who developed a loss of psychic self-activation associated to a dysexecutive syndrome following resuscitation from cardiac arrest. Neuroimaging revealed extensive bilateral lesions in the putamen, with a relative spare of the caudate, and exhibiting a dorsoventral gradient that was predominantly rostrally to the anterior commissure and spared most of the ventral striatum. In comprehensive neuropsychological and neuropsychiatric assessments, we observed dissociation between the improvement of the self-activation deficits and the stability of the dysexecutive syndrome. The pattern of recovery after this lesion lends support to current models proposing the existence of two main subcortico-cortical circuits: a dorsal circuit, mostly mediating cognitive processes, and a ventral circuit, implicated in motivation.

What Is the Relationship between Dopamine and Effort?

The trade-off between reward and effort is at the heart of most behavioral theories, from ecology to economics. Compared to reward, however, effort remains poorly understood, both at the behavioral and neurophysiological levels. This is important because unwillingness to overcome effort to gain reward is a common feature of many neuropsychiatric and neurological disorders. A recent surge in interest in the neurobiological basis of effort has led to seemingly conflicting results regarding the role of dopamine. We argue here that, upon closer examination, there is actually striking consensus across studies: dopamine primarily codes for future reward but is less sensitive to anticipated effort cost. This strong association between dopamine and the incentive effects of rewards places dopamine in a key position to promote reward-directed action.

The neuroanatomical and neurochemical basis of apathy and impulsivity in frontotemporal lobar degeneration

Apathy and impulsivity are common and often coexistent consequences of frontotemporal lobar degeneration (FTLD). They increase patient morbidity and carer distress, but remain under-estimated and poorly treated. Recent trans-diagnostic approaches that span the spectrum of clinical presentations of FTLD and parkinsonism, indicate that apathy and impulsivity can be fractionated into multiple neuroanatomical and pharmacological systems. These include ventral/dorsal fronto-striatal circuits for reward-sensitivity, response-inhibition, and decision-making; moderated by noradrenaline, dopamine, and serotonin. Improved assessment tools, formal models of cognition and behavior, combined with brain imaging and psycho-pharmacology, are creating new therapeutic targets and establishing principles for stratification in future clinical trials.

Current perspectives on incentive salience and applications to clinical disorders

Affective neuroscience research has revealed that reward contains separable components of 'liking', 'wanting', and learning. Here we focus on current 'liking' and 'wanting' findings and applications to clinical disorders. 'Liking' is the hedonic impact derived from a pleasant experience, and is amplified by opioid and related signals in discrete sites located in limbic-related brain areas. 'Wanting' refers to incentive salience, a motivation process for reward, and is mediated by larger systems involving mesocorticolimbic dopamine. Deficits in incentive salience may contribute to avolitional features of depression and related disorders, whereas deficits in hedonic impact may produce true anhedonia. Excesses in incentive salience, on the other hand, can lead to addiction, especially when narrowly focused on a particular target. Finally, a fearful form of motivational salience may even contribute to some paranoia symptoms of schizophrenia and related disorders.

Dynamic Encoding of Effort and Reward throughout the Execution of Action by External Globus Pallidus Neurons in Monkeys

Humans and animals must evaluate the costs and expected benefits of their actions to make adaptive choices. Prior studies have demonstrated the involvement of the basal ganglia in this evaluation. However, little is known about the role of the external part of the globus pallidus (GPe), which is well positioned to integrate motor and reward-related information, in this process. To investigate this role, the activity of 126 neurons was recorded in the associative and limbic parts of the GPe of two monkeys performing a behavioral task in which different levels of force were required to obtain different amounts of liquid reward. The results first revealed that the activity of associative and limbic GPe neurons could be modulated not only by cognitive and limbic but also motor information at the same time, both during a single period or during different periods throughout the trial, mainly in an independent way. Moreover, as a population, GPe neurons encoded these types of information dynamically throughout the trial, when each piece of information was the most relevant for the achievement of the action. Taken together, these results suggest that GPe neurons could be dedicated to the parallel monitoring of task parameters essential to adjusting and maintaining goal-directed behavior.

Distinct effects of apathy and dopamine on effort-based decision-making in Parkinson's disease

Effort-based decision-making is a cognitive process crucial to normal motivated behaviour. Apathy is a common and disabling complication of Parkinson's disease, but its aetiology remains unclear. Intriguingly, the neural substrates associated with apathy also subserve effort-based decision-making in animal models and humans. Furthermore, the dopaminergic system plays a core role in motivating effortful behaviour for reward, and its dysfunction has been proposed to play a crucial role in the aetiology of apathy in Parkinson's disease. We hypothesized that disrupted effort-based decision-making underlies the syndrome of apathy in Parkinson's disease, and that this disruption may be modulated by the dopaminergic system. An effort-based decision-making task was administered to 39 patients with Parkinson's disease, with and without clinical apathy, ON and OFF their normal dopaminergic medications across two separate sessions, as well as 32 healthy age- and gender-matched controls. On a trial-by-trial basis, participants decided whether to accept or reject offers of monetary reward in return for exerting different levels of physical effort via handheld, individually calibrated dynamometers. Effort and reward were manipulated independently, such that offers spanned the full range of effort/reward combinations. Apathy was assessed using the Lille apathy rating scale. Motor effects of the dopamine manipulation were assessed using the Unified Parkinson's Disease Rating Scale part three motor score. The primary outcome variable was choice (accept/decline offer) analysed using a hierarchical generalized linear mixed effects model, and the vigour of squeeze (Newtons exerted above required force). Both apathy and dopamine depletion were associated with reduced acceptance of offers. However, these effects were driven by dissociable patterns of responding. While apathy was characterized by increased rejection of predominantly low reward offers, dopamine increased responding to high effort, high reward offers, irrespective of underlying motivational state. Dopamine also exerted a main effect on motor vigour, increasing force production independently of reward offered, while apathy did not affect this measure. The findings demonstrate that disrupted effort-based decision-making underlies Parkinson's disease apathy, but in a manner distinct to that caused by dopamine depletion. Apathy is associated with reduced incentivization by the rewarding outcomes of actions. In contrast, dopamine has a general effect in motivating behaviour for high effort, high reward options without altering the response pattern that characterizes the apathetic state. Thus, the motivational deficit observed in Parkinson's disease appears not to be simply secondary to dopaminergic depletion of mesocorticolimbic pathways, suggesting non-dopaminergic therapeutic strategies for apathy may be important future targets.

Functional connectivity of the ventral tegmental area and avolition in subjects with schizophrenia: a resting state functional MRI study

Avolition, a deficit in goal-directed behavior, is a key aspect of negative symptoms. It is highly prevalent in schizophrenia and is associated to poor functional outcome and to measures of real life motivation, indicating that central to the concept is the lack of interest and motivation. In this study we tested the hypothesis that avolition is related to altered connectivity within dopaminergic cortico-striatal circuits involved in motivation processes. Since dopamine input to these circuits derives mostly from the ventro-tegmental area (VTA), we investigated the relationships between the resting-state functional connectivity (RS-FC) of the VTA and avolition in twenty-six subjects with schizophrenia (SCZ), treated with second-generation antipsychotics only, compared to twenty-two healthy controls (HC). SCZ, in comparison to HC, showed significantly reduced RS-FC of the VTA with bilateral ventro-lateral prefrontal cortex (VLPFC), bilateral insular cortex (IC) and right (R) lateral occipital complex (LOC) and increased RS-FC of the VTA with bilateral dorso-lateral prefrontal cortex (DLPFC). Significant negative correlations were found between avolition and RS-FC of the VTA with the bilateral IC, R VLPFC and R LOC. According to our findings, avolition is linked to a disconnectivity of the VTA from several key cortical regions involved in the integration of value information with action selection. These findings are in line with translational animal models of "auto-activation apathy".

Associating resting-state connectivity with trait impulsivity

Psychometric research has identified stable traits that predict inter-individual differences in appetitive motivation and approach behavior. Behavioral Inhibition System/Behavioral Activation System (BIS/BAS) scales have been developed to quantitatively assess these traits. However, neural mechanisms corresponding to the proposed constructs reflected in BIS/BAS are still poorly defined. The ventral striatum (VS) and orbitofrontal cortex (OFC) are implicated in subserving reward-related functions that are also associated with the BAS. In this study, we examined whether functional connectivity between these regions predicts components of these scales. We employed resting-state functional connectivity and BIS/BAS scores assessed by a personality questionnaire. Participants completed a resting state run and the Behavioral Inhibition and Activation Systems (BIS/BAS) Questionnaire. Using resting-state BOLD, we assessed correlations between two basal ganglia ROIs (caudate and putamen) and bilateral OFC ROIs, establishing single subject connectivity summary scores. Summary scores were correlated with components of BIS/BAS scores. Results demonstrate a novel correlation between BAS-fun seeking and resting-state connectivity between middle OFC and putamen, implying that spontaneous synchrony between reward-processing regions may play a role in defining personality characteristics related to impulsivity.

Vigor of reaching movements: reward discounts the cost of effort

Making a movement may be thought of as an economic decision in which one spends effort to acquire reward. Time discounts reward, which predicts that the magnitude of reward should affect movement vigor: we should move faster, spending greater effort, when there is greater reward at stake. Indeed, saccade peak velocities are greater and reaction-times shorter when a target is paired with reward. In this study, we focused on human reaching and asked whether movement kinematics were affected by expectation of reward. Participants made out-and-back reaching movements to one of four quadrants of a 14-cm circle. During various periods of the experiment only one of the four quadrants was paired with reward, and the transition from reward to nonreward status of a quadrant occurred randomly. Our experiment design minimized dependence of reward on accuracy, granting the subjects wide latitude in self-selecting their movement speed, amplitude, and variability. When a quadrant was paired with reward, reaching movements had a shorter reaction time, higher peak velocity, and greater amplitude. Despite this greater vigor, movements toward the rewarded quadrant suffered from less variability: both reaction times and reach kinematics were less variable when there was expectation of reward. Importantly, the effect of reward on vigor was specific to the movement component that preceded the time of reward (outward reach), not the movement component that followed it (return reach). Our results suggest that expectation of reward not only increases vigor of human reaching but also decreases its variability. NEW & NOTEWORTHY Movements may be thought of as an economic transaction where the vigor of the movement represents the effort that the brain is willing to expend to acquire a rewarding state. We show that in reaching, reward discounts the cost of effort, producing movements with shorter reaction time, higher velocity, greater amplitude, and reduced reaction-time variability. These results complement earlier observations in saccades, suggesting a common principle of economics across modalities of motor control.

La motivation dans tous ses K

La motivation peut être définie comme la fonction qui oriente et active le comportement. Nous résumons dans cette revue les acquis récents des neurosciences concernant les bases cérébrales des fonctions motivationnelles. En clinique neuropsychiatrique, les troubles de la motivation sont fréquents et actuellement évalués par des échelles qui ne renseignent pas sur les mécanismes sous-jacents. Nous présentons ici une nouvelle approche, dite computationnelle. Elle consiste à phénotyper le comportement des patients dans des tests de motivation, au moyen de modèles computationnels. Ces phénotypes computationnels caractérisent l’état du patient et pourraient aider au suivi et à la personnalisation du traitement.

Early Detection of Apathetic Phenotypes in Huntington's Disease Knock-in Mice Using Open Source Tools

Apathy is one of the most prevalent and progressive psychiatric symptoms in Huntington's disease (HD) patients. However, preclinical work in HD mouse models tends to focus on molecular and motor, rather than affective, phenotypes. Measuring behavior in mice often produces noisy data and requires large cohorts to detect phenotypic rescue with appropriate power. The operant equipment necessary for measuring affective phenotypes is typically expensive, proprietary to commercial entities, and bulky which can render adequately sized mouse cohorts as cost-prohibitive. Thus, we describe here a home-built, open-source alternative to commercial hardware that is reliable, scalable, and reproducible. Using off-the-shelf hardware, we adapted and built several of the rodent operant buckets (ROBucket) to test Htt^Q111/+ mice for attention deficits in fixed ratio (FR) and progressive ratio (PR) tasks. We find that, despite normal performance in reward attainment in the FR task, Htt^Q111/+ mice exhibit reduced PR performance at 9-11 months of age, suggesting motivational deficits. We replicated this in two independent cohorts, demonstrating the reliability and utility of both the apathetic phenotype, and these ROBuckets, for preclinical HD studies.

The pathophysiological mechanisms of motivational deficits in Parkinson's disease

Parkinson's disease (PD) is a progressive degenerative disorder that leads to disabling motor symptoms and a wide variety of neuropsychiatric symptoms. Apathy is the most common psychiatric disorder in the early stages of untreated PD and can be defined as a hypodopaminergic syndrome, which also includes anxiety and depression. Apathy is also considered the core feature of the parkinsonian triad (apathy, anxiety and depression) of behavioural non-motor signs, including a motivational deficit. Moreover, apathy is recognised as a distinct chronic neuropsychiatric behavioural disorder based on specific diagnostic criteria. Given the prevalence of apathy in approximately 40% of the general Parkinson's disease population, this appears to be a contributing factor to dementia in PD; also, apathy symptoms are factors that potentially contribute to morbidity, leading to a major impairment of health-related quality of life, thus stressing the importance of understanding the pathophysiology of this disease. Several studies have clearly established a prominent role for DA-mediated signals in PD apathy. However, synergistic interaction between dopaminergic impairment resulting from the neurodegenerative process and deep brain stimulation of the subthalamic nucleus may cause or exacerbate apathy. Furthermore, serotoninergic mechanism signalling is also likely to be of importance in this pathophysiology.