Sensitivity to cognitive effort mediates psychostimulant effects on a novel rodent cost/benefit decision-making task

Short-Term Memory Capacity Predicts Willingness to Expend Cognitive Effort for Reward

We must often decide whether the effort required for a task is worth the reward. Past rodent work suggests that willingness to deploy cognitive effort can be driven by individual differences in perceived reward value, depression, or chronic stress. However, many factors driving cognitive effort deployment-such as short-term memory ability-cannot easily be captured in rodents. Furthermore, we do not fully understand how individual differences in short-term memory ability, depression, chronic stress, and reward anticipation impact cognitive effort deployment for reward. Here, we examined whether these factors predict cognitive effort deployment for higher reward in an online visual short-term memory task. Undergraduate participants were grouped into high and low effort groups (n HighEffort = 348, n LowEffort = 81; n Female = 332, n Male = 92, M Age = 20.37, Range Age = 16-42) based on decisions in this task. After completing a monetary incentive task to measure reward anticipation, participants completed short-term memory task trials where they could choose to encode either fewer (low effort/reward) or more (high effort/reward) squares before reporting whether or not the color of a target square matched the square previously in that location. We found that only greater short-term memory ability predicted whether participants chose a much higher proportion of high versus low effort trials. Drift diffusion modeling showed that high effort group participants were more biased than low effort group participants toward selecting high effort trials. Our findings highlight the role of individual differences in cognitive effort ability in explaining cognitive effort deployment choices.

Neural substrates of the interaction between effort-expenditure reward decision-making and outcome anticipation

OBJECTIVE

Reward anticipation is important for future decision-making, possibly due to re-evaluation of prior decisions. However, the exact relationship between reward anticipation and prior effort-expenditure decision-making, and its neural substrates are unknown.

METHOD

Thirty-three healthy participants underwent fMRI scanning while performing the Effort-based Pleasure Experience Task (E-pet). Participants were required to make effort-expenditure decisions and anticipate the reward.

RESULTS

We found that stronger anticipatory activation at the posterior cingulate cortex was correlated with slower reaction time while making decisions with a high-probability of reward. Moreover, the substantia nigra was significantly activated in the prior decision-making phase, and involved in reward-anticipation in view of its strengthened functional connectivity with the mammillary body and the putamen in trial conditions with a high probability of reward.

CONCLUSIONS

These findings support the role of reward anticipation in re-evaluating decisions based on the brain-behaviour correlation. Moreover, the study revealed the neural interaction between reward anticipation and decision-making.

Insight into differing decision-making strategies that underlie cognitively effort-based decision making using computational modeling in rats

RATIONALE

The rat cognitive effort task (rCET), a rodent model of cognitive rather than physical effort, requires animals to choose between an easy or hard visuospatial discrimination, with a correct hard choice more highly rewarded. Like in humans, there is stable individual variation in choice behavior. In previous reports, animals were divided into two groups-workers and slackers-based on their mean preference for the harder option. Although these groups differed in their response to pharmacological challenges, the rationale for using this criterion for grouping was not robust.

METHODS

We collated experimental data from multiple cohorts of male and female rats performing the rCET and used a model-based framework combining drift diffusion modeling with cluster analysis to identify the decision-making processes underlying variation in choice behavior.

RESULTS

We verified that workers and slackers are statistically different groups but also found distinct intra-group profiles. These subgroups exhibited dissociable performance during the attentional phase, linked to distinct decision-making profiles during choice. Reanalysis of previous pharmacology data using this model-based framework showed that serotonergic drug effects were explained by changes in decision boundaries and non-decision times, while scopolamine's effects were driven by changes in decision starting points and rates of evidence accumulation.

CONCLUSIONS

Modeling revealed the decision-making processes that are associated with cognitive effort costs, and how these differ across individuals. Reanalysis of drug data provided insight into the mechanisms through which different neurotransmitter systems impact cognitively effortful attention and decision-making processes, with relevance to multiple psychiatric disorders.

Amphetamine increases motivation of humans and mice as measured by breakpoint, but does not affect an Electroencephalographic biomarker

Translation of drug targets from preclinical studies to clinical trials has been aided by cross-species behavioral tasks, but evidence for brain-based engagement during task performance is still required. Cross-species progressive ratio breakpoint tasks (PRBTs) measure motivation-related behavior and are pharmacologically and clinically sensitive. We recently advanced elevated parietal alpha power as a cross-species electroencephalographic (EEG) biomarker of PRBT engagement. Given that amphetamine increases breakpoint in mice, we tested its effects on breakpoint and parietal alpha power in both humans and mice. Twenty-three healthy participants performed the PRBT with EEG after amphetamine or placebo in a double-blind design. C57BL/6J mice were trained on PRBT with EEG (n = 24) and were treated with amphetamine or vehicle. A second cohort of mice was trained on PRBT without EEG (n = 40) and was treated with amphetamine or vehicle. In humans, amphetamine increased breakpoint. In mice, during concomitant EEG, 1 mg/kg of amphetamine significantly decreased breakpoint. In cohort 2, however, 0.3 mg/kg of amphetamine increased breakpoint consistent with human findings. Increased alpha power was observed in both species as they reached breakpoint, replicating previous findings. Amphetamine did not affect alpha power in either species. Amphetamine increased effort in humans and mice. Consistent with previous reports, elevated parietal alpha power was observed in humans and mice as they performed the PRBT. Amphetamine did not affect this EEG biomarker of effort. Hence, these findings support the pharmacological predictive validity of the PRBT to measure effort in humans and mice and suggest that this EEG biomarker is not directly reflective of amphetamine-induced changes in effort.

A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates

Background

Understanding the neurobiological substrates of psychiatric disorders requires comprehensive evaluations of cognitive and motivational functions in preclinical research settings. The translational validity of such evaluations will be supported by (1) tasks with high construct validity that are engaging and easy to teach to human and nonhuman participants, (2) software that enables efficient switching between multiple tasks in single sessions, (3) software that supports tasks across a broad range of physical experimental setups, and (4) by platform architectures that are easily extendable and customizable to encourage future optimization and development.

New Method

We describe the Multi-task Universal Suite for Experiments ( M-USE ), a software platform designed to meet these requirements. It leverages the Unity video game engine and C# programming language to (1) support immersive and engaging tasks for humans and nonhuman primates, (2) allow experimenters or participants to switch between multiple tasks within-session, (3) generate builds that function across computers, tablets, and websites, and (4) is freely available online with documentation and tutorials for users and developers. M-USE includes a task library with seven pre-existing tasks assessing cognitive and motivational constructs of perception, attention, working memory, cognitive flexibility, motivational and affective self-control, relational long-term memory, and visuo-spatial problem solving.

Results

M-USE was used to test NHPs on up to six tasks per session, all available as part of the Task Library, and to extract performance metrics for all major cognitive and motivational constructs spanning the Research Domain Criteria (RDoC) of the National Institutes of Mental Health.

Comparison with Existing Methods

Other experiment design and control systems exist, but do not provide the full range of features available in M-USE, including a pre-existing task library for cross-species assessments; the ability to switch seamlessly between tasks in individual sessions; cross-platform build capabilities; license-free availability; and its leveraging of video-engine capabilities used to gamify tasks.

Conclusions

The new multi-task platform facilitates cross-species translational research for understanding the neurobiological substrates of higher cognitive and motivational functions.

Amphetamines Improve the Motivation to Invest Effort in Attention-Deficit/Hyperactivity Disorder

Prevailing frameworks propose that a key feature of attention-deficit/hyperactivity disorder (ADHD) is lower motivation. An important component of motivation is the willingness to engage in cognitively or physically effortful behavior. However, the degree to which effort sensitivity is impaired in ADHD has rarely been tested, and the efficacy of stimulant medication in ameliorating any such impairments is unclear. Here, we tested 20 individuals with ADHD (11 males, 9 females) who were managed with amphetamine-based medication (dexamfetamine, lisdexamfetamine), and 24 controls (8 males, 16 females). Individuals with ADHD were tested over two counterbalanced sessions, ON and OFF their usual amphetamine-based medication. In each session, participants performed an effort-based decision-making task, in which they were required to choose how much cognitive or physical effort they were willing to engage in return for reward. Our results revealed three main findings. First, individuals with ADHD had lower motivation relative to controls to invest effort in both the cognitive and physical domains. Second, amphetamine increased motivation uniformly across both domains. Finally, the net effect of amphetamine treatment was to mostly restore motivation across both domains of effort relative to healthy controls. These data provide clear evidence for a heightened sensitivity to both cognitive and physical effort in ADHD, and reveal the efficacy of amphetamine-based drugs in restoring effort sensitivity to levels similar to controls. These findings confirm the existence of reduced motivational drive in ADHD, and more broadly provide direct causal evidence for a domain-general role of catecholamines in motivating effortful behavior.SIGNIFICANCE STATEMENT A core feature of attention-deficit/hyperactivity disorder (ADHD) is thought to be a heightened aversion to effort. Surprisingly, however, the degree to which effort sensitivity is impaired in ADHD has rarely been tested. More broadly, the relative efficacy of catecholamines in motivating the investment of cognitive and physical effort is unclear. We tested 20 individuals with ADHD ON and OFF amphetamines, and compared their behavior on an effort-based decision-making task to 24 controls. When tested OFF medication, the ADHD group was less cognitively and physically motivated than controls. However, amphetamines led to a comparable increase in motivation across both domains. This demonstrates the efficacy of catecholamines in facilitating domain-general effort, and highlights the broader potential of such drugs to treat disorders of motivation.

The motivational role of the ventral striatum and amygdala in learning from gains and losses

The ventral striatum (VS) and amygdala are two structures often implicated as essential structures for learning. The literature addressing the contribution of these areas to learning, however, is not entirely consistent. We propose that these inconsistencies are due to learning environments and the effect they have on motivation. To differentiate aspects of learning from environmental factors that affect motivation, we ran a series of experiments with varying task factors. We compared monkeys (Macaca mulatta) with VS lesions, amygdala lesions, and unoperated controls on reinforcement learning (RL) tasks that involve learning from both gains and losses as well as from deterministic and stochastic schedules of reinforcement. We found that for all three groups, performance varied by experiment. All three groups modulated their behavior in the same directions, to varying degrees, across the three experiments. This behavioral modulation is why we find deficits in some experiments, but not others. The amount of effort animals exhibited differed depending on the learning environment. Our results suggest that the VS is important for the amount of effort animals will give in rich deterministic and relatively leaner stochastic learning enivornments. We also showed that monkeys with amygdala lesions can learn stimulus-based RL in stochastic environments and environments with loss and conditioned reinforcers. These results show that learning environments shape motivation and that the VS is essential for distinct aspects of motivated behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Vigor, Effort-Related Aspects of Motivation and Anhedonia

In this chapter we provide an overview of the pharmacological and circuit mechanisms that determine the willingness to expend effort in pursuit of rewards. A particular focus will be on the role of the mesolimbic dopamine system, as well the contributing roles of limbic and cortical brains areas involved in the evaluation, selection, and invigoration of goal-directed actions. We begin with a review of preclinical studies, which have provided key insights into the brain systems that are necessary and sufficient for effort-based decision-making and have characterized novel compounds that enhance selection of high-effort activities. Next, we summarize translational studies identifying and expanding this circuitry in humans. Finally, we discuss the relevance of this work for understanding common motivational impairments as part of the broader anhedonia symptom domain associated with mental illness, and the identification of new treatment targets within this circuitry to improve motivation and effort-expenditure.

Dopaminergic medication increases motivation to exert cognitive control by reducing subjective effort costs in Parkinson's patients

Engaging in demanding mental activities requires the allocation of cognitive control, which can be effortful and aversive. Individuals thus tend to avoid exerting cognitive effort if less demanding behavioral options are available. Recent accounts propose a key role for dopamine in motivating behavior by increasing the sensitivity to rewards associated with effort exertion. Whether dopamine additionally plays a specific role in modulating the sensitivity to the costs of cognitive effort, even in the absence of any incentives, is much less clear. To address this question, we assessed cognitive effort avoidance in patients (n = 38) with Parkinson's disease, a condition characterized by loss of midbrain dopaminergic neurons, both ON and OFF dopaminergic medication and compared them to healthy controls (n = 24). Effort avoidance was assessed using the Demand Selection Task (DST), in which participants could freely choose between performing a high-demand or a low-demand version of a task-switching paradigm. Critically, participants were not offered any incentives to choose the more effortful option, nor for good performance. While healthy controls and patients OFF their dopaminergic medications consistently preferred the low-demand option, effort avoidance in patients ON dopaminergic medications was reduced compared to patients OFF, a difference which seems to lessen over trials. These differences in preference could not be explained by altered task-switching performance. Although patients ON were less accurate at detecting the different effort levels, as measured during instructed forced-choice blocks, their detection ability was not associated with effort avoidance, unlike in the healthy controls and the patients OFF. Our findings provide evidence that dopamine replacement in Parkinson's patients increases the willingness to engage in cognitively demanding behavior, and that this cannot be explained by possible effects of dopamine replacement on performance nor on the ability to detect effort demands. These results suggest that dopamine plays a role in reducing the sensitivity to effort costs that is independent of its role in enhancing the sensitivity to the benefits of effort exertion.

Effects of the psychoactive compounds in green tea on risky decision-making

Epigallocatechin-3-gallate (EGCG) and caffeine are the two primary compounds found in green tea. While EGCG has anxiolytic and anti-inflammatory effects, its acute effects on cognition are not well understood. Furthermore, despite widespread green tea consumption, little is known about how EGCG and caffeine co-administration impacts behavior. Here, we investigated the effects of multiple doses of either EGCG or caffeine on a rat model of risk-taking. This was assessed using the risky decision-making task (RDT), in which rats choose between a small, well-tolerated reward and a large reward with escalating risk of mild footshock. Rats were tested in RDT after acute systemic administration of EGCG, caffeine or joint EGCG and caffeine. EGCG caused a dose-dependent reduction in risk-taking without affecting reward discrimination or task engagement. Caffeine did not impact risk-taking, but elevated locomotor activity and reduced task engagement at high doses. Finally, exposure to both EGCG and caffeine had no effect on risk-taking, suggesting that low-dose caffeine is sufficient to mask the risk-aversion caused by EGCG. These data suggest EGCG as a potential therapeutic treatment for psychological disorders that induce compulsive risky decision-making.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT_2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT_2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT_2C antagonism may optimize choice by facilitating exploration.

Electrophysiological biomarkers of behavioral dimensions from cross-species paradigms

There has been a fundamental failure to translate preclinically supported research into clinically efficacious treatments for psychiatric disorders. One of the greatest impediments toward improving this species gap has been the difficulty of identifying translatable neurophysiological signals that are related to specific behavioral constructs. Here, we present evidence from three paradigms that were completed by humans and mice using analogous procedures, with each task eliciting candidate a priori defined electrophysiological signals underlying effortful motivation, reinforcement learning, and cognitive control. The effortful motivation was assessed using a progressive ratio breakpoint task, yielding a similar decrease in alpha-band activity over time in both species. Reinforcement learning was assessed via feedback in a probabilistic learning task with delta power significantly modulated by reward surprise in both species. Additionally, cognitive control was assessed in the five-choice continuous performance task, yielding response-locked theta power seen across species, and modulated by difficulty in humans. Together, these successes, and also the teachings from these failures, provide a roadmap towards the use of electrophysiology as a method for translating findings from the preclinical assays to the clinical settings.

Knockout of the Serotonin Transporter in the Rat Mildly Modulates Decisional Anhedonia

Serotonin transporter gene variance has long been considered an essential factor contributing to depression. However, meta-analyses yielded inconsistent findings recently, asking for further understanding of the link between the gene and depression-related symptoms. One key feature of depression is anhedonia. While data exist on the effect of serotonin transporter gene knockout (5-HTT^-/-) in rodents on consummatory and anticipatory anhedonia, with mixed outcomes, the effect on decisional anhedonia has not been investigated thus far. Here, we tested whether 5-HTT^-/- contributes to decisional anhedonia. To this end, we established a novel touchscreen-based go/go task of visual decision-making. During the learning of stimulus discrimination, 5-HTT^+/+ rats performed more optimal decision-making compared to 5-HTT^-/- rats at the beginning, but this difference did not persist throughout the learning period. During stimulus generalization, the generalization curves were similar between both genotypes and did not alter as the learning progress. Interestingly, the response time in 5-HTT^+/+ rats increased as the session increased in general, while 5-HTT^-/- rats tended to decrease. The response time difference might indicate that 5-HTT^-/- rats altered willingness to exert cognitive effort to the categorization of generalization stimuli. These results suggest that the effect of 5-HTT ablation on decisional anhedonia is mild and interacts with learning, explaining the discrepant findings on the link between 5-HTT gene and depression.

A mosaic of cost-benefit control over cortico-striatal circuitry

Dopamine contributes to cognitive control through well-established effects in both the striatum and cortex. Although earlier work suggests that dopamine affects cognitive control capacity, more recent work suggests that striatal dopamine may also impact on cognitive motivation. We consider the emerging perspective that striatal dopamine boosts control by making people more sensitive to the benefits versus the costs of cognitive effort, and we discuss how this sensitivity shapes competition between controlled and prepotent actions. We propose that dopamine signaling in distinct cortico-striatal subregions mediates different types of cost-benefit tradeoffs, and also discuss mechanisms for the local control of dopamine release, enabling selectivity among cortico-striatal circuits. In so doing, we show how this cost-benefit mosaic can reconcile seemingly conflicting findings about the impact of dopamine signaling on cognitive control.

Contribution of Eye-Tracking to Study Cognitive Impairments Among Clinical Populations

In the field of psychology, the merge of decision-theory and neuroscientific methods produces an array of scientifically recognized paradigms. For example, by exploring consumer’s eye-movement behavior, researchers aim to deepen the understanding of how patterns of retinal activation are being meaningfully transformed into visual experiences and connected with specific reactions (e.g., purchase). Notably, eye-movements provide knowledge of one’s homeostatic balance and gatekeep information that shape decisions. Hence, vision science investigates the quality of observed environments determined under various experimental conditions. Moreover, it answers questions on how human process visual stimuli and use gained information for a successful strategy to achieve certain goals. While capturing cognitive states with the support of the eye-trackers progresses at a relatively fast pace in decision-making research, measuring the visual performance of real-life tasks, which require complex cognitive skills, is tentatively translated into clinical experiments. Nevertheless, the potential of the human eye as a highly valuable source of biomarkers has been underlined. In this article, we aim to draw readers attention to decision-making experimental paradigms supported with eye-tracking technology among clinical populations. Such interdisciplinary approach may become an important component that will (i) help in objectively illustrating patient’s models of beliefs and values, (ii) support clinical interventions, and (iii) contribute to health services. It is possible that shortly, eye-movement data from decision-making experiments will grant the scientific community a greater understanding of mechanisms underlining mental states and consumption practices that medical professionals consider as obsessions, disorders or addiction.

Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning

Effort-related decision-making and reward learning are both dopamine-dependent, but preclinical research suggests they depend on different dopamine signaling dynamics. Therefore, the same dose of a dopaminergic medication could have differential effects on effort for reward vs. reward learning. However, no study has tested how effort and reward learning respond to the same dopaminergic medication within subjects. The current study aimed to test the effect of therapeutic doses of d-amphetamine on effort for reward and reward learning in the same healthy volunteers. Participants (n = 30) completed the Effort Expenditure for Reward Task (EEfRT) measure of effort-related decision-making, and the Probabilistic Reward Task (PRT) measure of reward learning, under placebo and two doses of d-amphetamine (10 mg, and 20 mg). Secondarily, we examined whether the individual characteristics of baseline working memory and willingness to exert effort for reward moderated the effects of d-amphetamine. d-Amphetamine increased willingness to exert effort, particularly at low to intermediate expected values of reward. Computational modeling analyses suggested this was due to decreased effort discounting rather than probability discounting or decision consistency. Both baseline effort and working memory emerged as moderators of this effect, such that d-amphetamine increased effort more in individuals with lower working memory and lower baseline effort, also primarily at low to intermediate expected values of reward. In contrast, d-amphetamine had no significant effect on reward learning. These results have implications for treatment of neuropsychiatric disorders, which may be characterized by multiple underlying reward dysfunctions.

Effort-Related Decision-Making in ADHD

ADHD is defined by behavioral symptoms that are not well characterized in relation to ADHD’s neurobiological mechanisms. This approach has limited our ability to define ADHD nosology and predict outcomes because it does not systematically examine facets of the disorder such as the inability to maintain cognitively effortful activities, as promoted in the NIMH RDoC approach. Existing data indicate ADHD is associated with differences in reward valuation and processing, but we do not know whether ADHD is also associated with higher levels of aversion to exerting cognitive effort and/or altered reward x effort interactions. Our ongoing study addresses this knowledge gap by examining individuals’ preferences between rewards associated with minimal effort and reward alternatives with a higher payoff but higher effort costs (“effort discounting”); thereby permitting us to characterize differences in biases and tradeoffs during effort-related decision-making in ADHD. The study takes advantage of a well-defined sample of ADHD-diagnosed and healthy control individuals to address three aims. First, we determine whether ADHD is associated with steeper discounting of larger, more effortful rewards. Second, we examine the subjective perception of effort in youth diagnosed with ADHD and healthy controls using tasks requiring varying levels of cognitive effort. Third, we explore relationships amongst indices of effort discounting, theoretically-related traits (e.g., grit, distress tolerance), biomarkers of effort-related decision-making (eye movements and pupil size), and various cognitive measures. Successful completion of the aims will permit us to better characterize ADHD-healthy control differences and lay a foundation for more computational approaches to ADHD diagnostic criteria.

Methylphenidate boosts choices of mental labor over leisure depending on striatal dopamine synthesis capacity

The cognitive enhancing effects of methylphenidate are well established, but the mechanisms remain unclear. We recently demonstrated that methylphenidate boosts cognitive motivation by enhancing the weight on the benefits of a cognitive task in a manner that depended on striatal dopamine. Here, we considered the complementary hypothesis that methylphenidate might also act by changing the weight on the opportunity cost of a cognitive task, that is, the cost of foregoing alternative opportunity. To this end, 50 healthy participants (25 women) completed a novel cognitive effort-discounting task that required choices between task and leisure. They were tested on methylphenidate, placebo, as well as the selective D2-receptor agent sulpiride, the latter to strengthen inference about dopamine receptor selectivity of methylphenidate's effects. Furthermore, they also underwent an [18F]DOPA PET scan to quantify striatal dopamine synthesis capacity. Methylphenidate boosted choices of cognitive effort over leisure across the group, and this effect was greatest in participants with more striatal dopamine synthesis capacity. The effects of sulpiride did not reach significance. This study strengthens the motivational account of methylphenidate's effects on cognition, and suggests that methylphenidate reduces the cost of mental labor by increasing striatal dopamine.

Kindling of the basolateral or central nucleus of the amygdala increases suboptimal choice in a rat gambling task and increases motor impulsivity in risk-preferring animals

Impairments in decision making under uncertainty, as measured by the Iowa Gambling Task (IGT), are observed in persons suffering from temporal lobe epilepsy (TLE), in which seizures originate in the amygdala and hippocampal formations. Gambling disorder is also more prevalent in this population. Individuals with amygdala damage show similar deficits in decision-making, as do rats with lesions restricted to the basolateral amygdala (BLA) performing an analogous rat gambling task (rGT), yet whether hyperstimulation of the BLA impacts risky decision-making has yet to be demonstrated. We therefore investigated whether kindling of the BLA affected rGT performance. In this task, sugar pellet profits are maximised through consistent selection of options associated with smaller per-trial gains but shorter punishing time-outs. Just as in the IGT, subjects must avoid the risky options, as penalties are disproportionately high despite the higher reward available. Most rats adopt the optimal strategy, but some instead make high numbers of risky, disadvantageous choices. Once stable choice preferences had been established on-task, sixteen male Long Evans rats were implanted unilaterally with a bipolar electrode targeting the BLA and stimulated twice daily until three stage five seizures had been elicited. The electrodes revealed to be nearly evenly places in the BLA and the Central Nucleus of the Amygdala (CeA). Kindling transiently increased choice of the option paired with the smallest reward but also the lowest level of punishment- a risk-averse, but suboptimal, choice. Risk-preferring rats also made more premature responses, a marker of motor impulsivity, and were faster to make a choice, whereas these variables were unaffected in optimal decision-makers. These data suggest epileptiform activity originating within the amygdala can impair choice and promote impulsivity, at least in some individuals.

The dopamine depleting agent tetrabenazine alters effort-related decision making as assessed by mouse touchscreen procedures

RATIONALE

Effort-based decision-making tasks allow animals to choose between preferred reinforcers that require high effort to obtain vs. low-effort/low reward options. Mesolimbic dopamine (DA) and related neural systems regulate effort-based choice. Tetrabenazine (TBZ) is a vesicular monoamine transport type-2 inhibitor that blocks DA storage and depletes DA. In humans, TBZ induces motivational dysfunction and depression. TBZ has been shown reliably to induce a low-effort bias in rats, but there are fewer mouse studies.

OBJECTIVES

The present studies used touchscreen operant procedures (Bussey-Saksida chambers) to assess the effects of TBZ on effort-based choice in mice.

METHODS

C57BL6 mice were trained to press an elevated lit panel on the touchscreen on a fixed ratio 1 schedule reinforced by strawberry milkshake, vs. approaching and consuming a concurrently available but less preferred food pellets (Bio-serv).

RESULTS

TBZ (2.0-8.0 mg/kg IP) shifted choice, producing a dose-related decrease in panel pressing but an increase in pellet intake. In contrast, reinforcer devaluation by pre-feeding substantially decreased both panel pressing and pellet intake. In free-feeding choice tests, mice strongly preferred the milkshake vs. the pellets, and TBZ had no effect on milkshake intake or preference, indicating that the TBZ-induced low-effort bias was not due to changes in primary food motivation or preference. TBZ significantly decreased tissue levels of nucleus accumbens DA.

CONCLUSION

The DA depleting agent TBZ induced an effort-related motivational dysfunction in mice, which may have clinical relevance for assessing novel drug targets for their potential use as therapeutic agents in patients with motivation impairments.

Evaluation of cognitive effort in rats is not critically dependent on ventrolateral orbitofrontal cortex

Organisms must frequently evaluate the amount of effort to invest in pursuing future rewards. Despite explicit awareness of the potential benefits of cognitive work, individuals vary in their willingness to attempt cognitively demanding tasks, regardless of intellectual ability. Such differences may suggest that the degree to which cognitive effort degrades perceived outcome value is a subjective, rather than objective, process, similar to risk and delay discounting. Although numerous studies suggest the orbitofrontal cortex (OFC) is important for allowing subjective value estimates to be updated and/or used in cost/benefit decision-making, the causal role of the OFC in valuations of mental effort has received scant investigation. We therefore trained 24 female Long-Evans rats on the rodent cognitive effort task (rCET) and assessed performance following temporary bilateral inactivation of the ventrolateral OFC (vlOFC). In the rCET, rats decide at trial outset whether to perform an easy or hard attentional challenge, namely to localize a brief visual stimulus to one of five possible locations. The difficulty of the challenge is determined by the stimulus duration (1.0 vs. 0.2s for easy vs. hard trials respectively), and success on hard trials results in double the sugar pellet rewards. Somewhat surprisingly, inactivations of the vlOFC did not affect rats' willingness or ability to exert cognitive effort for larger rewards, despite increasing omissions and motor impulsivity on-task. When considered with previous work, it appears the vlOFC plays a minimal role in cognitive effort allocation specifically, and in valuations of effort more generally.

Investigating serotonergic contributions to cognitive effort allocation, attention, and impulsive action in female rats

BACKGROUND

Individuals must frequently evaluate whether it is worth allocating cognitive effort for desired outcomes. Motivational deficits are a common feature of psychiatric illness such as major depression. Selective serotonin reuptake inhibitors are commonly used to treat this disorder, yet some data suggest these compounds are ineffective at treating amotivation, and may even exacerbate it.

AIMS

Here we used the rodent Cognitive Effort Task (rCET) to assess serotonergic (5-hydroxytryptamine, 5-HT) contributions to decision-making with cognitive effort costs.

METHODS

The rCET is a modified version of the 5-choice serial reaction time task, a well-validated test of visuospatial attention and impulse control. At the start of each rCET trial, rats chose one of two levers, which set the difficulty of an attentional challenge, namely the localization of a visual stimulus illuminated for 0.2 or 1 s on hard versus easy trials. Successful completion of hard trials was rewarded with double the sugar pellets. Twenty-four female Long-Evans rats were trained on the rCET and systemically administered the 5-HT_1A agonist 8-OH-DPAT, the 5-HT_2A antagonist M100907, the 5-HT_2C agonist Ro-60-0175, as well as the 5-HT_2C antagonist SB 242, 084.

RESULTS

5-HT_2A antagonism dose-dependently reduced premature responding, while 5-HT_2C antagonism had the opposite effect. 8-OH-DPAT impaired accuracy of target detection at higher doses, while Ro-60-0175 dose-dependently improved accuracy on difficult trials. However, none of the drugs affected the rats' choice of the harder option.

CONCLUSION

When considered with existing work evaluating decision-making with physical effort costs, it appears that serotonergic signalling plays a minor role in guiding effort allocation.

Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work

Stimulants such as methylphenidate are increasingly used for cognitive enhancement but precise mechanisms are unknown. We found that methylphenidate boosts willingness to expend cognitive effort by altering the benefit-to-cost ratio of cognitive work. Willingness to expend effort was greater for participants with higher striatal dopamine synthesis capacity, whereas methylphenidate and sulpiride, a selective D2 receptor antagonist, increased cognitive motivation more for participants with lower synthesis capacity. A sequential sampling model informed by momentary gaze revealed that decisions to expend effort are related to amplification of benefit-versus-cost information attended early in the decision process, whereas the effect of benefits is strengthened with higher synthesis capacity and by methylphenidate. These findings demonstrate that methylphenidate boosts the perceived benefits versus costs of cognitive effort by modulating striatal dopamine signaling.

Catecholaminergic modulation of the cost of cognitive control in healthy older adults

Catecholamines have long been associated with cognitive control and value-based decision-making. More recently, we have shown that catecholamines also modulate value-based decision-making about whether or not to engage in cognitive control. Yet it is unclear whether catecholamines influence these decisions by altering the subjective value of control. Thus, we tested whether tyrosine, a catecholamine precursor altered the subjective value of performing a demanding working memory task among healthy older adults (60-75 years). Contrary to our prediction, tyrosine administration did not significantly increase the subjective value of conducting an N-back task for reward, as a main effect. Instead, in line with our previous study, exploratory analyses indicated that drug effects varied as a function of participants' trait impulsivity scores. Specifically, tyrosine increased the subjective value of conducting an N-back task in low impulsive participants, while reducing its value in more impulsive participants. One implication of these findings is that the over-the-counter tyrosine supplements may be accompanied by an undermining effect on the motivation to perform demanding cognitive tasks, at least in certain older adults. Taken together, these findings indicate that catecholamines can alter cognitive control by modulating motivation (rather than just the ability) to exert cognitive control.

Relative insensitivity to time-out punishments induced by win-paired cues in a rat gambling task

RATIONALE

Pairing rewarding outcomes with audiovisual cues in simulated gambling games increases risky choice in both humans and rats. However, the cognitive mechanism through which this sensory enhancement biases decision-making is unknown.

OBJECTIVES

To assess the computational mechanisms that promote risky choice during gambling, we applied a series of reinforcement learning models to a large dataset of choices acquired from rats as they each performed one of two variants of a rat gambling task (rGT), in which rewards on "win" trials were delivered either with or without salient audiovisual cues.

METHODS

We used a sampling technique based on Markov chain Monte Carlo to obtain posterior estimates of model parameters for a series of RL models of increasing complexity, in order to assess the relative contribution of learning about positive and negative outcomes to the latent valuation of each choice option on the cued and uncued rGT.

RESULTS

Rats which develop a preference for the risky options on the rGT substantially down-weight the equivalent cost of the time-out punishments during these tasks. For each model tested, the reduction in learning from the negative time-outs correlated with the degree of risk preference in individual rats. We found no apparent relationship between risk preference and the parameters that govern learning from the positive rewards.

CONCLUSIONS

The emergence of risk-preferring choice on the rGT derives from a relative insensitivity to the cost of the time-out punishments, as opposed to a relative hypersensitivity to rewards. This hyposensitivity to punishment is more likely to be induced in individual rats by the addition of salient audiovisual cues to rewards delivered on win trials.

Anabolic-androgenic steroids and cognitive effort discounting in male rats

Anabolic-androgenic steroids (AAS) are drugs of abuse that impair behavior and cognition. In a rodent model of AAS abuse, testosterone-treated male rats expend more physical effort, by repeatedly pressing a lever for a large reward in an operant discounting task. However, since modern society prioritizes cognitive over physical effort, it is important to determine if AAS limit cognitive effort. Here we tested the effects of AAS on a novel cognitive-effort discounting task. Each operant chamber had 3 nose-pokes, opposite 2 levers and a pellet dispenser. Rats pressed a lever to illuminate 1 nose-poke; they responded in the illuminated nose-poke to receive sugar pellets. For the 'easy' lever, the light remained on for 1 s, and a correct response earned 1 pellet. For the 'hard' lever, the light duration decreased from 1 s to 0.1 s across 5 blocks of trials, and a correct response earned 4 pellets. As the duration of the nose-poke light decreased, all rats decreased their choice of the hard lever in a modest discounting curve. Task accuracy also decreased significantly across the 5 blocks of trials. However, there was no effect of testosterone on choice of the hard lever or task accuracy. Antagonism of dopamine D1 or D2 receptors had no effect on lever choice or task accuracy. However, serotonin depletion significantly decreased preference for the hard lever, and impaired task accuracy. Thus, physical effort discounting depends on dopamine activity, while cognitive effort discounting task is sensitive to serotonin. AAS impair physical effort discounting, but not cognitive effort discounting.

Increased motor impulsivity in a rat gambling task during chronic ropinirole treatment: potentiation by win-paired audiovisual cues

RATIONALE

Chronic administration of D_2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD).

OBJECTIVES

We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs).

METHODS

Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days.

RESULTS

Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task.

CONCLUSIONS

These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D_2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

What Is the Relationship between Dopamine and Effort?

The trade-off between reward and effort is at the heart of most behavioral theories, from ecology to economics. Compared to reward, however, effort remains poorly understood, both at the behavioral and neurophysiological levels. This is important because unwillingness to overcome effort to gain reward is a common feature of many neuropsychiatric and neurological disorders. A recent surge in interest in the neurobiological basis of effort has led to seemingly conflicting results regarding the role of dopamine. We argue here that, upon closer examination, there is actually striking consensus across studies: dopamine primarily codes for future reward but is less sensitive to anticipated effort cost. This strong association between dopamine and the incentive effects of rewards places dopamine in a key position to promote reward-directed action.

Mental labour

Mental effort is an elementary notion in our folk psychology and a familiar fixture in everyday introspective experience. However, as an object of scientific study, mental effort has remained rather elusive. Cognitive psychology has provided some tools for understanding how effort impacts performance, by linking effort with cognitive control function. What has remained less clear are the principles that govern the allocation of mental effort. Under what circumstances do people choose to invest mental effort, and when do they decline to do so? And what regulates the intensity of mental effort when it is applied? In new and promising work, these questions are being approached with the tools of behavioural economics. Though still in its infancy, this economic approach to mental effort research has already uncovered important aspects of effort-based decision-making, and points clearly to future lines of inquiry, including some intriguing opportunities presented by recent artificial intelligence research.

Persistent effect of withdrawal from intravenous methamphetamine self-administration on brain activation and behavioral economic indices involving an effort cost

Exposure to drugs of abuse produces maladaptive changes in cost-benefit decision-making, including the evaluation of time and risk. Studies probing the effects of drug exposure on such evaluations have primarily used experimenter-administered drug regimens. Similarly, while much is known about the neural bases of effort, there have been relatively fewer investigations of the effects of drug experience on effort-based choices. We recently reported that experimenter-administered methamphetamine (meth) resulted in steeper discounting of effort for food rewards in rats, when assessed in protracted withdrawal. Here, we studied rats that underwent withdrawal from weeks of meth intravenous self-administration that later could freely select between a high effort, preferred option (progressive ratio lever pressing for sucrose pellets) versus a low effort, less preferred option (freely-available lab chow). We found decreased effort for the preferred reward and changes in a behavioral economic index demonstrating an increased sensitivity to effort in meth-experienced rats. Critically, the decreased effort for the preferred option was only present in the context of a competing option, not when it was the only option. We also confirmed rats preferred sucrose pellets over chow when both were freely available. These long-lasting changes were accompanied by decreased c-Fos activation in ventral striatum and basolateral amygdala, regions known to be important in effort-based choices. Taken together with our previous observations, these results suggest a robust and enduring effect of meth on value-based decision-making, and point to the underlying neural mechanisms that support the evaluation of an effort cost.

Caffeine and Selective Adenosine Receptor Antagonists as New Therapeutic Tools for the Motivational Symptoms of Depression

Major depressive disorder is one of the most common and debilitating psychiatric disorders. Some of the motivational symptoms of depression, such anergia (lack of self-reported energy) and fatigue are relatively resistant to traditional treatments such as serotonin uptake inhibitors. Thus, new pharmacological targets are being investigated. Epidemiological data suggest that caffeine consumption can have an impact on aspects of depressive symptomatology. Caffeine is a non-selective adenosine antagonist for A1/A2A receptors, and has been demonstrated to modulate behavior in classical animal models of depression. Moreover, selective adenosine receptor antagonists are being assessed for their antidepressant effects in animal studies. This review focuses on how caffeine and selective adenosine antagonists can improve different aspects of depression in humans, as well as in animal models. The effects on motivational symptoms of depression such as anergia, fatigue, and psychomotor slowing receive particular attention. Thus, the ability of adenosine receptor antagonists to reverse the anergia induced by dopamine antagonism or depletion is of special interest. In conclusion, although further studies are needed, it appears that caffeine and selective adenosine receptor antagonists could be therapeutic agents for the treatment of motivational dysfunction in depression.

Individual differences in the energizing effects of caffeine on effort-based decision-making tests in rats

Motivated behavior is characterized by activation and high work output. Nucleus accumbens (Nacb) modulates behavioral activation and effort-based decision-making. Caffeine is widely consumed because of its energizing properties. This methylxanthine is a non-selective adenosine A₁/A_2A receptor antagonist. Adenosine receptors are highly concentrated in Nacb. Adenosine agonists injected into Nacb, shift preference towards low effort alternatives. The present studies characterized effort-related effects of caffeine in a concurrent progressive ratio (PROG)/free reinforcer choice procedure that requires high levels of work output, and generates great variability among different animals. Male Sprague-Dawley rats received an acute dose of caffeine (2.5-20.0 mg/kg, IP) and 30 min later were tested in operant boxes. One group was food-restricted and had to lever pressed for high carbohydrate pellets, another group was non-food-restricted and lever pressed for a high sucrose solution. Caffeine (2.5 and 5.0 mg/kg) increased lever pressing in food-restricted animals that were already high responders. However, in non-restricted animals, caffeine (5.0 and 10.0 mg/kg) increased work output only among low responders. In fact, caffeine (10.0 and 20.0 mg/kg) in non-restricted animals, reduced lever pressing among high responders in the PROG task, and also in a different group of animals lever pressing in an easy task (fixed ratio 7 schedule) that uniformly generates high levels of responding. Caffeine did not modify sucrose preference or consumption under free access conditions. Thus, when animals do not have a homeostatic need, caffeine can help those not very intrinsically motivated to work harder for a more palatable reward. However, caffeine can disrupt performance of animals intrinsically motivated to work hard for a better reward.

The Effort Paradox: Effort Is Both Costly and Valued

According to prominent models in cognitive psychology, neuroscience, and economics, effort (be it physical or mental) is costly: when given a choice, humans and non-human animals alike tend to avoid effort. Here, we suggest that the opposite is also true and review extensive evidence that effort can also add value. Not only can the same outcomes be more rewarding if we apply more (not less) effort, sometimes we select options precisely because they require effort. Given the increasing recognition of effort's role in motivation, cognitive control, and value-based decision-making, considering this neglected side of effort will not only improve formal computational models, but also provide clues about how to promote sustained mental effort across time.

Low distress tolerance predicts heightened drug seeking and taking after extended abstinence from cocaine self-administration

Distress tolerance (DT), defined as the ability to persist in goal-directed behavior while experiencing psychological distress, is associated with greater frequency of substance use and poor treatment outcomes. To examine a potential causal role substance use may play in DT, we developed a rodent model of DT in which rats had to press a lever within a continuously decreasing time window for reward while receiving negative feedback on failure trials. DT was defined as the time rats continued to seek reward before quitting the task. We assessed the relationship of DT with cocaine seeking/taking by measuring DT before cocaine self-administration (SA), and after 1 week and 1 month of drug abstinence. We found that DT prior to cocaine SA did not predict cocaine seeking/taking, yet DT measured after 1 month abstinence significantly predicted subsequent high levels of early session cocaine taking. Additionally, high DT measured after abstinence protected against high cocaine seeking, but this protective effect was blocked in rats with high impulsivity. Finally, while a decrease in 1 month-abstinent DT was observed following SA across treatment conditions, among cocaine-exposed rats, greater cocaine SA correlated with a steeper decrease in DT. These results show that low DT after drug abstinence is associated with heightened levels of cocaine seeking and taking behavior and that impulsivity influences this effect. Collectively, these results support the validity of our rodent DT model while extending the human literature and set the foundation for future animal studies designed to determine neural mechanisms underlying DT.

Deciphering Decision Making: Variation in Animal Models of Effort- and Uncertainty-Based Choice Reveals Distinct Neural Circuitries Underlying Core Cognitive Processes

Maladaptive decision-making is increasingly recognized to play a significant role in numerous psychiatric disorders, such that therapeutics capable of ameliorating core impairments in judgment may be beneficial in a range of patient populations. The field of "decision neuroscience" is therefore in its ascendancy, with researchers from diverse fields bringing their expertise to bear on this complex and fascinating problem. In addition to the advances in neuroimaging and computational neuroscience that contribute enormously to this area, an increase in the complexity and sophistication of behavioral paradigms designed for nonhuman laboratory animals has also had a significant impact on researchers' ability to test the causal nature of hypotheses pertaining to the neural circuitry underlying the choice process. Multiple such decision-making assays have been developed to investigate the neural and neurochemical bases of different types of cost/benefit decisions. However, what may seem like relatively trivial variation in behavioral methodologies can actually result in recruitment of distinct cognitive mechanisms, and alter the neurobiological processes that regulate choice. Here we focus on two areas of particular interest, namely, decisions that involve an assessment of uncertainty or effort, and compare some of the most prominent behavioral paradigms that have been used to investigate these processes in laboratory rodents. We illustrate how an appreciation of the diversity in the nature of these tasks can lead to important insights into the circumstances under which different neural regions make critical contributions to decision making.

Seeing through the smoke: Human and animal studies of cannabis use and endocannabinoid signalling in corticolimbic networks

Public opinion surrounding the recreational use and therapeutic potential of cannabis is shifting. This review describes new work examining the behavioural and neural effects of cannabis and the endocannabinoid system, highlighting key regions within corticolimbic brain circuits. First, we consider the role of human genetic factors and cannabis strain chemotypic differences in contributing to interindividual variation in the response to cannabinoids, such as THC, and review studies demonstrating that THC-induced impairments in decision-making processes are mediated by actions at prefrontal CB1 receptors. We further describe evidence that signalling through prefrontal or ventral hippocampal CB1 receptors modulates mesolimbic dopamine activity, aberrations of which may contribute to emotional processing deficits in schizophrenia. Lastly, we review studies suggesting that endocannabinoid tone in the amygdala is a critical regulator of anxiety, and report new data showing that FAAH activity is integral to this response. Together, these findings underscore the importance of cannabinoid signalling in the regulation of cognitive and affective behaviours, and encourage further research given their social, political, and therapeutic implications.

Neural mechanisms of sensitivity to peer information in young adult cannabis users

Though social influence is a critical factor in the initiation and maintenance of marijuana use, the neural correlates of influence in those who use marijuana are unknown. In this study, marijuana-using young adults (MJ; n = 20) and controls (CON; n = 23) performed a decision-making task in which they made a perceptual choice after viewing the choices of unknown peers via photographs, while they underwent functional magnetic resonance imaging scans. The MJ and CON groups did not show differences in the overall number of choices that agreed with versus opposed group influence, but only the MJ group showed reaction time slowing when deciding against group choices. Longer reaction times were associated with greater activation of frontal regions. The MJ goup, compared to CON, showed significantly greater activation in the caudate when presented with peer information. Across groups, caudate activation was associated with self-reported susceptibility to influence. These findings indicate that young adults who use MJ may exhibit increased effort when confronted with opposing peer influence, as well as exhibit greater responsivity of the caudate to social information. These results not only better define the neural basis of social decisions, but also suggest that marijuana use is associated with exaggerated neural activity during decision making that involves social information.

Chronic administration of the dopamine D2/3 agonist ropinirole invigorates performance of a rodent slot machine task, potentially indicative of less distractible or compulsive-like gambling behaviour

RATIONALE

Whilst dopamine agonist therapies can successfully manage the symptoms of diseases such as Parkinson's disease (PD), fibromyalgia and restless leg syndrome, they can also cause impulse control and addiction disorders such as gambling disorder (GD). These compulsive behaviours seriously undermine the utility of such treatments.

OBJECTIVES

The objective of the study was to model this phenomenon using a rodent slot machine task (rSMT) in order to investigate the neurobiological basis underlying such behavioural changes.

METHODS

Male Long Evans rats were trained to perform the rSMT. The D₂-like agonist ropinirole, or saline, was then delivered continuously for 28 days via osmotic mini-pump. The effects of ropinirole on baseline rSMT performance, as well as extinction and reinstatement sessions, were determined during this time. Brain samples from key frontostriatal regions implicated in GD and PD were then harvested immediately or after a 4-week washout period during which behaviour returned to pre-drug baseline.

RESULTS

Ropinirole invigorated task performance, in that drug treatment resulted in a robust and sustained increase in the number of trials completed. Ex vivo analyses revealed that chronic ropinirole treatment led to a pattern of changes indicative of upregulation within the β-arrestin-AKT-GSK3β intracellular cascade, recently theorised to dominate D₂-mediated signalling under hyperdopaminergic conditions, in the dorsal striatum, rather than the canonical PKA-dependent signalling pathway associated with D₂ receptor activation.

CONCLUSIONS

Such findings provide novel insight into the role of dopamine signalling in mediating compulsive-like gambling behaviour and may inform more directed pharmacotherapies for the treatment of both idiopathic and iatrogenic GD.

The effects of reduced dopamine transporter function and chronic lithium on motivation, probabilistic learning, and neurochemistry in mice: Modeling bipolar mania

BACKGROUND

Bipolar disorder (BD) mania patients exhibit poor cognition and reward-seeking/hypermotivation, negatively impacting a patient's quality of life. Current treatments (e.g., lithium), do not treat such deficits. Treatment development has been limited due to a poor understanding of the neural mechanisms underlying these behaviors. Here, we investigated putative mechanisms underlying cognition and reward-seeking/motivational changes relevant to BD mania patients using two validated mouse models and neurochemical analyses.

METHODS

The effects of reducing dopamine transporter (DAT) functioning via genetic (knockdown vs. wild-type littermates), or pharmacological (GBR12909- vs. vehicle-treated C57BL/6J mice) means were assessed in the probabilistic reversal learning task (PRLT), and progressive ratio breakpoint (PRB) test, during either water or chronic lithium treatment. These tasks quantify reward learning and effortful motivation, respectively. Neurochemistry was performed on brain samples of DAT mutants ± chronic lithium using high performance liquid chromatography.

RESULTS

Reduced DAT functioning increased reversals in the PRLT, an effect partially attenuated by chronic lithium. Chronic lithium alone slowed PRLT acquisition. Reduced DAT functioning increased motivation (PRB), an effect attenuated by lithium in GBR12909-treated mice. Neurochemical analyses revealed that DAT knockdown mice exhibited elevated homovanillic acid levels, but that lithium had no effect on these elevated levels.

CONCLUSIONS

Reducing DAT functioning recreates many aspects of BD mania including hypermotivation and improved reversal learning (switching), as well as elevated homovanillic acid levels. Chronic lithium only exerted main effects, impairing learning and elevating norepinephrine and serotonin levels of mice, not specifically treating the underlying mechanisms identified in these models.

Δ9-Tetrahydrocannabinol decreases willingness to exert cognitive effort in male rats

BACKGROUND

Acceptance of cannabis use is growing. However, prolonged use is associated with diminished psychosocial outcomes, potentially mediated by drug-induced cognitive impairments. Δ9-Tetrahydrocannabinol (THC) is the main psychoactive ingredient in cannabis, yet other phytocannabinoids in the plant, such as cannabidiol (CBD), have unique properties. Given that CBD can modulate the undesirable effects of THC, therapeutic agents, such as nabiximols, contain higher CBD:THC ratios than illicit marijuana. We tested the hypothesis that THC impairs a relevant cognitive function for long-term success, namely willingness to exert cognitive effort for greater rewards, and that CBD could attenuate such decision-making impairments.

METHODS

Male Long-Evans rats (n = 29) performing the rat cognitive effort task (rCET) received acute THC and CBD, independently and concurrently, in addition to other cannabinoids. Rats chose between 2 options differing in reward magnitude, but also in the cognitive effort (attentional load) required to obtain them.

RESULTS

We found that THC decreased choice of hard trials without impairing the animals' ability to accurately complete them. Strikingly, this impairment was correlated with CB1 receptor density in the medial prefrontal cortex - an area previously implicated in effortful decision-making. In contrast, CBD did not affect choice. Coadministration of 1:1 CBD:THC matching that in nabiximols modestly attenuated the deleterious effects of THC in "slacker" rats.

LIMITATIONS

Only male rats were investigated, and the THC/CBD coadministration experiment was carried out in a subset of individuals.

CONCLUSION

These findings confirm that THC, but not CBD, selectively impairs decision-making involving cognitive effort costs. However, coadministration of CBD only partially ameliorates such THC-induced dysfunction.

Chronic D2/3 agonist ropinirole treatment increases preference for uncertainty in rats regardless of baseline choice patterns

D_2/3 receptor agonists are effective treatments for Parkinson's disease (PD), but can precipitate impulse control disorders (ICDs) including gambling disorder (GD). The neurobiological mechanisms underlying this devastating side-effect of dopamine agonist replacement therapy (DRT), and any dependence on the dopamine depletion caused by PD, are unclear. It is also unclear whether previous biases towards risk or uncertainty are a risk factor for developing these ICDs. We investigated whether chronic D_2/3 agonist administration (5 mg/kg/day ropinirole for 28 days) altered performance of a rat model of gambling-like behaviour, the rodent betting task (rBT), and examined if baseline behaviour predicted this behavioural change. The rBT captures individual differences in subjective preference for uncertain outcomes: animals choose between guaranteed or probabilistic reinforcement of equal expected value. Chronic ropinirole dramatically increased selection of the uncertain option in two-thirds of animals, regardless of baseline preferences. The effect on choice in the rBT was replicated in a dorsolateral striatal 6-hydroxydopamine (6-OHDA) rat model of early PD. These studies are the first to look at individual differences in response to chronic, rather than pulsatile, dosing of DRT in a rodent model of gambling behaviour. These findings suggest that DRT-induced PG may stem from increases in subjective valuation of uncertainty. Such symptoms likely arise because of changes in dopaminergic striatal signalling caused by DRT rather than from an interaction between pre-morbid behaviours or PD itself.