Shifting uncertainty intolerance: methylphenidate and attention-deficit hyperactivity disorder

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects are often willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No Info) vs. a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%) and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) in the anterior cingulate cortex, orbitofrontal cortex, basolateral amygdala, or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of the anterior cingulate cortex destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that previous choice predicted current choice in all conditions, however previously rewarded Info trials strongly predicted preference in all conditions except in female rats following anterior cingulate cortex inhibition. The results reveal a causal, sex-dependent role for the anterior cingulate cortex in decisions involving information.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects often are willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No-info) vs a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%), and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory DREADDs in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC), basolateral amygdala (BLA), or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of ACC destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that the previous choice strongly predicted preference in control animals, but not in female rats following ACC inhibition. The results reveal a causal, sex-dependent role for ACC in decisions involving information.

Enhanced decision-making in nicotine dependent individuals who abstain: A computational analysis using Hierarchical Drift Diffusion Modeling

BACKGROUND

Variability in decision-making capacity and reward responsiveness may underlie differences in the ability to abstain from smoking. Computational modeling of choice behavior, as with the Hierarchical Drift Diffusion Model (HDDM), can help dissociate reward responsiveness from underlying components of decision-making. Here we used the HDDM to identify which decision-making or reward-related parameters, extracted from data acquired in a reward processing task, contributed to the ability of people who smoke that are not seeking treatment to abstain from cigarettes during a laboratory task.

METHODS

80 adults who smoke cigarettes completed the Probabilistic Reward Task (PRT) - a signal detection task with a differential reinforcement schedule - following smoking as usual, and the Relapse Analogue Task (RAT) - a task in which participants could earn money for delaying smoking up to 50min - after a period of overnight abstinence. Two cohorts were defined by the RAT; those who waited either 0-min (n=36) or the full 50-min (n=44) before smoking.

RESULTS

PRT signal detection metrics indicated all subjects learned the task contingencies, with no differences in response bias or discriminability between the two groups. However, HDDM analyses indicated faster drift rates in 50-min vs. 0-min waiters.

CONCLUSIONS

Relative to those who did not abstain, computational modeling indicated that people who abstained from smoking for 50min showed faster evidence accumulation during reward-based decision-making. These results highlight the importance of decision-making mechanisms to smoking abstinence, and suggest that focusing on the evidence accumulation process may yield new targets for treatment.

Distinct reinforcement learning profiles distinguish between language and attentional neurodevelopmental disorders

BACKGROUND

Theoretical models posit abnormalities in cortico-striatal pathways in two of the most common neurodevelopmental disorders (Developmental dyslexia, DD, and Attention deficit hyperactive disorder, ADHD), but it is still unclear what distinct cortico-striatal dysfunction might distinguish language disorders from others that exhibit very different symptomatology. Although impairments in tasks that depend on the cortico-striatal network, including reinforcement learning (RL), have been implicated in both disorders, there has been little attempt to dissociate between different types of RL or to compare learning processes in these two types of disorders. The present study builds upon prior research indicating the existence of two learning manifestations of RL and evaluates whether these processes can be differentiated in language and attention deficit disorders. We used a two-step RL task shown to dissociate model-based from model-free learning in human learners.

RESULTS

Our results show that, relative to neurotypicals, DD individuals showed an impairment in model-free but not in model-based learning, whereas in ADHD the ability to use both model-free and model-based learning strategies was significantly compromised.

CONCLUSIONS

Thus, learning impairments in DD may be linked to a selective deficit in the ability to form action-outcome associations based on previous history, whereas in ADHD some learning deficits may be related to an incapacity to pursue rewards based on the tasks' structure. Our results indicate how different patterns of learning deficits may underlie different disorders, and how computation-minded experimental approaches can differentiate between them.

Valence framing induces cognitive bias

Valence framing effects refer to inconsistent choice preferences in response to positive versus negative formulation of mathematically equivalent outcomes. Here, we manipulate valence framing in a two-alternative forced choice dictator game using gains and losses as frames to investigate the cognitive mechanisms underlying valence framing. We applied a Drift-Diffusion Model (DDM) to examine whether gain (i.e., “take” money) and loss (i.e., “give” money) frames evoke a cognitive bias as previous research did not consistently reveal framing effects using reaction times and response frequency as dependent variables. DDMs allow decomposing the decision process into separate cognitive mechanisms, whereby a cognitive bias was repeatedly associated with a shift in the starting point of the model. Conducting both a laboratory (N = 62) and an online study (N = 109), female participants allocated money between themselves and another person in a prosocial or selfish way. In each study, one group was instructed to give money (give frame), the other to take money (take frame). Consistent with previous studies, no differences were found in response times and response frequencies. However, in both studies, substantial bias towards the selfish option was found in the take frame groups, captured by the starting point of the DDM. Thus, our results suggest that valence framing induces a cognitive bias in decision processing in women, even when no behavioral differences are present.

Fronto-striatal connectivity patterns account for the impact of methylphenidate on choice impulsivity among healthy adults

Choice impulsivity depicts a preference towards smaller-sooner rewards over larger-delayed rewards, and is often assessed using a delay discounting (DD) task. Previous research uncovered the prominent role of dopaminergic signaling within fronto-striatal circuits in mediating choice impulsivity. Administration of methylphenidate (MPH), an indirect dopaminergic agonist, was shown to reduce choice impulsivity in animals and pathological populations, although significant inter-individual variability in these effects was reported. Whether MPH impacts choice impulsivity among healthy individuals, and whether variability in the impact of MPH is related to fronto-striatal activation and connectivity patterns, has yet to be assessed. Here, fifty-seven healthy young adults completed the DD task twice during fMRI scans, after acute administration of either MPH (20 mg) or placebo, in a randomized double-blind placebo-controlled design. Acute MPH administration was found to reduce choice impulsivity at the group level, yet substantial variability in this behavioral response was observed. MPH was also found to increase activation in the bilateral putamen and the right caudate, and to enhance functional connectivity between the left putamen and medial prefrontal cortex (mPFC), particularly during non-impulsive choices. Notably, the more putamen-mPFC functional connectivity increased during non-impulsive choices following MPH administration, the less an individual was likely to make impulsive choices. These findings reveal, for the first time in healthy adults, that acute MPH administration is associated with reduced choice impulsivity and increased striatal activation and fronto-striatal connectivity; and furthermore, that the magnitude of MPH-induced change in fronto-striatal connectivity may account for individual differences in the impact of MPH on impulsive behavior.

Prepubertal methylphenidate leads to sex-dependent differences in probabilistic discounting

Prescription psychostimulants, such as methylphenidate (MPH), have served as a first line treatment for ADHD and associated developmental disorders since 1961. Psychostimulants has been shown to improve attention, response inhibition, and reduce hyperactivity in patients with ADHD, as well as in non-clinical human populations and animals. While there is a considerable amount of preclinical research investigating the effects of stimulant medications on reward sensitivity and basic learning in male rats, less is understood about their effects in females. Further, there are competing theories on the long-term cognitive impact of MPH, specifically in children who do not have ADHD. To this end, Long-Evans female and male rats were exposed to methylphenidate (0, 2.5, 5 mg/kg, BID, IP) for 20 days during early development (PD10-29). After discontinuation of MPH into adulthood, rats (beginning PD 60) were trained and tested for risk-preference using a 2-choice probabilistic discounting task. For this task, rats were given an option between a 'large-risky' choice (3 sugar pellets delivered on a probabilistic VR schedule) and 'small-certain' choice (1 sugar pellet delivered on a FR schedule). Rats were subsequently tested on an open field conflict test. The results demonstrate that prepubertal exposure to MPH can have lasting effects on decision-making. Specifically, female rats treated with 2.5 mg/kg MPH displayed a decrease in preference for the risky option, whereas male rats treated with the same dose showed an overall increase in preference compared to sex-matched controls. Irrespective of sex, rats treated with 2.5 mg/kg MPH also demonstrated a decrease in anxiety/inhibitory behavior on the modified open field test compared to controls. These results were not due to differences in locomotor behavior. Overall, the study contributes to the growing body of evidence to suggest that MPH exposure early in development can have a sex-dependent impact on decision-making in adulthood.

When Helping Is Risky: The Behavioral and Neurobiological Trade-off of Social and Risk Preferences

Helping other people can entail risks for the helper. For example, when treating infectious patients, medical volunteers risk their own health. In such situations, decisions to help should depend on the individual's valuation of others' well-being (social preferences) and the degree of personal risk the individual finds acceptable (risk preferences). We investigated how these distinct preferences are psychologically and neurobiologically integrated when helping is risky. We used incentivized decision-making tasks (Study 1; N = 292 adults) and manipulated dopamine and norepinephrine levels in the brain by administering methylphenidate, atomoxetine, or a placebo (Study 2; N = 154 adults). We found that social and risk preferences are independent drivers of risky helping. Methylphenidate increased risky helping by selectively altering risk preferences rather than social preferences. Atomoxetine influenced neither risk preferences nor social preferences and did not affect risky helping. This suggests that methylphenidate-altered dopamine concentrations affect helping decisions that entail a risk to the helper.