Disrupted reinforcement learning during post-error slowing in ADHD

A critical review of hot executive functioning in youth attention-deficit/hyperactivity disorder: Methodological limitations, conceptual considerations, and future directions

Hot executive functioning (EF) - EF under emotionally or motivationally salient conditions - is a putative etiology of attention-deficit/hyperactivity disorder (ADHD), disruptive behavior problems (DBPs), and their related impairments. Despite two decades of research, the present study is the first review of the construct in youth ADHD, with a particular focus on the role of task design, age, and DBPs, as well as relevant conceptual and methodological considerations. While certain hot EF tasks have been investigated extensively (e.g., choice impulsivity), substantial inconsistency in measurement of the broader construct remains, severely limiting conclusions. Future research should a) consider the extent to which various hot EF tasks relate to one another, a higher order factor, and other related constructs; b) further investigate task design, particularly the elicitation of emotion or motivation and its anticipated effect on EF; and c) incorporate multiple levels of analysis to validate similarities and differences among tasks with regard to the affective experiences and cognitive demands they elicit. With improved measurement and conceptual clarity, hot EF has potential to advance the literature on etiological pathways to ADHD, DBPs and associated impairments and, more broadly, may represent a useful tool for understanding the influence of emotion and motivation on cognition.

Neurobiological basis of reinforcement-based decision making in adults with ADHD treated with lisdexamfetamine dimesylate: Preliminary findings and implications for mechanisms influencing clinical improvement

BACKGROUND

ADHD is often described as a disorder of altered reward sensitivity, yet few studies have examined the extent to which: (i) treatments for ADHD impact reward-related mechanisms; and (ii) changes in the reward system are associated with clinical improvement. This study addresses these issues - examining the extent to which clinical improvement following lisdexamfetamine (LDX) treatment is associated with changes in brain reward system activation.

METHODS

Twenty adults (M = 11, 55%, F = 9, 45%), ages 19-52 (M = 33.9, SD = 10.0) with ADHD participated in a randomized cross-over study with lisdexamfetamine (LDX) and placebo (PB). Changes in brain activation were assessed during functional magnetic resonance (fMRI) scans: after receiving 3-5 weeks of treatment with LDX and 3-5 weeks of no drug/PB. fMRI contrasts were derived from the passive-avoidance (PA) learning task, which assessed reward-related learning using computational variables. We analyzed the following conditions: the Choice-Phase, modulated by the expected value (EV; i.e., object-choose and object-reject), and the Feedback-Phase, modulated by the prediction error (PE; i.e., reward and punish). Clinical symptom severity was assessed via interview with the ADHD-Rating Scale (ADHD-RS-IV). To address the primary objective, we performed group-level mass-univariate regression analyses between LDX and PB of percent change of the ADHD-RS total scores and the four contrast images under the Choice- and Feedback-conditions. Significance was set at a whole-brain voxel-wise threshold of p < 0.05 with family-wise error (FWE) correction and an extent (cluster) threshold of 50 contiguous voxels.

RESULTS

Improvement in ADHD symptoms with LDX was accompanied by significantly increased activation in a series of brain regions previously implicated in reinforcement processing in the choice and feedback conditions (e.g., left caudate and putamen, right orbitofrontal cortex, left middle frontal, superior frontal, and precentral gyri).

CONCLUSIONS

These findings, while preliminary, are the first to show that ADHD symptom improvement with stimulant treatment is associated with increased responsiveness of brain systems engaged in reward processing. Results support the hypothesis that LDX treatment may restore balance to dysfunction (e.g., hypoactivation) within the brain reward circuitry in adults with ADHD. Trial RegistrationClinicaltrials.gov Identifier: NCT01924429.

Success versus failure in cognitive control: Meta-analytic evidence from neuroimaging studies on error processing

Brain mechanisms of error processing have often been investigated using response interference tasks and focusing on the posterior medial frontal cortex, which is also implicated in resolving response conflict in general. Thereby, the role other brain regions may play has remained undervalued. Here, activation likelihood estimation meta-analyses were used to synthesize the neuroimaging literature on brain activity related to committing errors versus responding successfully in interference tasks and to test for commonalities and differences. The salience network and the temporoparietal junction were commonly recruited irrespective of whether responses were correct or incorrect, pointing towards a general involvement in coping with situations that call for increased cognitive control. The dorsal posterior cingulate cortex, posterior thalamus, and left superior frontal gyrus showed error-specific convergence, which underscores their consistent involvement when performance goals are not met. In contrast, successful responding revealed stronger convergence in the dorsal attention network and lateral prefrontal regions. Underrecruiting these regions in error trials may reflect failures in activating the task-appropriate stimulus-response contingencies necessary for successful response execution.

Prenatal heroin exposure alters brain morphology and connectivity in adolescent mice

The United States is experiencing a dramatic increase in maternal opioid misuse and, consequently, the number of individuals exposed to opioids in utero. Prenatal opioid exposure has both acute and long-lasting effects on health and wellbeing. Effects on the brain, often identified at school age, manifest as cognitive impairment, attention deficit, and reduced scholastic achievement. The neurobiological basis for these effects is poorly understood. Here, we examine how in utero exposure to heroin affects brain development into early adolescence in a mouse model. Pregnant C57BL/6J mice received escalating doses of heroin twice daily on gestational days 4-18. The brains of offspring were assessed on postnatal day 28 using 9.4 T diffusion MRI of postmortem specimens at 36 μm resolution. Whole-brain volumes and the volumes of 166 bilateral regions were compared between heroin-exposed and control offspring. We identified a reduction in whole-brain volume in heroin-exposed offspring and heroin-associated volume changes in 29 regions after standardizing for whole-brain volume. Regions with bilaterally reduced standardized volumes in heroin-exposed offspring relative to controls include the ectorhinal and insular cortices. Regions with bilaterally increased standardized volumes in heroin-exposed offspring relative to controls include the periaqueductal gray, septal region, striatum, and hypothalamus. Leveraging microscopic resolution diffusion tensor imaging and precise regional parcellation, we generated whole-brain structural MRI diffusion connectomes. Using a dimension reduction approach with multivariate analysis of variance to assess group differences in the connectome, we found that in utero heroin exposure altered structure-based connectivity of the left septal region and the region that acts as a hub for limbic regulatory actions. Consistent with clinical evidence, our findings suggest that prenatal opioid exposure may have effects on brain morphology, connectivity, and, consequently, function that persist into adolescence. This work expands our understanding of the risks associated with opioid misuse during pregnancy and identifies biomarkers that may facilitate diagnosis and treatment.

Catecholaminergic and cholinergic neuromodulation in autism spectrum disorder: A comparison to attention-deficit hyperactivity disorder

Autism spectrum disorder (ASD) is a heterogeneous neurodevelopmental disorder characterized by social impairments and restricted, repetitive behaviors. Treatment of ASD is notoriously difficult and might benefit from identification of underlying mechanisms that overlap with those disturbed in other developmental disorders, for which treatment options are more obvious. One example of the latter is attention-deficit hyperactivity disorder (ADHD), given the efficacy of especially stimulants in treatment of ADHD. Deficiencies in catecholaminergic systems [dopamine (DA), norepinephrine (NE)] in ADHD are obvious targets for stimulant treatment. Recent findings suggest that dysfunction in catecholaminergic systems may also be a factor in at least a subgroup of ASD. In this review we scrutinize the evidence for catecholaminergic mechanisms underlying ASD symptoms, and also include in this analysis a third classic ascending arousing system, the acetylcholinergic (ACh) network. We complement this with a comprehensive review of DA-, NE-, and ACh-targeted interventions in ASD, and an exploratory search for potential treatment-response predictors (biomarkers) in ASD, genetically or otherwise. Based on this review and analysis we propose that (1) stimulant treatment may be a viable option for an ASD subcategory, possibly defined by genetic subtyping; (2) cerebellar dysfunction is pronounced for a relatively small ADHD subgroup but much more common in ASD and in both cases may point toward NE- or ACh-directed intervention; (3) deficiency of the cortical salience network is sizable in subgroups of both disorders, and biomarkers such as eye blink rate and pupillometric data may predict the efficacy of targeting this underlying deficiency via DA, NE, or ACh in both ASD and ADHD.

Dopaminergic and nitric oxide systems interact to regulate the electrical activity of neurons in the medial septal nucleus in rats

Research characterizing the neuronal substrate of anxiety has implicated different brain areas, including the medial septal nucleus (m-SEPT). Previous reports indicated a role of dopamine and nitric oxide (NO) in anxiety-related behaviors. In this study, the extracellular single-unit recording was performed from the m-SEPT in adult male albino Wistar rats. Baseline activity was recorded for 5 min, and the post-injection recording was performed for another 5 min after the microinjection of each drug. The results showed that (1) both D1- and D2-like receptor agonists (SKF-38393 and quinpirole) enhanced the firing rate of m-SEPT neurons; (2) both D1- and D2-like antagonists (SCH-23390 and sulpiride) attenuated the firing rate of m-SEPT neurons; (3) L-arginine (NO precursor) increased the firing rate of m-SEPT neurons, but a non-specific NOS inhibitor, L-NAME, elicited no significant alterations; (4) the non-specific NOS inhibitor reversed the enhanced firing rate produced by SKF-38393 and quinpirole; (5) neither of the dopaminergic antagonists changed the enhanced activity resulted from the application of the NO precursor. These results contribute to our understanding of the complex neurotransmitter interactions in the m-SEPT and showed that both dopaminergic and NO neurotransmission are involved in the modulation of the firing rate of neurons in the m-SEPT.

The Asymmetric Laplace Gaussian (ALG) Distribution as the Descriptive Model for the Internal Proactive Inhibition in the Standard Stop Signal Task

Measurements of response inhibition components of reactive inhibition and proactive inhibition within the stop-signal paradigm have been of particular interest to researchers since the 1980s. While frequentist nonparametric and Bayesian parametric methods have been proposed to precisely estimate the entire distribution of reactive inhibition, quantified by stop signal reaction times (SSRT), there is no method yet in the stop signal task literature to precisely estimate the entire distribution of proactive inhibition. We identify the proactive inhibition as the difference of go reaction times for go trials following stop trials versus those following go trials and introduce an Asymmetric Laplace Gaussian (ALG) model to describe its distribution. The proposed method is based on two assumptions of independent trial type (go/stop) reaction times and Ex-Gaussian (ExG) models. Results indicated that the four parametric ALG model uniquely describes the proactive inhibition distribution and its key shape features, and its hazard function is monotonically increasing, as are its three parametric ExG components. In conclusion, the four parametric ALG model can be used for both response inhibition components and its parameters and descriptive and shape statistics can be used to classify both components in a spectrum of clinical conditions.

VTA dopamine neuron activity encodes social interaction and promotes reinforcement learning through social prediction error

Social interactions are motivated behaviors that in many species facilitate learning. However, how the brain encodes the reinforcing properties of social interactions remains elusive. Here, using in vivo recording in freely moving mice, we show that dopamine (DA) neurons of the ventral tegmental area (VTA) increase their activity during interactions with an unfamiliar conspecific and display heterogeneous responses. Using a social instrumental task (SIT), we then show that VTA DA neuron activity encodes social prediction error and drives social reinforcement learning. Thus, our findings suggest that VTA DA neurons are a neural substrate for a social learning signal that drives motivated behavior.

Reinforcement and Compensatory Mechanisms in Attention-Deficit Hyperactivity Disorder: A Systematic Review of Case-Control Studies

Attention-deficit hyperactivity disorder (ADHD) is a neuropsychological disorder that causes inattentiveness, hyperactivity, and impulsiveness in patients. Ventral striatal hypo-responsiveness, orbitofrontal cortex, and dopaminergic status in the brain are related to the pathogenesis of ADHD. Reinforcement tasks by monetary incentive delay (MID) was shown to produce more responsiveness in patients. In this study, we reviewed how reinforcement interventions and compensatory mechanisms affect the behavior of ADHD patients. This systematic review was undertaken as per the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines, and PubMed database was used for literature search. The quality appraisal was completed using the Newcastle-Ottawa scale, and nine case-control studies were included in this systematic review. A total of 976 participants were included, with 493 cases and 330 controls. The studies included discuss reinforcement, attention networks, and compensatory mechanisms. Our review concludes that reinforcement improves responsiveness to gain and loss of rewards in ADHD patients. Reward processing is selectively associated with the salience network. While ADHD, predominantly the inattentive type, is insensitive to stimuli, ADHD combined type and controls showed similar responsiveness. The right visual cortex may also be related to compensatory mechanisms in ADHD. As we only included case-control studies from the last eight years, in the English language, we might have missed some relevant studies related to this research. Because the included studies have a relatively small sample size, we recommend future studies to explore larger cohorts of patients to improve the reliability of findings pertinent to this field.

Visual statistical learning and integration of perceptual priors are intact in attention deficit hyperactivity disorder

Background

Deficits in visual statistical learning and predictive processing could in principle explain the key characteristics of inattention and distractibility in attention deficit hyperactivity disorder (ADHD). Specifically, from a Bayesian perspective, ADHD may be associated with flatter likelihoods (increased sensory processing noise), and/or difficulties in generating or using predictions. To our knowledge, such hypotheses have never been directly tested.

Methods

We here test these hypotheses by evaluating whether adults diagnosed with ADHD (n = 17) differed from a control group (n = 30) in implicitly learning and using low-level perceptual priors to guide sensory processing. We used a visual statistical learning task in which participants had to estimate the direction of a cloud of coherently moving dots. Unbeknown to the participants, two of the directions were more frequently presented than the others, creating an implicit bias (prior) towards those directions. This task had previously revealed differences in other neurodevelopmental disorders, such as autistic spectrum disorder and schizophrenia.

Results

We found that both groups acquired the prior expectation for the most frequent directions and that these expectations substantially influenced task performance. Overall, there were no group differences in how much the priors influenced performance. However, subtle group differences were found in the influence of the prior over time.

Conclusion

Our findings suggest that the symptoms of inattention and hyperactivity in ADHD do not stem from broad difficulties in developing and/or using low-level perceptual priors.

Reduced striatal GABA in unmedicated children with ADHD at 7T

Attention-deficit hyperactive disorder (ADHD) is characterized by inattention and increased impulsive and hypermotoric behaviors.Despite the high prevalence and impact of ADHD, little is known about the underlying neurophysiology of ADHD. The main inhibitory and excitatory neurotransmitters γ-aminobutyric acid (GABA) and glutamate are receiving increased attention in ADHD and can be measured using Magnetic Resonance Spectroscopy (MRS). However, MRS studies in ADHD are limited. We measured GABA and glutamate in young unmedicated participants, utilizing high magnetic field strength. Fifty unmedicated children (26 with ADHD, 24 controls) aged 5-9 years completed MRS at 7T and behavioral testing. GABA and glutamate were measured in dorsolateral prefrontal cortex (DLPFC), anterior cingulate cortex (ACC), premotor cortex (PMC), and striatum, and estimated using LCModel. Children with ADHD showed poorer inhibitory control and significantly reduced GABA/Cr in the striatum, but not in ACC, DLPFC, or PMC regions. There were no significant group differences for Glu/Cr levels, or correlations with behavioral manifestations of ADHD. The primary finding of this study is a reduction of striatal GABA levels in unmedicated children with ADHD at 7T. These findings provide guidance for future studies or interventions. Reduced striatal GABA may be a marker for specific GABA-related treatment for ADHD.

BOLD differences normally attributed to inhibitory control predict symptoms, not task-directed inhibitory control in ADHD

Background

Altered brain activity that has been observed in attention deficit hyperactivity disorder (ADHD) while performing cognitive control tasks like the stop signal task (SST) has generally been interpreted as reflecting either weak (under-active) or compensatory (over-active) versions of the same functions as in healthy controls. If so, then regional activities that correlate with the efficiency of inhibitory control (i.e. stop signal reaction time, SSRT) in healthy subjects should also correlate with SSRT in ADHD. Here we test the alternate hypothesis that BOLD (blood-oxygen-level-dependent) differences might instead reflect the redirection of neural processing resources normally used for task-directed inhibitory control, towards actively managing symptomatic behaviour. If so, then activities that correlate with SSRT in TD should instead correlate with inattentive and hyperactive symptoms in ADHD.

Methods

We used fMRI (functional magnetic resonance imaging) in 14 typically developing (TD) and 14 ADHD adolescents performing the SST, and in a replication sample of 14 healthy adults. First, we identified significant group BOLD differences during all phases of activity in the SST (i.e. warning, response, reactive inhibition, error detection and post-error slowing). Next, we correlated these phases of activity with SSRT in TD and with SSRT, inattentive and hyperactive symptom scores in ADHD. We then identified whole brain significant correlations in regions of significant group difference in activity.

Results

Only three regions of significant group difference were correlated with SSRT in TD and replication groups (left and right inferior frontal gyri (IFG) during error detection and hypothalamus during post-error slowing). Consistent with regions of altered activity managing symptomatic behaviour instead of task-directed behaviour, left IFG correlated with greater inattentive score, right IFG correlated with lower hyperactive score and hypothalamus correlated with greater inattentive score and oppositely correlated with SSRT compared to TD.

Conclusions

Stimuli that elicit task-directed integration of neural processing in healthy subjects instead appear to be directing integrated function towards managing symptomatic behaviour in ADHD. The ability of the current approach to determine whether altered neural activities reflect comparable functions in ADHD and control groups has broad implications for the development and monitoring of therapeutic interventions.

Methamphetamine Users Show No Behavioral Deficits in Response Selection After Protracted Abstinence

Introduction: Chronic recreational methamphetamine use causes dopaminergic neurotoxicity, which has been linked to impairments in executive functioning. Within this functional domain, response selection and the resolution of associated conflicts have repeatedly been demonstrated to be strongly modulated by dopamine. Yet, it has never been investigated whether chronic methamphetamine use leads to general impairments in response selection (i.e., irrespective of consumption-associated behavior) after substance use is discontinued. Materials and Methods: We tested n = 24 abstinent methamphetamine users (on average 2.7 years of abstinence) and n = 24 individually matched controls in a cross-sectional design with a flanker task. Results: Compared to healthy controls, former methamphetamine consumers had significantly slower reaction times, but did not show differences in the size of the flanker or Gratton effect, or post-error slowing. Complementary Bayesian analyses further substantiated this lack of effects despite prior consumption for an average of 7.2 years. Discussion: The ability to select a correct response from a subset of conflicting alternatives, as well as the selective attention required for this seem to be largely preserved in case of prolonged abstinence. Likewise, the ability to take previous contextual information into account during response selection and to process errors seem to be largely preserved as well. Complementing previously published finding of worse inhibition/interference control in abstinent consumers, our results suggest that not all executive domains are (equally) impaired by methamphetamine, possibly because different cognitive processes require different levels of dopamine activity.