An electrophysiological investigation of reinforcement effects in attention deficit/hyperactivity disorder: Dissociating cue sensitivity from down-stream effects on target engagement and performance

Brain stimulation over the left DLPFC enhances motivation for effortful rewards in patients with major depressive disorder

BACKGROUND

Amotivation is a typical feature in major depressive disorder (MDD), which produces reduced willingness to exert effort. The dorsolateral prefrontal cortex (DLPFC) is a crucial structure in goal-directed actions and therefore is a potential target in modulating effortful motivation. However, it remains unclear whether the intervention is effective for patients with MDD.

METHODS

We employed transcranial magnetic stimulation (TMS), computational modelling and event-related potentials (ERPs) to reveal the causal relationship between the left DLPFC and motivation for effortful rewards in MDD. Fifty patients underwent both active and sham TMS sessions, each followed by performing an Effort-Expenditure for Rewards Task, during which participants chose and implemented between low-effort/low-reward and high-effort/high-reward options.

RESULTS

The patients showed increased willingness to exert effort for rewards during the DLPFC facilitated session, compared with the sham session. They also had a trend in larger P3 amplitude for motivated attention toward chosen options, larger CNV during preparing for effort exertion, and larger SPN during anticipating a high reward. Besides, while behavior indexes for effortful choices were negatively related to depression severity in the sham session, this correlation was weakened in the active stimulation session.

CONCLUSIONS

These findings provide behavioral, computational, and neural evidence for the left DLPFC on effortful motivation for rewards. Facilitated DLPFC improves motor preparation and value anticipation after making decisions especially for highly effortful rewards in MDD. Facilitated DLPFC also has a potential function in enhancing motivated attention during cost-benefit trade-off. This neuromodulation effect provides a potential treatment for improving motivation in clinics.

The domain-variant indirect association between electrophysiological response to reward and ADHD presentations is moderated by dopaminergic polymorphisms

BACKGROUND

Understanding the etiopathogenesis of attention-deficit/hyperactivity disorder (ADHD) may necessitate decomposition of the heterogeneous clinical phenotype into more homogeneous intermediate phenotypes. Reinforcement sensitivity is a promising candidate, but the exact nature of the ADHD-reward relation - including how, for whom, and to which ADHD dimensions atypicalities in reward processing are relevant - is equivocal.

METHODS

Aims were to examine, in a carefully phenotyped sample of adolescents (N = 305; Mage = 15.30 years, SD = 1.07; 39.7% girls), whether functional dopaminergic polymorphisms implicated in both reward processing and ADHD (1) are differentially associated with event-related potentials (ERPs) of reward anticipation at distinct levels of ADHD risk (nno risk = 174, nat-risk = 131, ndiagnosed = 83); and (2) moderate the indirect effect of dispositional affectivity on the association between ERPs and ADHD domains.

RESULTS

In adolescents at-risk for or with ADHD, carrying a hypodopaminergic allele was associated with enhanced ERPs of attention allocation to cue and attenuated ERPs of anticipatory attention to feedback. No associations were observed in adolescents not at-risk for or without ADHD. Controlling for age and sex, both the negative indirect effect of positive affectivity (PA) on the association between ERPs and inattention and the positive indirect effect of PA on the association between ERPs and hyperactivity/impulsivity were supported only for those with high activity dopamine transporter (DAT) alleles.

CONCLUSIONS

Reward and affective processing are promising intermediate phenotypes relevant to disentangling ADHD developmental pathways. Consistent with developmental multifinality, through the successive effects of reward anticipation and positive affectivity, functional dopaminergic variants may confer protection against inattention or risk for hyperactivity/impulsivity.

Adolescent ADHD and electrophysiological reward responsiveness: A machine learning approach to evaluate classification accuracy and prognosis

We evaluated event-related potential (ERP) indices of reinforcement sensitivity as ADHD biomarkers by examining, in N=306 adolescents (M_age=15.78, SD=1.08), the extent to which ERP amplitude and latency variables measuring reward anticipation and response (1) differentiate, in age- and sex-matched subsamples, (i) youth with vs. without ADHD, (ii) youth at-risk for vs. not at-risk for ADHD, and, in the with ADHD subsample, (iii) youth with the inattentive vs. the hyperactive/impulsive (H/I) and combined presentations. We further examined the extent to which ERP variables (2) predict, in the ADHD subsample, substance use (i) concurrently and (ii) prospectively at 18-month follow-up. Linear support vector machine analyses indicated ERPs weakly differentiate youth with/without (65%) - and at-risk for/not at-risk for (63%) - ADHD but better differentiate ADHD presentations (78%). Regression analyses showed in adolescents with ADHD, ERPs explain a considerable proportion of variance (50%) in concurrent alcohol use and, controlling for concurrent marijuana and tobacco use, explain a considerable proportion of variance (87 and 87%) in, and predict later marijuana and tobacco use. Findings are consistent with the dual-pathway model of ADHD. Results also highlight limitations of a dichotomous, syndromic classification and indicate differences in neural reinforcement sensitivity are a promising ADHD prognostic biomarker.

Differentiating the abnormalities of social and monetary reward processing associated with depressive symptoms

BACKGROUND

Reward dysfunction is a major dimension of depressive symptomatology, but it remains obscure if that dysfunction varies across different reward types. In this study, we focus on the abnormalities in anticipatory/consummatory processing of monetary and social reward associated with depressive symptoms.

METHODS

Forty participants with depressive symptoms and forty normal controls completed the monetary incentive delay (MID) and social incentive delay (SID) tasks with event-related potential (ERP) recording.

RESULTS

In the SID but not the MID task, both the behavioral hit rate and the ERP component contingent negative variation (CNV; indicating reward anticipation) were sensitive to the interaction between the grouping factor and reward magnitude; that is, the depressive group showed a lower hit rate and a smaller CNV to large-magnitude (but not small-magnitude) social reward cues compared to the control group. Further, these two indexes were correlated with each other. Meanwhile, the ERP components feedback-related negativity and P3 (indicating reward consumption) were sensitive to the main effect of depression across the MID and SID tasks, though this effect was more prominent in the SID task.

CONCLUSIONS

Overall, we suggest that depressive symptoms are associated with deficits in both the reward anticipation and reward consumption stages, particularly for social rewards. These findings have a potential to characterize the profile of functional impairment that comprises and maintains depression.

Reliability of reward ERPs in middle-late adolescents using a custom and a standardized preprocessing pipeline

Despite advantage of neuroimaging measures in translational research frameworks, less is known about the psychometric properties thereof, especially in middle-late adolescents. Earlier, we examined evidence of convergent and incremental validity of reward anticipation and response event-related potentials (ERPs) and here we examined, in the same sample of 43 adolescents (M_age  = 15.67 years; SD = 1.01; range: 14-18; 32.6% boys), data quality (signal-to-noise ratio [SNR]), stability (mean amplitude across trials), and internal consistency (Cronbach's α and split-half reliability) of the same ERPs. Further, because observed time course and peak amplitude of ERP grand averages and thus findings on SNR, stability, and internal consistency may depend on preprocessing method, we employed a custom and a standardized preprocessing pipeline and compared findings across those. Using our custom pipeline, reward anticipation components were stable by the 40th trial, achieved acceptable internal consistency by the 19th, and all (but the stimulus-preceding negativity [SPN]) achieved acceptable SNR by the 41st trial. Initial response to reward components were stable by the 20th trial and achieved acceptable internal consistency by the 11th and acceptable SNR by the 45th trial. Difference scores had worse psychometric properties than parent measures. Time course and peak amplitudes of ERPs and thus results on SNR, stability, and internal consistency were comparable across preprocessing pipelines. In case of reward anticipation ERPs examined here, 41 trials (+4 artifacted and removed) and, in case of reward response ERPs, 45 trials (+5 artifacted) yielded stable and internally consistent estimates with acceptable SNR. Results are robust across preprocessing methods.

The Limits of Motivational Influence in ADHD: No Evidence for an Altered Reaction to Negative Reinforcement

Functional magnetic resonance imaging studies have reported a diminished response in the brain’s reward circuits to contingent cues predicting future monetary gain in adolescents with attention-deficit/hyperactivity disorder (ADHD). The situation with regard to monetary loss is less clear, despite recognition that both positive and negative consequences impact ADHD behaviour. Here, we employ a new Escape Monetary Loss Incentive task in an MRI scanner, which allows the differentiation of contingency and valence effects during loss avoidance, to examine ADHD-related alterations in monetary loss processing. There was no evidence of atypical processing of contingent or non-contingent monetary loss cues in ADHD — either in terms of ratings of emotional and motivational significance or brain responses. This suggests that the ability to process contingencies between performance and negative outcomes is intact in ADHD and that individuals with ADHD are no more (or less) sensitive to negative outcomes than controls. This latter finding stands in stark contrast to recent evidence from a similar task of atypical emotion network recruitment (e.g. amygdala) in ADHD individuals to cues predicting another negative event, the imposition of delay, suggesting marked specificity in the way they respond to negative events.

I, robot: depression plays different roles in human-human and human-robot interactions

Socially engaging robots have been increasingly applied to alleviate depressive symptoms and to improve the quality of social life among different populations. Seeing that depression negatively influences social reward processing in everyday interaction, we investigate this influence during simulated interactions with humans or robots. In this study, 35 participants with mild depression and 35 controls (all from nonclinical populations) finished the social incentive delay task with event-related potential recording, in which they received performance feedback from other persons or from a robot. Compared to the controls, the mild depressive symptom (MDS) group represented abnormalities of social reward processing in the human feedback condition: first, the MDS group showed a lower hit rate and a smaller contingent-negative variation (correlated with each other) during reward anticipation; second, depression level modulated both the early phase (indexed by the feedback-related negativity (FRN)) and the late phase (indexed by the P3) of reward consumption. In contrast, the effect of depression was evident only on FRN amplitude in the robot feedback condition. We suggest that compared to human-human interaction, the rewarding properties of human-robot interaction are less likely to be affected by depression. These findings have implications for the utilization of robot-assisted intervention in clinical practice.

Reinforcement and Compensatory Mechanisms in Attention-Deficit Hyperactivity Disorder: A Systematic Review of Case-Control Studies

Attention-deficit hyperactivity disorder (ADHD) is a neuropsychological disorder that causes inattentiveness, hyperactivity, and impulsiveness in patients. Ventral striatal hypo-responsiveness, orbitofrontal cortex, and dopaminergic status in the brain are related to the pathogenesis of ADHD. Reinforcement tasks by monetary incentive delay (MID) was shown to produce more responsiveness in patients. In this study, we reviewed how reinforcement interventions and compensatory mechanisms affect the behavior of ADHD patients. This systematic review was undertaken as per the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines, and PubMed database was used for literature search. The quality appraisal was completed using the Newcastle-Ottawa scale, and nine case-control studies were included in this systematic review. A total of 976 participants were included, with 493 cases and 330 controls. The studies included discuss reinforcement, attention networks, and compensatory mechanisms. Our review concludes that reinforcement improves responsiveness to gain and loss of rewards in ADHD patients. Reward processing is selectively associated with the salience network. While ADHD, predominantly the inattentive type, is insensitive to stimuli, ADHD combined type and controls showed similar responsiveness. The right visual cortex may also be related to compensatory mechanisms in ADHD. As we only included case-control studies from the last eight years, in the English language, we might have missed some relevant studies related to this research. Because the included studies have a relatively small sample size, we recommend future studies to explore larger cohorts of patients to improve the reliability of findings pertinent to this field.

Task-related motivation and academic achievement in children and adolescents with ADHD

Academic impairment in individuals with attention-deficit/hyperactivity disorder (ADHD) is in part due to reduced motivation for academic tasks, which is likely to vary as a function of task characteristics. The current study employed a new questionnaire-the Child and Adolescent Motivational Profile (CHAMP)-to examine; (1) which task characteristic participants with ADHD perceive as most motivating relative to typically developing peers (TDP) and (2) whether these differences mediate academic functioning. 34 participants with ADHD and 435 TDP (8-16 years) completed the CHAMP. Academic achievement (grade point average) and self-reported positive/negative classroom experiences were recorded. No task characteristics were rated higher in terms of their motivational salience in the ADHD group than in the control sample. Marked/graded, Socially evaluated, Collaborative, Requiring focus and Cognitively challenging task characteristics were rated significantly lower by the ADHD group than controls. The lower rating of Socially evaluated was explained by comorbid ODD symptoms. Cognitively challenging was rated as particularly unmotivating by individuals with ADHD. ADHD was associated with a decreased GPA and a more negative classroom experience. The associations between ADHD and GPA/negative classroom experience were both partially mediated by scores on the Cognitively Challenging scale. For children and adolescents with ADHD tasks that are cognitively challenging were not particularly motivating. To increase task motivation, and improve academic performance of individuals with ADHD, it may be important to include rewarded task elements as they are appraised as particularly motivating by these individuals and this appraisal was similar to that of TDP.

Altered Neural Processing of Reward and Punishment in Women With Methamphetamine Use Disorder

It has been suggested that the altered function of reward and punishment is an important vulnerability factor leading to the development of drug use disorders. Previous studies have identified evidence of neurophysiological dysfunction in the reward process of individuals with substance use disorders. To date, only a few event-related potential (ERP) studies have examined the neural basis of reward and punishment processing in women with methamphetamine (MA) use disorders. The current ERP research aims to investigate the neurophysiological mechanisms of reward and punishment in women with MA use disorder using a monetary incentive delay task. Nineteen women with MA use disorder (MA group) and 20 healthy controls (HC group) were recruited in this study. The behavioral data showed that the reaction time (RT) was faster and the response accuracy (ACC) was higher for the potential reward and punishment conditions compared to neutral conditions. During the monetary incentive anticipation stage, the Cue-P3, and stimulus-preceding negativity (SPN) were larger in the MA group than in the HC group. The SPN under the potential reward condition was larger than that under the neutral condition in the MA group but not in the HC group. During the monetary incentive consummation stage, the feedback-related negativity and feedback P3 (FB-P3) following positive feedback were significantly larger than negative feedback in the potential reward condition for the HC group, but not for the MA group. However, the FB-P3 following negative feedback was significantly larger than positive feedback in the potential punishment condition for the MA group, but not the HC group. The results suggest that women with MUD have stronger expectations of generic reward and stronger response of generic harm avoidance, which could be targeted in designing interventions for women with MA use disorder.

Neural and self-reported reward responsiveness are associated with dispositional affectivity and emotion dysregulation in adolescents with evidence for convergent and incremental validity

Adolescence is a developmental period characterized by heightened reward sensitivity which, in turn, confers risk for pertinent negative outcomes, underscoring the need to better understand biological bases and behavioral correlates of reward responsiveness during this developmental phase. Our goals in the current study were to examine, in a sample of 43 typically developing adolescents (M_age  = 15.67 years; SD = 1.01; 32.6% boys), (1) evidence of convergent validity between neural and self-report reward responsiveness, (2) associations between neural reward responsiveness and self-report dispositional affectivity and emotion dysregulation (ED) and (3) evidence of incremental validity of self-report beyond neural reward responsiveness in predicting affectivity and ED. During electroencephalography (EEG), adolescents completed two experimental paradigms probing event-related potential (ERP) indices of reward anticipation and initial responsiveness to reward attainment. Following EEG, they completed self-report measures of reward responsiveness, affectivity, and ED. Findings indicated some evidence of convergent validity between enhanced ERP indices of reward anticipation and initial response to reward and greater reinforcement sensitivity; that ERP indices of both reward responsiveness aspects predicted lower negative affectivity and less ED; and evidence of incremental validity of self-report beyond neural reward responsiveness in predicting outcomes. Results underscore the utility of a multi-method framework in assessing adolescent reward responsiveness and support the relevance of reward responsiveness in explaining individual differences in dispositional affectivity and ED.

Neural generators involved in visual cue processing in children with attention-deficit/hyperactivity disorder (ADHD)

Event-related potentials (ERP) studies report alterations in the ongoing visuo-attentional processes in children with attention-deficit/hyperactivity disorder (ADHD). We hypothesized that the neural generators progressively recruited after a cue stimulus imply executive-related areas well before engagement in executive processing in children with ADHD compared to typically developed children (TDC). We computed source localization (swLORETA) of the ERP and ERSP evoked by the Cue stimulus during a visual Cue-Go/Nogo paradigm in 15 ADHD compared to 16 TDC. A significant difference in N200/P200 amplitude over the right centro-frontal regions was observed between ADHD and TDC, supported by a stronger contribution of the left visuo-motor coordination area, premotor cortex, and prefrontal cortex in ADHD. In addition, we recorded a greater beta power spectrum in ADHD during the 80-230 ms interval, which was explained by increased activity in occipito-parieto-central areas and lower activity in the left supramarginal gyrus and prefrontal areas in ADHD. Successive analysis of the ERP generators (0-500 ms with successive periods of 50 ms) revealed significant differences beginning at 50 ms, with higher activity in the ventral anterior cingulate cortex, premotor cortex, and fusiform gyrus, and ending at 400-500 ms with higher activity of the dorsolateral prefrontal cortex and lower activity of the posterior cingulate cortex in ADHD compared to TDC. The areas contributing to ERP in ADHD and TDC differ from the early steps of visuo-attentional processing and reveal an overinvestment of the executive networks interfering with the activity of the dorsal attention network in children with ADHD.

Electrophysiological correlates of spontaneous mind wandering in attention-deficit/hyperactivity disorder

We recently hypothesised that increased spontaneous mind wandering (MW-S) reflects a core process underlying attention-deficit/hyperactivity disorder (ADHD). Previous studies show that individuals with ADHD and neurotypical individuals with increased MW-S display similar cognitive-performance and electrophysiological (EEG) impairments in attentional processes. However, the cognitive-EEG markers associated with increased MW-S in ADHD remain poorly understood. We therefore investigated such markers in a sample of 69 sex- and age-matched adults with ADHD and 29 controls during the Sustained Attention to Response Task. We compared task performance and EEG measures (P3, time-frequency brain-oscillations) of attentional processes between groups, and examined their association with a validated self-report questionnaire of MW-S. Finally, we tested the hypothesis that MW-S and ADHD diagnosis relate to the same cognitive-EEG impairments using a hierarchical regression model. Compared to controls, adults with ADHD showed attenuations in P3, event-related alpha and beta suppression during response inhibition (No-Go trials), and theta power activations during response execution (Go trials), as well as increased reaction time variability and more commission/omission errors. MW-S was also continuously associated with most cognitive-EEG measures related to ADHD. The hierarchical regressions on measures associated with both ADHD diagnosis and MW-S showed that MW-S did not explain additional variance in the cognitive-EEG markers (except for beta suppression) beyond ADHD diagnosis, and vice versa. These findings are consistent with our hypothesis that ADHD diagnosis and MW-S share common neural deficits, and that MW-S may reflect a core symptom of the disorder.

In Quest of Pathognomonic/Endophenotypic Markers of Attention Deficit Hyperactivity Disorder (ADHD): Potential of EEG-Based Frequency Analysis and ERPs to Better Detect, Prevent and Manage ADHD

Attention deficit hyperactivity disorder (ADHD) is a chronic heritable developmental delay psychiatric disorder requiring chronic management, characterized by inattention, hyperactivity, hyperkinectivity and impulsivity. Subjective clinical evaluation still remains crucial in its diagnosis. Discussed are two key aspects in the “characterizing ADHD” and on the quest for objective “pathognomonic/endophenotypic diagnostic markers of ADHD”. The first aspect briefly revolves around issues related to identification of pathognomonic/endophenotypic diagnostic markers in ADHD. Issues discussed include changes in ADHD definition, remission/persistence and overlapping-symptoms cum shared-heritability with its co-morbid cross-border mental disorders. The second aspect discussed is neurobiological and EEG-based studies on ADHD. Given the neurobiological and temporal aspects of ADHD symptoms the electroencephalograph (EEG) like NeuralScan by Medeia appears as an appropriate tool. The EEGs appropriateness is further enhanced when coupled with suitable behavior/cognitive/motor/psychological tasks/paradigms yielding EEG-based markers like event-related-potential (ERPs like P3 amplitudes and latency), reaction time variability (RTV), Theta:Beta ratio (TBR) and sensorimotor rhythm (SMR). At present, these markers could potentially help in the neurobiological characterization of ADHD and either help in identifying or lay the groundwork for identifying pathognomonic and/or endophenotypic EEG-based markers enabling its diagnosis, treatment and management.

The reinforcing value of delay escape in attention deficit/hyperactivity disorder: An electrophysiological study

The delay aversion hypothesis argues that the tendency for impulsive choice (preference for smaller sooner over larger later rewards) is motivated by the escape of negative affective states associated with delay. This model predicts that individuals with ADHD find the imposition of delay before an outcome or event especially aversive and its escape reinforcing. Consistent with this, fMRI studies show that ADHD is associated with amygdala hyper-sensitivity to cues of delay. However, evidence that delay escape is reinforcing is lacking. Here we extend fMRI research by using electrophysiological methods to study the reinforcing properties of delay-escape in ADHD. Thirty controls and 25 adolescents with ADHD aged 10–15 years performed the Escape Delay Incentive (EDI) task- in which pre-target cues indicated three conditions: i) CERTAIN DELAY: delay would follow a response irrespective of response speed ii) CONDITIONAL DELAY: delay would only follow if the response was too slow and iii) NO DELAY: delay would follow the response whatever the speed. We focused on the Contingent Negative Variation (CNV), a cue-evoked marker of motivated response preparation, across two time windows (CNV1 and CNV2). We took measures of parent, teacher and self-rated ADHD symptoms, task performance (RT) and self-rated delay aversion. We isolated CNV components and compared these between ADHD and controls. Adolescents with ADHD displayed a larger CNV2 to the CONDITIONAL DELAY than the CERTAIN DELAY cues compared to controls. However, this effect was not mirrored at the performance level and was unrelated to self-reported delay aversion. Our study provides the first ERP evidence that delay escape differentially reinforcers neural activation of attention preparation in ADHD cases. Future studies should examine the impact of varying cognitive load on task EDI performance.

•

Individuals with ADHD find cues predicting the imposition of delay aversive but evidence that delay escape is reinforcing is lacking

•

We used the Escape-Delay Incentive Task to isolate the CNV, reflecting motivated attention preparation to escape delay cues

•

Adolescents with ADHD displayed larger CNV2 to cues signalling the possibility to escape delay

•

Results provide the first ERP evidence of the reinforcing value of delay escape in ADHD