The ease and sureness of a decision: evidence accumulation of conflict and uncertainty

Evidence Accumulation and Neural Correlates of Uncertainty in Obsessive-Compulsive Disorder

BACKGROUND

Decision making is frequently associated with risk taking under uncertainty. Elevated intolerance of uncertainty is suggested to be a critical feature of obsessive-compulsive disorder (OCD). However, impairments of latent constructs of uncertainty processing and its neural correlates remain unclear in OCD.

METHODS

In 83 participants (24 OCD patients treated with capsulotomy, 28 OCD control participants, and 31 healthy control participants), we performed magnetic resonance imaging using a card gambling task in which participants made decisions whether to bet or not that the next card would be larger than the current one. A hierarchical drift diffusion model was used to dissociate speed and amount of evidence accumulated before a decisional threshold (i.e., betting or no betting) was reached.

RESULTS

High uncertainty was characterized by a smaller amount of evidence accumulation (lower thresholds), thus dissociating uncertainty from conflict tasks and highlighting the specificity of this task to test value-based uncertainty. OCD patients exhibited greater caution with poor performance and greater evidence accumulation overall along with slower speed of accumulation, particularly under low uncertainty. Bilateral dorsal anterior cingulate and anterior insula distinguished high- and low-uncertainty decision processes in healthy control participants but not in the OCD groups, indicating impairments in anticipation of differences in outcome variance and salience network activity. There were no behavioral or imaging differences relating to capsulotomy despite improvements in OCD symptoms.

CONCLUSIONS

Our findings highlight greater impairments particularly in more certain trials in the OCD groups along with impaired neural differentiation of high and low uncertainty and suggest uncertainty processing as a trait cognitive endophenotype rather than a state-specific factor.

Disruptions of salience network during uncertain anticipation of conflict control in anxiety

BACKGROUND

Anxiety has been characterized by disrupted processing of conflict control, while little is known about anticipatory processing of conflicts in anxiety. Anticipation is the key factor in both anxiety and cognitive control, especially under uncertain conditions. The current study therefore examined neurocomputational mechanisms of uncertain anticipation of conflict control in anxiety.

METHODS

Twenty-six participants with high-trait anxiety and twenty-nine low-trait anxiety participants completed a cue-flanker task with functional magnetic resonance imaging. The hierarchical drift diffusion model (HDDM) was used to measure the cognitive computations during the task. To identify the neurocomputational mechanism of anticipatory control in anxiety, mediation analysis and dynamic causal modelling (DCM) analysis were conducted to examine the relationship between functional connectivity of brain networks and the parameters of HDDM.

RESULTS

We found influences of regulatory signals from the dorsolateral prefrontal cortex to dorsal anterior cingulate cortex on decision threshold in low-trait anxiety (LTA), but not in high-trait anxiety (HTA), especially for the condition with uncertain cues. The results indicate deficient top-down anticipatory control of upcoming conflicts in anxious individuals. DCM and HDDM analyses revealed that lower decision threshold was associated with higher intrinsic connectivity of salience network (SN) in anxious individuals, suggesting that dysfunctional SN disrupts anticipation of conflict control under uncertainty in anxiety.

CONCLUSIONS

Our results suggest hyperfunction of the SN underlies the deficient information accumulation during uncertain anticipation of upcoming conflicts in anxiety. Our findings shed new light on the mechanisms of anticipation processing and the psychopathology of anxiety.

Enhanced decision-making in nicotine dependent individuals who abstain: A computational analysis using Hierarchical Drift Diffusion Modeling

BACKGROUND

Variability in decision-making capacity and reward responsiveness may underlie differences in the ability to abstain from smoking. Computational modeling of choice behavior, as with the Hierarchical Drift Diffusion Model (HDDM), can help dissociate reward responsiveness from underlying components of decision-making. Here we used the HDDM to identify which decision-making or reward-related parameters, extracted from data acquired in a reward processing task, contributed to the ability of people who smoke that are not seeking treatment to abstain from cigarettes during a laboratory task.

METHODS

80 adults who smoke cigarettes completed the Probabilistic Reward Task (PRT) - a signal detection task with a differential reinforcement schedule - following smoking as usual, and the Relapse Analogue Task (RAT) - a task in which participants could earn money for delaying smoking up to 50min - after a period of overnight abstinence. Two cohorts were defined by the RAT; those who waited either 0-min (n=36) or the full 50-min (n=44) before smoking.

RESULTS

PRT signal detection metrics indicated all subjects learned the task contingencies, with no differences in response bias or discriminability between the two groups. However, HDDM analyses indicated faster drift rates in 50-min vs. 0-min waiters.

CONCLUSIONS

Relative to those who did not abstain, computational modeling indicated that people who abstained from smoking for 50min showed faster evidence accumulation during reward-based decision-making. These results highlight the importance of decision-making mechanisms to smoking abstinence, and suggest that focusing on the evidence accumulation process may yield new targets for treatment.

Elucidating medial temporal and frontal lobe contributions to approach-avoidance conflict decision-making using functional MRI and the hierarchical drift diffusion model

The prefrontal cortex (PFC) has long been associated with arbitrating between approach and avoidance in the face of conflicting and uncertain motivational information, but recent work has also highlighted medial temporal lobe (MTL) involvement. It remains unclear, however, how the contributions of these regions differ in their resolution of conflict information and uncertainty. We designed an fMRI paradigm in which participants approached or avoided object pairs that differed by motivational conflict and outcome uncertainty (complete certainty vs. complete uncertainty). Behavioral data and decision-making parameters estimated using the hierarchical drift diffusion model revealed that participants' responding was driven by conflict rather than uncertainty. Our neural data suggest that PFC areas contribute to cognitive control during approach-avoidance conflict by potentially adjusting response caution and the strength of evidence generated towards either choice, with differential involvement of anterior cingulate cortex and dorsolateral prefrontal cortex. The MTL, on the other hand, appears to contribute to evidence generation, with the hippocampus linked to evidence accumulation for stimuli. Although findings within perirhinal cortex were comparatively equivocal, some evidence suggests contributions to perceptual representations, particularly under conditions of threat. Our findings provide evidence that MTL and PFC regions may contribute uniquely to arbitrating approach-avoidance conflict.

Neural Substrates of the Drift-Diffusion Model in Brain Disorders

Many studies on the drift-diffusion model (DDM) explain decision-making based on a unified analysis of both accuracy and response times. This review provides an in-depth account of the recent advances in DDM research which ground different DDM parameters on several brain areas, including the cortex and basal ganglia. Furthermore, we discuss the changes in DDM parameters due to structural and functional impairments in several clinical disorders, including Parkinson's disease, Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders, Obsessive-Compulsive Disorder (OCD), and schizophrenia. This review thus uses DDM to provide a theoretical understanding of different brain disorders.

Association of Environmental Uncertainty With Altered Decision-making and Learning Mechanisms in Youths With Obsessive-Compulsive Disorder

Importance

Adults with obsessive-compulsive disorder (OCD) display perseverative behavior in stable environments but exhibit vacillating choice when payoffs are uncertain. These findings may be associated with intolerance of uncertainty and compulsive behaviors; however, little is known about the mechanisms underlying learning and decision-making in youths with OCD because research into this population has been limited.

Objective

To investigate cognitive mechanisms associated with decision-making in youths with OCD by using executive functioning tasks and computational modeling.

Design, Setting, and Participants

In this cross-sectional study, 50 youths with OCD (patients) and 53 healthy participants (controls) completed a probabilistic reversal learning (PRL) task between January 2014 and March 2020. A separate sample of 27 patients and 46 controls completed the Wisconsin Card Sorting Task (WCST) between January 2018 and November 2020. The study took place at the University of Cambridge in the UK.

Main Outcomes and Measures

Decision-making mechanisms were studied by fitting hierarchical bayesian reinforcement learning models to the 2 data sets and comparing model parameters between participant groups. Model parameters included reward and punishment learning rates (feedback sensitivity), reinforcement sensitivity and decision consistency (exploitation), and stickiness (perseveration). Associations of receipt of serotonergic medication with performance were assessed.

Results

In total, 50 patients (29 female patients [58%]; median age, 16.6 years [IQR, 15.3-18.0 years]) and 53 controls (30 female participants [57%]; median age, 16.4 years [IQR, 14.8-18.0 years]) completed the PRL task. A total of 27 patients (18 female patients [67%]; median age, 16.1 years [IQR, 15.2-17.2 years]) and 46 controls (28 female participants [61%]; median age, 17.2 [IQR, 16.3-17.6 years]) completed the WCST. During the reversal phase of the PRL task, patients made fewer correct responses (mean [SD] proportion: 0.83 [0.16] for controls and 0.61 [0.31] for patients; 95% CI, -1.31 to -0.64) and switched choices more often following false-negative feedback (mean [SD] proportion: 0.09 [0.16] for controls vs 0.27 [0.34] for patients; 95% CI, 0.60-1.26) and true-positive feedback (mean [SD] proportion: 0.93 [0.17] for controls vs 0.73 [0.34] for patients; 95% CI, -2.17 to -1.31). Computational modeling revealed that patients displayed enhanced reward learning rates (mean difference [MD], 0.21; 95% highest density interval [HDI], 0.04-0.38) but decreased punishment learning rates (MD, -0.29; 95% HDI, -0.39 to -0.18), reinforcement sensitivity (MD, -4.91; 95% HDI, -9.38 to -1.12), and stickiness (MD, -0.35; 95% HDI, -0.57 to -0.11) compared with controls. There were no group differences on standard WCST measures and computational model parameters. However, patients who received serotonergic medication showed slower response times (mean [SD], 1420.49 [279.71] milliseconds for controls, 1471.42 [212.81] milliseconds for patients who were unmedicated, and 1738.25 [349.23] milliseconds for patients who were medicated) (control vs medicated MD, -320.26 [95% CI, -547.00 to -88.68]) and increased unique errors (mean [SD] proportion: 0.001 [0.004] for controls, 0.002 [0.004] for patients who were unmedicated, and 0.008 [0.01] for patients who were medicated) (control vs medicated MD, -0.007 [95% CI, -3.14 to -0.36]) on the WCST.

Conclusions and Relevance

The results of this cross-sectional study indicated that youths with OCD showed atypical probabilistic reversal learning but were generally unimpaired on the deterministic WCST, although unexpected results were observed for patients receiving serotonergic medication. These findings have implications for reframing the understanding of early-onset OCD as a disorder in which decision-making is associated with uncertainty in the environment, a potential target for therapeutic treatment. These results provide continuity with findings in adults with OCD.

Apathy in small vessel cerebrovascular disease is associated with deficits in effort-based decision making

Patients with small vessel cerebrovascular disease frequently suffer from apathy, a debilitating neuropsychiatric syndrome, the underlying mechanisms of which remain to be established. Here we investigated the hypothesis that apathy is associated with disrupted decision making in effort-based decision making, and that these alterations are associated with abnormalities in the white matter network connecting brain regions that underpin such decisions. Eighty-two patients with MRI evidence of small vessel disease were assessed using a behavioural paradigm as well as diffusion weighted MRI. The decision-making task involved accepting or rejecting monetary rewards in return for performing different levels of physical effort (hand grip force). Choice data and reaction times were integrated into a drift diffusion model that framed decisions to accept or reject offers as stochastic processes approaching a decision boundary with a particular drift rate. Tract-based spatial statistics were used to assess the relationship between white matter tract integrity and apathy, while accounting for depression. Overall, patients with apathy accepted significantly fewer offers on this decision-making task. Notably, while apathetic patients were less responsive to low rewards, they were also significantly averse to investing in high effort. Significant reductions in white matter integrity were observed to be specifically related to apathy, but not to depression. These included pathways connecting brain regions previously implicated in effort-based decision making in healthy people. The drift rate to decision parameter was significantly associated with both apathy and altered white matter tracts, suggesting that both brain and behavioural changes in apathy are associated with this single parameter. On the other hand, depression was associated with an increase in the decision boundary, consistent with an increase in the amount of evidence required prior to making a decision. These findings demonstrate altered effort-based decision making for reward in apathy, and also highlight dissociable mechanisms underlying apathy and depression in small vessel disease. They provide clear potential brain and behavioural targets for future therapeutic interventions, as well as modelling parameters that can be used to measure the effects of treatment at the behavioural level.

Shifting uncertainty intolerance: methylphenidate and attention-deficit hyperactivity disorder

Risk evaluation is a critical component of decision making. Risk tolerance is relevant in both daily decisions and pathological disorders such as attention-deficit hyperactivity disorder (ADHD), where impulsivity is a cardinal symptom. Methylphenidate, a commonly prescribed drug in ADHD, improves attention but has mixed reports on risk-based decision making. Using a double-blinded placebo protocol, we studied the risk attitudes of ADHD patients and age-matched healthy volunteers while performing the 2-step sequential learning task and examined the effect of methylphenidate on their choices. We then applied a novel computational analysis using the hierarchical drift-diffusion model to extract parameters such as threshold ('a'-amount of evidence accumulated before making a decision), drift rate ('v'-information processing speed) and response bias ('z' apriori bias towards a specific choice) focusing specifically on risky choice preference. Critically, we show that ADHD patients on placebo have an apriori bias towards risky choices compared to controls. Furthermore, methylphenidate enhanced preference towards risky choices (higher apriori bias) in both groups but had a significantly greater effect in the patient population independent of clinical scores. Thus, methylphenidate appears to shift tolerance towards risky uncertain choices possibly mediated by prefrontal dopaminergic and noradrenergic modulation. We emphasise the utility of computational models in detecting underlying processes. Our findings have implications for subtle yet differential effects of methylphenidate on ADHD compared to healthy population.

Cognitive performance in children and adolescents at high-risk for obsessive-compulsive disorder

BACKGROUND

Cognitive performance has been studied in adults with obsessive-compulsive symptoms (OCS) and in adult relatives of patients with obsessive-compulsive disorder (OCD) Meanwhile, few studies have been conducted with children under the same conditions. This study compared the neurocognitive domains previously associated with dysfunction in OCD, especially visuoconstructive ability, visuospatial memory, executive functions, and intelligence, in children and adolescents at high risk (HR) for OCD (n = 18) and non-OCD controls (NOC) (n = 31).

METHODS

For the HR group, we considered the first-degree relatives of patients with OCD that present OCS, but do not meet diagnostic criteria for OCD. Psychiatric diagnosis was assessed by experienced clinicians using the Structured Clinical Interview for DSM-IV and OCS severity was measured by the Yale-Brown Obsessive-Compulsive Scale. Neurocognitive assessment was performed with a comprehensive neuropsychological battery. Performance on the cognitive domains was compared between groups using Multivariate Analysis of Variance, whereas performance on the neuropsychological variables was compared between groups using independent t-tests in a cognitive subdomain analysis.

RESULTS

The cognitive domain analysis revealed a trend towards significance for impairments in the motor and processing speed domain (p = 0.019; F = 3.12) in the HR group. Moreover, the cognitive subdomain analysis identified a statistically significant underperformance in spatial working memory in the HR group when compared to the NOC group (p = 0.005; t = - 2.94), and a trend towards significance for impairments in non-verbal memory and visuoconstructive tasks in the HR group.

CONCLUSIONS

Our results suggest impairments in spatial working memory and motor and processing speed in a non-clinical sample of HR participants. Considering the preliminary nature of our findings, further studies investigating these neurocognitive domains as potential predictors of pediatric OCD are warranted.

The influence of subcortical shortcuts on disordered sensory and cognitive processing

The very earliest stages of sensory processing have the potential to alter how we perceive and respond to our environment. These initial processing circuits can incorporate subcortical regions, such as the thalamus and brainstem nuclei, which mediate complex interactions with the brain's cortical processing hierarchy. These subcortical pathways, many of which we share with other animals, are not merely vestigial but appear to function as 'shortcuts' that ensure processing efficiency and preservation of vital life-preserving functions, such as harm avoidance, adaptive social interactions and efficient decision-making. Here, we propose that functional interactions between these higher-order and lower-order brain areas contribute to atypical sensory and cognitive processing that characterizes numerous neuropsychiatric disorders.