Motivation and value influences in the relative balance of goal-directed and habitual behaviours in obsessive-compulsive disorder

On the effects of impulsivity and compulsivity on neural correlates of model-based performance

Impaired goal-directed behavior is associated with a range of mental disorders, implicating underlying transdiagnostic factors. While compulsivity has been linked to reduced model-based (MB) control, impulsivity has rarely been studied in the context of reinforcement learning despite its links to reward processing and cognitive control. This study investigated the neural mechanisms underlying MB control and the influence of impulsivity and compulsivity, using EEG data from 238 individuals during a two-step decision making task. Single-trial analyses revealed a modulation of the feedback-related negativity (FRN), where amplitudes were higher after common transitions and positive reward prediction error (RPE), indicating a valence effect. Meanwhile, enhanced P3 amplitudes after rare transitions and both positive and negative RPE possibly reflect surprise. In a second step, we regressed the mean b values of the effect of RPE on the EEG signals onto self-reported impulsivity and compulsivity and behavioral MB control (w). The effect of RPE on FRN-related activity was mainly associated with higher w scores, linking the FRN to MB control. Crucially, the modulation of the P3 by RPE was negatively associated with compulsivity, pointing to a deficient mental model in highly compulsive individuals.

Compulsive avoidance in youths and adults with OCD: an aversive pavlovian-to-instrumental transfer study

Compulsive behaviour may often be triggered by Pavlovian cues. Assessing how Pavlovian cues drive instrumental behaviour in obsessive-compulsive disorder (OCD) is therefore crucial to understand how compulsions develop and are maintained. An aversive Pavlovian-to-Instrumental transfer (PIT) paradigm, particularly one involving avoidance/cancellation of negative outcomes, can enable such investigation and has not previously been studied in clinical-OCD. Forty-one participants diagnosed with OCD (21 adults; 20 youths) and 44 controls (21 adults; 23 youths) completed an aversive PIT task. Participants had to prevent the delivery of unpleasant noises by moving a joystick in the correct direction. They could infer these correct responses by learning appropriate response-outcome (instrumental) and stimulus-outcome (Pavlovian) associations. We then assessed whether Pavlovian cues elicited specific instrumental avoidance responses (specific PIT) and induced general instrumental avoidance (general PIT). We investigated whether task learning and confidence indices influenced PIT strength differentially between groups. There was no overall group difference in PIT performance, although youths with OCD showed weaker specific PIT than youth controls. However, urge to avoid unpleasant noises and preference for safe over unsafe stimuli influenced specific and general PIT respectively in OCD, while PIT in controls was more influenced by confidence in instrumental and Pavlovian learning. Thus, in OCD, implicit motivational factors, but not learnt knowledge, may contribute to the successful integration of aversive Pavlovian and instrumental cues. This implies that compulsive avoidance may be driven by these automatic processes. Youths with OCD show deficits in specific PIT, suggesting cue integration impairments are only apparent in adolescence. These findings may be clinically relevant as they emphasise the importance of targeting such implicit motivational processes when treating OCD.

Neurocomputational model of compulsivity: deviating from an uncertain goal-directed system

Despite a theory that an imbalance in goal-directed versus habitual systems serve as building blocks of compulsions, research has yet to delineate how this occurs during arbitration between the two systems in obsessive-compulsive disorder. Inspired by a brain model in which the inferior frontal cortex selectively gates the putamen to guide goal-directed or habitual actions, this study aimed to examine whether disruptions in the arbitration process via the fronto-striatal circuit would underlie imbalanced decision-making and compulsions in patients. Thirty patients with obsessive-compulsive disorder [mean (standard deviation) age = 26.93 (6.23) years, 12 females (40%)] and 30 healthy controls [mean (standard deviation) age = 24.97 (4.72) years, 17 females (57%)] underwent functional MRI scans while performing the two-step Markov decision task, which was designed to dissociate goal-directed behaviour from habitual behaviour. We employed a neurocomputational model to account for an uncertainty-based arbitration process, in which a prefrontal arbitrator (i.e. inferior frontal gyrus) allocates behavioural control to a more reliable strategy by selectively gating the putamen. We analysed group differences in the neural estimates of uncertainty of each strategy. We also compared the psychophysiological interaction effects of system preference (goal-directed versus habitual) on fronto-striatal coupling between groups. We examined the correlation between compulsivity score and the neural activity and connectivity involved in the arbitration process. The computational model captured the subjects' preferences between the strategies. Compared with healthy controls, patients had a stronger preference for the habitual system (t = -2.88, P = 0.006), which was attributed to a more uncertain goal-directed system (t = 2.72, P = 0.009). Before the allocation of controls, patients exhibited hypoactivity in the inferior frontal gyrus compared with healthy controls when this region tracked the inverse of uncertainty (i.e. reliability) of goal-directed behaviour (P = 0.001, family-wise error rate corrected). When reorienting behaviours to reach specific goals, patients exhibited weaker right ipsilateral ventrolateral prefronto-putamen coupling than healthy controls (P = 0.001, family-wise error rate corrected). This hypoconnectivity was correlated with more severe compulsivity (r = -0.57, P = 0.002). Our findings suggest that the attenuated top-down control of the putamen by the prefrontal arbitrator underlies compulsivity in obsessive-compulsive disorder. Enhancing fronto-striatal connectivity may be a potential neurotherapeutic approach for compulsivity and adaptive decision-making.

Beliefs, compulsive behavior and reduced confidence in control

OCD has been conceptualized as a disorder arising from dysfunctional beliefs, such as overestimating threats or pathological doubts. Yet, how these beliefs lead to compulsions and obsessions remains unclear. Here, we develop a computational model to examine the specific beliefs that trigger and sustain compulsive behavior in a simple symptom-provoking scenario. Our results demonstrate that a single belief disturbance-a lack of confidence in the effectiveness of one's preventive (harm-avoiding) actions-can trigger and maintain compulsions and is directly linked to compulsion severity. This distrust can further explain a number of seemingly unrelated phenomena in OCD, including the role of not-just-right feelings, the link to intolerance to uncertainty, perfectionism, and overestimation of threat, and deficits in reversal and state learning. Our simulations shed new light on which underlying beliefs drive compulsive behavior and highlight the important role of perceived ability to exert control for OCD.

Neural inhibition as implemented by an actor-critic model involves the human dorsal striatum and ventral tegmental area

Inhibition is implicated across virtually all human experiences. As a trade-off of being very efficient, this executive function is also prone to many errors. Rodent and computational studies show that midbrain regions play crucial roles during errors by sending dopaminergic learning signals to the basal ganglia for behavioural adjustment. However, the parallels between animal and human neural anatomy and function are not determined. We scanned human adults while they performed an fMRI inhibitory task requiring trial-and-error learning. Guided by an actor-critic model, our results implicate the dorsal striatum and the ventral tegmental area as the actor and the critic, respectively. Using a multilevel and dimensional approach, we also demonstrate a link between midbrain and striatum circuit activity, inhibitory performance, and self-reported autistic and obsessive-compulsive subclinical traits.

Greater reliance on model-free learning in adolescent anorexia nervosa: An examination of dual-system reinforcement learning

Alterations in learning and decision-making systems are thought to contribute to core features of anorexia nervosa (AN), a psychiatric disorder characterized by persistent dietary restriction and weight loss. Instrumental learning theory identifies a dual-system of habit and goal-directed decision-making, linked to model-free and model-based reinforcement learning algorithms. Difficulty arbitrating between these systems, resulting in an over-reliance on one strategy over the other, has been implicated in compulsivity and extreme goal pursuit, both of which are observed in AN. Characterizing alterations in model-free and model-based systems, and their neural correlates, in AN may clarify mechanisms contributing to symptom heterogeneity (e.g., binge/purge symptoms). This study tested whether adolescents with restricting AN (AN-R; n = 36) and binge/purge AN (AN-BP; n = 20) differentially utilized model-based and model-free learning systems compared to a healthy control group (HC; n = 28) during a Markov two-step decision-making task under conditions of reward and punishment. Associations between model-free and model-based learning and resting-state functional connectivity between neural regions of interest, including orbitofrontal cortex (OFC), nucleus accumbens (NAcc), putamen, and sensory motor cortex (SMC) were examined. AN-R showed higher utilization of model-free learning compared to HC for reward, but attenuated model-free and model-based learning for punishment. In AN-R only, higher model-based learning was associated with stronger OFC-to-left NAcc functional connectivity, regions linked to goal-directed behavior. Greater utilization of model-free learning for reward in AN-R may differentiate this group, particularly during adolescence, and facilitate dietary restriction by prioritizing habitual control in rewarding contexts.

Perseveration and Shifting in Obsessive-Compulsive Disorder as a Function of Uncertainty, Punishment, and Serotonergic Medication

Background

The nature of cognitive flexibility deficits in obsessive-compulsive disorder (OCD), which historically have been tested with probabilistic reversal learning tasks, remains elusive. Here, a novel deterministic reversal task and inclusion of unmedicated patients in the study sample illuminated the role of fixed versus uncertain rules/contingencies and of serotonergic medication. Additionally, our understanding of probabilistic reversal was enhanced through theoretical computational modeling of cognitive flexibility in OCD.

Methods

We recruited 49 patients with OCD, 21 of whom were unmedicated, and 43 healthy control participants matched for age, IQ, and gender. Participants were tested on 2 tasks: a novel visuomotor deterministic reversal learning task with 3 reversals (feedback rewarding/punishing/neutral) measuring accuracy/perseveration and a 2-choice visual probabilistic reversal learning task with uncertain feedback and a single reversal measuring win-stay and lose-shift. Bayesian computational modeling provided measures of learning rate, reinforcement sensitivity, and stimulus stickiness.

Results

Unmedicated patients with OCD were impaired on the deterministic reversal task under punishment only at the first and third reversals compared with both control participants and medicated patients with OCD, who had no deficit. Perseverative errors were correlated with OCD severity. On the probabilistic reversal task, unmedicated patients were only impaired at reversal, whereas medicated patients were impaired at both the learning and reversal stages. Computational modeling showed that the overall change was reduced feedback sensitivity in both OCD groups.

Conclusions

Both perseveration and increased shifting can be observed in OCD, depending on test conditions including the predictability of reinforcement. Perseveration was related to clinical severity and remediated by serotonergic medication.

Opponent learning with different representations in the cortico-basal ganglia pathways can develop obsession-compulsion cycle

Obsessive-compulsive disorder (OCD) has been suggested to be associated with impairment of model-based behavioral control. Meanwhile, recent work suggested shorter memory trace for negative than positive prediction errors (PEs) in OCD. We explored relations between these two suggestions through computational modeling. Based on the properties of cortico-basal ganglia pathways, we modeled human as an agent having a combination of successor representation (SR)-based system that enables model-based-like control and individual representation (IR)-based system that only hosts model-free control, with the two systems potentially learning from positive and negative PEs in different rates. We simulated the agent's behavior in the environmental model used in the recent work that describes potential development of obsession-compulsion cycle. We found that the dual-system agent could develop enhanced obsession-compulsion cycle, similarly to the agent having memory trace imbalance in the recent work, if the SR- and IR-based systems learned mainly from positive and negative PEs, respectively. We then simulated the behavior of such an opponent SR+IR agent in the two-stage decision task, in comparison with the agent having only SR-based control. Fitting of the agents' behavior by the model weighing model-based and model-free control developed in the original two-stage task study resulted in smaller weights of model-based control for the opponent SR+IR agent than for the SR-only agent. These results reconcile the previous suggestions about OCD, i.e., impaired model-based control and memory trace imbalance, raising a novel possibility that opponent learning in model(SR)-based and model-free controllers underlies obsession-compulsion. Our model cannot explain the behavior of OCD patients in punishment, rather than reward, contexts, but it could be resolved if opponent SR+IR learning operates also in the recently revealed non-canonical cortico-basal ganglia-dopamine circuit for threat/aversiveness, rather than reward, reinforcement learning, and the aversive SR + appetitive IR agent could actually develop obsession-compulsion if the environment is modeled differently.

Impairment of arbitration between model-based and model-free reinforcement learning in obsessive-compulsive disorder

Introduction

Obsessive-compulsive disorder (OCD) is characterized by an imbalance between goal-directed and habitual learning systems in behavioral control, but it is unclear whether these impairments are due to a single system abnormality of the goal-directed system or due to an impairment in a separate arbitration mechanism that selects which system controls behavior at each point in time.

Methods

A total of 30 OCD patients and 120 healthy controls performed a 2-choice, 3-stage Markov decision-making paradigm. Reinforcement learning models were used to estimate goal-directed learning (as model-based reinforcement learning) and habitual learning (as model-free reinforcement learning). In general, 29 high Obsessive-Compulsive Inventory-Revised (OCI-R) score controls, 31 low OCI-R score controls, and all 30 OCD patients were selected for the analysis.

Results

Obsessive-compulsive disorder (OCD) patients showed less appropriate strategy choices than controls regardless of whether the OCI-R scores in the control subjects were high (p = 0.012) or low (p < 0.001), specifically showing a greater model-free strategy use in task conditions where the model-based strategy was optimal. Furthermore, OCD patients (p = 0.001) and control subjects with high OCI-R scores (H-OCI-R; p = 0.009) both showed greater system switching rather than consistent strategy use in task conditions where model-free use was optimal.

Conclusion

These findings indicated an impaired arbitration mechanism for flexible adaptation to environmental demands in both OCD patients and healthy individuals reporting high OCI-R scores.

Mice lacking Ptprd exhibit deficits in goal-directed behavior and female-specific impairments in sensorimotor gating

Protein Tyrosine Phosphatase receptor type D (PTPRD) is a member of the protein tyrosine phosphatase family that mediates cell adhesion and synaptic specification. Genetic studies have linked Ptprd to several neuropsychiatric phenotypes, including Restless Leg Syndrome (RLS), opioid abuse disorder, and antipsychotic-induced weight gain. Genome-wide association studies (GWAS) of either pediatric obsessive-compulsive traits, or Obsessive-Compulsive Disorder (OCD), have identified loci near PTPRD as genome-wide significant, or strongly suggestive for this trait. We assessed Ptprd wild-type (WT), heterozygous (HT), and knockout (KO) mice for behavioral dimensions that are altered in OCD, including anxiety and exploration (open field test, dig test), perseverative behavior (splash-induced grooming, spatial d), sensorimotor gating (prepulse inhibition), and home cage goal-directed behavior (nest building). No effect of genotype was observed in any measure of the open field test, dig test, or splash test. However, Ptprd KO mice of both sexes showed impairments in nest building behavior. Finally, female, but not male, Ptprd KO mice showed deficits in prepulse inhibition, an operational measure of sensorimotor gating that is reduced in female, but not male, OCD patients. Our results indicate that constitutive lack of Ptprd may contribute to the development of certain domains that are altered OCD, including goal-directed behavior, and reduced sensorimotor gating specifically in females.

Corticostriatal dynamics underlying components of binge-like consumption of palatable food in mice

Binge eating (BE) is a maladaptive repetitive feeding behavior present across nearly all eating disorder diagnoses. Despite the substantial negative impact of BE on psychological and physiological health, its underlying neural mechanisms are largely unknown. Other repetitive behavior disorders (e.g., obsessive compulsive disorder) show dysfunction within corticostriatal circuitry. However, to date, no work has investigated the in vivo neural dynamics underlying corticostriatal activity during BE episodes. The aim of the current study was to longitudinally examine in vivo neural activity within corticostriatal regions - the infralimbic cortex (IL) and dorsolateral striatum (DLS)- in a robust pre-clinical model for BE. Female C57BL6/J mice (N = 32) were randomized to receive: 1) intermittent (daily, 2-h) binge-like access to palatable food (sweetened condensed milk) (BE), or 2) continuous, non-intermittent (24-h) access to palatable food (control). In vivo calcium imaging was performed via fiber photometry at baseline and after chronic (4 weeks) engagement in the model for BE. Specific consummatory behaviors (feeding bout onset/offset) during recordings were captured using lickometers which generated TTL outputs for precise alignment of behavior to neural data. IL showed no specific changes in neural activity related to BE. However, BE animals showed decreased DLS activity at feeding onset and offset at the chronic timepoint when compared to activity at the baseline timepoint. Additionally, BE mice had significantly lower DLS activity at feeding onset and offset at the chronic timepoint compared to control mice. These results point to a role for DLS hypofunction in chronic BE, highlighting a potential target for future treatment intervention.

Cortical Grey Matter Mediates Increases in Model-Based Control and Learning from Positive Feedback from Adolescence to Adulthood

Cognition and brain structure undergo significant maturation from adolescence into adulthood. Model-based (MB) control is known to increase across development, which is mediated by cognitive abilities. Here, we asked two questions unaddressed in previous developmental studies. First, what are the brain structural correlates of age-related increases in MB control? Second, how are age-related increases in MB control from adolescence to adulthood influenced by motivational context? A human developmental sample (n = 103; age, 12-50, male/female, 55:48) completed structural MRI and an established task to capture MB control. The task was modified with respect to outcome valence by including (1) reward and punishment blocks to manipulate the motivational context and (2) an additional choice test to assess learning from positive versus negative feedback. After replicating that an age-dependent increase in MB control is mediated by cognitive abilities, we demonstrate first-time evidence that gray matter density (GMD) in the parietal cortex mediates the increase of MB control with age. Although motivational context did not relate to age-related changes in MB control, learning from positive feedback improved with age. Meanwhile, negative feedback learning showed no age effects. We present a first report that an age-related increase in positive feedback learning was mediated by reduced GMD in the parietal, medial, and dorsolateral prefrontal cortex. Our findings indicate that brain maturation, putatively reflected in lower GMD, in distinct and partially overlapping brain regions could lead to a more efficient brain organization and might thus be a key developmental step toward age-related increases in planning and value-based choice.SIGNIFICANCE STATEMENT Changes in model-based decision-making are paralleled by extensive maturation in cognition and brain structure across development. Still, to date the neuroanatomical underpinnings of these changes remain unclear. Here, we demonstrate for the first time that parietal GMD mediates age-dependent increases in model-based control. Age-related increases in positive feedback learning were mediated by reduced GMD in the parietal, medial, and dorsolateral prefrontal cortex. A manipulation of motivational context did not have an impact on age-related changes in model-based control. These findings highlight that brain maturation in distinct and overlapping cortical regions constitutes a key developmental step toward improved value-based choices.

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Cognitive Neuroscience of Obsessive-Compulsive Disorder

Cognitive neuroscientific research has the ability to yield important insights into the complex neurobiological processes underlying obsessive-compulsive disorder (OCD). This article provides an updated review of neuroimaging studies in seven neurocognitive domains. Findings from the literature are discussed in the context of obsessive-compulsive phenomenology and treatment. Expanding our knowledge of the neural mechanisms involved in OCD could help optimize treatment outcomes and guide the development of novel interventions.

Sufficient reliability of the behavioral and computational readouts of a probabilistic reversal learning task

Task-based measures that capture neurocognitive processes can help bridge the gap between brain and behavior. To transfer tasks to clinical application, reliability is a crucial benchmark because it imposes an upper bound to potential correlations with other variables (e.g., symptom or brain data). However, the reliability of many task readouts is low. In this study, we scrutinized the retest reliability of a probabilistic reversal learning task (PRLT) that is frequently used to characterize cognitive flexibility in psychiatric populations. We analyzed data from N = 40 healthy subjects, who completed the PRLT twice. We focused on how individual metrics are derived, i.e., whether data were partially pooled across participants and whether priors were used to inform estimates. We compared the reliability of the resulting indices across sessions, as well as the internal consistency of a selection of indices. We found good to excellent reliability for behavioral indices as derived from mixed-effects models that included data from both sessions. The internal consistency was good to excellent. For indices derived from computational modeling, we found excellent reliability when using hierarchical estimation with empirical priors and including data from both sessions. Our results indicate that the PRLT is well equipped to measure individual differences in cognitive flexibility in reinforcement learning. However, this depends heavily on hierarchical modeling of the longitudinal data (whether sessions are modeled separately or jointly), on estimation methods, and on the combination of parameters included in computational models. We discuss implications for the applicability of PRLT indices in psychiatric research and as diagnostic tools.

Active inference and the two-step task

Sequential decision problems distill important challenges frequently faced by humans. Through repeated interactions with an uncertain world, unknown statistics need to be learned while balancing exploration and exploitation. Reinforcement learning is a prominent method for modeling such behaviour, with a prevalent application being the two-step task. However, recent studies indicate that the standard reinforcement learning model sometimes describes features of human task behaviour inaccurately and incompletely. We investigated whether active inference, a framework proposing a trade-off to the exploration-exploitation dilemma, could better describe human behaviour. Therefore, we re-analysed four publicly available datasets of the two-step task, performed Bayesian model selection, and compared behavioural model predictions. Two datasets, which revealed more model-based inference and behaviour indicative of directed exploration, were better described by active inference, while the models scored similarly for the remaining datasets. Learning using probability distributions appears to contribute to the improved model fits. Further, approximately half of all participants showed sensitivity to information gain as formulated under active inference, although behavioural exploration effects were not fully captured. These results contribute to the empirical validation of active inference as a model of human behaviour and the study of alternative models for the influential two-step task.

Application of EMGB to Study Impacts of Public Green Space on Active Transport Behavior: Evidence from South Korea

Public green spaces (e.g., parks, green trails, greenways) and motivations to engage in active transport are essential for encouraging walking and cycling. However, how these key factors influence walker and cyclist behavior is potentially being increasingly influenced by the use of smart apps, as they become more ubiquitous in everyday practices. To fill this research gap, this work creates and tests a theoretically integrated study framework grounded in an extended model of goal-directed behavior, including public green space and motivation with perceived usefulness of smart apps. In order to accomplish the purpose of this study, we conducted an online survey of Korean walkers (n = 325) and cyclists (n = 326) between 10 and 25 July 2021 and applied partial least squares, structural equation, and multi-group analysis to validate the research model. Results revealed that active transport users' awareness of public green space positively influences attitude toward (γ = 0.163), as well as behavioral intention of (γ = 0.159), walking and cycling. Additionally, motivation (extrinsic and intrinsic) greatly influences attitude (γ = 0.539) and behavioral intention (γ = 0.535). Subjective norms (γ = 0.137) and positive (γ = 0.466) and negative anticipated emotions (γ = 0.225) have a significant impact on the desire that leads to behavioral intention. High and low perceived smart app usefulness also significantly moderates between public green space and attitude (t-value = 25.705), public green space and behavioral intention (t-value = 25.726), motivation and attitude (t-value = -25.561), and motivation and behavioral intention (t-value = -15.812). Consequently, the findings are useful to academics and practitioners by providing new knowledge and insights.

Association of Obsessive-Compulsive Disorder and Obsessive-Compulsive Symptoms With Substance Misuse in 2 Longitudinal Cohorts in Sweden

IMPORTANCE

Neurobiological models have postulated shared neural mechanisms between obsessive-compulsive disorder (OCD) and substance use disorders, but results from clinical and epidemiological studies are conflicting or even suggest that OCD may be protective against substance misuse.

OBJECTIVE

To investigate whether OCD and obsessive-compulsive symptoms are associated with substance misuse and the extent to which shared genetic and/or environmental factors account for this association.

DESIGN, SETTING, AND PARTICIPANTS

In this cohort study, individuals in the general population of Sweden born between January 1, 1932, and December 31, 1997 (population cohort), were followed up through Swedish nationwide registers from January 1, 1997, to December 31, 2013. The second cohort included twin participants in the Child and Adolescent Twin Study in Sweden (CATSS) followed up from ages 18 to 24 years. Data were analyzed from March 1, 2021, to March 31, 2022.

EXPOSURES

Lifetime International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, diagnosis of OCD in the National Patient Register (population cohort 1), and self-reported obsessive-compulsive symptoms at 18 years of age (CATSS cohort).

MAIN OUTCOMES AND MEASURES

Substance misuse was defined as registered substance use-related disorder, criminal conviction, or death (population cohort), and self-reported alcohol and drug dependence symptoms at 18 and 24 years of age (CATSS cohort).

RESULTS

The general population cohort included 6 304 188 individuals (48.9% women and 51.1% men; median baseline age, 30.5 [IQR, 15.0-46.4] years), of whom 27 342 had an OCD diagnosis. Obsessive-compulsive disorder was associated with an elevated risk of substance misuse (hazard ratio, 3.68 [95% CI, 3.52-3.85]). In the 9230 individuals in the CATSS cohort (5551 women [60.1%] and 3679 men [39.9%]), obsessive-compulsive symptoms at 18 years of age were associated with increased symptoms of alcohol dependence (concurrent [n = 9219], β = 0.18 [95% CI, 0.16-0.20]; longitudinal [n = 3381], β = 0.10 [95% CI, 0.06-0.14]) and drug dependence (concurrent [n = 749], β = 0.19 [95% CI, 0.11-0.27]; longitudinal [n = 452], β = 0.15 [95% CI, 0.04-0.25]). Comorbid anxiety and depression did not entirely explain the associations in either cohort. Using data from full siblings and maternal half-siblings (population cohort) and monozygotic and dizygotic twins (CATSS cohort) provided estimates of the relative contribution of genetic and environmental influences to the covariance between OCD and obsessive-compulsive symptoms and substance misuse or dependence. The associations were explained by genetic (56%-68%) and nonshared environmental (32%-44%) factors.

CONCLUSIONS AND RELEVANCE

The findings of this Swedish population-based cohort study challenge the notion that OCD is protective against developing substance misuse. The association of OCD and obsessive-compulsive symptoms with substance misuse was largely explained by shared genetics but was also compatible with partial environmental mediation.

Habitual or hyper-controlled behavior: OCD symptoms and explicit sequence learning

BACKGROUND AND OBJECTIVES

This study examined whether ritualistic behaviors characteristic of obsessive-compulsive disorder (OCD) are a product of dysfunctional goal-directed behavior leading to habitual behavior (Gillan & Robbins, 2014). We used an explicit motor sequence learning task to investigate the repetition of chunked action sequences across the OC spectrum. As sequential motor behavior is practiced, action movements appear to get bundled together, and the initial movement of the sequence activates the entire sequence, leaving it relatively insensitive to change. Therefore, compulsive behavior in OCD may be a result of failing to inhibit the full activation of an extensively learned action sequence.

METHODS

Fifty-seven participants across the range of OCD symptoms practiced one sequence and then tested on a novel sequence in which one of the middle movements was omitted. Optimal performance for the new sequence required goal-directed inhibition of the original sequence and goal-directed execution of the new sequence instead. To manipulate activation of goal-directed behavior, we added a dual-task condition with a competing auditory tonal N-Back task. Data were analyzed using mixed-effects models.

RESULTS

Although we did observe expected learning patterns during learning of the original sequence, slower reaction times for the new sequences, and higher errors in the dual-task condition, performance was not significantly related to either obsessive-compulsive symptoms or distress symptoms.

LIMITATIONS

The current study used an analog sample; replication in a treatment seeking sample is warranted.

CONCLUSIONS

These findings challenge the goal-directed dysfunction model of OCD.

Explicit knowledge of task structure is a primary determinant of human model-based action

Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of participants, and less in those with obsessive-compulsive disorder. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, in humans, explicit task structural knowledge is a primary determinant of model-based reinforcement learning and is most readily acquired from instruction rather than experience.

A selective serotonin reuptake inhibitor ameliorates obsessive-compulsive disorder-like perseverative behavior by attenuating 5-HT2C receptor signaling in the orbitofrontal cortex

Perseveration is a characteristic of patients with obsessive-compulsive disorder (OCD). Clinically, neuronal activity in the lateral orbitofrontal cortex (OFC) is increased in OCD patients. Successful treatment with selective serotonin reuptake inhibitors (SSRIs) reduces activity in the lateral OFC of OCD patients, but the precise mechanisms underlying this effect are unclear. Previously, we reported that repeated injection of the dopamine D₂ receptor agonist quinpirole (QNP) resulted in OCD-like deficits, including perseveration in a reversal learning task. QNP-treated mice showed hyperactivity in lateral OFC pyramidal neurons. The present study demonstrated that 4-week administration of an SSRI increased the rate of correct choice in a reversal learning task. Using the electrophysiological approach, we revealed that an SSRI decreased the activity of lateral OFC pyramidal neurons in QNP-treated mice by potentiating inhibitory inputs. The 4-week administration of an SSRI inhibited the potentiation of neuronal activity induced by a 5-HT_2C receptor agonist. Additionally, both 4-week administration of SSRI and acute application of 5-HT_2C receptor antagonist prevented the QNP-induced potentiation of inhibitory inputs to fast-spiking interneurons in the lateral OFC. Administration of a 5-HT_2C receptor antagonist to mice for 4 days increased the rate of correct choice in a reversal learning task. Collectively, these results indicate that chronic SSRI ameliorated perseverative behavior in QNP-treated mice by modulating inhibitory inputs in the lateral OFC. Short-term 5-HT_2C receptor blockade also ameliorated QNP-induced behavioral and neurological abnormalities by, at least in part, a common mechanism with chronic SSRI.

Valence bias in metacontrol of decision making in adolescents and young adults

The development of metacontrol of decision making and its susceptibility to framing effects were investigated in a sample of 201 adolescents and adults in Germany (12-25 years, 111 female, ethnicity not recorded). In a task that dissociates model-free and model-based decision making, outcome magnitude and outcome valence were manipulated. Both adolescents and adults showed metacontrol and metacontrol tended to increase across adolescence. Furthermore, model-based decision making was more pronounced for loss compared to gain frames but there was no evidence that this framing effect differed with age. Thus, the strategic adaptation of decision making continues to develop into young adulthood and for both adolescents and adults, losses increase the motivation to invest cognitive resources into an effortful decision-making strategy.

Ketamine increases activity of a fronto-striatal projection that regulates compulsive behavior in SAPAP3 knockout mice

Obsessive-Compulsive Disorder (OCD), characterized by intrusive thoughts (obsessions) and repetitive behaviors (compulsions), is associated with dysfunction in fronto-striatal circuits. There are currently no fast-acting pharmacological treatments for OCD. However, recent clinical studies demonstrated that an intravenous infusion of ketamine rapidly reduces OCD symptoms. To probe mechanisms underlying ketamine’s therapeutic effect on OCD-like behaviors, we used the SAPAP3 knockout (KO) mouse model of compulsive grooming. Here we recapitulate the fast-acting therapeutic effect of ketamine on compulsive behavior, and show that ketamine increases activity of dorsomedial prefrontal neurons projecting to the dorsomedial striatum in KO mice. Optogenetically mimicking this increase in fronto-striatal activity reduced compulsive grooming behavior in KO mice. Conversely, inhibiting this circuit in wild-type mice increased grooming. Finally, we demonstrate that ketamine blocks the exacerbation of grooming in KO mice caused by optogenetically inhibiting fronto-striatal activity. These studies demonstrate that ketamine increases activity in a fronto-striatal circuit that causally controls compulsive grooming behavior, suggesting this circuit may be important for ketamine’s therapeutic effects in OCD.

Intravenous infusion of ketamine rapidly reduces obsessive-compulsive disorder symptoms. Here, the authors show in mice that ketamine acts by increasing activity in a fronto-striatal circuit that causally controls compulsive grooming behaviour.

Fear conditioning and extinction in obsessive-compulsive disorder: A systematic review

Laboratory experiments using fear conditioning and extinction protocols help lay the groundwork for designing, testing, and optimizing innovative treatments for anxiety-related disorders. Yet, there is limited basic research on fear conditioning and extinction in obsessive-compulsive disorder (OCD). This is surprising because exposure-based treatments based on associative learning principles are among the most popular and effective treatment options for OCD. Here, we systematically review and critically assess existing aversive conditioning and extinction studies of OCD. Across 12 studies, there was moderate evidence that OCD is associated with abnormal acquisition of conditioned responses that differ from comparison groups. There was relatively stronger evidence of OCD's association with impaired extinction processes. This included multiple studies finding elevated conditioned responses during extinction learning and poorer threat/safety discrimination during recall, although a minority of studies yielded results inconsistent with this conclusion. Overall, the conditioning model holds value for OCD research, but more work is necessary to clarify emerging patterns of results and increase clinical translational utility to the level seen in other anxiety-related disorders. We detail limitations in the literature and suggest next steps, including modeling OCD with more complex conditioning methodology (e.g., semantic/conceptual generalization, avoidance) and improving individual-differences assessment with dimensional techniques.

Toward a neurocircuit-based taxonomy to guide treatment of obsessive-compulsive disorder

An important challenge in mental health research is to translate findings from cognitive neuroscience and neuroimaging research into effective treatments that target the neurobiological alterations involved in psychiatric symptoms. To address this challenge, in this review we propose a heuristic neurocircuit-based taxonomy to guide the treatment of obsessive-compulsive disorder (OCD). We do this by integrating information from several sources. First, we provide case vignettes in which patients with OCD describe their symptoms and discuss different clinical profiles in the phenotypic expression of the condition. Second, we link variations in these clinical profiles to underlying neurocircuit dysfunctions, drawing on findings from neuropsychological and neuroimaging studies in OCD. Third, we consider behavioral, pharmacological, and neuromodulatory treatments that could target those specific neurocircuit dysfunctions. Finally, we suggest methods of testing this neurocircuit-based taxonomy as well as important limitations to this approach that should be considered in future research.

Fronto-striatal structures related with model-based control as an endophenotype for obsessive-compulsive disorder

Recent theories suggest a shift from model-based goal-directed to model-free habitual decision-making in obsessive–compulsive disorder (OCD). However, it is yet unclear, whether this shift in the decision process is heritable. We investigated 32 patients with OCD, 27 unaffected siblings (SIBs) and 31 healthy controls (HCs) using the two-step task. We computed behavioral and reaction time analyses and fitted a computational model to assess the balance between model-based and model-free control. 80 subjects also underwent structural imaging. We observed a significant ordered effect for the shift towards model-free control in the direction OCD > SIB > HC in our computational parameter of interest. However less directed analyses revealed no shift towards model-free control in OCDs. Nonetheless, we found evidence for reduced model-based control in OCDs compared to HCs and SIBs via 2nd stage reaction time analyses. In this measure SIBs also showed higher levels of model-based control than HCs. Across all subjects these effects were associated with the surface area of the left medial/right dorsolateral prefrontal cortex. Moreover, correlations between bilateral putamen/right caudate volumes and these effects varied as a function of group: they were negative in SIBs and OCDs, but positive in HCs. Associations between fronto-striatal regions and model-based reaction time effects point to a potential endophenotype for OCD.

Frontoparietal hyperconnectivity during cognitive regulation in obsessive-compulsive disorder followed by reward valuation inflexibility

Obsessive-compulsive disorder (OCD) is characterized by cognitive deficits and altered reward processing systems. An imbalance between cognitive and reward pathways may explain the lack of control over obsessions followed by rewarding compulsive behaviors. While the processes of emotional cognitive regulation are widely studied in OCD, the mechanisms of cognitive regulation of reward are poorly described. Our goal was to investigate the OCD impact on cognitive regulation of reward at behavioral and neural functioning levels. OCD and control participants performed a functional magnetic resonance imaging task where they cognitively modulated their craving for food pictures under three cognitive regulation conditions: indulge/increase craving, distance/decrease craving, and natural/no regulation of craving. After regulation, the participants gave each picture a monetary value. We found that OCD patients had fixed food valuation scores while the control group modulated these values accordingly to the regulation conditions. Moreover, we observed frontoparietal hyperconnectivity during cognitive regulation. Our results suggest that OCD is characterized by deficits in cognitive regulation of internal states associated with inflexible behavior during reward processing. These findings bring new insights into the nature of compulsive behaviors in OCD.

A Qualitative Study of Understanding Reasons for Self-Harm in Adolescent Girls

Objective: Self-harm is an important public health issue in the UK. Young people who self-harm frequently feel misunderstood, and unable to access help. Improving understanding is key to informing the development and delivery of effective treatments and services. Methods: In this qualitative study, we interviewed nine adolescent girls (13–17 years old) with recurrent self-harm, recruited from NHS specialist child and adolescent mental health services. Data were analysed using Interpretative Phenomenological Analysis (IPA). Results: Findings revealed that self-harm is experienced as powerful mental and physical urges, sated only by self-harming, suggesting that self-harm could be considered a compulsive rather than impulsive disorder, representing a new perspective on the behaviour. Five themes emerged: emotion regulation; an addictive urge; self-harm to survive; interpersonal triggers; interpersonal relationships, not mechanical distractors, reduce self-harm. Conclusions: This study provides further evidence that non-suicidal self-injury may be engaged in to reduce suicidal risk. Seeking the company of helpful friends or family members may reduce the urge to self-harm. Repetitive self-harm may be a compulsive behaviour.

High-frequency neuromodulation improves obsessive-compulsive behavior

Nearly one billion people worldwide suffer from obsessive-compulsive behaviors^1,2, yet our mechanistic understanding of these behaviors is incomplete, and effective therapeutics are unavailable. An emerging perspective characterizes obsessive-compulsive behaviors as maladaptive habit learning^3,4, which may be associated with abnormal beta-gamma neurophysiology of the orbitofrontal-striatal circuitry during reward processing^5,6. We target the orbitofrontal cortex with alternating current, personalized to the intrinsic beta-gamma frequency of the reward network, and show rapid, reversible, frequency-specific modulation of reward- but not punishment-guided choice behavior and learning, driven by increased exploration in the setting of an actor-critic architecture. Next, we demonstrate that chronic application of the procedure over 5 days robustly attenuates obsessive-compulsive behavior in a non-clinical population for 3 months, with the largest benefits for individuals with more severe symptoms. Finally, we show that convergent mechanisms underlie modulation of reward learning and reduction of obsessive-compulsive symptoms. The results contribute to neurophysiological theories of reward, learning and obsessive-compulsive behavior, suggest a unifying functional role of rhythms in the beta-gamma range, and set the groundwork for the development of personalized circuit-based therapeutics for related disorders.

Electroencephalographic Correlates of Obsessive-Compulsive Disorder

This chapter reviews EEG research in Obsessive-Compulsive Disorder (OCD), focusing on Event-Related Potentials (ERPs) such as the Contingent Negative Variation, N2, Error-Related Negativity, the feedback Error-Related Negativity and the Readiness Potential and their neural bases. The functional significance, utility and correlation of these ERPs with OCD symptoms will be discussed, alongside novel theories for integrating the research findings. I will consider hypotheses including goal-directed behaviour, overreliance on habits, dissociations between action and knowledge, and excessive intolerance of uncertainty in the context of EEG studies, thus providing a comprehensive framework of the electroencephalographic literature concerning OCD.

Reliance on model-based and model-free control in obesity

Consuming more energy than is expended may reflect a failure of control over eating behaviour in obesity. Behavioural control arises from a balance between two dissociable strategies of reinforcement learning: model-free and model-based. We hypothesized that weight status relates to an imbalance in reliance on model-based and model-free control, and that it may do so in a linear or quadratic manner. To test this, 90 healthy participants in a wide BMI range [normal-weight (n = 31), overweight (n = 29), obese (n = 30)] performed a sequential decision-making task. The primary analysis indicated that obese participants relied less on model-based control than overweight and normal-weight participants, with no difference between overweight and normal-weight participants. In line, secondary continuous analyses revealed a negative linear, but not quadratic, relationship between BMI and model-based control. Computational modelling of choice behaviour suggested that a mixture of both strategies was shifted towards less model-based control in obese participants. Our findings suggest that obesity may indeed be related to an imbalance in behavioural control as expressed in a phenotype of less model-based control potentially resulting from enhanced reliance on model-free computations.

Beyond dichotomies in reinforcement learning

Reinforcement learning (RL) is a framework of particular importance to psychology, neuroscience and machine learning. Interactions between these fields, as promoted through the common hub of RL, has facilitated paradigm shifts that relate multiple levels of analysis in a singular framework (for example, relating dopamine function to a computationally defined RL signal). Recently, more sophisticated RL algorithms have been proposed to better account for human learning, and in particular its oft-documented reliance on two separable systems: a model-based (MB) system and a model-free (MF) system. However, along with many benefits, this dichotomous lens can distort questions, and may contribute to an unnecessarily narrow perspective on learning and decision-making. Here, we outline some of the consequences that come from overconfidently mapping algorithms, such as MB versus MF RL, with putative cognitive processes. We argue that the field is well positioned to move beyond simplistic dichotomies, and we propose a means of refocusing research questions towards the rich and complex components that comprise learning and decision-making.

Large nest building and high marble-burying: Two compulsive-like phenotypes expressed by deer mice (Peromyscus maniculatus bairdii) and their unique response to serotoninergic and dopamine modulating intervention

This study aimed to further dissect the deer mouse (Peromyscus maniculatus bairdii) model of compulsive-like behavior with respect to two persistent-like behavioral phenotypes viz. large nest building (LNB) and high marble-burying (HMB), which may be relevant to understanding the neurobiology of different symptom dimensions in obsessive-compulsive and related disorders. Since LNB is sensitive to chronic, high dose escitalopram intervention but HMB is not, we assessed whether the two behaviors could be further distinguished based on their response to 4 weeks of uninterrupted serotoninergic intervention (i.e. escitalopram; ESC; 50 mg/kg/day), dopaminergic antagonism, i.e. flupentixol; FLU; 0.9 mg/kg/day), dopaminergic potentiation (i.e. rasagiline; RAS; 5 mg/kg/day), and their respective combinations with escitalopram (ESC/FLU and ESC/RAS). Here we show LNB to be equally responsive to chronic ESC and ESC/FLU. HMB was insensitive to either of these interventions but was responsive to ESC/RAS. Additionally, we report that scoring preoccupied interaction with marbles over several trials is an appropriate measure of compulsive-like behavioral persistence in addition to the standard marble burying test. Taken together, these data provide further evidence that LNB and HMB in deer mice have distinctive neurobiological underpinnings. Thus, the naturally occurring compulsive-like behaviors expressed by deer mice may be useful in providing a platform to test unique treatment targets for different symptom dimensions of OCD and related disorders.

The neurochemical substrates of habitual and goal-directed control

Our daily decisions are governed by the arbitration between goal-directed and habitual strategies. However, the neurochemical basis of this arbitration is unclear. We assessed the contribution of dopaminergic, serotonergic, and opioidergic systems to this balance across reward and loss domains. Thirty-nine participants (17 healthy controls, 15 patients with pathological gambling, and 7 with binge eating disorder) underwent positron emission tomography (PET) imaging with [¹⁸F]FDOPA, [¹¹C]MADAM and [¹¹C]carfentanil to assess presynaptic dopamine, and serotonin transporter and mu-opioid receptor binding potential. Separately, participants completed a modified two-step task, which quantifies the degree to which decision-making is influenced by goal-directed or habitual strategies. All participants completed a version with reward outcomes; healthy controls additionally completed a version with loss outcomes. In the context of rewarding outcomes, we found that greater serotonin transporter binding potential in prefrontal regions was associated with habitual control, while greater serotonin transporter binding potential in the putamen was marginally associated with goal-directed control; however, the findings were no longer significant when controlling for the opposing valence (loss). In blocks with loss outcomes, we found that the opioidergic system, specifically greater [¹¹C]carfentanil binding potential, was positively associated with goal-directed control and negatively associated with habit-directed control. Our findings illuminate the complex neurochemical basis of goal-directed and habitual behavior, implicating differential roles for prefrontal and subcortical serotonin in decision-making across healthy and pathological populations.

Balancing Between Goal-Directed and Habitual Responding Following Acute Stress

Abstract. Instrumental learning is regulated by two memory systems: a relatively rigid but efficient habit system and a flexible but resource-demanding goal-directed system. Previous work has demonstrated that exposure to acute stress may shift the balance between these systems toward the habitual system. In the current study, we used a 2-day outcome devaluation paradigm with a 75% reward contingency rate and altered food reward categories to replicate and extend our previous findings. Participants learned neutral stimulus–response–reward associations on the first day. On the second day, rewards were devalued by eating to satiety. Subsequently, acute stress was induced in half of the participants using the Maastricht Acute Stress Test, while the other half engaged in a nonstressful control task. Finally, relative goal-directed versus habitual behavior was evaluated in a slips-of-action phase, where more slips-of-action indicate a shift toward the habitual system. Results showed that participants successfully acquired the stimulus–response–reward associations, that devaluation was effective, and that stressed participants displayed significant increases in cortisol and blood pressure. Stress led participants to commit more slips-of-action compared with nonstressed controls. The current study extends previous work, showing that the employed paradigm and outcome devaluation procedure are boundary conditions to the stress-induced shift in instrumental responding.

Factors Influencing Manipulation of a Familiar Object in Patients With Limb Apraxia After Stroke

Previous studies have shown that hand actions to visual objects are affected both by perceptual factors and by action goals. Our aim was to study how these processes affected hand actions in chronic stroke patients, based on whether they had limb apraxia. Twenty-two left hemisphere, chronic stroke patients were measured on neuropsychological tasks of limb apraxia, which was identified in a subgroup of 10 patients. All patients underwent testing on a separate task of making simple reach and grasp actions to a cup. Their performance was compared to a group of 18 healthy age-matched volunteers. Participants were instructed to grasp the top or bottom of a cup to either lift or turn it over so as to end with a hand position that was either comfortable or uncomfortable. This task tested the influence of the compatibility of hand–cup orientation, as well as goals driven by the end-state comfort of the hand, on action selection for object manipulation. Participants’ performance was measured in terms of error rates, and speed of initiation and reaching (movement time) to the object. The patients’ performance was significantly delayed, and error rates increased when reaching to grasp a cup under conditions of poor compatibility and end-state comfort. The subgroup of patients with apraxia showed a decreased influence of compatibility of hand interaction with the cup, with increased error rates and delayed response times, compared to patients with no apraxia and healthy volunteers. This is despite the fact they did not display significant deficits on neuropsychological tasks of real object use. The study shows that patients with apraxia have difficulties in selecting elements of object-directed actions, pertaining to both habitual and goal-directed factors.

Instrumental learning in a mouse model for obsessive-compulsive disorder: Impaired habit formation in Sapap3 mutants

It has been hypothesized that maladaptive habit formation contributes to compulsivity in psychiatric disorders such as obsessive-compulsive disorder (OCD). Here, we used an established animal model of OCD, Sapap3 knockout mice (SAPAP3^-/-), to investigate the balance of goal-directed and habitual behavior in compulsive individuals and if altered habit formation is associated with compulsive-like behavior. We subjected 24 SAPAP3^-/- and 24 wildtype littermates (WT) to two different schedules of reinforcement in a within-subjects design: a random-ratio (RR) schedule to promote goal-directedness, and a random-interval (RI) schedule, known to facilitate habitual responding. SAPAP3^-/- acquired responding under both schedules, but showed lower response rates and fewer attempts to collect food pellets than WT, indicative of altered reward processing. As expected, WT were sensitive to sensory-specific satiety (outcome devaluation) following RR training, but not RI training, demonstrating schedule-specific acquisition of goal-directed and habitual responding, respectively. In contrast, SAPAP3^-/- were sensitive to outcome devaluation after both RR and RI training, suggesting decreased engagement of a habitual response strategy. No linear relation was observed between increased grooming and behavior during the outcome devaluation test in SAPAP3^-/-. Together, our findings demonstrate altered reward processing and impaired habit learning in SAPAP3^-/-. We report a diminished propensity to form habits in these mice, which albeit inconsistent with the predominant idea of excessive habit formation in OCD, nonetheless points at dysregulation of behavioral automation in the context of compulsivity. Thus, the habit hypothesis of compulsivity should be updated to state that an imbalance of habitual and goal-directed responding in either direction can contribute to the development of compulsive behavior.

No substantial change in the balance between model-free and model-based control via training on the two-step task

Human decisions can be habitual or goal-directed, also known as model-free (MF) or model-based (MB) control. Previous work suggests that the balance between the two decision systems is impaired in psychiatric disorders such as compulsion and addiction, via overreliance on MF control. However, little is known whether the balance can be altered through task training. Here, 20 healthy participants performed a well-established two-step task that differentiates MB from MF control, across five training sessions. We used computational modelling and functional near-infrared spectroscopy to assess changes in decision-making and brain hemodynamic over time. Mixed-effects modelling revealed overall no substantial changes in MF and MB behavior across training. Although our behavioral and brain findings show task-induced changes in learning rates, these parameters have no direct relation to either MF or MB control or the balance between the two systems, and thus do not support the assumption of training effects on MF or MB strategies. Our findings indicate that training on the two-step paradigm in its current form does not support a shift in the balance between MF and MB control. We discuss these results with respect to implications for restoring the balance between MF and MB control in psychiatric conditions.

Psychiatric conditions such as compulsion or addiction are associated with an overreliance on habitual, or model-free, decision-making. Goal-directed, or model-based, decision-making may protect against such overreliance. We therefore asked whether model-free control could be reduced, and model-based control strengthened, via task training. We used the well-characterized two-step task that differentiates model-based from model-free actions. Our results suggest that training on the current form of the two-step task does not support a shift in the balance between model-free and model-based strategies. Factors such as devaluation, demotivation or automatization during training may play a role in the missing emergence of a training effect. Future studies could adapt the two-step task so as to separate such factors from decision-making strategies.

Pediatric OCD in the era of RDoC

The NIMH Research Domain Criteria (RDoC) initiative was established with the goal of developing an alternative research classification to further research efforts in mental health. While RDoC acknowledges that constructs should be considered within a developmental framework, developmental considerations have not yet been well integrated within the existing RDoC matrix. In this paper, we consider RDoC in relation to pediatric OCD, a paradigmatic example of a neuropsychiatric disorder that often has onset in childhood but is also present across the lifespan. We discuss three RDoC subdomains with relevance to OCD as exemplars, providing for each construct a brief review of normative developmental changes, the state of construct-relevant research in pediatric OCD, and challenges and limitations related to developmental considerations within each subdomain. Finally, we conclude with a brief discussion of how RDoC may continue to evolve with regard to developmental considerations in order to further research in pediatric OCD.

Annual Research Review: Developmental computational psychiatry

Most psychiatric disorders emerge during childhood and adolescence. This is also a period that coincides with the brain undergoing substantial growth and reorganisation. However, it remains unclear how a heightened vulnerability to psychiatric disorder relates to this brain maturation. Here, we propose 'developmental computational psychiatry' as a framework for linking brain maturation to cognitive development. We argue that through modelling some of the brain's fundamental cognitive computations, and relating them to brain development, we can bridge the gap between brain and cognitive development. This in turn can lead to a richer understanding of the ontogeny of psychiatric disorders. We illustrate this perspective with examples from reinforcement learning and dopamine function. Specifically, we show how computational modelling deepens an understanding of how cognitive processes, such as reward learning, effort learning, and social learning might go awry in psychiatric disorders. Finally, we sketch the promises and limitations of a developmental computational psychiatry.

Increased perseverative errors following high-definition transcranial direct current stimulation over the ventrolateral cortex during probabilistic reversal learning

BACKGROUND

The prefrontal cortex regulates behavioural adaptation in response to feedback. However, the causal role of different prefrontal regions remains unclear, based on indirect evidence derived from functional neuroimaging. Neuroimaging studies show dorsomedial prefrontal activation during feedback monitoring, whereas the ventrolateral prefrontal cortex engages during behavioural adaptation (shifting).

OBJECTIVE

We used high-definition transcranial direct current stimulation (HD-tDCS) to elucidate the roles of the ventrolateral prefrontal cortex (vlPFC) and the dorsomedial prefrontal cortex (dmPFC) in behaviour change, using a probabilistic reversal learning task (PRLT).

METHOD

Fifty-two healthy adults were randomly assigned to receive cathodal HD-tDCS to inhibit the vlPFC or the dmPFC versus sham stimulation, prior to completing the PRLT. The outcome measures were the number of perseverative errors and the electroencephalography (EEG) signals of feedback-related negativity (FRN) in the PRLT. We hypothesised that inhibition of the vlPFC would be specifically associated with more perseverative errors and weaker FRNs.

RESULTS

We found that vlPFC inhibition was associated with higher perseverative errors compared to sham and dmPFC stimulation conditions. Although there were no statistically significant differences in FRN amplitudes, the effect sizes indicate an association between inhibition of the vlPFC and lower FRN amplitudes.

CONCLUSION

Our findings support a causal role of the vlPFC on feedback-based behavioural adaptation, which is critical for adaptive goal-driven behaviour.

Impaired generalization of reward but not loss in obsessive-compulsive disorder

BACKGROUND

Generalizing from past experiences can be adaptive by allowing those experiences to guide behavior in new situations. Generalizing too much, however, can be maladaptive. For example, individuals with pathological anxiety are believed to overgeneralize emotional responses from past threats, broadening their scope of fears. Whether individuals with pathological anxiety overgeneralize in other situations remains unclear.

METHODS

The present study (N = 57) used a monetary sensory preconditioning paradigm with rewards and losses to address this question in individuals with obsessive-compulsive disorder (OCD) and social anxiety disorder (SAD), comparing them to healthy comparison subjects (HC). In all groups, we tested direct learning of associations between cues and reward vs. loss outcomes, as well as generalization of learning to novel choice options.

RESULTS

We found no differences between the three groups in the direct learning of stimuli with their outcomes: all subjects demonstrated intact stimulus-response learning by choosing rewarding options and avoiding negative ones. However, OCD subjects were less likely to generalize from rewards than either the SAD or HC groups, and this impairment was not found for losses. Additionally, greater deficits in reward generalization were correlated with severity of threat estimation, as measured by a subscale of the Obsessive Beliefs Questionnaire, both within OCD and across all groups.

CONCLUSIONS

These findings suggest that a compromised ability to generalize from rewarding events may impede adaptive behavior in OCD and in those susceptible to high estimation of threat.

Model-based learning and individual differences in depression: The moderating role of stress

Inflexible decision-making has been proposed as a transdiagnostic risk factor for mood disorders. Evidence suggests that inflexible decision-making may emerge only when individuals are experiencing increased negative affect or stress. 151 participants completed symptom measures of depression and anxiety, followed by a two-stage decision-making task that distinguishes between habitual and goal-directed choice. An experimental manipulation to induce stress was introduced halfway through the task. Individuals with higher depression levels became less model-based after the manipulation than those with lower depression levels. There was no relationship between trait anxiety and the impact of the manipulation on decision-making. Controlling for main effects of anxiety did not attenuate the association between depression and impact of stress. Anhedonia was associated with the impact of the manipulation on model-based decision-making. These results suggest that risk for depression is associated with reflexive decision-making, but these effects may only emerge under conditions of stress.

Drunk decisions: Alcohol shifts choice from habitual towards goal-directed control in adolescent intermediate-risk drinkers

BACKGROUND

Studies in humans and animals suggest a shift from goal-directed to habitual decision-making in addiction. We therefore tested whether acute alcohol administration reduces goal-directed and promotes habitual decision-making, and whether these effects are moderated by self-reported drinking problems.

METHODS

Fifty-three socially drinking males completed the two-step task in a randomised crossover design while receiving an intravenous infusion of ethanol (blood alcohol level=80 mg%), or placebo. To minimise potential bias by long-standing heavy drinking and subsequent neuropsychological impairment, we tested 18- to 19-year-old adolescents.

RESULTS

Alcohol administration consistently reduced habitual, model-free decisions, while its effects on goal-directed, model-based behaviour varied as a function of drinking problems measured with the Alcohol Use Disorders Identification Test. While adolescents with low risk for drinking problems (scoring <8) exhibited an alcohol-induced numerical reduction in goal-directed choices, intermediate-risk drinkers showed a shift away from habitual towards goal-directed decision-making, such that alcohol possibly even improved their performance.

CONCLUSIONS

We assume that alcohol disrupted basic cognitive functions underlying habitual and goal-directed decisions in low-risk drinkers, thereby enhancing hasty choices. Further, we speculate that intermediate-risk drinkers benefited from alcohol as a negative reinforcer that reduced unpleasant emotional states, possibly displaying a novel risk factor for drinking in adolescence.

Mapping Compulsivity in the DSM-5 Obsessive Compulsive and Related Disorders: Cognitive Domains, Neural Circuitry, and Treatment

Compulsions are repetitive, stereotyped thoughts and behaviors designed to reduce harm. Growing evidence suggests that the neurocognitive mechanisms mediating behavioral inhibition (motor inhibition, cognitive inflexibility) reversal learning and habit formation (shift from goal-directed to habitual responding) contribute toward compulsive activity in a broad range of disorders. In obsessive compulsive disorder, distributed network perturbation appears focused around the prefrontal cortex, caudate, putamen, and associated neuro-circuitry. Obsessive compulsive disorder-related attentional set-shifting deficits correlated with reduced resting state functional connectivity between the dorsal caudate and the ventrolateral prefrontal cortex on neuroimaging. In contrast, experimental provocation of obsessive compulsive disorder symptoms reduced neural activation in brain regions implicated in goal-directed behavioral control (ventromedial prefrontal cortex, caudate) with concordant increased activation in regions implicated in habit learning (presupplementary motor area, putamen). The ventromedial prefrontal cortex plays a multifaceted role, integrating affective evaluative processes, flexible behavior, and fear learning. Findings from a neuroimaging study of Pavlovian fear reversal, in which obsessive compulsive disorder patients failed to flexibly update fear responses despite normal initial fear conditioning, suggest there is an absence of ventromedial prefrontal cortex safety signaling in obsessive compulsive disorder, which potentially undermines explicit contingency knowledge and may help to explain the link between cognitive inflexibility, fear, and anxiety processing in compulsive disorders such as obsessive compulsive disorder.