Action-Outcome Knowledge Dissociates From Behavior in Obsessive-Compulsive Disorder Following Contingency Degradation

A dual-pathway architecture enables chronic stress to disrupt agency and promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted systems neuroscience approach in male and female mice, we reveal a dual pathway, amygdala-striatal neuronal circuit architecture by which a recent history of chronic stress disrupts the action-outcome learning underlying adaptive agency and promotes the formation of inflexible habits. We found that the basolateral amygdala projection to the dorsomedial striatum is activated by rewarding events to support the action-outcome learning needed for flexible, goal-directed decision making. Chronic stress attenuates this to disrupt action-outcome learning and, therefore, agency. Conversely, the central amygdala projection to the dorsomedial striatum mediates habit formation. Following stress this pathway is progressively recruited to learning to promote the premature formation of inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to disrupt agency and promote habit. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and mental health conditions.

Compulsive avoidance in youths and adults with OCD: an aversive pavlovian-to-instrumental transfer study

Compulsive behaviour may often be triggered by Pavlovian cues. Assessing how Pavlovian cues drive instrumental behaviour in obsessive-compulsive disorder (OCD) is therefore crucial to understand how compulsions develop and are maintained. An aversive Pavlovian-to-Instrumental transfer (PIT) paradigm, particularly one involving avoidance/cancellation of negative outcomes, can enable such investigation and has not previously been studied in clinical-OCD. Forty-one participants diagnosed with OCD (21 adults; 20 youths) and 44 controls (21 adults; 23 youths) completed an aversive PIT task. Participants had to prevent the delivery of unpleasant noises by moving a joystick in the correct direction. They could infer these correct responses by learning appropriate response-outcome (instrumental) and stimulus-outcome (Pavlovian) associations. We then assessed whether Pavlovian cues elicited specific instrumental avoidance responses (specific PIT) and induced general instrumental avoidance (general PIT). We investigated whether task learning and confidence indices influenced PIT strength differentially between groups. There was no overall group difference in PIT performance, although youths with OCD showed weaker specific PIT than youth controls. However, urge to avoid unpleasant noises and preference for safe over unsafe stimuli influenced specific and general PIT respectively in OCD, while PIT in controls was more influenced by confidence in instrumental and Pavlovian learning. Thus, in OCD, implicit motivational factors, but not learnt knowledge, may contribute to the successful integration of aversive Pavlovian and instrumental cues. This implies that compulsive avoidance may be driven by these automatic processes. Youths with OCD show deficits in specific PIT, suggesting cue integration impairments are only apparent in adolescence. These findings may be clinically relevant as they emphasise the importance of targeting such implicit motivational processes when treating OCD.

Bad habits-good goals? Meta-analysis and translation of the habit construct to alcoholism

Excessive alcohol consumption remains a global public health crisis, with millions suffering from alcohol use disorder (AUD, or simply "alcoholism"), leading to significantly reduced life expectancy. This review examines the interplay between habitual and goal-directed behaviors and the associated neurobiological changes induced by chronic alcohol exposure. Contrary to a strict habit-goal dichotomy, our meta-analysis of the published animal experiments combined with a review of human studies reveals a nuanced transition between these behavioral control systems, emphasizing the need for refined terminology to capture the probabilistic nature of decision biases in individuals with a history of chronic alcohol exposure. Furthermore, we distinguish habitual responding from compulsivity, viewing them as separate entities with diverse roles throughout the stages of the addiction cycle. By addressing species-specific differences and translational challenges in habit research, we provide insights to enhance future investigations and inform strategies for combatting AUD.

Action sequence learning, habits, and automaticity in obsessive-compulsive disorder

This study investigates the goal/habit imbalance theory of compulsion in obsessive-compulsive disorder (OCD), which postulates enhanced habit formation, increased automaticity, and impaired goal/habit arbitration. It directly tests these hypotheses using newly developed behavioral tasks. First, OCD patients and healthy participants were trained daily for a month using a smartphone app to perform chunked action sequences. Despite similar procedural learning and attainment of habitual performance (measured by an objective automaticity criterion) by both groups, OCD patients self-reported higher subjective habitual tendencies via a recently developed questionnaire. Subsequently, in a re-evaluation task assessing choices between established automatic and novel goal-directed actions, both groups were sensitive to re-evaluation based on monetary feedback. However, OCD patients, especially those with higher compulsive symptoms and habitual tendencies, showed a clear preference for trained/habitual sequences when choices were based on physical effort, possibly due to their higher attributed intrinsic value. These patients also used the habit-training app more extensively and reported symptom relief post-study. The tendency to attribute higher intrinsic value to familiar actions may be a potential mechanism leading to compulsions and an important addition to the goal/habit imbalance hypothesis in OCD. We also highlight the potential of smartphone app training as a habit reversal therapeutic tool.

Opening new vistas on obsessive-compulsive disorder with the observing response task

Obsessive-compulsive disorder (OCD), a highly prevalent and debilitating disorder, is incompletely understood in terms of underpinning behavioural, psychological, and neural mechanisms. This is attributable to high symptomatic heterogeneity; cardinal features comprise obsessions and compulsions, including clinical subcategories. While obsessive and intrusive thoughts are arguably unique to humans, dysfunctional behaviours analogous to those seen in clinical OCD have been examined in nonhuman animals. Genetic, ethological, pharmacological, and neurobehavioural approaches all contribute to understanding the emergence and persistence of compulsive behaviour. One behaviour of particular interest is maladaptive checking, whereby human patients excessively perform checking rituals despite these serving no purpose. Dysfunctional and excessive checking is the most common symptom associated with OCD and can be readily operationalised in rodents. This review considers animal models of OCD, the neural circuitries associated with impairments in habit-based and goal-directed behaviour, and how these may link to the compulsions observed in OCD. We further review the Observing Response Task (ORT), an appetitive instrumental learning procedure that distinguishes between functional and dysfunctional checking, with translational application in humans and rodents. By shedding light on the psychological and neural bases of compulsive-like checking, the ORT has potential to offer translational insights into the underlying mechanisms of OCD, in addition to being a platform for testing psychological and neurochemical treatment approaches.

Characterizing Human Habits in the Lab

Habits pose a fundamental puzzle for those aiming to understand human behavior. They pervade our everyday lives and dominate some forms of psychopathology but are extremely hard to elicit in the lab. In this Registered Report, we developed novel experimental paradigms grounded in computational models, which suggest that habit strength should be proportional to the frequency of behavior and, in contrast to previous research, independent of value. Specifically, we manipulated how often participants performed responses in two tasks varying action repetition without, or separately from, variations in value. Moreover, we asked how this frequency-based habitization related to value-based operationalizations of habit and self-reported propensities for habitual behavior in real life. We find that choice frequency during training increases habit strength at test and that this form of habit shows little relation to value-based operationalizations of habit. Our findings empirically ground a novel perspective on the constituents of habits and suggest that habits may arise in the absence of external reinforcement. We further find no evidence for an overlap between different experimental approaches to measuring habits and no associations with self-reported real-life habits. Thus, our findings call for a rigorous reassessment of our understanding and measurement of human habitual behavior in the lab.

Cortical glutamate and GABA are related to compulsive behaviour in individuals with obsessive compulsive disorder and healthy controls

There has been little analysis of neurochemical correlates of compulsive behaviour to illuminate its underlying neural mechanisms. We use 7-Tesla proton magnetic resonance spectroscopy (¹H-MRS) to assess the balance of excitatory and inhibitory neurotransmission by measuring glutamate and GABA levels in anterior cingulate cortex (ACC) and supplementary motor area (SMA) of healthy volunteers and participants with Obsessive-Compulsive Disorder (OCD). Within the SMA, trait and clinical measures of compulsive behaviour are related to glutamate levels, whereas a behavioural index of habitual control correlates with the glutamate:GABA ratio. Participants with OCD also show the latter relationship in the ACC while exhibiting elevated glutamate and lower GABA levels in that region. This study highlights SMA mechanisms of habitual control relevant to compulsive behaviour, common to the healthy sub-clinical and OCD populations. The results also demonstrate additional involvement of anterior cingulate in the balance between goal-directed and habitual responding in OCD.

Atypical action updating in a dynamic environment associated with adolescent obsessive-compulsive disorder

BACKGROUND

Computational research had determined that adults with obsessive-compulsive disorder (OCD) display heightened action updating in response to noise in the environment and neglect metacognitive information (such as confidence) when making decisions. These features are proposed to underlie patients' compulsions despite the knowledge they are irrational. Nonetheless, it is unclear whether this extends to adolescents with OCD as research in this population is lacking. Thus, this study aimed to investigate the interplay between action and confidence in adolescents with OCD.

METHODS

Twenty-seven adolescents with OCD and 46 controls completed a predictive-inference task, designed to probe how subjects' actions and confidence ratings fluctuate in response to unexpected outcomes. We investigated how subjects update actions in response to prediction errors (indexing mismatches between expectations and outcomes) and used parameters from a Bayesian model to predict how confidence and action evolve over time. Confidence-action association strength was assessed using a regression model. We also investigated the effects of serotonergic medication.

RESULTS

Adolescents with OCD showed significantly increased learning rates, particularly following small prediction errors. Results were driven primarily by unmedicated patients. Confidence ratings appeared equivalent between groups, although model-based analysis revealed that patients' confidence was less affected by prediction errors compared to controls. Patients and controls did not differ in the extent to which they updated actions and confidence in tandem.

CONCLUSIONS

Adolescents with OCD showed enhanced action adjustments, especially in the face of small prediction errors, consistent with previous research establishing 'just-right' compulsions, enhanced error-related negativity, and greater decision uncertainty in paediatric-OCD. These tendencies were ameliorated in patients receiving serotonergic medication, emphasising the importance of early intervention in preventing disorder-related cognitive deficits. Confidence ratings were equivalent between young patients and controls, mirroring findings in adult OCD research.

Obsessive-compulsive disorder is characterized by decreased Pavlovian influence on instrumental behavior

Obsessive-compulsive disorder (OCD) is characterized by uncontrollable repetitive actions thought to rely on abnormalities within fundamental instrumental learning systems. We investigated cognitive and computational mechanisms underlying Pavlovian biases on instrumental behavior in both clinical OCD patients and healthy controls using a Pavlovian-Instrumental Transfer (PIT) task. PIT is typically evidenced by increased responding in the presence of a positive (previously rewarded) Pavlovian cue, and reduced responding in the presence of a negative cue. Thirty OCD patients and thirty-one healthy controls completed the Pavlovian Instrumental Transfer test, which included instrumental training, Pavlovian training for positive, negative and neutral cues, and a PIT phase in which participants performed the instrumental task in the presence of the Pavlovian cues. Modified Rescorla-Wagner models were fitted to trial-by-trial data of participants to estimate underlying computational mechanism and quantify individual differences during training and transfer stages. Bayesian hierarchical methods were used to estimate free parameters and compare the models. Behavioral and computational results indicated a weaker Pavlovian influence on instrumental behavior in OCD patients than in HC, especially for negative Pavlovian cues. Our results contrast with the increased PIT effects reported for another set of disorders characterized by compulsivity, substance use disorders, in which PIT is enhanced. A possible reason for the reduced PIT in OCD may be impairment in using the contextual information provided by the cues to appropriately adjust behavior, especially when inhibiting responding when a negative cue is present. This study provides deeper insight into our understanding of deficits in OCD from the perspective of Pavlovian influences on instrumental behavior and may have implications for OCD treatment modalities focused on reducing compulsive behaviors.

A molecularly integrated amygdalo-fronto-striatal network coordinates flexible learning and memory

Behavioral flexibility-that is, the ability to deviate from established behavioral sequences-is critical for navigating dynamic environments and requires the durable encoding and retrieval of new memories to guide future choice. The orbitofrontal cortex (OFC) supports outcome-guided behaviors. However, the coordinated neural circuitry and cellular mechanisms by which OFC connections sustain flexible learning and memory remain elusive. Here we demonstrate in mice that basolateral amygdala (BLA)→OFC projections bidirectionally control memory formation when familiar behaviors are unexpectedly not rewarded, whereas OFC→dorsomedial striatum (DMS) projections facilitate memory retrieval. OFC neuronal ensembles store a memory trace for newly learned information, which appears to be facilitated by circuit-specific dendritic spine plasticity and neurotrophin signaling within defined BLA-OFC-DMS connections and obstructed by cocaine. Thus, we describe the directional transmission of information within an integrated amygdalo-fronto-striatal circuit across time, whereby novel memories are encoded by BLA→OFC inputs, represented within OFC ensembles and retrieved via OFC→DMS outputs during future choice.

Motivation(s) from control: response-effect contingency and confirmation of sensorimotor predictions reinforce different levels of selection

Humans and other animals live in dynamic environments. To reliably manipulate the environment and attain their goals they would benefit from a constant modification of motor-responding based on responses' current effect on the current environment. It is argued that this is exactly what is achieved by a mechanism that reinforces responses which have led to accurate sensorimotor predictions. We further show that evaluations of a response's effectiveness can occur simultaneously, driven by at least two different processes, each relying on different statistical properties of the feedback and affecting a different level of responding. Specifically, we show the continuous effect of (a) a sensorimotor process sensitive only to the conditional probability of effects given that the agent acted on the environment (i.e., action-effects) and of (b) a more abstract judgement or inference that is also sensitive to the conditional probabilities of occurrence of feedback given no action by the agent (i.e., inaction-effects). The latter process seems to guide action selection (e.g., should I act?) while the former the manner of the action's execution. This study is the first to show that different evaluation processes of a response's effectiveness influence different levels of responding.

The Habitual Tendencies Questionnaire: A tool for psychometric individual differences research

Habits are automatic responses to learned stimuli or contextual cues that are insensitive to goals. Although habits may allow for automated behaviours that increase efficiency in our daily lives, an over-reliance on habits has been suggested to contribute to disorders such as obsessive-compulsive disorder (OCD). There are currently few established measures of individual differences in habitual tendencies. To fill this gap, the present study generated and validated a novel 11-item scale, the Habitual Tendencies Questionnaire (HTQ), to measure individual differences in habitual tendencies in the general population. In Study 1, factor analysis revealed three underlying subcomponents of the HTQ: Compulsivity, Preference for Regularity, and Aversion to Novelty, with Compulsivity showing the strongest association with subclinical OCD symptomatology. Study 2 validated the HTQ and replicated the findings of Study 1 in a larger sample, and explored relationships with other personality traits. The results emphasise the importance of measuring individual variation in habitual thinking styles, illustrating that different facets of habitual tendencies may contribute to diverse behavioural and clinical outcomes. The present investigation provides a new, reliable way of measuring habitual tendencies and has important implications for future explorations into the nature of individual differences from a dimensional perspective to psychiatry.

Search for solutions, learning, simulation, and choice processes in suicidal behavior

Suicide may be viewed as an unfortunate outcome of failures in decision processes. Such failures occur when the demands of a crisis exceed a person's capacity to (i) search for options, (ii) learn and simulate possible futures, and (iii) make advantageous value-based choices. Can individual-level decision deficits and biases drive the progression of the suicidal crisis? Our overview of the evidence on this question is informed by clinical theory and grounded in reinforcement learning and behavioral economics. Cohort and case-control studies provide strong evidence that limited cognitive capacity and particularly impaired cognitive control are associated with suicidal behavior, imposing cognitive constraints on decision-making. We conceptualize suicidal ideation as an element of impoverished consideration sets resulting from a search for solutions under cognitive constraints and mood-congruent Pavlovian influences, a view supported by mostly indirect evidence. More compelling is the evidence of impaired learning in people with a history of suicidal behavior. We speculate that an inability to simulate alternative futures using one's model of the world may undermine alternative solutions in a suicidal crisis. The hypothesis supported by the strongest evidence is that the selection of suicide over alternatives is facilitated by a choice process undermined by randomness. Case-control studies using gambling tasks, armed bandits, and delay discounting support this claim. Future experimental studies will need to uncover real-time dynamics of choice processes in suicidal people. In summary, the decision process framework sheds light on neurocognitive mechanisms that facilitate the progression of the suicidal crisis. This article is categorized under: Economics > Individual Decision-Making Psychology > Emotion and Motivation Psychology > Learning Neuroscience > Behavior.

Cognitive Rigidity, Habitual Tendencies, and Obsessive-Compulsive Symptoms: Individual Differences and Compensatory Interactions

Recent theories have posited a range of cognitive risk factors for obsessive-compulsive disorder (OCD), including cognitive inflexibility and a maladaptive reliance on habits. However, empirical and methodological inconsistencies have obscured the understanding of whether inflexibility and habitual tendencies indeed shape OCD symptoms in clinical and sub-clinical populations, and whether there are notable interactions amongst these traits. The present investigation adopted an interactionist individual differences approach to examine the associations between behaviorally-assessed cognitive flexibility and subclinical OCD symptomatology in a healthy population. It also explored the nature of the interactions between cognitive flexibility and habitual tendencies, and the degree to which these cognitive traits predict subclinical OCD symptomatology. Across two studies, including a preregistration, Bayesian and regression analyses revealed that cognitive inflexibility and compulsive habitual tendencies act as unique and independent predictors of subclinical OCD symptomatology in healthy populations. Furthermore, there was a significant interaction between cognitive rigidity and habitual compulsivity, which accounted for 49.4% of the variance in subclinical OCD symptomatology in Study 1, and 37.3% in Study 2. In-depth analyses revealed a compensatory effect between cognitive inflexibility and habitual compulsivity such that both are necessary for OCD symptomatology, but neither is sufficient. These results imply that in order to generate reliable and nuanced models of the endophenotype of OCD symptomatology, it is essential to account for interactions between psychological traits. Moreover, the present findings have important implications for theories on the cognitive roots of OCD, and potentially in the development of interventions that target both cognitive inflexibility and habitual compulsivity.

The prefrontal cortex and OCD

Obsessive Compulsive Disorder (OCD) is a highly prevalent and severe neuropsychiatric disorder, with an incidence of 1.5-3% worldwide. However, despite the clear public health burden of OCD and relatively well-defined symptom criteria, effective treatments are still limited, spotlighting the need for investigation of the neural substrates of the disorder. Human neuroimaging studies have consistently highlighted abnormal activity patterns in prefrontal cortex (PFC) regions and connected circuits in OCD during both symptom provocation and performance of neurocognitive tasks. Because of recent technical advances, these findings can now be leveraged to develop novel targeted interventions. Here we will highlight current theories regarding the role of the prefrontal cortex in the generation of OCD symptoms, discuss ways in which this knowledge can be used to improve treatments for this often disabling illness, and lay out challenges in the field for future study.

Effect of non-instructed instrumental contingency of monetary reward and positive affect in a cognitive control task

In recent years, we observed a strong interest in the influence of motivation and emotion on cognitive control. Prior studies suggest that the instrumental contingency between a response and a rewarding or affective stimulus is particularly important in that context-which is resonating with observations in the associative learning literature. However, despite this overlap, and the relevance of non-instructed learning in real life, the vast majority of studies investigating motivation-cognition interactions use direct instructions to inform participants about the contingencies between responses and stimuli. Thus, there is little experimental insight regarding how humans detect non-instructed contingencies between their actions and motivational or affective outcomes, and how these learned contingencies come to influence cognitive control processes. In an attempt to close this gap, the goal of the present study was to test the effect of non-instructed contingent and non-contingent outcomes (i.e. monetary reward and positive affective stimuli) on cognitive control using the AX-continuous performance task (AX-CPT) paradigm. We found that entirely non-instructed contingencies between responses and positive outcomes (both monetary and affective ones) led to significant performance improvement. The present results open new perspectives for studying the influence of motivation and emotion on cognitive control at the insertion with associative learning.

Selective reinforcement of conflict processing in the Stroop task

Motivation signals have been shown to influence the engagement of cognitive control processes. However, most studies focus on the invigorating effect of reward prospect, rather than the reinforcing effect of reward feedback. The present study aimed to test whether people strategically adapt conflict processing when confronted with condition-specific congruency-reward contingencies in a manual Stroop task. Results show that the size of the Stroop effect can be affected by selectively rewarding responses following incongruent versus congruent trials. However, our findings also suggest important boundary conditions. Our first two experiments only show a modulation of the Stroop effect in the first half of the experimental blocks, possibly due to our adaptive threshold procedure demotivating adaptive behavior over time. The third experiment showed an overall modulation of the Stroop effect, but did not find evidence for a similar modulation on test items, leaving open whether this effect generalizes to the congruency conditions, or is stimulus-specific. More generally, our results are consistent with computational models of cognitive control and support contemporary learning perspectives on cognitive control. The findings also offer new guidelines and directions for future investigations on the selective reinforcement of cognitive control processes.

Experimentally induced and real-world anxiety have no demonstrable effect on goal-directed behaviour

BACKGROUND

Goal-directed control guides optimal decision-making and it is an important cognitive faculty that protects against developing habits. Previous studies have found some evidence of goal-directed deficits when healthy individuals are stressed, and in psychiatric conditions characterised by compulsive behaviours and anxiety. Here, we tested if goal-directed control is affected by state anxiety, which might explain the former results.

METHODS

We carried out a causal test of this hypothesis in two experiments (between-subject N = 88; within-subject N = 50) that used the inhalation of hypercapnic gas (7.5% CO2) to induce an acute state of anxiety in healthy volunteers. In a third experiment (N = 1413), we used a correlational design to test if real-life anxiety-provoking events (panic attacks, stressful events) are associated with impaired goal-directed control.

RESULTS

In the former two causal experiments, we induced a profoundly anxious state, both physiologically and psychologically, but this did not affect goal-directed performance. In the third, correlational, study, we found no evidence for an association between goal-directed control, panic attacks or stressful life eventsover and above variance accounted for by trait differences in compulsivity.

CONCLUSIONS

In sum, three complementary experiments found no evidence that anxiety impairs goal-directed control in human subjects.

Controlling one's world: Identification of sub-regions of primate PFC underlying goal-directed behavior

Impaired detection of causal relationships between actions and their outcomes can lead to maladaptive behavior. However, causal roles of specific prefrontal cortex (PFC) sub-regions and the caudate nucleus in mediating such relationships in primates are unclear. We inactivated and overactivated five PFC sub-regions, reversibly and pharmacologically: areas 24 (perigenual anterior cingulate cortex), 32 (medial PFC), 11 (anterior orbitofrontal cortex, OFC), 14 (rostral ventromedial PFC/medial OFC), and 14-25 (caudal ventromedial PFC) and the anteromedial caudate to examine their role in expressing learned action-outcome contingencies using a contingency degradation paradigm in marmoset monkeys. Area 24 or caudate inactivation impaired the response to contingency change, while area 11 inactivation enhanced it, and inactivation of areas 14, 32, or 14-25 had no effect. Overactivation of areas 11 and 24 impaired this response. These findings demonstrate the distinct roles of PFC sub-regions in goal-directed behavior and illuminate the candidate neurobehavioral substrates of psychiatric disorders, including obsessive-compulsive disorder.

•

Monkey pgACC-24 is necessary for detecting causal control of actions over outcomes

•

Its projection target in the caudate nucleus is also implicated

•

Three other subregions of the ventromedial prefrontal cortex are not necessary

•

Anterior OFC-11 may mediate Pavlovian influences on goal-directed behavior

Reduced Glutamate Turnover in the Putamen Is Linked With Automatic Habits in Human Cocaine Addiction

BACKGROUND

The balance between goal-directed behavior and habits has been hypothesized to be biased toward the latter in individuals with cocaine use disorder (CUD), suggesting possible neurochemical changes in the putamen, which may contribute to their compulsive behavior.

METHODS

We assessed habitual behavior in 48 patients with CUD and 42 healthy control participants using a contingency degradation paradigm and the Creature of Habit Scale. In a subgroup of this sample (CUD: n = 21; control participants: n = 22), we also measured glutamate and glutamine concentrations in the left putamen using ultra-high-field (7T) magnetic resonance spectroscopy. We hypothesized that increased habitual tendencies in patients with CUD would be associated with abnormal glutamatergic metabolites in the putamen.

RESULTS

Compared with their non-drug-using peers, patients with CUD exhibited greater habitual tendencies during contingency degradation, which correlated with increased levels of self-reported daily habits. We further identified a significant reduction in glutamate concentration and glutamate turnover (glutamate-to-glutamine ratio) in the putamen in patients with CUD, which was significantly related to the level of self-reported daily habits.

CONCLUSIONS

Patients with CUD exhibit enhanced habitual behavior, as assessed both by questionnaire and by a laboratory paradigm of contingency degradation. This automatic habitual tendency is related to a reduced glutamate turnover in the putamen, suggesting a dysregulation of habits caused by chronic cocaine use.

Compulsivity is linked to reduced adolescent development of goal-directed control and frontostriatal functional connectivity

A characteristic of adaptive behavior is its goal-directed nature. An ability to act in a goal-directed manner is progressively refined during development, but this refinement can be impacted by the emergence of psychiatric disorders. Disorders of compulsivity have been framed computationally as a deficit in model-based control, and have been linked also to abnormal frontostriatal connectivity. However, the developmental trajectory of model-based control, including an interplay between its maturation and an emergence of compulsivity, has not been characterized. Availing of a large sample of healthy adolescents (n = 569) aged 14 to 24 y, we show behaviorally that over the course of adolescence there is a within-person increase in model-based control, and this is more pronounced in younger participants. Using a bivariate latent change score model, we provide evidence that the presence of higher compulsivity traits is associated with an atypical profile of this developmental maturation in model-based control. Resting-state fMRI data from a subset of the behaviorally assessed subjects (n = 230) revealed that compulsivity is associated with a less pronounced change of within-subject developmental remodeling of functional connectivity, specifically between the striatum and a frontoparietal network. Thus, in an otherwise clinically healthy population sample, in early development, individual differences in compulsivity are linked to the developmental trajectory of model-based control and a remodeling of frontostriatal connectivity.

Alcohol Hangover Does Not Alter the Application of Model-Based and Model-Free Learning Strategies

Frequent alcohol binges shift behavior from goal-directed to habitual processing modes. This shift in reward-associated learning strategies plays a key role in the development and maintenance of alcohol use disorders and seems to persist during (early stages of) sobriety in at-risk drinkers. Yet still, it has remained unclear whether this phenomenon might be associated with alcohol hangover and thus also be found in social drinkers. In an experimental crossover design, n = 25 healthy young male participants performed a two-step decision-making task once sober and once hungover (i.e., when reaching sobriety after consuming 2.6 g of alcohol per estimated liter of total body water). This task allows the separation of effortful model-based and computationally less demanding model-free learning strategies. The experimental induction of alcohol hangover was successful, but we found no significant hangover effects on model-based and model-free learning scores, the balance between model-free and model-based valuation (ω), or perseveration tendencies (π). Bayesian analyses provided positive evidence for the null hypothesis for all measures except π (anecdotal evidence for the null hypothesis). Taken together, alcohol hangover, which results from a single binge drinking episode, does not impair the application of effortful and computationally costly model-based learning strategies and/or increase model-free learning strategies. This supports the notion that the behavioral deficits observed in at-risk drinkers are most likely not caused by the immediate aftereffects of individual binge drinking events.

Evidence for a dissociation between causal beliefs and instrumental actions

Human experiments have demonstrated that instrumental performance of an action and the causal beliefs of the effectiveness of an action in producing a reward are correlated and controlled by the probability of an action leading to a reward. The animal literature, however, shows that instrumental performance under free-operant training differs even when the reward probabilities are matched while subjects undergo training under ratio or interval schedules of reward. In two experiments, we investigated whether causal beliefs would correlate with instrumental performance under ratio and interval schedules for matched reward probabilities. In both experiments, we found that performance was higher under ratio than under interval training. However, causal beliefs were similar between these two conditions despite these differences in instrumental performance. When reward probabilities were increased by experimental manipulations in Experiment 2, the causal beliefs increased but performance decreased with respect to Experiment 1. This is evidence that instrumental performance and causal action-reward attribution may not follow from the same psychological process under free-operant training.

Impaired awareness of action-outcome contingency and causality during healthy ageing and following ventromedial prefrontal cortex lesions

Detecting causal relationships between actions and their outcomes is fundamental to guiding goal-directed behaviour. The ventromedial prefrontal cortex (vmPFC) has been extensively implicated in computing these environmental contingencies, via animal lesion models and human neuroimaging. However, whether the vmPFC is critical for contingency learning, and whether it can occur without subjective awareness of those contingencies, has not been established. To address this, we measured response adaption to contingency and subjective awareness of action-outcome relationships in individuals with vmPFC lesions and healthy elderly subjects. We showed that in both vmPFC damage and ageing, successful behavioural adaptation to variations in action-outcome contingencies was maintained, but subjective awareness of these contingencies was reduced. These results highlight two contexts where performance and awareness have been dissociated, and show that learning response-outcome contingencies to guide behaviour can occur without subjective awareness. Preserved responding in the vmPFC group suggests that this region is not critical for computing action-outcome contingencies to guide behaviour. In contrast, our findings highlight a critical role for the vmPFC in supporting awareness, or metacognitive ability, during learning. We further advance the hypothesis that responding to changing environmental contingencies, whilst simultaneously maintaining conscious awareness of those statistical regularities, is a form of dual-tasking that is impaired in ageing due to reduced prefrontal function.

Compulsivity in Alcohol Use Disorder and Obsessive Compulsive Disorder: Implications for Neuromodulation

Alcohol use Disorder (AUD) is one of the leading causes of morbidity and mortality worldwide. The progression of the disorder is associated with the development of compulsive alcohol use, which in turn contributes to the high relapse rate and poor longer term functioning reported in most patients, even with treatment. While the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) defines AUD by a cluster of symptoms, parsing its heterogeneous phenotype by domains of behavior such as compulsivity may be a critical step to improve outcomes of this condition. Still, neurobiological underpinnings of compulsivity need to be fully elucidated in AUD in order to better design targeted treatment strategies. In this manuscript, we review and discuss findings supporting common mechanisms between AUD and OCD, dissecting the construct of compulsivity and focusing specifically on characteristic disruptions in habit learning and cognitive control in the two disorders. Finally, neuromodulatory interventions are proposed as a probe to test compulsivity as key pathophysiologic feature of AUD, and as a potential therapy for the subgroup of individuals with compulsive alcohol use, i.e., the more resistant stage of the disorder. This transdiagnostic approach may help to destigmatize the disorder, and suggest potential treatment targets across different conditions.

Obsessive-Compulsive Disorder: Puzzles and Prospects

Obsessive-compulsive disorder is a severe and disabling psychiatric disorder that presents several challenges for neuroscience. Recent advances in its genetic and developmental causation, as well as its neuropsychological basis, are reviewed. Hypotheses concerning an imbalance between goal-directed and habitual behavior together with neural correlates in cortico-striatal circuitry are evaluated and contrasted with metacognitive theories. Treatments for obsessive-compulsive disorder (OCD) tend to be of mixed efficacy but include psychological, pharmacological, and surgical approaches, the underlying mechanisms of which are still under debate. Overall, the prospects for new animal models and an integrated understanding of the pathophysiology of OCD are considered in the context of dimensional psychiatry.

Avoidance Problems Reconsidered

Active avoidance is the prototypical paradigm for studying aversively-motivated instrumental behavior. However, avoidance research stalled amid heated theoretical debates and the hypothesis that active avoidance is essentially Pavlovian flight. Here I reconsider key "avoidance problems" and review neurobehavioral data collected with modern tools. Although the picture remains incomplete, these studies strongly suggest that avoidance has an instrumental component and is mediated by brain circuits that resemble appetitive instrumental actions more than Pavlovian fear reactions. Rapid progress may be possible if investigators consider important factors like safety signals, response-competition, goal-directed vs. habitual control and threat imminence in avoidance study design. Since avoidance responses likely contribute to active coping, this research has important implications for understanding human resilience and disorders of control.