Individual differences in the engagement of habitual control over alcohol seeking predict the development of compulsive alcohol seeking and drinking

Random interval schedule of reinforcement influences punishment resistance for cocaine in rats

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.

Bad habits-good goals? Meta-analysis and translation of the habit construct to alcoholism

Excessive alcohol consumption remains a global public health crisis, with millions suffering from alcohol use disorder (AUD, or simply "alcoholism"), leading to significantly reduced life expectancy. This review examines the interplay between habitual and goal-directed behaviors and the associated neurobiological changes induced by chronic alcohol exposure. Contrary to a strict habit-goal dichotomy, our meta-analysis of the published animal experiments combined with a review of human studies reveals a nuanced transition between these behavioral control systems, emphasizing the need for refined terminology to capture the probabilistic nature of decision biases in individuals with a history of chronic alcohol exposure. Furthermore, we distinguish habitual responding from compulsivity, viewing them as separate entities with diverse roles throughout the stages of the addiction cycle. By addressing species-specific differences and translational challenges in habit research, we provide insights to enhance future investigations and inform strategies for combatting AUD.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

From compulsivity to compulsion: the neural basis of compulsive disorders

Compulsive behaviour, an apparently irrational perseveration in often maladaptive acts, is a potential transdiagnostic symptom of several neuropsychiatric disorders, including obsessive-compulsive disorder and addiction, and may reflect the severe manifestation of a dimensional trait termed compulsivity. In this Review, we examine the psychological basis of compulsions and compulsivity and their underlying neural circuitry using evidence from human neuroimaging and animal models. Several main elements of this circuitry are identified, focused on fronto-striatal systems implicated in goal-directed behaviour and habits. These systems include the orbitofrontal, prefrontal, anterior cingulate and insular cortices and their connections with the basal ganglia as well as sensoriomotor and parietal cortices and cerebellum. We also consider the implications for future classification of impulsive-compulsive disorders and their treatment.

Pan-striatal reduction in the expression of the astrocytic dopamine transporter precedes the development of dorsolateral striatum dopamine-dependent incentive heroin seeking habits

The emergence of compulsive drug-seeking habits, a hallmark feature of substance use disorder, has been shown to be predicated on the engagement of dorsolateral striatal control over behaviour. This process involves the dopamine-dependent functional coupling of the anterior dorsolateral striatum (aDLS) with the nucleus accumbens core, but the mechanisms by which this coupling occurs have not been fully elucidated. The striatum is tiled by a syncytium of astrocytes that express the dopamine transporter (DAT), the level of which is altered in individuals with heroin use disorder. Astrocytes are therefore uniquely placed functionally to bridge dopamine-dependent mechanisms across the striatum. Here we tested the hypothesis that exposure to heroin influences the expression of DAT in striatal astrocytes across the striatum before the development of DLS-dependent incentive heroin seeking habits. Using Western-blot, qPCR, and RNAscope™, we measured DAT protein and mRNA levels in whole tissue, culture and in situ astrocytes from striatal territories of rats with a well-established cue-controlled heroin seeking habit and rats trained to respond for heroin or food under continuous reinforcement. Incentive heroin seeking habits were associated with a reduction in DAT protein levels in the anterior aDLS that was preceded by a heroin-induced reduction in DAT mRNA and protein in astrocytes across the striatum. Striatal astrocytes were also shown to be susceptible to direct dopamine- and opioid-induced downregulation of DAT expression. These results suggest that astrocytes may critically regulate the striatal dopaminergic adaptations that lead to the development of incentive heroin seeking habits.

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Non-consummatory behavior signals predict aversion-resistant alcohol drinking in head-fixed mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6 J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior. This article is part of the Special Issue on "PFC circuit function in psychiatric disease and relevant models".

The development of compulsive coping behavior depends on dorsolateral striatum dopamine-dependent mechanisms

Humans greatly differ in how they cope with stress, a natural behavior learnt through negative reinforcement. Some individuals engage in displacement activities, others in exercise or comfort eating, and others still in alcohol use. Across species, adjunctive behaviors, such as polydipsic drinking, are used as a form of displacement activity that reduces stress. Some individuals, in particular those that use alcohol to self-medicate, tend to lose control over such coping behaviors, which become excessive and compulsive. However, the psychological and neural mechanisms underlying this individual vulnerability have not been elucidated. Here we tested the hypothesis that the development of compulsive adjunctive behaviors stems from the functional engagement of the dorsolateral striatum (DLS) dopamine-dependent habit system after a prolonged history of adjunctive responding. We measured in longitudinal studies in male Sprague Dawley rats the sensitivity of early established vs compulsive polydipsic water or alcohol drinking to a bilateral infusion into the anterior DLS (aDLS) of the dopamine receptor antagonist α-flupentixol. While most rats acquired a polydipsic drinking response with water, others only did so with alcohol. Whether drinking water or alcohol, the acquisition of this coping response was insensitive to aDLS dopamine receptor blockade. In contrast, after prolonged experience, adjunctive drinking became dependent on aDLS dopamine at a time when it was compulsive in vulnerable individuals. These data suggest that habits may develop out of negative reinforcement and that the engagement of their underlying striatal system is necessary for the manifestation of compulsive adjunctive behaviors.

Non-Consummatory Behavior Signals Predict Aversion-Resistant Alcohol Drinking in Head-Fixed Mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior.

Punishment resistance for cocaine is associated with inflexible habits in rats

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Computational Mechanisms of Addiction and Anxiety: A Developmental Perspective

A central goal of computational psychiatry is to identify systematic relationships between transdiagnostic dimensions of psychiatric symptomatology and the latent learning and decision-making computations that inform individuals' thoughts, feelings, and choices. Most psychiatric disorders emerge prior to adulthood, yet little work has extended these computational approaches to study the development of psychopathology. Here, we lay out a roadmap for future studies implementing this approach by developing empirically and theoretically informed hypotheses about how developmental changes in model-based control of action and Pavlovian learning processes may modulate vulnerability to anxiety and addiction. We highlight how insights from studies leveraging computational approaches to characterize the normative developmental trajectories of clinically relevant learning and decision-making processes may suggest promising avenues for future developmental computational psychiatry research.

Activation of GABAB receptors in central amygdala attenuates activity of PKCδ + neurons and suppresses punishment-resistant alcohol self-administration in rats

Alcohol use despite negative consequences is a core phenomenon of alcohol addiction. We recently used alcohol self-administration that is resistant to footshock punishment as a model of this behavior, and found that activity of PKCδ + GABAergic neurons in the central amygdala (CeA) is a determinant of individual susceptibility for punishment resistance. In the present study, we examined whether activation of GABA_B receptors in CeA can attenuate the activity of PKCδ + neurons in this region, and whether this will result in suppression of punishment- resistant alcohol self-administration in the minority of rats that show this behavior. Systemic administration of the clinically approved GABA_B agonist baclofen (1 and 3 mg/kg) dose- dependently reduced punishment-resistant alcohol self-administration. Bilateral microinjections of baclofen into CeA (64 ng in 0.3 µl/side) reduced the activity of PKCδ + neurons, as measured by Fos expression. This manipulation also selectively suppressed punished alcohol self-administration in punishment-resistant rats. Expression analysis indicated that virtually all CeA PKCδ + neurons express the GABA_B receptor. Using in vitro electrophysiology, we found that baclofen induced hyperpolarization of CeA neurons, reducing their firing rate in response to depolarizing current injections. Together, our findings provide a potential mechanism that contributes to the clinical efficacy of baclofen in alcohol addiction. Therapeutic use of baclofen itself is limited by problems of tolerance and need for dose escalation. Our findings support a mechanistic rationale for developing novel, improved alcohol addiction medications that target GABA_B receptors, and that lack these limitations, such as e.g., GABA_B positive allosteric modulators (PAM:s).

Towards a machine-learning assisted diagnosis of psychiatric disorders and their operationalization in preclinical research: Evidence from studies on addiction-like behaviour in individual rats

Over the last few decades, there has been a progressive transition from a categorical to a dimensional approach to psychiatric disorders. Especially in the case of substance use disorders, interest in the individual vulnerability to transition from controlled to compulsive drug taking warrants the development of novel dimension-based objective stratification tools. Here we drew on a multidimensional preclinical model of addiction, namely the 3-criteria model, previously developed to identify the neurobehavioural basis of the individual's vulnerability to switch from controlled to compulsive drug taking, to test a machine-learning assisted classifier objectively to identify individual subjects as vulnerable/resistant to addiction. Datasets from our previous studies on addiction-like behaviour for cocaine or alcohol were fed into a variety of machine-learning algorithms to develop a classifier that identifies resilient and vulnerable rats with high precision and reproducibility irrespective of the cohort to which they belong. A classifier based on K-median or K-mean-clustering (for cocaine or alcohol, respectively) followed by artificial neural networks emerged as a highly reliable and accurate tool to predict if a single rat is vulnerable/resilient to addiction. Thus, each rat previously characterized as displaying 0-criterion (i.e., resilient) or 3-criteria (i.e., vulnerable) in individual cohorts was correctly labelled by this classifier. The present machine-learning-based classifier objectively labels single individuals as resilient or vulnerable to developing addiction-like behaviour in a multisymptomatic preclinical model of addiction-like behaviour in rats. This novel dimension-based classifier increases the heuristic value of these preclinical models while providing proof of principle to deploy similar tools for the future of diagnosis of psychiatric disorders.

Discriminating goal-directed and habitual cocaine seeking in rats using a novel outcome devaluation procedure

Habits are theorized to play a key role in compulsive cocaine seeking, yet there is limited methodology for assessing habitual responding for intravenous (IV) cocaine. We developed a novel outcome devaluation procedure to discriminate goal-directed from habitual responding in cocaine-seeking rats. This procedure elicits devaluation temporarily and requires no additional training, allowing repeated testing at different time points. After training male rats to self-administer IV cocaine, we devalued the drug outcome via experimenter-administered IV cocaine (a "satiety" procedure) prior to a 10-min extinction test. Many rats were sensitive to outcome devaluation, a hallmark of goal-directed responding. These animals reduced responding when given a dose of experimenter-administered cocaine that matched or exceeded satiety levels during self-administration. However, other rats were insensitive to experimenter-administered cocaine, suggesting their responding was habitual. Importantly, reinforcement schedules and neural manipulations that produce goal-directed responding (i.e., ratio schedules or dorsolateral striatum lesions) caused sensitivity to outcome devaluation, whereas reinforcement schedules and neural manipulations that produce habitual responding (i.e., interval schedules or dorsomedial striatum lesions) caused insensitivity. Satiety-based outcome devaluation is an innovative new tool to dissect the neural and behavioral mechanisms underlying IV cocaine-seeking behavior.

A Systematic Review of Exercise Intervention Program for People With Substance Use Disorder

Addiction has been attributed to development of habit-based neural circuits that promote continued substance use despite a conscious wish to abstain. The goal of this study was to determine if physical exercise could serve as an alternative habit to replace habitual substance use, and whether this exercise intervention methods differed for opioid vs. amphetamine Dependents. A total of 14 randomized controlled experimental literatures on exercise intervention in people with opioid and amphetamine use disorder were screened, the 14 literature included 4 opioids and 10 amphetamines. From the 14 literature, the information of intervention program elements were counted, respectively. Independent sample t-test was used to compare the similarities and differences between the two intervention methods, and intervention mechanism of dependents were discussed. All rehabilitation exercises for opioid dependents use aerobic exercise, while most rehabilitation exercises for amphetamine dependents use aerobic exercise, and a few use aerobic and anaerobic mixed exercise. There is no significant difference in exercise time, exercise frequency and cycle between the two intervention schemes (P > 0.05). The rehabilitation indicators of opioid and amphetamine dependents generally include psychological indicators and physiological indicators, and most of the tests mainly focus on measuring psychological indicators such as mood and drug craving of dependents. The goal of exercise intervention for opioid and amphetamine dependents is similar, the first is to improve mood, reduce craving, improve sleep, and the second is to enhance physical fitness. In the treatment of Substance use disorder, exercise intervention can be used as an auxiliary treatment. Exercise intervention emphasizes low intensity and high frequency. Exercise intervention tends to cultivate long-term exercise habits or exercise lifestyle. Based on this "habit" mechanism, exercise can complete the substitution of material dependence.

Striatal dopamine signals are region specific and temporally stable across action-sequence habit formation

Habits are automatic, inflexible behaviors that develop slowly with repeated performance. Striatal dopamine signaling instantiates this habit-formation process, presumably region specifically and via ventral-to-dorsal and medial-to-lateral signal shifts. Here, we quantify dopamine release in regions implicated in these presumed shifts (ventromedial striatum [VMS], dorsomedial striatum [DMS], and dorsolateral striatum [DLS]) in rats performing an action-sequence task and characterize habit development throughout a 10-week training. Surprisingly, all regions exhibited stable dopamine dynamics throughout habit development. VMS and DLS signals did not differ between habitual and non-habitual animals, but DMS dopamine release increased during action-sequence initiation and decreased during action-sequence completion in habitual rats, whereas non-habitual rats showed opposite effects. Consistently, optogenetic stimulation of DMS dopamine release accelerated habit formation. Thus, we demonstrate that dopamine signals do not shift regionally during habit formation and that dopamine in DMS, but not VMS or DLS, determines habit bias, attributing “habit functions” to a region previously associated exclusively with non-habitual behavior.

•

Validation of a novel test that monitors habit development individually across time

•

Dopamine release during habit development is stable across relevant striatal regions

•

Only dopamine release in dorsomedial striatum correlates with habit development

•

Optogenetic stimulation of dorsomedial striatal dopamine accelerates habit formation

Incorporating inter-individual variability in experimental design improves the quality of results of animal experiments

Inter-individual variability in quantitative traits is believed to potentially inflate the quality of results in animal experimentation. Yet, to our knowledge this effect has not been empirically tested. Here we test whether inter-individual variability in emotional response within mouse inbred strains affects the outcome of a pharmacological experiment. Three mouse inbred strains (BALB/c, C57BL/6 and 129S2) were behaviorally characterized through repeated exposure to a mild aversive stimulus (modified Hole Board, five consecutive trials). A multivariate clustering procedure yielded two multidimensional response types which were displayed by individuals of all three strains. We show that systematic incorporation of these individual response types in the design of a pharmacological experiment produces different results from an experimental pool in which this variation was not accounted for. To our knowledge, this is the first study that empirically confirms that inter-individual variability affects the interpretation of behavioral phenotypes and may obscure experimental results in a pharmacological experiment.