Are we compulsively chasing rainbows?

The multiple faces of footshock punishment in animal research on addiction

Continued drug use despite negative consequences is a hallmark of addiction commonly modelled in rodents using punished drug intake. Over the years, addiction research highlighted two subpopulations of punishment sensitive and resistant animals. While helpful to interrogate the neurobiology of drug-related behaviors, these procedures carry some weaknesses that need to be recognized and eventually defused. Mainly focusing on footshock-related work, we will first discuss the criteria used to define punishment-resistant animals and how their relative arbitrariness may impact our findings. With the overarching goal of improving our interpretation of the punishment-resistant phenotype, we will evaluate how tailored punishment protocols may better apprehend resistance to punishment, and how testing the robustness of punishment resistance could yield new results and strengthen interpretations. Second, we will question whether and to what extent punishment sensitivity, as currently defined, is reflective of abstinence and suggest that punishment resistance is, in fact, a prerequisite to model abstinence from addiction. Again, we will examine how challenging the robustness of the punishment-sensitive phenotype may help to better characterize it. Finally, we will evaluate whether diminished relapse-like behavior after repeated punishment-induced abstinence could not only contribute to better understand the mechanisms of abstinence, but also uniquely model progressive recovery (i.e., after repeated failed attempts at recovery) which is the norm in people with addiction. Altogether, by questioning the strengths and weaknesses of our models, we would like to open discussions on the different ways we interpret punishment sensitivity and resistance and the aspects that remain to be explored.

Understanding sex differences and the translational value of models of persistent substance use despite negative consequences

Persistent substance use despite negative consequences is a key facet of substance use disorder. The last decade has seen the preclinical field adopt the use of punishment to model adverse consequences associated with substance use. This has largely involved the pairing of drug use with either electric foot shock or quinine, a bitter tastant. Whilst at face value, these punishers may model aspects of the physical and psychological consequences of substance use, such models are yet to assist the development of approved medications for treatment. This review discusses progress made with animal models of punishment to understand the behavioral consequences of persistent substance use despite negative consequences. We highlight the importance of examining sex differences, especially when the behavioral response to punishment changes following drug exposure. Finally, we critique the translational value these models provide for the substance use disorder field.

Effects of pharmacological and environmental manipulations on choice between fentanyl and shock avoidance/escape in male and female rats under mutually exclusive and non-exclusive choice conditions

Substance use disorders are defined by persistent drug consumption despite adverse consequences. Accordingly, we developed two fentanyl-vs-shock avoidance/escape choice procedures in which male and female rats responded under a fixed-ratio (FR)1:FR1 concurrent schedule of shock avoidance/escape and IV fentanyl under either mutually exclusive or non-exclusive choice conditions. Initial experiments using a discrete-trial procedure determined behavioral allocation between mutually exclusive shock avoidance/escape and different fentanyl doses (0.32-18 μg/kg/infusion; Experiment 1). Shock intensity (0.1-0.7 mA) and shock avoidance/escape response requirement (FR1-16) were also manipulated (Experiment 2). Next, we used a free-operant procedure in which shock avoidance/escape and fentanyl were continuously available under non-exclusive conditions, and response-shock (R-S) interval (30-1000 s) was manipulated (Experiment 3). Finally, we tested the hypothesis that extended-access fentanyl self-administration would produce fentanyl dependence, establish fentanyl withdrawal as an endogenous negative reinforcer, and increase fentanyl choice in both procedures (Experiments 4 and 5). The shock avoidance/escape contingency decreased fentanyl self-administration, and rats consistently chose shock avoidance/escape over fentanyl in both choice conditions. Decreasing shock intensity or increasing shock avoidance/escape response requirement failed to increase fentanyl choice, suggesting that fentanyl and shock avoidance/escape are independent economic commodities. Increasing the R-S interval increased fentanyl choice but failed to increase shock delivery. Extended fentanyl access engendered high fentanyl intake and opioid withdrawal signs but failed to increase fentanyl choice under either choice condition. These results suggest that neither positive fentanyl reinforcement nor negative reinforcement by fentanyl withdrawal is sufficient to reduce shock avoidance/escape-maintained responding and increase foot shock as an adverse consequence.

Effects of Highly Palatable Diet on motivation for food and resistance to punishment in rats: Role of sex and age of exposure

Exposure to highly palatable food is believed to induce behavioral and neurobiological changes that may produce addiction-like behavior and increase the risks of obesity and overweight. Studies in rodents have led to conflicting results suggesting that several factors such as sex and age of exposure contribute to the development of maladaptive behaviors towards food. In addition, it is not clear whether effects of exposure to highly palatable diets (HPD) persist after their discontinuation, which would indicate long-term risks to develop addiction-like behavior. In this study, we investigated the persistent effects of an intermittent 8-week exposure to HPD in male and female rats as a function of age of exposure (adult and adolescent). We found that intermittent exposure to HPD did not alter body weight, but it affected consumption of standard food during the time of exposure in all groups. In addition, in adults, HPD produced a decrease in the initial baseline responding in FR1 schedules, an effect that persisted for 4 weeks in males but not in female rats. However, we found that exposure to HPD did not affect resistance to punishment measured by progressive shock strength break points or motivation for food as measured by progressive-ratio break points regardless of sex or age of exposure. Altogether, these results do not provide support for the hypothesis that intermittent exposure to HPD produce persistent increases in the vulnerability to develop addiction-like behaviors towards palatable food.

Adolescent nicotine exposure promotes adulthood opioid consumption that persists despite adverse consequences and increases the density of insular perineuronal nets

Adolescence marks a sensitive period for neurodevelopment wherein exposure to drugs of abuse may disrupt maturation and induce persistent changes in neurophysiology which may exacerbate the risk for developing substance use disorders in adulthood. Adolescent nicotine exposure (ANE) enhances motivation to obtain drugs of abuse, particularly opioids, and increases vulnerability for the development of opioid use disorder (OUD). Here, we characterized ANE effects on learning about the adverse consequences of opioid consumption in adulthood in the absence of further nicotine administration. First, we show that ANE engenders punishment resistant fentanyl self-administration in a heterogenous seeking-taking chain schedule of reinforcement at least at the tested dose of fentanyl (0.75 μg/kg). We found that ANE rats consumed significantly more fentanyl and contingent foot shock punishment was less efficacious in limiting fentanyl seeking in ANE rats, relative to nicotine-naïve controls. Next, we demonstrated that ANE limits learning about the deleterious consequences of acute opioid intoxication in adulthood. In a combined conditioned taste avoidance and place preference paradigm we found that ANE resulted in significant reductions in the strength of morphine-induced CTA, and a simultaneous enhancement of CPP at a higher dose that was less capable of driving reinforcement in naïve controls. Finally, we examined the expression of perineuronal nets (PNNs) within insular cortex (IC) and found ANE rats to have increased density of PNNs across the anterior IC and significantly more parvalbumin-labeled IC cells relative to naïve controls. Together, these data lay the framework for a mechanistic explanation of the extreme comorbidity between nicotine use and development of OUDs.

Delay of punishment highlights differential vulnerability to developing addiction-like behavior toward sweet food

Resistance to punishment is commonly used to measure the difficulty in refraining from rewarding activities when negative consequences ensue, which is a hallmark of addictive behavior. We recently developed a progressive shock strength (PSS) procedure in which individual rats can titrate the amount of punishment that they are willing to tolerate to obtain food rewards. Here, we investigated the effects of a range of delays (0-12 s) on resistance to punishment measured by PSS break points. As expected from delay discounting principles, we found that delayed shock was less effective as a punisher, as revealed by higher PSS breakpoints. However, this discounting effect was not equally distributed in the population of rats, and the introduction of a delay highlighted the existence of two populations: rats that were sensitive to immediate punishment were also sensitive to delayed shock, whereas rats that were resistant to immediate punishment showed strong temporal discounting of delayed punishment. Importantly, shock-sensitive rats suppressed responding even in subsequent non-punishment sessions, and they differed from shock-resistant rats in anxiety-like behavior, but not in sensitivity to pain. These results show that manipulation of temporal contingencies of punishment in the PSS procedure provides a valuable tool to identify individuals with a double vulnerability to addiction: low sensitivity to aversion and excessive discounting of negative future consequences. Conversely, the shock-sensitive population may provide a model of humans who are vulnerable to opportunity loss due to excessive anxiety.

Non-consummatory behavior signals predict aversion-resistant alcohol drinking in head-fixed mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6 J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior. This article is part of the Special Issue on "PFC circuit function in psychiatric disease and relevant models".

Dopaminergic systems create reward seeking despite adverse consequences

Resource-seeking behaviours are ordinarily constrained by physiological needs and threats of danger, and the loss of these controls is associated with pathological reward seeking1. Although dysfunction of the dopaminergic valuation system of the brain is known to contribute towards unconstrained reward seeking2,3, the underlying reasons for this behaviour are unclear. Here we describe dopaminergic neural mechanisms that produce reward seeking despite adverse consequences in Drosophila melanogaster. Odours paired with optogenetic activation of a defined subset of reward-encoding dopaminergic neurons become cues that starved flies seek while neglecting food and enduring electric shock punishment. Unconstrained seeking of reward is not observed after learning with sugar or synthetic engagement of other dopaminergic neuron populations. Antagonism between reward-encoding and punishment-encoding dopaminergic neurons accounts for the perseverance of reward seeking despite punishment, whereas synthetic engagement of the reward-encoding dopaminergic neurons also impairs the ordinary need-dependent dopaminergic valuation of available food. Connectome analyses reveal that the population of reward-encoding dopaminergic neurons receives highly heterogeneous input, consistent with parallel representation of diverse rewards, and recordings demonstrate state-specific gating and satiety-related signals. We propose that a similar dopaminergic valuation system dysfunction is likely to contribute to maladaptive seeking of rewards by mammals.

Non-Consummatory Behavior Signals Predict Aversion-Resistant Alcohol Drinking in Head-Fixed Mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior.

Dysfunctional decision-making in binge-eating disorder: A meta-analysis and systematic review

Binge-Eating Disorder (BED) involves anticipatory craving and urges, subjective loss-of-control during binge-eating episodes, and post-feeding psychological distress and guilt. Evidence indicates neurocognitive dysfunctions contribute to BED onset, maintenance, and treatment response. However, an integrated understanding of how cognitive processes underpin BED symptomology is lacking. We utilised a multi-stage decision-making model defining ten cognitive processes underpinning Preference Formation, Choice Implementation, Feedback Processing, and Flexibility/Shifting, to comprehensively review research published since 2013. We used preregistered PICOS criteria to assess 1966 articles identified from PubMed, PsycInfo, and Scopus database searches. This yielded 50 studies reporting behavioural cognitive tasks outcomes, comparing individuals with BED to controls with normal and higher weight. Meta-analyses revealed a unique profile of cognitive dysfunctions that spanned all decision-making stages. Significant deficits were evident in Uncertainty Evaluation, Attentional Inhibition, Choice Consistency, and Cognitive Flexibility/Set-shifting. We propose a novel model of dysfunctional decision-making processes in BED and describe their role in binge-eating behaviour. We further highlight the potential for cognitive interventions to target these processes and address the significant treatment gap in BED.

Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking

Alcohol use disorder extracts substantial personal, social and clinical costs, and continued intake despite negative consequences (compulsion-like consumption) can contribute strongly. Here we discuss lickometry, a simple method where lick times are determined across a session, while analysis across many aspects of licking can offer important insights into underlying psychological and action strategies, including their brain mechanisms. We first describe studies implicating anterior insula (AIC) and dorsal medial prefrontal cortex (dMPF) in compulsion-like responding for alcohol, then review work suggesting that AIC/ventral frontal cortex versus dMPF regulate different aspects of behavior (oral control and overall response strategy, versus moment-to-moment action organization). We then detail our lickometer work comparing alcohol-only drinking (AOD) and compulsion-like drinking under moderate- or higher-challenge (ModChD or HiChD, using quinine-alcohol). Many studies have suggested utilization of one of two main strategies, with higher motivation indicated by more bouts, and greater palatability suggested by longer, faster bouts. Instead, ModChD shows decreased variability in many lick measures, which is unexpected but consistent with the suggested importance of automaticity for addiction. Also surprising is that HiChD retains several behavior changes seen with ModChD, reduced tongue variability and earlier bout start, even though intake is otherwise disrupted. Since AIC-related measures are retained under both moderate- and higher-challenge, we propose a novel hypothesis that AIC sustains overall commitment regardless of challenge level, while disordered licking during HiChD mirrors the effects of dMPF inhibition. Thus, while AIC provides overall drive despite challenge, the ability to act is ultimately determined within the dMPF.

Early-onset smoking theory of compulsivity development: a neurocognitive model for the development of compulsive tobacco smoking

According to the literature, individuals who start tobacco smoking during adolescence are at greater risk of developing severe tobacco addiction and heavier smoking behavior in comparison with individuals who uptake tobacco smoking during subsequent developmental stages. As suggested by animal models, this may be related to the unique neuroadaptive and neurotoxic effects of nicotine on adolescents' fronto-striatal brain regions modulating cognitive control and impulsivity. Previous research has proposed that these neuroadaptive and neurotoxic effects may cause a heightened reward-oriented impulsive behavior that may foster smoking relapses during quit attempts. However, developments in the field of addiction neuroscience have proposed drug addiction to represent a type of compulsive behavior characterized by the persistent use of a particular drug despite evident adverse consequences. One brain region that has received increased attention in recent years and that has been proposed to play a central role in modulating such compulsive drug-seeking and using behavior is the insular cortex. Lesion studies have shown that structural damages in the insular cortex may disrupt smoking behavior, while neuroimaging studies reported lower gray matter volume in the anterior insular cortex of chronic smokers compared with non-smokers, in addition to correlations between gray matter volume in the anterior insular cortex and measures of compulsive cigarette smoking. Based on the findings of our recent study reporting on early-onset smokers (mean age at regular smoking initiation = 13.2 years) displaying lower gray matter and white matter volume in the anterior insular cortex compared to late-onset smokers (mean age at regular smoking initiation = 18.0 years), we propose that the anterior insular cortex may play a central role in mediating the association between smoking uptake during adolescence and smoking heaviness/tobacco addiction during adulthood.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

Binge eating, overeating and food addiction: Approaches for examining food overconsumption in laboratory rodents

Overeating ranges in severity from casual overindulgence to an overwhelming drive to consume certain foods. At its most extreme, overeating can manifest as clinical diagnoses such as binge eating disorder or bulimia nervosa, yet subclinical forms of overeating such as emotional eating or uncontrolled eating can still have a profoundly negative impact on health and wellbeing. Although rodent models cannot possibly capture the full spectrum of disordered overeating, studies in laboratory rodents have substantially progressed our understanding of the neurobiology of overconsumption. These experimental approaches range from simple food-exposure protocols that promote binge-like eating and the development of obesity, to more complex operant procedures designed to examine distinct 'addiction-like' endophenotypes for food. This review provides an overview of these experimental approaches, with the view to providing a comprehensive resource for preclinical investigators seeking to utilize behavioural models for studying the neural systems involved in food overconsumption.

Animal models of compulsion alcohol drinking: Why we love quinine-resistant intake and what we learned from it

Alcohol Use Disorder (AUD) ranks among the most prevalent mental disorders, extracting ~$250 billion/year in the US alone and producing myriad medical and social harms. Also, the number of deaths related to problem drinking has been increasing dramatically. Compulsive alcohol drinking, characterized by intake that persists despite negative consequences, can be particularly important and a major obstacle to treatment. With the number of people suffering from AUD increasing during the past years, there is a critical need to understand the neurobiology related to compulsive drives for alcohol, as well as the development of novel AUD pharmacological therapies. Here we discuss rodent compulsion-like alcohol drinking (CLAD) models, focusing on the two most widely used adverse stimuli to model rodent compulsion-like responding, quinine adulteration of alcohol and footshook-resistant alcohol intake. For both cases, the goal is to uncover behavior patterns and brain circuits that underlie drive for alcohol even in the face of negative consequences. We discuss caveats, benefits, and potential brain mechanisms, of models for consequence-resistant responding for alcohol more generally, and especially highlight some advantages of quinine-resistance over footshook-resistance. Further, since this review contributes to a Special issue focused on Molecular Aspects of Compulsive Drug Use, we discuss our new findings showing how the noradrenergic system is related to CLAD responding. In particular, we comment on the importance of α1 and β adrenergic receptors (ARs) as potential targets for treating AUD.

Extended access to fentanyl vapor self-administration leads to addiction-like behaviors in mice: Blood chemokine/cytokine levels as potential biomarkers

Rodent models are useful for understanding the mechanisms that underlie opioid addiction, but most preclinical studies have focused on rewarding and consummatory aspects of opioids without components of dependence-induced escalation of drug taking or seeking. We characterized several opioid-related behaviors in mice using a model of vaporized fentanyl self-administration. Male and female C57BL/6J mice were assigned to short-access (ShA; 1 h, nondependent) or long-access (LgA; 6 h, dependent) fentanyl vapor self-administration and subsequently tested in a battery of behavioral tests, followed by blood collection during withdrawal. Compared with mice in the ShA group, mice in the LgA group escalated their fentanyl intake, were more motivated to work to obtain the drug, exhibited greater hyperalgesia, and exhibited greater signs of naloxone-precipitated withdrawal. Principal component analysis indicated the emergence of two independent behavioral constructs: "intake/motivation" and "hyperalgesia/punished seeking." In mice in the LgA condition only, "hyperalgesia/punished seeking" was associated with plasma levels of proinflammatory interleukin-17 (IL-17), chemokine (C-C motif) ligand 4 (CCL-4), and tumor necrosis factor α (TNF-α). Overall, the results suggest that extended access to opioids leads to addiction-like behavior, and some constructs that are associated with addiction-like behavior may be associated with levels of the proinflammatory cytokines/chemokines IL-17, TNF-α, and CCL-4 in blood.

Alcohol use disorder criteria exhibit different comorbidity patterns

BACKGROUND AND AIMS

Alcohol use disorder is comorbid with numerous other forms of psychopathology, including externalizing disorders (e.g. conduct disorder) and, to a lesser extent, internalizing conditions (e.g. depression, anxiety). Much of the time, overlap among alcohol use disorder and other conditions is explored at the disorder level, assuming that criteria are co-equal indicators of other psychopathology, even though alcohol use disorder criteria span numerous varied domains. Emerging evidence suggests that there are symptom clusters within the construct of alcohol use disorder that relate differentially with important external criteria, including psychopathology and allied personality traits (e.g. impulsivity, novelty-seeking). The present study mapped individual alcohol use disorder criteria onto internalizing and externalizing dimensions.

DESIGN AND PARTICIPANTS

We used multivariate and factor analytical modeling and data from two large nationally representative samples of past year drinkers (n = 25 604; 19 454).

SETTING

United States.

MEASUREMENTS

Psychopathology was assessed using the Alcohol Use Disorder and Associated Disabilities Interview Schedule, yielding alcohol use disorder criteria, internalizing diagnoses (i.e. major depressive disorder, dysthymia, social anxiety disorder, generalized anxiety disorder, specific phobia, agoraphobia and panic disorder) and externalizing diagnoses and symptoms (i.e. antisocial personality disorder, conduct disorder and three impulsivity items drawn from borderline personality disorder criteria). Alcohol consumption was assessed in terms of past-year drinking frequency, usual amount of alcohol consumed on drinking days, binge drinking frequency, intoxication frequency, and maximum number of drinks in a 24-hour period.

FINDINGS

Four different patterns emerged. First, several alcohol use disorder criteria were relatively weakly associated with externalizing and internalizing. Secondly, withdrawal was associated with internalizing, but this association was not specific to distress. Thirdly, there was a general lack of specificity between alcohol use disorder criteria and narrower forms of internalizing, despite what might be predicted by modern models of addiction. Fourthly, recurrent use in hazardous situations reflected higher degrees of externalizing and lower internalizing liability.

CONCLUSIONS

Different symptom combinations appear to yield differential expressions of alcohol use disorder that are disorder-specific, or reflect broader tendencies toward externalizing, internalizing or both.