Individual decision-making in the causal pathway to addiction: contributions and limitations of rodent models

Drugs of abuse hijack a mesolimbic pathway that processes homeostatic need

Drugs of abuse are thought to promote addiction in part by "hijacking" brain reward systems, but the underlying mechanisms remain undefined. Using whole-brain FOS mapping and in vivo single-neuron calcium imaging, we found that drugs of abuse augment dopaminoceptive ensemble activity in the nucleus accumbens (NAc) and disorganize overlapping ensemble responses to natural rewards in a cell type-specific manner. Combining FOS-Seq, CRISPR-perturbation, and single-nucleus RNA sequencing, we identified Rheb as a molecular substrate that regulates cell type-specific signal transduction in NAc while enabling drugs to suppress natural reward consumption. Mapping NAc-projecting regions activated by drugs of abuse revealed input-specific effects on natural reward consumption. These findings characterize the dynamic, molecular and circuit basis of a common reward pathway, wherein drugs of abuse interfere with the fulfillment of innate needs.

A brief measure of non-drug reinforcement: Association with treatment outcomes during initial substance use recovery

BACKGROUND

Translational research demonstrates that drug use is inversely associated with availability and engagement with meaningful non-drug reinforcers. Evaluation of non-drug reinforcement in treatment-receiving clinical populations is limited, likely owing to the time intensive nature of existing measures. This study explores the association of non-drug reinforcers with treatment outcomes using a novel, brief measure of past month non-drug reinforcement quantifying three elements: relative frequency, access, and enjoyability.

METHODS

Respondents enrolled in substance use treatment (residential, intensive outpatient, and medically managed withdrawal) in clinics across the United States (N = 5481) completed standardized assessments of non-drug reinforcement and treatment outcomes (i.e., return to use and life satisfaction) one-month after treatment discharge. Non-drug reinforcement measures (availability, engagement, enjoyability) were used as predictors of return to use and life satisfaction using generalized linear models.

RESULTS

Non-drug reinforcement indices were associated with return to use and life satisfaction in unadjusted models (e.g., 12.4 % versus 58.3 % return to use for those with the highest and lowest availability, respectively). Consistent results were observed in models adjusted for sociodemographic variables and risk factors (i.e., sleep disturbance, anhedonia, stress). Comparisons by drug class generally showed lower non-drug reinforcement among patients reporting heroin or methamphetamine as their primary drug.

CONCLUSIONS

Results highlight the importance of non-drug reinforcement during the first month following treatment. Rapid measurement of non-drug reinforcement in stepped care settings may illuminate critical deficits in early stages of behavior change, identify those at greatest risk for return to use, and provide targets for treatment to improve recovery trajectories.

Advances in AAV technology for delivering genetically encoded cargo to the nonhuman primate nervous system

Modern neuroscience approaches including optogenetics, calcium imaging, and other genetic manipulations have facilitated our ability to dissect specific circuits in rodent models to study their role in neurological disease. These approaches regularly use viral vectors to deliver genetic cargo (e.g., opsins) to specific tissues and genetically-engineered rodents to achieve cell-type specificity. However, the translatability of these rodent models, cross-species validation of identified targets, and translational efficacy of potential therapeutics in larger animal models like nonhuman primates remains difficult due to the lack of efficient primate viral vectors. A refined understanding of the nonhuman primate nervous system promises to deliver insights that can guide the development of treatments for neurological and neurodegenerative diseases. Here, we outline recent advances in the development of adeno-associated viral vectors for optimized use in nonhuman primates. These tools promise to help open new avenues for study in translational neuroscience and further our understanding of the primate brain.

A contextualized reinforcer pathology approach to addiction

Behavioural economic accounts of addiction conceptualize harmful drug use as an operant reinforcer pathology, emphasizing that a drug is consumed because of overvaluation of smaller immediate rewards relative to larger delayed rewards (delay discounting) and high drug reinforcing value (drug demand). These motivational processes are within-individual determinants of behaviour. A third element of learning theory posits that harmful drug use depends on the relative constraints on access to other available activities and commodities in the choice context (alternative reinforcers), reflecting the substantial influence of environmental factors. In this Perspective, we integrate alternative reinforcers into the contemporary behavioural economic account of harmful drug use - the contextualized reinforcer pathology model - and review empirical literature across the translational spectrum in support of this model. Furthermore, we consider how increases in drug-related mortality and health disparities in addiction can be understood and potentially ameliorated via a contextualized reinforcer pathology model in which lack of alternative reinforcement is a major risk factor for addiction.

Sex-specific decision-making impairments and striatal dopaminergic changes after binge drinking history in rats

Binge drinking (BD) is a harmful behavior for health and is a predictive factor for the development of alcohol addiction. Weak decision-making (DM) capacities could play a role in the vulnerability to BD which in turn would lead to DM impairments, thus perpetuating BD. Longitudinal preclinical studies are however lacking and necessary to understand this complex relationship. Both DM and BD are influenced by sex and involve dopamine release in the core of the nucleus accumbens, a central mechanism regulated by dopamine D2/3 autoreceptors. In this context, we used an operant self-administration procedure of BD in male and female rats, and longitudinally assessed DM capacity, memory and anxiety-like behavior. To better understand the mechanisms potentially involved in the relationship between DM and BD, ex vivo dopamine transmission was assessed short term after the end of the binge exposure in the core of the nucleus accumbens (NAc) using the fast-scan cyclic voltammetry (FSCV) technique and the D2/3 agonist quinpirole. We found important basal sex differences in DM, with female rats showing better performances at baseline. Choice processes were impaired exclusively in males after BD history, associated with a decrease in impulse control in both sexes, while memory and anxiety-like behavior were not affected. Our neurobiological results demonstrate that BD did not affect basal dopamine signaling in the NAc core, regardless of the sex, but reveal changes in the sensitivity to the inhibitory effects of quinpirole in females. DM impairments were neither associated with changes in basal dopamine signaling nor pre-synaptic D2 activity. Overall, our findings show that BD affects both DM processes and dopamine transmission in the core of the NAc in a sex-related manner, further suggesting that these effects may play a role in the vicious cycle leading to BD perpetuation and the early onset of AUD. Our results may inform novel strategies for therapeutic and prevention interventions.

From concepts to treatment: a dialog between a preclinical researcher and a clinician in addiction medicine

The debate surrounding the brain disease model and the associated questioning of the relevance of animal models is polarizing the field of addiction, and tends to widen the gap between preclinical research and addiction medicine. Here, we aimed at bridging this gap by establishing a dialog between a preclinical researcher and a clinician in addiction medicine. Our objective was to evaluate animal models and the neuroscientific conceptualization of addiction in light of alcohol or drug dependence and treatment in patients struggling with an addiction. We sought to determine how preclinical research influenced addiction medicine over past decades, and reciprocally, what can preclinical researchers learn from addiction medicine that could lead to more effective approaches. In this dialog, we talk about the co-evolution of addiction concepts and treatments from neuroscientific and medical perspectives. This dialog illustrates the reciprocal influences and mutual enrichment between the two disciplines and reveals that, although preclinical research might not produce new pharmacotherapies, it does shape the theoretical conceptualization of addiction and could thereby contribute to the implementation of therapeutic approaches.

Reinforcement learning detuned in addiction: integrative and translational approaches

Suboptimal decision-making strategies have been proposed to contribute to the pathophysiology of addiction. Decision-making, however, arises from a collection of computational components that can independently influence behavior. Disruptions in these different components can lead to decision-making deficits that appear similar behaviorally, but differ at the computational, and likely the neurobiological, level. Here, we discuss recent studies that have used computational approaches to investigate the decision-making processes underlying addiction. Studies in animal models have found that value updating following positive, but not negative, outcomes is predictive of drug use, whereas value updating following negative, but not positive, outcomes is disrupted following drug self-administration. We contextualize these findings with studies on the circuit and biological mechanisms of decision-making to develop a framework for revealing the biobehavioral mechanisms of addiction.

Behavioral economics of substance use: Understanding and reducing harmful use during the COVID-19 pandemic

Behavioral economic research demonstrates that alcohol and drug consumption is (a) an inverse function of constraints on access to the substance and (b) a direct function of constraints on access to alternative rewards. Physical distancing interventions and economic consequences of the COVID-19 pandemic have resulted in unprecedented reductions in many of the constraints on substance use and in critical evolutionarily salient sources of alternative reward, such as social interaction, physical activity, leisure activities and hobbies, and academic and occupational pursuits. Thus, behavioral economics suggests that the pandemic and necessary public health response have created a "perfect storm" for exacerbation of individual-level and population-level substance use problems and also points to multilevel intervention strategies. We summarize this perspective and research by highlighting 3 critical behavioral processes that will influence drug and alcohol consumption. First, the sudden absence of many effective constraints on substance use (work, school, community, or service obligations) will reduce the actual and perceived cost of use. Second, physical distancing measures will reduce the availability, and increase the cost, of many rewarding substance-free activities and commodities. Third, increased uncertainty around current and future events increases discounting of delayed rewards. These effects will be especially pernicious among populations with existing health disparities. Next, we outline interventions suggested by behavioral economics to mitigate the impact of COVID-19 on substance use that are aimed at increasing perceived costs of use; increasing access to substance-free activities, including treatment; and lengthening the timeframe for behavioral allocation and altering environmental contexts to promote healthy choices. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Animal Models of the Behavioral Symptoms of Substance Use Disorders

To more effectively manage substance use disorders, it is imperative to understand the neural, genetic, and psychological underpinnings of addictive behavior. To contribute to this understanding, considerable efforts have been made to develop translational animal models that capture key behavioral characteristics of addiction on the basis of DSM5 criteria of substance use disorders. In this review, we summarize empirical evidence for the occurrence of addiction-like behavior in animals. These symptoms include escalation of drug use, neurocognitive deficits, resistance to extinction, exaggerated motivation for drugs, increased reinstatement of drug seeking after extinction, preference for drugs over nondrug rewards, and resistance to punishment. The occurrence of addiction-like behavior in laboratory animals has opened the opportunity to investigate the neural, genetic, and psychological background of key aspects of addiction, which may ultimately contribute to the prevention and treatment of substance use disorders.

Shifts in behavioral allocation patterns as a natural recovery mechanism: Postresolution expenditure patterns

BACKGROUND

Behavioral economics predicts that recovery from Alcohol Use Disorder involves shifts in resource allocation away from drinking, toward valuable nondrinking rewards that reinforce and stabilize recovery behavior patterns. Further, these shifts should distinguish nonproblem drinking (moderation) outcomes from outcomes involving abstinence or relapse. To evaluate these hypotheses, 5 prospective studies of recent natural recovery attempts were integrated to examine changes in monetary spending during the year following the initial cessation of heavy drinking as a function of 1-year drinking outcomes.

METHODS

Problem drinkers from Southeastern U.S. communities (N = 493, 67% male, 65% white, mean age = 46.5 years) were enrolled soon after stopping heavy drinking without treatment and followed prospectively for a year. An expanded Timeline Followback interview assessed daily drinking and monetary spending on alcohol and nondrinking commodities during the year before and after recovery initiation.

RESULTS

Longitudinal associations between postresolution drinking and spending were evaluated using MPlus v.8. Initial models evaluated whether changes in spending at 4-month intervals predicted drinking outcomes at 1 year and showed significant associations in 6 commodity categories (alcohol, consumable goods, gifts, entertainment, financial/legal affairs, housing/durable goods/insurance; ps < 0.05). Cross-lagged models showed that the moderation outcome group shifted spending mid-year to obtain large rewards with enduring benefits (e.g., housing), whereas the abstinent and relapsed groups spent less overall and purchased smaller rewards (e.g., consumable goods, entertainment, and gifts) throughout the year.

CONCLUSIONS

Dynamic changes in monetary allocation occurred during the postresolution year. As hypothesized, compared to the groups who abstained or relapsed, the moderation group shifted spending in ways that, overall, yielded higher value alcohol-free reinforcement that should reinforce recovery while they enjoyed some limited nonproblem drinking below heavy drinking thresholds. These findings add to evidence that moderation entails different behavioral regulation processes than abstinent and relapse outcomes, which were more similar to one another.

Probing the decision-making mechanisms underlying choice between drug and nondrug rewards in rats

Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.

Pharmacokinetics trumps pharmacodynamics during cocaine choice: a reconciliation with the dopamine hypothesis of addiction

Cocaine is known to increase brain dopamine at supranormal levels in comparison to alternative nondrug rewards. According to the dopamine hypothesis of addiction, this abnormally large dopamine response would explain why cocaine use is initially highly rewarding and addictive. Though resting on solid neuroscientific foundations, this hypothesis has nevertheless proven difficult to reconcile with research on cocaine choice in experimental animals. When facing a choice between an intravenous bolus of cocaine and a nondrug alternative (e.g., sweet water), both delivered immediately after choice, rats do not choose the drug, as would be predicted, but instead develop a strong preference for the nondrug alternative. Here we report evidence that reconciles this finding with the dopamine hypothesis of addiction. First, a systematic literature analysis revealed that the delays of effects of intravenous cocaine on nucleus accumbens dopamine are of the order of tens of seconds and are considerably longer than those of nondrug reward. Second, this was confirmed by measuring response times to cocaine omission during self-administration as a behavioral proxy of these delays. Finally, when the influence of the drug delays was reduced during choice by adding an increasing delay to both the drug and nondrug rewards, rats shifted their choice to cocaine. Overall, this study suggests that cocaine is indeed supranormal in reward magnitude, as postulated by the dopamine hypothesis of addiction, but is less preferred during choice because its pharmacokinetics makes it an inherently more delayed reward than the alternative. Reframing previous drug choice studies in rats as intertemporal choice studies reveals that the discounting effects of delays spare no rewards, including supranormal ones, and that during choice, pharmacokinetics trumps pharmacodynamics.

Drug Addiction: Hyperkatifeia/Negative Reinforcement as a Framework for Medications Development

Compulsive drug seeking that is associated with addiction is hypothesized to follow a heuristic framework that involves three stages (binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation) and three domains of dysfunction (incentive salience/pathologic habits, negative emotional states, and executive function, respectively) via changes in the basal ganglia, extended amygdala/habenula, and frontal cortex, respectively. This review focuses on neurochemical/neurocircuitry dysregulations that contribute to hyperkatifeia, defined as a greater intensity of negative emotional/motivational signs and symptoms during withdrawal from drugs of abuse in the withdrawal/negative affect stage of the addiction cycle. Hyperkatifeia provides an additional source of motivation for compulsive drug seeking via negative reinforcement. Negative reinforcement reflects an increase in the probability of a response to remove an aversive stimulus or drug seeking to remove hyperkatifeia that is augmented by genetic/epigenetic vulnerability, environmental trauma, and psychiatric comorbidity. Neurobiological targets for hyperkatifeia in addiction involve neurocircuitry of the extended amygdala and its connections via within-system neuroadaptations in dopamine, enkephalin/endorphin opioid peptide, and γ-aminobutyric acid/glutamate systems and between-system neuroadaptations in prostress corticotropin-releasing factor, norepinephrine, glucocorticoid, dynorphin, hypocretin, and neuroimmune systems and antistress neuropeptide Y, nociceptin, endocannabinoid, and oxytocin systems. Such neurochemical/neurocircuitry dysregulations are hypothesized to mediate a negative hedonic set point that gradually gains allostatic load and shifts from a homeostatic hedonic state to an allostatic hedonic state. Based on preclinical studies and translational studies to date, medications and behavioral therapies that reset brain stress, antistress, and emotional pain systems and return them to homeostasis would be promising new targets for medication development. SIGNIFICANCE STATEMENT: The focus of this review is on neurochemical/neurocircuitry dysregulations that contribute to hyperkatifeia, defined as a greater intensity of negative emotional/motivational signs and symptoms during withdrawal from drugs of abuse in the withdrawal/negative affect stage of the drug addiction cycle and a driving force for negative reinforcement in addiction. Medications and behavioral therapies that reverse hyperkatifeia by resetting brain stress, antistress, and emotional pain systems and returning them to homeostasis would be promising new targets for medication development.

Computational theory-driven studies of reinforcement learning and decision-making in addiction: What have we learned?

Computational psychiatry provides a powerful new approach for linking the behavioral manifestations of addiction to their precise cognitive and neurobiological substrates. However, this emerging area of research is still limited in important ways. While research has identified features of reinforcement learning and decision-making in substance users that differ from health, less emphasis has been placed on capturing addiction cycles/states dynamically, within-person. In addition, the focus on few behavioral variables at a time has precluded more detailed consideration of related processes and heterogeneous clinical profiles. We propose that a longitudinal and multidimensional examination of value-based processes, a type of dynamic "computational fingerprint", will provide a more complete understanding of addiction as well as aid in developing better tailored and timed interventions.

Contribution of the prefrontal cortex and basolateral amygdala to behavioral decision-making under reward/punishment conflict

RATIONALE

Control of reward-seeking behavior under conditions of punishment is an important function for survival.

OBJECTIVES AND METHODS

We designed a task in which rats could choose to either press a lever and obtain a food pellet accompanied by a footshock or refrain from pressing the lever to avoid footshock, in response to tone presentation. In the task, footshock intensity steadily increased, and the task was terminated when the lever press probability reached < 25% (last intensity). Rats were trained until the last intensity was stable. Subsequently, we investigated the effects of the pharmacological inactivation of the ventromedial prefrontal cortex (vmPFC), lateral orbitofrontal cortex (lOFC), and basolateral amygdala (BLA) on task performance.

RESULTS

Bilateral inactivation of the vmPFC, lOFC, and BLA did not alter lever press responses at the early stage of the task. The number of lever presses increased following vmPFC and BLA inactivation but decreased following lOFC inactivation during the later stage of the task. The last intensity was elevated by vmPFC or BLA inactivation but lowered by lOFC inactivation. Disconnection of the vmPFC-BLA pathway induced behavioral alterations that were similar to vmPFC or BLA inactivation. Inactivation of any regions did not alter footshock sensitivity and anxiety levels.

CONCLUSIONS

Our results demonstrate a strong role of the vmPFC and BLA and their interactions in reward restraint to avoid punishment and a prominent role of the lOFC in reward-seeking under reward/punishment conflict situations.

Are animal models of addiction useful?

BACKGROUND

Pre-clinical research involving non-human animals has made important contributions to our understanding of risk factors for addiction, neuroadaptations that follow chronic drug exposure and to the development of some efficacious pharmacotherapies for addiction. Despite these contributions, we argue that animal models of addiction have impeded progress in our understanding of addiction and its treatment in humans.

ARGUMENT

First, the majority of pharmacological treatments that were initially developed using animal models have failed to prove effective for the treatment of addiction in humans, resulting in a huge waste of resources. Secondly, we demonstrate that prevailing animal models that portray addiction as a disorder of compulsion and habit cannot be reconciled with observations that psychoactive drug use in humans is a goal-directed operant behaviour that remains under the control of its consequences, even in people who are addicted. Thirdly, addiction may be a uniquely human phenomenon that is dependent on language, which necessarily limits the validity of animal models. Finally, we argue that addicted brains must be understood as one component of broader networks of symptoms and environmental and social factors that are impossible to model in laboratory animals.

CONCLUSIONS

A case can be made that animal models of addiction have not served us well in understanding and treating addiction in humans. It is important to reconsider some widely held beliefs about the nature of addictive behaviour in humans that have arisen from the zeal to translate observations of laboratory animals.

Nonhuman animal models of substance use disorders: Translational value and utility to basic science

BACKGROUND

The National Institute on Drug Abuse (NIDA) recently released a Request for Information (RFI) soliciting comments on nonhuman animal models of substance use disorders (SUD).

METHODS

A literature review was performed to address the four topics outlined in the RFI and one topic inspired by the RFI: (1) animal models that best recapitulate SUD, (2) animal models that best balance the trade-offs between resources and ecological validity, (3) animal models whose translational value are frequently misrepresented or overrepresented by the scientific community, (4) aspects of SUD that are not currently being modeled in animals, and (5) animal models that are optimal for examining the basic mechanisms by which drugs produce their abuse-related effects.

RESULTS

Models that employ response-contingent drug administration, use complex schedules of reinforcement, measure behaviors that mimic the distinguishing features of SUD, and use animals that are phylogenetically similar to humans have the greatest translational value. Models that produce stable and reproducible baselines of behavior, lessen the number of uncontrolled variables, and minimize the influence of extraneous factors are best at examining basic mechanisms contributing to drug reward and reinforcement.

CONCLUSIONS

Nonhuman animal models of SUD have undergone significant refinements to increase their utility for basic science and translational value for SUD. The existing literature describes numerous examples of how these models may best be utilized to answer mechanistic questions of drug reward and identify potential therapeutic interventions for SUD. Progress in the field could be accelerated by further collaborations between researchers using animals versus humans.

Animal models in addiction research: A dimensional approach

Drug addiction affects approximately 10% of the population and these numbers are rising. Treatment and prevention of addiction are impeded by current diagnostic systems, such as DSM-5, which are based on outcomes rather than processes. Here, we review the importance of adopting a dimensional framework, specifically the Research Domain Criteria (RDoC), to identify protective and vulnerability mechanisms in addiction. We discuss how preclinical researchers should work within this framework to develop animal models based on domains of function. We highlight RDoC paradigms related to addiction and discuss how these can be used to investigate the biological underpinnings of an addiction cycle (i.e., binge/intoxication, negative affect, and craving). Using this information, we then outline the critical role of animal research in ongoing revisions to the RDoC matrix (specifically the functional significance of domains, constructs and subconstructs) and its contribution to the development and refinement of addiction theories. We conclude with an overview of the contribution that animal research has made to the development of pharmacological and behavioural treatments for addiction.

Decision-making in addiction: Current knowledge, clinical implications and future directions

This article serves to summarize this special issue on "Decision-making in Addiction." The manuscripts included in this issue cover topics as diverse as theory, types of models used to study decision-making, underlying pharmacological, behavioral and brain mechanisms, and individual differences. Together, these papers can serve as a comprehensive resource outlining our contemporary understanding of how decision-making processes contribute to addictive behavior. The knowledge included here can inform treatment development, clearly pointing to the need for tailored interventions based on individual differences.

Effects of alcohol dependence on discrete choice between alcohol and saccharin

Dependence on drugs has enduring effects on drug intake and relapse. The role of choice in enhanced susceptibility to drug use in drug dependence has been little studied. Here we determine the effects of alcohol dependence on the choice between alcohol and a non-drug reward, saccharin, using the discrete choice model in food-restricted male rats. We trained rats to self-administer alcohol (12% w/v) and saccharin (0.05, 0.1%), tested their choice of alcohol vs. saccharin, and determined the effects of deprivation and intertrial interval (ITI) duration on choice. We then determined the effects of alcohol dependence, induced by repeated intermittent exposure to alcohol vapor on choice of alcohol vs. saccharin (0.1%) in discrete choice trials as well as on the effects of adulteration of alcohol with quinine on choice. We trained another group of rats to self-administer intravenous (i.v.) nicotine (0.03 mg/kg/infusion) and oral saccharin (0.1%), determined their choice, and examined the roles of ITI duration and concurrent access on choice. Rats chose equivalent amounts of 0.05% saccharin and 12% alcohol, showed a stronger choice for 0.1% saccharin, and alcohol and saccharin choice were modestly decreased and increased, respectively, by deprivation. Alcohol dependence led to profound increases in the choice of alcohol over saccharin while adulteration of alcohol with quinine did not affect choice in non-dependent or dependent rats. Rats showed marked choice for 0.1% saccharin over i.v. nicotine. The strong effect that dependence had on alcohol choice is an important validation of the discrete choice procedure.