Cocaine-associated decision-making: Toward isolating preference

Enhancing translation: A need to leverage complex preclinical models of addictive drugs to accelerate substance use treatment options

Preclinical models of addictive drugs have been developed for decades to model aspects of the clinical experience in substance use disorders (SUDs). These include passive exposure as well as volitional intake models across addictive drugs and have been utilized to also measure withdrawal symptomatology and potential neurobehavioral mechanisms underlying relapse to drug seeking or taking. There are a number of Food and Drug Administration (FDA)-approved medications for SUDs, however, many demonstrate low clinical efficacy as well as potential sex differences, and we also note gaps in the continuum of care for certain aspects of clinical experiences in individuals who use drugs. In this review, we provide a comprehensive update on both frequently utilized and novel behavioral models of addiction with a focus on translational value to the clinical experience and highlight the need for preclinical research to follow epidemiological trends in drug use patterns to stay abreast of clinical treatment needs. We then note areas in which models could be improved to enhance the medications development pipeline through efforts to enhance translation of preclinical models. Next, we describe neuroscience efforts that can be leveraged to identify novel biological mechanisms to enhance medications development efforts for SUDs, focusing specifically on advances in brain transcriptomics approaches that can provide comprehensive screening and identification of novel targets. Together, the confluence of this review demonstrates the need for careful selection of behavioral models and methodological parameters that better approximate the clinical experience combined with cutting edge neuroscience techniques to advance the medications development pipeline for SUDs.

Characterization of operant social interaction in rats: effects of access duration, effort, peer familiarity, housing conditions, and choice between social interaction vs. food or remifentanil

RATIONALE AND OBJECTIVE

Social factors play a critical role in drug addiction. We recently showed that rats will abstain from methamphetamine, cocaine, heroin, and remifentanil self-administration when given a choice between the addictive drug and operant social interaction. Here, we further characterized operant social interaction by determining the effects of access duration, effort, peer familiarity, and housing conditions. We also determined choice between social interaction vs. palatable food or remifentanil.

METHODS

We first trained single-housed male and female rats to lever-press for social interaction with a sex- and age-matched peer. Next, we determined effects of access duration (3.75 to 240 s), effort (increasing fixed-ratio schedule requirements or progressive ratio schedule), peer familiarity (familiar vs. unfamiliar), and housing conditions (single vs. paired housing) on social self-administration. We also determined choice between social interaction vs. palatable food pellets or intravenous remifentanil (0, 1, 10 µg/kg/infusion).

RESULTS

Increasing access duration to a peer decreased social self-administration under fixed ratio but not progressive ratio schedule; the rats showed similar preference for short vs. long access duration. Social self-administration under different fixed ratio requirements was higher in single-housed than in paired-housed rats and higher for a familiar vs. unfamiliar partner in single-housed but not paired-housed rats. Response rates of food-sated rats under increasing fixed-ratio requirements were higher for palatable food than for social interaction. The rats strongly preferred palatable food over social interaction and showed dose-dependent preference for social interaction vs. remifentanil.

CONCLUSIONS

We identified parameters influencing the reinforcing effects of operant social interaction and introduce a choice procedure sensitive to remifentanil self-administration dose.

Drug versus non-drug behaviors: A dual-reward model of sex differences and neurobiological mechanisms in rats

Substance Use Disorders (SUDs) are an impactful problem characterized by chronic relapse and engagement in drug-related behaviors at the expense of non-drug behaviors. Brain regions implicated in drug and non-drug-related behaviors often overlap, complicating investigations of neurobiological mechanisms underlying SUDs. Here we presented a within-subject model for studying self-administration, reinforcer competition, extinction, and cued reinstatement of cocaine- and food-seeking in rats. Due to differences in cocaine- and food-reinforced behavior, we transformed data to proportions of baseline, revealing increased resistance to extinction and disproportionately greater cued reinstatement of cocaine seeking relative to food seeking. Consistent with previous reports, females showed greater preference for cocaine reinforcement than males, though these findings failed to reach statistical significance. To demonstrate the model's utility for investigating neurobiological mechanisms, we included proof-of-concept calcium imaging data demonstrating the utility of the behavioral model for detecting cellular activity patterns associated with cocaine- and food-seeking behaviors. Future studies utilizing this model should improve understanding of the development and expression of pathological behaviors characteristic of SUDs in humans, sex differences in these behaviors, and their neurobiological correlates. Thus, the model has utility for improving understanding of SUDs, leading to novel treatments to reduce the pathological behaviors associated with SUDs.

Contextual extinction of drug-associated discriminative stimuli fails to attenuate drug-vs-food choice in rhesus monkeys

Relapse within the context of a substance use disorder can be triggered by cues that function as discriminative stimuli to signal contingencies of drug availability and promote drug-taking behavior. Extinction procedures can weaken this association between drug-associated cues and drug-taking behavior and may reduce the probability of relapse. This study evaluated a regimen of extinction training on cocaine and heroin self-administration in rhesus monkeys under a drug-vs-food choice procedure. Behavior was initially maintained under a concurrent schedule of food (1-g food pellets; fixed-ratio 100 schedule) and cocaine injections (0-0.1 mg/kg/injection; fixed-ratio 10) (n = 4 males) or heroin injections (0-0.01 mg/kg/injection; fixed-ratio 10) (n = 3 females and 1 male) during daily 2-hr choice sessions. Subsequently, choice sessions were supplemented by daily 20-hr saline self-administration sessions for 14 consecutive days. During saline self-administration sessions, only drug-associated discriminative stimuli were presented and responding produced saline injections. Drug continued to be available during choice sessions. Prior to extinction training, both cocaine and heroin maintained dose-dependent increases in drug-vs-food choice. Exposure to 14 saline self-administration sessions failed to significantly decrease drug choice and increase food choice. These preclinical results do not support the effectiveness of extinguishing drug-associated discriminative stimuli as a nonpharmacological treatment strategy for reducing drug choice.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Quantifying value-based determinants of drug and non-drug decision dynamics

RATIONALE

A growing body of research suggests that substance use disorder (SUD) may be characterized as disorders of decision making. However, drug choice studies assessing drug-associated decision making often lack more complex and dynamic conditions that better approximate contexts outside the laboratory and may lead to incomplete conclusions regarding the nature of drug-associated value.

OBJECTIVES

The current study assessed isomorphic (choice between identical food options) and allomorphic (choice between remifentanil [REMI] and food) choice across dynamically changing reward probabilities, magnitudes, and differentially reward-predictive stimuli in male rats to better understand determinants of drug value. Choice data were analyzed at aggregate and choice-by-choice levels using quantitative matching and reinforcement learning (RL) models, respectively.

RESULTS

Reductions in reward probability or magnitude independently reduced preferences for food and REMI commodities. Inclusion of reward-predictive cues significantly increased preference for food and REMI rewards. Model comparisons revealed that reward-predictive stimuli significantly altered the economic substitutability of food and REMI rewards at both levels of analysis. Furthermore, model comparisons supported the reformulation of reward value updating in RL models from independent terms to a shared, relative term, more akin to matching models.

CONCLUSIONS

The results indicate that value-based quantitative choice models can accurately capture choice determinants within complex decision-making contexts and corroborate drug choice as a multidimensional valuation process. Collectively, the present study indicates commonalities in decision-making for drug and non-drug rewards, validates the use of economic-based SUD therapies (e.g., contingency management), and implicates the neurobehavioral processes underlying drug-associated decision-making as a potential avenue for future SUD treatment.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

A drug-vs-food "choice" self-administration procedure in rats to investigate pharmacological and environmental mechanisms of substance use disorders

BACKGROUND

Preclinical drug self-administration procedures are commonly used to investigate expression, mechanisms, and treatment of substance use disorders.

NEW METHOD

The aims were to back-translate an intravenous drug-vs-food choice procedure primarily utilized in monkeys to male and female rats and to develop a surgical method for sustained intravenous catheter patency suitable for long-term drug-choice studies.

RESULTS

The surgical protocol resulted in a median intravenous jugular catheter patency in male and female rats of 126 days (range: 25-365 days). Drug-vs-food choice was established with opioids (fentanyl and heroin), psychostimulants (cocaine, methamphetamine, and amphetamine), and an opioid/psychostimulant mixture (fentanyl + methamphetamine). The average time from catheter implantation to stable choice behavior across all drugs was 27 sessions (range: 16-44 sessions). Choice behavior stabilized more quickly for cocaine and fentanyl than for other drugs. Manipulations of both environmental variables (e.g., response requirement or food reinforcer magnitude) and pharmacological variables (e.g., extended access drug self-administration or continuous buprenorphine treatment via osmotic pump) significantly shifted opioid-vs-food choice consistent with previous monkey studies.

COMPARISON WITH EXISTING METHODS

Duration of intravenous catheter patency in rats was suitable for long-term, within-subject drug choice studies. Effects of environmental and pharmacological manipulations in rats confirmed and extended previous results from monkeys.

CONCLUSIONS

The concordance of behavioral results between rats and monkeys using the present drug-vs-food choice procedure supports its utility to improve our basic understanding of the expression and mechanisms of substance use disorders towards to development of more effective therapeutics.

Remifentanil-food choice follows predictions of relative subjective value

BACKGROUND

Preclinical studies into drug vs. nondrug choice have emerged to better model and investigate the neurobehavioral mechanisms underlying drug preference. Current literature has suggested that drugs of abuse have inherently low value, thus promoting food preference. Herein, we examined remifentanil vs. food choice to test both the relative value hypothesis and the 'direct effects' (pharmacological effects of drugs on alternative reinforcers) hypothesis of opioid preference.

METHODS

Adult male rats were trained under two choice procedures (controlled vs. uncontrolled reinforcer frequency) for remifentanil vs. food choice. Furthermore, a series of procedural manipulations known to affect drug reinforcement were tested under both choice procedures. Using remifentanil self-administration data, pharmacokinetic profiles were calculated and analyzed to determine if opioid intake was related to opioid preference.

RESULTS

Both choice procedures produced dose-dependent preference. Moreover, procedural manipulations produced comparable changes in remifentanil preference under both choice procedures. In addition, calculated pharmacokinetic data revealed that preference was dissociable from intake under the controlled reinforcer frequency choice procedure.

CONCLUSIONS

When compared to the 'direct effects' hypothesis, remifentanil preference was better predicted by the relative value hypothesis, formalized in generalized matching. Use of a controlled reinforcer frequency schedule successfully removed the drug preference-intake confound found in most drug-choice procedures. Importantly, drug preference under the controlled reinforcer frequency schedule remained sensitive to procedural manipulations known to affect drug reinforcement. Thus, given that differential drug intake itself affects neurobiological measurements, future use of controlled reinforcer frequency schedules may help to better isolate the neurobehavioral mechanisms that mediate opioid preference.

Neuronal activity associated with cocaine preference: Effects of differential cocaine intake

Differences in overall cocaine intake can directly affect neuroadaptations, and this relationship can make it difficult to interpret neurobiological changes seen in drug-choice studies, since drug intake varies between subjects. Herein, a choice procedure that controls for cocaine intake was utilized to explore if neuronal activity, measured as cFos expression in the orbitofrontal cortex (OFC) and nucleus accumbens (NAc), was reflective of preference. Results demonstrated that cFos expression, in both the OFC and NAc, was independent of cocaine preference when cocaine intake was kept constant across individuals. However, when cocaine intake was systematically varied, the expression of cFos associated with cocaine preference was related to overall cocaine intake in the OFC, but not the NAc. Altogether, these results demonstrate that cocaine intake during choice can affect neurobiological outcome measures; thus, the neurobehavioral mechanisms underlying cocaine preference may be better isolated when controlling for cocaine frequency and intake. In all, some caution is warranted when interpreting results from choice studies evaluating the neurobehavioral mechanisms that underlie drug preference when drug frequency and intake are uncontrolled, and future research is needed to determine the role of drug frequency and intake on neurobiological measures associated with drug choice.

Behavioral economic demand as a unifying language for addiction science: Promoting collaboration and integration of animal and human models

The intersection of pharmacological, psychological, and economic theory within behavioral economics has helped advance an understanding of substance use disorder. A notable contribution of this approach is the conceptualization of reinforcement from a behavioral economic demand perspective. Demand analyses provide a multidimensional view of reinforcement in which distinct behavioral mechanisms are measured that impact decision making and drug consumption. This review describes the state of research on behavioral economic demand as a common language for addiction science researchers across varied model systems and stages of a translational continuum. We first provide an overview of the theoretical concepts and procedures used to evaluate demand in animal and human models. The potential for demand to serve as a common language for diverse research groups in psychopharmacology and addiction science (e.g., those evaluating neurobehavioral outcomes, medications development, clinical practice) is then described. An overview is also provided of existing empirical studies that, while small in number, suggest good linguistic and conceptual overlap between animal and human demand models when studying biological, environmental, and pharmacological individual difference vulnerabilities underlying drug-taking behavior. Refinement of methodological procedures and incorporation of more nuanced environmental features should help improve correspondence between animal and human demand studies as well as clinical translation of such findings. Our hope is that this review and commentary ultimately serves as inspiration for new collaborative efforts involving behavioral economic demand between animal and human researchers who share a common goal of improving substance use treatment outcomes and broader psychological wellbeing. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Pair housing, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effect of probability presentation order on amphetamine-induced changes in risky choice

Probability discounting is often measured with independent schedules. Independent schedules have several limitations, such as confounding preference for one alternative with frequency of reward presentation and generating ceiling/floor effects at certain probabilities. To address this potential caveat, a controlled reinforcer frequency schedule can be used, in which the manipulandum that leads to reinforcement is pseudo-randomly determined before each trial. This schedule ensures subjects receive equal presentations of the small and large magnitude reinforcers across each block of trials. A total of 24 pair-housed and 11 individually housed female Sprague Dawley rats were tested in a controlled reinforcer frequency procedure. For half of the rats, the odds against (OA) receiving the large magnitude reinforcer increased across the session (ascending schedule); the OA decreased across the session for half of the rats (descending schedule). Following training, rats received treatments of amphetamine (AMPH; 0, 0.25, 0.5, 1.0 mg/kg; s.c.). For pair-housed rats, AMPH (0.5 mg/kg) increased risky choice, regardless of probability presentation order, whereas a higher dose of AMPH (1.0 mg/kg) decreased discriminability of reinforcer magnitude for rats trained on the descending schedule only. For individually housed rats, probability presentation order modulated the effects of AMPH on probability discounting, as AMPH (0.25 and 0.5 mg/kg) increased risky choice in rats trained on the ascending schedule but not on the descending schedule. These results show that pair-housing animals, but not using a controlled reinforcer frequency procedure, attenuates the modulatory effects of probability presentation order on drug effects on risky choice.

Using a dependent schedule to measure risky choice in male rats: Effects of d-amphetamine, methylphenidate, and methamphetamine

Risky choice is the tendency to choose a large, uncertain reward over a small, certain reward, and is typically measured with probability discounting, in which the probability of obtaining the large reinforcer decreases across blocks of trials. One caveat to traditional procedures is that independent schedules are used, in which subjects can show exclusive preference for one alternative relative to the other. For example, some rats show exclusive preference for the small, certain reinforcer as soon as delivery of the large reinforcer becomes probabilistic. Therefore, determining if a drug increases risk aversion (i.e., decreases responding for the probabilistic alternative) is difficult (due to floor effects). The overall goal of this experiment was to use a concurrent-chains procedure that incorporated a dependent schedule during the initial link, thus preventing animals from showing exclusive preference for one alternative relative to the other. To determine how pharmacological manipulations alter performance in this task, male Sprague-Dawley rats (n = 8) received injections of amphetamine (0, 0.25, 0.5, 1.0 mg/kg), methylphenidate (0, 0.3, 1.0, 3.0 mg/kg), and methamphetamine (0, 0.5, 1.0, 2.0 mg/kg). Amphetamine (0.25 mg/kg) and methylphenidate (3.0 mg/kg) selectively increased risky choice, whereas higher doses of amphetamine (0.5 and 1.0 kg/mg) and each dose of methamphetamine impaired stimulus control (i.e., flattened the discounting function). These results show that dependent schedules can be used to measure risk-taking behavior and that psychostimulants promote suboptimal choice when this schedule is used. (PsycInfo Database Record (c) 2020 APA, all rights reserved).