Neuronal representation of individual heroin choices in the orbitofrontal cortex

Neural circuits controlling choice behavior in opioid addiction

As the opioid epidemic presents an ever-expanding public health threat, there is a growing need to identify effective new treatments for opioid use disorder (OUD). OUD is characterized by a behavioral misallocation in choice behavior between opioids and other rewards, as opioid use leads to negative consequences, such as job loss, family neglect, and potential overdose. Preclinical models of addiction that incorporate choice behavior, as opposed to self-administration of a single drug reward, are needed to understand the neural circuits governing opioid choice. These choice models recapitulate scenarios that humans suffering from OUD encounter in their daily lives. Indeed, patients with substance use disorders (SUDs) exhibit a propensity to choose drug under certain conditions. While most preclinical addiction models have focused on relapse as the outcome measure, our data suggest that choice is an independent metric of addiction severity, perhaps relating to loss of cognitive control over choice, as opposed to excessive motivational drive to seek drugs during relapse. In this review, we examine both preclinical and clinical literature on choice behavior for drugs, with a focus on opioids, and the neural circuits that mediate drug choice versus relapse. We argue that preclinical models of opioid choice are needed to identify promising new avenues for OUD therapy that are translationally relevant. Both forward and reverse translation will be necessary to identify novel treatment interventions. This article is part of the Special Issue on "Opioid-induced changes in addiction and pain circuits".

Economic choice between remifentanil and food in squirrel monkeys

Traditional approaches for evaluating if compounds are reinforcing, and thus a risk for abuse, include preclinical self-administration procedures conducted in the absence of alternative reinforcers. While the track record of this approach for determining abuse potential is good, that for predicting efficacy of addiction treatments is not. An alternate approach would be economic choice between drug and nondrug rewards, with parametrically varied options from trial to trial. This would promote goal-directed decisions between reward modalities and should provide metrics that reflect changes in internal state that influence desirability of a given option. We report herein a high throughput economic choice procedure in which squirrel monkeys choose between a short-lived opiate, remifentanil, and a palatable food reward. Stimuli on touchscreens indicate the amount of each reward type offered by varying the number of reward-specific elements. The rapid clearance of remifentanil avoids accumulation of confounding levels of drug, and permits a large number of trials with a wide range of offers of each reward modality. The use of a single metric encompassing multiple values of each reward type within a session enables estimation of indifference values using logistic regression. This indifference value is sensitive to reward devaluation within each reward domain, and is therefore a useful metric for determining shifts in reward preference, as shown with satiation and pharmacological treatment approaches.

A common limiter circuit for opioid choice and relapse identified in a rodent addiction model

Activity in numerous brain regions drives heroin seeking, but no circuits that limit heroin seeking have been identified. Furthermore, the neural circuits controlling opioid choice are unknown. In this study, we examined the role of the infralimbic cortex (IL) to nucleus accumbens shell (NAshell) pathway during heroin choice and relapse. This model yielded subpopulations of heroin versus food preferring rats during choice, and choice was unrelated to subsequent relapse rates to heroin versus food cues, suggesting that choice and relapse are distinct behavioral constructs. Supporting this, inactivation of the IL with muscimol produced differential effects on opioid choice versus relapse. A pathway-specific chemogenetic approach revealed, however, that the IL-NAshell pathway acts as a common limiter of opioid choice and relapse. Furthermore, dendritic spines in IL-NAshell neurons encode distinct aspects of heroin versus food reinforcement. Thus, opioid choice and relapse share a common addiction-limiting circuit in the IL-NAshell pathway.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

The role of dopaminergic and serotonergic transmission in the processing of primary and monetary reward

Natural rewards such as erotic stimuli activate common neural pathways with monetary rewards. In human studies, the manipulation of dopamine and serotonin play an important role in the processing of monetary rewards with less understood on its role on erotic stimuli. In this study, we investigate the neuromodulatory effects of dopaminergic and serotonergic transmission in the processing of erotic versus monetary visual stimuli. We scanned one hundred and two (N = 102) healthy volunteers using functional magnetic resonance imaging while performing a modified version of the well-validated monetary incentive delay task consisting of erotic, monetary and neutral visual stimuli. We show a role for enhanced central dopamine and lowered central serotonin levels in increasing activity in the right caudate and left anterior insula during anticipation of erotic relative to monetary rewards in healthy controls. We further show differential activation in the anticipation of natural versus monetary rewards with the former associated with ventromesial and dorsomesial activity and the latter with dorsal cingulate, striatal and anterior insular activity. These findings are consistent with preclinical and clinical findings of a role for dopaminergic and serotonergic mechanisms in the processing of natural rewards. Our study provides further insights into the neural substrates underlying reward processing for natural primary erotic rewards and yields importance for the neurochemical systems of addictive disorders including gambling disorder.

Relative expected value of drugs versus competing rewards underpins vulnerability to and recovery from addiction

Behavioural economic theories of addiction contend that greater expected value of drug relative to alternative non-drug rewards is the core mechanism underpinning vulnerability to and recovery from addiction. To evaluate this claim, we exhaustively review studies with human drug users that have measured concurrent choice between drugs vs. alternative rewards, and explored individual differences. These studies show that drug choice can be modulated by drug cues, drug devaluation, imposition of costs/punishment and negative mood induction. Regarding individual differences, dependence severity was reliably associated with overall drug preference, and self-reported drug use to cope with negative affect was reliably associated with greater sensitivity to mood induced increases in drug choice. By contrast, there were no reliable individual differences in sensitivity to the effect of drug cues, drug devaluation or punishment on drug choice. These findings provide insight into the mechanisms that underpin vulnerability to dependence: vulnerability is conferred by greater relative value ascribed to drugs, and relative drug value is further augmented by negative affective states in those who report drug use coping motives. However, dependence does not appear to be characterised by abnormal cue-reactivity, habit learning or compulsion. We then briefly review emerging literature which demonstrates that therapeutic interventions and recovery from addiction might be attributed to changes in the expected relative value of drug versus alternative rewards. Finally, we outline a speculative computational account of the distortions in decision-making that precede action selection in addiction, and we explain how this account provides a blueprint for future research on the determinants of drug choice, and mechanisms of treatment and recovery from addiction. We conclude that a unified economic decision-making account of addiction has great promise in reconciling diverse addiction theories, and neuropsychological evaluation of the underlying decision mechanisms is a fruitful area for future research and treatment.

Orbitofrontal Cortex Encodes Preference for Alcohol

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents.

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents. To understand the relationship between OFC function and individual alcohol use, we recorded OFC neuron activity in rats during EtOH self-administration, characterizing the neural correlates of individual preference for alcohol. After one month of intermittent access to 20% EtOH, male Long–Evans rats were trained to self-administer 20% EtOH, 10% EtOH, and 15% sucrose. OFC neuronal activity was recorded and associated with task performance and EtOH preference. Rats segregated into high and low EtOH drinkers based on homecage consumption and operant seeking of 20% EtOH. Motivation for 10% EtOH and sucrose was equally high in both groups. OFC neuronal activity was robustly increased or decreased during sucrose and EtOH seeking and consumption, and strength of changes in OFC activity was directly associated with individual preference for 20% EtOH. EtOH-associated OFC activity was more similar to sucrose-associated activity in high versus low EtOH drinkers. The results show that OFC neurons are activated during alcohol seeking based on individual preference, supporting this brain region as a potential substrate for alcohol motivation that may be dysregulated in alcohol misuse.

Reorganization of theta phase-locking in the orbitofrontal cortex drives cocaine choice under the influence

Cortical theta oscillations of neuronal activity are a fundamental mechanism driving goal-directed behavior. We previously identified in the rat orbitofrontal cortex (OFC) a neuronal correlate of individual preferences between cocaine use and an alternative nondrug reward (i.e. saccharin). Whether theta oscillations are also associated with choice behavior between a drug and a nondrug reward remains unknown. Here we investigated the temporal structure between single unit activity and theta band oscillations (4-12 Hz) in the OFC of rats choosing between cocaine and saccharin. First, we found that the relative amplitude of theta oscillations is associated with subjective value and preference between two rewards. Second, OFC phase-locked neurons fired on opposite phase of the theta oscillation during saccharin and cocaine rewards, suggesting the existence of two separable neuronal assemblies. Finally, the pharmacological influence of cocaine at the moment of choice altered both theta band power and theta phase-locking in the OFC. That is, this drug influence shifted spike-phase relative to theta cycle and decreased the synchronization of OFC neurons relative to the theta oscillation. Overall, this study indicates that the reorganization of theta phase-locking under the influence of cocaine biases OFC neuronal assemblies in favor of cocaine choice and at the expense of a normally preferred alternative, a neuronal change that may contribute to drug preference in cocaine addiction.

Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory

Drug addiction may be a goal-directed choice driven by excessive drug value in negative affective states, a habit driven by strong stimulus-response associations, or a compulsion driven by insensitivity to costs imposed on drug seeking. Laboratory animal and human evidence for these three theories is evaluated. Excessive goal theory is supported by dependence severity being associated with greater drug choice/economic demand. Drug choice is demonstrably goal-directed (driven by the expected value of the drug) and can be augmented by stress/negative mood induction and withdrawal-effects amplified in those with psychiatric symptoms and drug use coping motives. Furthermore, psychiatric symptoms confer risk of dependence, and coping motives mediate this risk. Habit theory of addiction has weaker support. Habitual behaviour seen in drug-exposed animals often does not occur in complex decision scenarios, or where responding is rewarded, so habit is unlikely to explain most human addictive behaviour where these conditions apply. Furthermore, most human studies have not found greater propensity to habitual behaviour in drug users or as a function of dependence severity, and the minority that have can be explained by task disengagement producing impaired explicit contingency knowledge. Compulsion theory of addiction also has weak support. The persistence of punished drug seeking in animals is better explained by greater drug value (evinced by the association with economic demand) than by insensitivity to costs. Furthermore, human studies have provided weak evidence that propensity to discount cost imposed on drug seeking is associated with dependence severity. These data suggest that human addiction is primarily driven by excessive goal-directed drug choice under negative affect, and less by habit or compulsion. Addiction is pathological because negative states powerfully increase expected drug value acutely outweighing abstinence goals.

Role of Projections between Piriform Cortex and Orbitofrontal Cortex in Relapse to Fentanyl Seeking after Palatable Food Choice-Induced Voluntary Abstinence

We recently developed a rat model of relapse to drug seeking after food choice-induced voluntary abstinence. Here, we used this model to study the role of the orbitofrontal cortex (OFC) and its afferent projections in relapse to fentanyl seeking. We trained male and female rats to self-administer palatable food pellets for 6 d (6 h/d) and intravenous fentanyl (2.5 μg/kg/infusion) for 12 d (6 h/d). We assessed relapse to fentanyl seeking after 13-14 voluntary abstinence days, achieved through a discrete choice procedure between fentanyl infusions and palatable food (20 trials/d). In both sexes, relapse after food choice-induced abstinence was associated with increased expression of the activity marker Fos in the OFC. Pharmacological inactivation of the OFC with muscimol plus baclofen (50 + 50 ng/side) decreased relapse to fentanyl seeking. We then determined projection-specific activation of OFC afferents during the relapse test by using Fos plus the retrograde tracer cholera toxin B (injected into the OFC). Relapse to fentanyl seeking was associated with increased Fos expression in the piriform cortex (Pir) neurons projecting to the OFC, but not in projections from the basolateral amygdala and thalamus. Pharmacological inactivation of the Pir with muscimol plus baclofen decreased relapse to fentanyl seeking after voluntary abstinence. Next, we used an anatomical disconnection procedure to determine whether projections between the Pir and OFC are critical for relapse to fentanyl seeking. Unilateral muscimol plus baclofen injections into the Pir in one hemisphere plus unilateral muscimol plus baclofen injections into the OFC in the contralateral, but not ipsilateral, hemisphere decreased relapse. Our results identify Pir-OFC projections as a new motivation-related pathway critical to relapse to opioid seeking after voluntary abstinence.SIGNIFICANCE STATEMENT There are few preclinical studies of fentanyl relapse, and these studies have used experimenter-imposed extinction or forced abstinence procedures. In humans, however, abstinence is often voluntary, with drug available in the drug environment but forgone in favor of nondrug alternative reinforcers. We recently developed a rat model of drug relapse after palatable food choice-induced voluntary abstinence. Here, we used classical pharmacology, immunohistochemistry, and retrograde tracing to demonstrate a critical role of the piriform and orbitofrontal cortices in relapse to opioid seeking after voluntary abstinence.

A concurrent pictorial drug choice task marks multiple risk factors in treatment-engaged smokers and drinkers

Concurrent choice tasks, where participants choose between a drug versus natural reward, predict dependence vulnerability in animals and humans. However, the sensitivity of concurrent choice tasks to multiple risk factors in treatment-engaged drug users has not been comprehensively tested. In experiment 1, 33 recently hospitalized smokers who were engaged with the smoking cessation service made forced choices between enlarging pictures of people smoking versus not smoking. In experiment 2, 48 drinkers who were engaged in an outpatient alcohol treatment service made forced choices between enlarging pictures of alcohol versus food. In these experiments, percent drug picture choice was significantly associated with dependence severity, craving, self-reported reasons for drug use (negative coping and cued craving), depression, anxiety, withdrawal intolerance, drug use frequency prior to treatment, and current abstinence status (coefficients ranged from r=0.39 to 0.66). The concurrent pictorial drug choice task is sensitive to multiple risk factors in clinical, treatment-engaged drug users, and may be used to identify individuals requiring more support, to test experimental treatment manipulations, and to translate to animal concurrent self-administration procedures.

Negative Mood Induction Increases Choice of Heroin Versus Food Pictures in Opiate-Dependent Individuals: Correlation With Self-Medication Coping Motives and Subjective Reactivity

Acute growth in negative affect is thought to play a major role in triggering relapse in opiate-dependent individuals. Consistent with this view, three lab studies have demonstrated that negative mood induction increases opiate craving in opiate-dependent individuals. The current study sought to confirm these effects with a behavioral measure of heroin seeking, and test whether the effect is associated with self-reported opiate use to cope with negative affect and subjective reactivity to mood induction. Participants were heroin-dependent individuals engaged with treatment services (n = 47) and control participants (n = 25). Heroin users completed a questionnaire assessing reasons for using heroin: negative affect, social pressure, and cued craving. Baseline heroin choice was measured by preference to enlarge heroin versus food thumbnail pictures in two-alternative forced-choice trials. Negative mood was then induced by depressive statements and music before heroin choice was tested again. Subjective reactivity was indexed by negative and positive mood reported at the pre-induction to post-test timepoints. Heroin users chose heroin images more frequently than controls overall ( p = .001) and showed a negative mood-induced increase in heroin choice compared to control participants (interaction p < .05). Mood-induced heroin choice was associated with self-reported heroin use to cope with negative affect ( p < .05), but not social pressure ( p = .39) or cued craving ( p = .52), and with subjective mood reactivity ( p = .007). These data suggest that acute negative mood is a trigger for heroin seeking in heroin-dependent individuals, and this effect is pronounced in those who report using heroin to cope with negative affect, and those who show greater subjective reactivity to negative triggers. Interventions should seek to target negative coping motives to build resilience to affective triggers for relapse.

A neuronal population code for resemblance between drug and nondrug reward outcomes in the orbitofrontal cortex

The orbitofrontal cortex (OFC) is implicated in choice and decision-making in both human and non-human animals. We previously identified in the rat OFC a mechanism that influences individual drug choices and preferences between a drug and a nondrug (i.e., sweet) outcome that is common across different types of drugs (cocaine and heroin). Importantly, this research also revealed some intriguing drug-specific differences. Notably, the size of non-selective OFC neurons that indiscriminately encode both the drug and the sweet outcomes varies as a function of the drug outcome available (cocaine or heroin). Here we tested the hypothesis that the relative size of the non-selective OFC population somehow represents the degree of resemblance between the drug and nondrug reward outcomes. We recorded OFC neuronal activity in vivo in the same individual rats while they were choosing between two outcomes with varying degrees of resemblance: high (two concentrations of sweet), intermediate (sweet versus heroin) and low (sweet versus cocaine). We found that the percentage of non-selective OFC neurons dramatically increased with the degree of resemblance between choice outcomes, from 26 to 62%. Overall, these findings reveal the existence of a neuronal population code for resemblance between different kinds of choice outcomes in the OFC.

Prelimbic cortex is a common brain area activated during cue-induced reinstatement of cocaine and heroin seeking in a polydrug self-administration rat model

Many preclinical studies examined cue-induced relapse to heroin and cocaine seeking in animal models, but most of these studies examined only one drug at a time. In human addicts, however, polydrug use of cocaine and heroin is common. We used a polydrug self-administration relapse model in rats to determine similarities and differences in brain areas activated during cue-induced reinstatement of heroin and cocaine seeking. We trained rats to lever press for cocaine (1.0 mg/kg per infusion, 3-hr/day, 18 day) or heroin (0.03 mg/kg per infusion) on alternating days (9 day for each drug); drug infusions were paired with either intermittent or continuous light cue. Next, the rats underwent extinction training followed by tests for cue-induced reinstatement where they were exposed to either heroin- or cocaine-associated cues. We observed cue-selective reinstatement of drug seeking: the heroin cue selectively reinstated heroin seeking and the cocaine cue selectively reinstated cocaine seeking. We used Fos immunohistochemistry to assess cue-induced neuronal activation in different subregions of the medial prefrontal cortex, dorsal striatum, nucleus accumbens, and amygdala. Fos expression results indicated that only the prelimbic cortex (PL) was activated by both heroin and cocaine cues; in contrast, no significant cue-induced neuronal activation was observed in other brain areas. RNA in situ hybridization indicated that the proportion of glutamatergic and GABAergic markers in PL Fos-expressing cells was similar for the heroin and cocaine cue-activated neurons. Overall, the results indicate that PL may be a common brain area involved in both heroin and cocaine seeking during polydrug use.

Brain Activity during Methamphetamine Anticipation in a Non-Invasive Self-Administration Paradigm in Mice

The ability to sense time and anticipate events is critical for survival. Learned responses that allow anticipation of the availability of food or water have been intensively studied. While anticipatory behaviors also occur prior to availability of regularly available rewards, there has been relatively little work on anticipation of drugs of abuse, specifically methamphetamine (MA). In the present study, we used a protocol that avoided possible CNS effects of stresses of handling or surgery by testing anticipation of MA availability in animals living in their home cages, with daily voluntary access to the drug at a fixed time of day. Anticipation was operationalized as the amount of wheel running prior to MA availability. Mice were divided into four groups given access to either nebulized MA or water, in early or late day. Animals with access to MA, but not water controls, showed anticipatory activity, with more anticipation in early compared to late day and significant interaction effects. Next, we explored the neural basis of the MA anticipation, using c-FOS expression, in animals euthanized at the usual time of nebulization access. In the dorsomedial hypothalamus (DMH) and orbitofrontal cortex (OFC), the pattern of c-FOS expression paralleled that of anticipatory behavior, with significant main and interaction effects of treatment and time of day. The results for the lateral septum (LS) were significant for main effects and marginally significant for interaction effects. These studies suggest that anticipation of MA is associated with activation of brain regions important in circadian timing, emotional regulation, and decision making.