Evidence for habitual and goal-directed behavior following devaluation of cocaine: a multifaceted interpretation of relapse

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Discriminating goal-directed and habitual cocaine seeking in rats using a novel outcome devaluation procedure

Habits are theorized to play a key role in compulsive cocaine seeking, yet there is limited methodology for assessing habitual responding for intravenous (IV) cocaine. We developed a novel outcome devaluation procedure to discriminate goal-directed from habitual responding in cocaine-seeking rats. This procedure elicits devaluation temporarily and requires no additional training, allowing repeated testing at different time points. After training male rats to self-administer IV cocaine, we devalued the drug outcome via experimenter-administered IV cocaine (a "satiety" procedure) prior to a 10-min extinction test. Many rats were sensitive to outcome devaluation, a hallmark of goal-directed responding. These animals reduced responding when given a dose of experimenter-administered cocaine that matched or exceeded satiety levels during self-administration. However, other rats were insensitive to experimenter-administered cocaine, suggesting their responding was habitual. Importantly, reinforcement schedules and neural manipulations that produce goal-directed responding (i.e., ratio schedules or dorsolateral striatum lesions) caused sensitivity to outcome devaluation, whereas reinforcement schedules and neural manipulations that produce habitual responding (i.e., interval schedules or dorsomedial striatum lesions) caused insensitivity. Satiety-based outcome devaluation is an innovative new tool to dissect the neural and behavioral mechanisms underlying IV cocaine-seeking behavior.

New directions in modelling dysregulated reward seeking for food and drugs

Behavioral models are central to behavioral neuroscience. To study the neural mechanisms of maladaptive behaviors (including binge eating and drug addiction), it is essential to develop and utilize appropriate animal models that specifically focus on dysregulated reward seeking. Both food and cocaine are typically consumed in a regulated manner by rodents, motivated by reward and homeostatic mechanisms. However, both food and cocaine seeking can become dysregulated, resulting in binge-like consumption and compulsive patterns of intake. The speakers in this symposium for the 2021 International Behavioral Neuroscience Meeting utilize behavioral models of dysregulated reward-seeking to investigate the neural mechanisms of binge-like consumption, enhanced cue-driven reward seeking, excessive motivation, and continued use despite negative consequences. In this review, we outline examples of maladaptive patterns of intake and explore recent animal models that drive behavior to become dysregulated, including stress exposure and intermittent access to rewards. Lastly, we explore select behavioral and neural mechanisms underlying dysregulated reward-seeking for both food and drugs.

Animal Models of the Behavioral Symptoms of Substance Use Disorders

To more effectively manage substance use disorders, it is imperative to understand the neural, genetic, and psychological underpinnings of addictive behavior. To contribute to this understanding, considerable efforts have been made to develop translational animal models that capture key behavioral characteristics of addiction on the basis of DSM5 criteria of substance use disorders. In this review, we summarize empirical evidence for the occurrence of addiction-like behavior in animals. These symptoms include escalation of drug use, neurocognitive deficits, resistance to extinction, exaggerated motivation for drugs, increased reinstatement of drug seeking after extinction, preference for drugs over nondrug rewards, and resistance to punishment. The occurrence of addiction-like behavior in laboratory animals has opened the opportunity to investigate the neural, genetic, and psychological background of key aspects of addiction, which may ultimately contribute to the prevention and treatment of substance use disorders.

Oral prescription opioid-seeking behavior in male and female mice

A significant portion of prescription opioid users self-administer orally rather than intravenously. Animal models of opioid addiction have demonstrated that intravenous cues are sufficient to cause drug seeking. However, intravenous models may not characterize oral users, and the preference to self-administer orally appears to be partially influenced by the user's sex. Our objectives were to determine whether oral opioid-associated cues are sufficient for relapse and whether sex differences exist in relapse susceptibility. Mice orally self-administered escalating doses of oxycodone under postprandial (prefed) or non-postprandial (no prefeeding) conditions. Both sexes demonstrated cue-induced reinstatement following abstinence. In separate mice, we found that oral oxycodone cues were sufficient to reinstate extinguished oral oxycodone-seeking behavior following abstinence without prior postprandial or water self-administration training. During self-administration, we incidentally found that female mice earned significantly more mg/kg oxycodone than male mice. Follow-up studies indicated sex differences in psychomotor stimulation and plasma oxycodone/oxymorphone following oral oxycodone administration. In addition, gonadal studies were performed in which we found divergent responses where ovariectomy-enhanced and orchiectomy-suppressed oral self-administration. While the suppressive effects of orchiectomy were identified across doses and postprandial conditions, the enhancing effects of ovariectomy were selective to non-postprandial conditions. These studies establish that (a) oral drug cues are sufficient to cause reinstatement that is independent of prandial conditions and water-seeking behavior, (b) earned oral oxycodone is larger in female mice compared with male mice potentially through differences in psychomotor stimulation and drug metabolism, and (c) gonadectomy produces divergent effects on oral oxycodone self-administration between sexes.

Computational models of drug use and addiction: A review

In this brief review, we describe current computational models of drug-use and addiction that fall into 2 broad categories: mathematically based models that rely on computational theories, and brain-based models that link computations to brain areas or circuits. Across categories, many are models of learning and decision-making, which may be compromised in addiction. Several mathematical models take predictive coding approaches, focusing on Bayesian prediction error. Other models focus on learning processes and (traditional) prediction error. Brain-based models have incorporated prefrontal cortex, basal ganglia, and the dopamine system, based on the effects of drugs on dopamine, motivation, and executive control circuits. Several models specifically describe how behavioral control may transition from habitual to goal-directed systems, consistent with computational accounts of compromised "model-based" control. Some brain-based models have linked this to the transition of behavioral control from ventral to dorsal striatum. Overall, we propose that while computational models capture some aspects of addiction and have advanced our thinking, most have focused on the effects of drug use rather than addiction per se, most have not been tested on and/or supported by human data, and few capture multiple stages and symptoms of addiction. We conclude by suggesting a path forward for computational models of addiction. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Fractionating the all-or-nothing definition of goal-directed and habitual decision-making

Goal-directed and habitual decision-making are fundamental processes that support the ongoing adaptive behavior. There is a growing interest in examining their disruption in psychiatric disease, often with a focus on a disease shifting control from one process to the other, usually a shift from goal-directed to habitual control. However, several different experimental procedures can be used to probe whether decision-making is under goal-directed or habitual control, including outcome devaluation and contingency degradation. These different experimental procedures may recruit diverse behavioral and neural processes. Thus, there are potentially many opportunities for these disease phenotypes to manifest as alterations to both goal-directed and habitual controls. In this review, we highlight the examples of behavioral and neural circuit divergence and similarity, and suggest that interpretation based on behavioral processes recruited during testing may leave more room for goal-directed and habitual decision-making to coexist. Furthermore, this may improve our understanding of precisely what the involved neural mechanisms underlying aspects of goal-directed and habitual behavior are, as well as how disease affects behavior and these circuits.

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it.

Effects of intra-accumbal or intra-prefrontal cortex microinjections of adenosine 2A receptor ligands on responses to cocaine reward and seeking in rats

RATIONALE AND OBJECTIVES

Many studies indicated that adenosine via its A_2A receptors influences the behavioral effects of cocaine by modulating dopamine neurotransmission. The hypothesis was tested that A_2A receptors in the nucleus accumbens (NAc) or the prefrontral cortex (PFc) may modulate cocaine reward and/or cocaine seeking behavior in rats.

METHODS

The effects of local bilateral microinjections of the selective A_2A receptor agonist CGS 21680 or the A_2A receptor antagonists KW 6002 and SCH 58261 were investigated on cocaine self-administration on reinstatement of cocaine seeking.

RESULTS

The intra-NAc shell, but not intra-infralimbic PFc, administration of CGS 21680 significantly reduced the number of active lever presses and the number of cocaine (0.25 mg/kg) infusions. However, tonic activation of A_2A receptors located in the NAc or PFc did not play a role in modulating the rewarding actions of cocaine since neither KW 6002 nor SCH 58261 microinjections altered the cocaine (0.5 mg/kg) infusions. The intra-NAc but not intra-PFc microinjections of CGS 21680 dose- dependently attenuated the reinstatement of active lever presses induced by cocaine (10 mg/kg, i.p.) and the drug-associated combined conditioned stimuli using the subthreshold dose of cocaine (2.5 mg/kg, i.p.). On the other hand, the intra-NAc pretreatment with SCH 58261, but not with KW 6002, given alone evoked reinstatement of cocaine seeking behavior.

CONCLUSION

The results strongly support the involvement of accumbal shell A_2A receptors as a target, the activation of which exerts an inhibitory control over cocaine reward and cocaine seeking.

Habitual nicotine-seeking in rats following limited training

RATIONALE AND OBJECTIVES

A potential reason that cigarette smoking can persist despite multiple quit attempts is that repeated voluntary nicotine intake may facilitate a transition from goal-directed to habitual behavioral control. Although accelerated habit formation for self-administered ethanol or cocaine has been previously demonstrated, this phenomenon has not been extensively studied with nicotine. We therefore examined the liability of nicotine self-administration to become habitual, while also examining that of orally consumed saccharin as an experimental control.

METHODS

Under fixed ratio 1 (FR-1) schedules, male Sprague-Dawley rats (n = 8-11/group) lever-pressed for intravenous (IV) nicotine (30 μg/kg/infusion) for 10 consecutive days, while also lever-pressing for saccharin solution (0.1% w/v, 0.19 mL/delivery) in separate operant sessions. In experiment 1, either nicotine or saccharin was devalued by pairing with the aversive agent lithium chloride (LiCl; 0.15 M, 14.1 mL/kg) prior to extinction and reacquisition testing. In experiment 2, the contingency between lever pressing and delivery of either nicotine or saccharin was degraded in six sessions, followed by extinction testing.

RESULTS

LiCl pairings selectively reduced responding for nicotine (-35% from control) and saccharin (-48%) in reacquisition testing, indicating that both rewards were effectively devalued. During extinction testing, saccharin-seeking responses were reduced by both manipulations (devaluation -30%, degradation -79%), suggesting that responding for saccharin was goal-directed. In contrast, nicotine-seeking responses were not significantly affected by either manipulation (devaluation -4%, degradation -21%), suggesting that responding for nicotine was habitually driven.

CONCLUSIONS

Operant responding for IV nicotine may rapidly come under habitual control, potentially contributing to the tenacity of tobacco use.

Extended cocaine-seeking produces a shift from goal-directed to habitual responding in rats

Cocaine addiction is often characterized by a rigid pattern of behavior in which cocaine users continue seeking and taking drug despite negative consequences associated with its use. As such, full acquisition and relapse of drug-seeking behavior may be attributed to a shift away from goal-directed responding and a shift towards the maladaptive formation of rigid and habit-like responses. This rigid nature of habitual responding can be developed with extended training and is typically characterized by insensitivity to changes in outcome value. The present study determined whether cocaine (primary reinforcer) and cocaine associated cues (secondary reinforcer) could be devalued in rats with different histories of cocaine self-administration. Specifically, rats were trained on two schedules of cocaine self-administration (long-access vs. short-access). Following training the cocaine reinforcer was devalued through three separate pairings of lithium chloride with cocaine infusions. Cocaine history did not have an impact on devaluation of cocaine-associated cues. However, the reinforcing properties of cocaine were devalued only in rats on a short-access cocaine schedule but not those trained on a long-access schedule. Taken together this pattern of findings suggests that, in short access rats, devaluation is specific to the primary reinforcer and not associative stimuli such as cues. Importantly, rats that received extended training during self-administration displayed insensitivity to outcome devaluation of the primary reinforcer as well as all associative stimuli, thus displaying rigid behavioral responding similar to behavioral patterns found in addiction. Alternatively, long access cocaine exposure may have altered the devaluation threshold.

A Closer Look at the Effects of Repeated Cocaine Exposure on Adaptive Decision-Making under Conditions That Promote Goal-Directed Control

It has been proposed that compulsive drug seeking reflects an underlying dysregulation in adaptive behavior that favors habitual (automatic and inflexible) over goal-directed (deliberative and highly flexible) action selection. Rodent studies have established that repeated exposure to cocaine or amphetamine facilitates the development of habits, producing behavior that becomes unusually insensitive to a reduction in the value of its outcome. The current study more directly investigated the effects of cocaine pre-exposure on goal-directed learning and action selection using an approach that discourages habitual performance. After undergoing a 15-day series of cocaine (15 or 30 mg/kg, i.p.) or saline injections and a drug withdrawal period, rats were trained to perform two different lever-press actions for distinct reward options. During a subsequent outcome devaluation test, both cocaine- and saline-treated rats showed a robust bias in their choice between the two actions, preferring whichever action had been trained with the reward that retained its value. Thus, it appears that the tendency for repeated cocaine exposure to promote habit formation does not extend to a more complex behavioral scenario that encourages goal-directed control. To further explore this issue, we assessed how prior cocaine treatment would affect the rats' ability to learn about a selective reduction in the predictive relationship between one of the two actions and its outcome, which is another fundamental feature of goal-directed behavior. Interestingly, we found that cocaine-treated rats showed enhanced, rather than diminished, sensitivity to this action-outcome contingency degradation manipulation. Given their mutual dependence on striatal dopamine signaling, we suggest that cocaine's effects on habit formation and contingency learning may stem from a common adaptation in this neurochemical system.

Stimulus devaluation induced by action stopping is greater for explicit value representations

We recently showed that rapidly stopping an action in the face of a reward-related stimulus reduces the subjective value of that stimulus (Wessel et al., 2014). In that study, there were three phases. In an initial learning phase, geometric shapes were associated with monetary value via implicit learning. In a subsequent treatment phase, half the shapes were paired with action stopping, and half were not. In a final auction phase, shapes that had been paired with stopping in the treatment phase were subjectively perceived as less valuable compared to those that were not. Exploratory post hoc analyses showed that the stopping-induced devaluation effect was larger for participants with greater explicit knowledge of stimulus values. Here, we repeated the study in 65 participants to systematically test whether the level of explicit knowledge influences the degree of devaluation. The results replicated the core result that action stopping reduces stimulus value. Furthermore, they showed that this effect was indeed significantly larger in participants with more explicit knowledge of the relative stimulus values in the learning phase. These results speak to the robustness of the stopping-induced devaluation effect, and furthermore imply that behavioral therapies using stopping could be successful in devaluing real-world stimuli, insofar as stimulus values are explicitly represented. Finally, to facilitate future investigations into the applicability of these findings, as well as the mechanisms underlying stopping-induced stimulus devaluation, we herein provide open source code for the behavioral paradigm.

Neuroscience of learning and memory for addiction medicine: from habit formation to memory reconsolidation

Identifying effective pharmacological treatments for addictive disorders has remained an elusive goal. Many different classes of drugs have shown some efficacy in preclinical models, but the number of effective clinical therapeutics has remained stubbornly low. The persistence of drug use and the high frequency of relapse is at least partly attributable to the enduring ability of environmental stimuli associated with drug use to maintain behavioral patterns of drug use and induce craving during abstinence. We propose that stimuli associated with drug use exert such powerful control over behavior through the development of abnormally strong memories, and their ability to initiate subconscious sequences of motor actions (habits) that promote uncontrolled drug use. In this chapter, we will review the evidence suggesting that drugs of abuse strengthen associations with cues in the environment and facilitate habit formation. We will also discuss potential mechanisms for disrupting memories associated with drug use to help improve treatments for addiction.

Electrophysiological evidence of alterations to the nucleus accumbens and dorsolateral striatum during chronic cocaine self-administration

As drug use becomes chronic, aberrant striatal processing contributes to the development of perseverative drug-taking behaviors. Two particular portions of the striatum, the nucleus accumbens (NAc) and the dorsolateral striatum (DLS), are known to undergo neurobiological changes from acute to chronic drug use. However, little is known about the exact progression of changes in functional striatal processing as drug intake persists. We sampled single-unit activity in the NAc and DLS throughout 24 daily sessions of chronic long-access cocaine self-administration, and longitudinally tracked firing rates (FR) specifically during the operant response, an upward vertical head movement. A total of 103 neurons were held longitudinally and immunohistochemically localised to either NAc Medial Shell (n = 29), NAc Core (n = 30), or DLS (n = 54). We modeled changes representative of each category as a whole. Results demonstrated that FRs of DLS Head Movement neurons were significantly increased relative to baseline during all sessions, while FRs of DLS Uncategorised neurons were significantly reduced relative to baseline during all sessions. NAc Shell neurons' FRs were also significantly decreased relative to baseline during all sessions while FRs of NAc Core neurons were reduced relative to baseline only during training days 1-18 but were not significantly reduced on the remaining sessions (19-24). The data suggest that all striatal subregions show changes in FR during the operant response relative to baseline, but longitudinal changes in response firing patterns were observed only in the NAc Core, suggesting that this region is particularly susceptible to plastic changes induced by abused drugs.

Rat ultrasonic vocalizations demonstrate that the motivation to contextually reinstate cocaine-seeking behavior does not necessarily involve a hedonic response

Human self-reports often indicate that changes in mood are a major contributor to drug relapse. Still, arguments have been made that instances of drug-seeking following abstinence in animal models (i.e. relapse/reinstatement) may be outside of hedonic control. Therefore, the present study utilized ultrasonic vocalizations in the rat in order to evaluate affect during cocaine self-administration and contextual reinstatement of cocaine-seeking in a pre-clinical model of drug relapse (abstinence-reinstatement model). Results show that while subjects effectively reinstated drug-seeking (lever pressing) following 30 days of abstinence, and spontaneously recovered/reinstated drug-seeking following 60 days of abstinence, ultrasonic vocalizations did not increase over baseline levels during either reinstatement session. These results are consistent with previous results from our laboratory and current theories of addiction suggesting that cues that are weakly associated with drug consumption can motivate drug-seeking behavior that is outside of hedonic processing.

Differential roles of ventral pallidum subregions during cocaine self-administration behaviors

The ventral pallidum (VP) is necessary for drug-seeking behavior. VP contains ventromedial (VPvm) and dorsolateral (VPdl) subregions, which receive projections from the nucleus accumbens shell and core, respectively. To date no study has investigated the behavioral functions of the VPdl and VPvm subregions. To address this issue, we investigated whether changes in firing rate (FR) differed between VP subregions during four events: approaching toward, responding on, or retreating away from a cocaine-reinforced operandum and a cocaine-associated cue. Baseline FR and waveform characteristics did not differ between subregions. VPdl neurons exhibited a greater change in FR compared with VPvm neurons during approaches toward, as well as responses on, the cocaine-reinforced operandum. VPdl neurons were more likely to exhibit a similar change in FR (direction and magnitude) during approach and response than VPvm neurons. In contrast, VPvm firing patterns were heterogeneous, changing FRs during approach or response alone, or both. VP neurons did not discriminate cued behaviors from uncued behaviors. No differences were found between subregions during the retreat, and no VP neurons exhibited patterned changes in FR in response to the cocaine-associated cue. The stronger, sustained FR changes of VPdl neurons during approach and response may implicate VPdl in the processing of drug-seeking and drug-taking behavior via projections to subthalamic nucleus and substantia nigra pars reticulata. In contrast, the heterogeneous firing patterns of VPvm neurons may implicate VPvm in facilitating mesocortical structures with information related to the sequence of behaviors predicting cocaine self-infusions via projections to mediodorsal thalamus and ventral tegmental area.

A multistep general theory of transition to addiction

BACKGROUND

Several theories propose alternative explanations for drug addiction.

OBJECTIVES

We propose a general theory of transition to addiction that synthesizes knowledge generated in the field of addiction into a unitary explanatory frame.

MAJOR PRINCIPLES OF THE THEORY

Transition to addiction results from a sequential three-step interaction between: (1) individual vulnerability; (2) degree/amount of drug exposure. The first step, sporadic recreational drug use is a learning process mediated by overactivation of neurobiological substrates of natural rewards that allows most individuals to perceive drugs as highly rewarding stimuli. The second, intensified, sustained, escalated drug use occurs in some vulnerable individuals who have a hyperactive dopaminergic system and impaired prefrontal cortex function. Sustained and prolonged drug use induces incentive sensitization and an allostatic state that makes drugs strongly wanted and needed. Habit formation can also contribute to stabilizing sustained drug use. The last step, loss of control of drug intake and full addiction, is due to a second vulnerable phenotype. This loss-of-control-prone phenotype is triggered by long-term drug exposure and characterized by long-lasting loss of synaptic plasticity in reward areas in the brain that induce a form of behavioral crystallization resulting in loss of control of drug intake. Because of behavioral crystallization, drugs are now not only wanted and needed but also pathologically mourned when absent.

CONCLUSIONS

This general theory demonstrates that drug addiction is a true psychiatric disease caused by a three-step interaction between vulnerable individuals and amount/duration of drug exposure.

Ethanol seeking by Long Evans rats is not always a goal-directed behavior

Background

Two parallel and interacting processes are said to underlie animal behavior, whereby learning and performance of a behavior is at first via conscious and deliberate (goal-directed) processes, but after initial acquisition, the behavior can become automatic and stimulus-elicited (habitual). With respect to instrumental behaviors, animal learning studies suggest that the duration of training and the action-outcome contingency are two factors involved in the emergence of habitual seeking of “natural” reinforcers (e.g., sweet solutions, food or sucrose pellets). To rigorously test whether behaviors reinforced by abused substances such as ethanol, in particular, similarly become habitual was the primary aim of this study.

Methodology/Principal Findings

Male Long Evans rats underwent extended or limited operant lever press training with 10% sucrose/10% ethanol (10S10E) reinforcement (variable interval (VI) or (VR) ratio schedule of reinforcement), or with 10% sucrose (10S) reinforcement (VI schedule only). Once training and pretesting were complete, the impact of outcome devaluation on operant behavior was evaluated after lithium chloride injections were paired with the reinforcer, or unpaired 24 hours later. After limited, but not extended instrumental training, lever pressing by groups trained under VR with 10S10E and under VI with 10S was sensitive to outcome devaluation. In contrast, responding by both the extended and limited training 10S10E VI groups was not sensitive to ethanol devaluation during the test for habitual behavior.

Conclusions/Significance

Operant behavior by rats trained to self-administer an ethanol-sucrose solution showed variable sensitivity to a change in the value of ethanol, with relative insensitivity developing sooner in animals that received time-variable ethanol reinforcement during training sessions. One important implication, with respect to substance abuse in humans, is that initial learning about the relationship between instrumental actions and the opportunity to consume ethanol-containing drinks can influence the time course for the development or expression of habitual ethanol seeking behavior.

Multiple roles for orexin/hypocretin in addiction

Orexins/hypocretins are hypothalamic peptides involved in arousal and wakefulness, but also play a critical role in drug addiction and reward-related behaviors. Here, we review the roles played by orexins in a variety of animal models of drug addiction, emphasizing both commonalities and differences for orexin's involvement in seeking of the major classes of abused drugs, as well as food. One common theme that emerges is an involvement of orexins in drug seeking triggered by external stimuli (e.g., cues, contexts or stressors). We also discuss the functional neuronal circuits in which orexins are embedded, and how these circuits mediate addiction-related behaviors, with particular focus on the role of orexin and glutamate interactions within the ventral tegmental area. Finally, we attempt to contextualize the role of orexins in reward by discussing ways in which these peptides, expressed in only a few thousand neurons in the brain, can have such wide-ranging effects on behavior.

Evidence for learned skill during cocaine self-administration in rats

RATIONALE

It has been proposed that cocaine abuse results in skilled or "automatic" drug-taking behaviors. Brain regions important for skill learning are implicated in cocaine self-administration. However, the development of skill during self-administration has not been investigated.

OBJECTIVES

The present experiment investigated the development of skilled self-administration over extended drug use by employing a novel operant vertical head movement under discriminative stimulus (S(D)) control. In addition, the capacity of the head movement to serve as an operant was tested by manipulating drug levels above or below satiety drug levels via frequent noncontingent microinfusions (0.2 s) of cocaine.

RESULTS

Animals acquired the vertical head movement operant, which increased in number over days. Task learning was demonstrated by reduced reaction time in response to the S(D), increased propensity to self-administer upon S(D) presentation, and escalated drug consumption over days. Skill learning was demonstrated by (1) an increase over days in the velocity of operant movements, as a function of shorter duration but not altered distance, and (2) an increase over days in the probability of initiating the operant at the optimal starting position. Evidence that responding was specific to self-administration was revealed during periods of experimenter-manipulated drug level: maintaining drug levels above satiety decreased responding while maintaining drug levels below satiety increased responding.

CONCLUSIONS

Under the specific set of circumstances tested herein, cocaine self-administration became skilled over extended drug use. The vertical head movement can be used as an operant comparable to lever pressing with the additional benefit of quantifying skill learning.

Dose-dependent differences in short ultrasonic vocalizations emitted by rats during cocaine self-administration

RATIONALE

The motivational impetuses underlying self-administration of cocaine and other drugs of abuse are not fully understood. One emerging factor is affect. Both positive and negative affective states have been hypothesized to influence drug seeking and drug taking. In parallel, it has been posited that the ultrasonic vocalizations (USVs) of Rattus norvegicus provide insight into the animals' affective reactions. Furthermore, it has been shown that mesolimbic dopamine (DA) plays a key role in cocaine self-administration and in USV production. Thus, affective processing as measured by rodent USVs likely coincides with cocaine self-administration, but to date has not been studied.

OBJECTIVE

The present study examined USVs in both the negative affective (18-32.99 kHz) and positive affective (38-80 kHz) ranges of rats during self-administration of a low (0.355 mg/kg/infusion) or high (0.71 mg/kg/infusion) dose of cocaine.

RESULTS

USVs in both ranges were observed in both dose groups. Vocalizations of the low-dose animals occurred primarily in the 22-kHz range (18-32.99 kHz), but exhibited shorter durations (10-500 ms) than those traditionally observed for 22-kHz calls in aversive situations. In contrast, USVs of the high-dose group were primarily observed in the 50-kHz frequency range (38-80 kHz), typically associated with appetitive outcomes.

CONCLUSIONS

These results provide evidence for the presence of USVs during cocaine self-administration. The observed dose-dependent difference in USVs provides novel support for the view that affect is one potential motivational factor influencing human drug use and relapse behaviors. Rodent USVs may provide a powerful tool for understanding the role of affect in addiction.

D-serine treatment reduces cocaine-primed reinstatement in rats following extended access to cocaine self-administration

The most intractable feature of drug addiction is the high rate of relapse, even following extended periods of abstinence from drug-taking. Evidence suggests that allowing rats extended access to cocaine self-administration leads to behavioral characteristics in these animals that are consistent with the development of addiction in humans. In the current study, rats were allowed to self-administer cocaine over a total of 22 daily sessions, the final seven of which were long-access (LgA) sessions of 6 h duration. Assessments of reinstatement of drug-seeking behavior were made following reintroduction to the drug-taking environment and noncontingent priming with either conditioned stimulus (CS) or cocaine in both extinguished and abstinent subject groups. Three separate groups of rats were treated with either saline or D-serine (100 mg/kg i.p.) administered 2 h prior to, or immediately following, each extinction training session. Saline-treated LgA rats were resistant to the effects of extinction training to reduce noncontingent priming of reinstatement of drug-seeking behavior with either CS or cocaine. In contrast, treatment with D-serine either before or immediately following the sessions resulted in a significant enhancement in the ability of extinction training to reduce cocaine-primed reinstatement of drug-seeking behavior. These results suggest that D-serine can act to enhance the consolidation of extinction learning in LgA rats, and is therefore a promising adjunctive agent along with behavioral therapy for the treatment of cocaine addiction.