Behavioral momentum of cocaine self-administration: effects of frequency of reinforcement on resistance to extinction

Intrinsic Functional Connectivity between the Anterior Insular and Retrosplenial Cortex as a Moderator and Consequence of Cocaine Self-Administration in Rats

While functional brain imaging studies in humans suggest that chronic cocaine use alters functional connectivity (FC) within and between key large-scale brain networks, including the default mode network (DMN), the salience network (SN), and the central executive network (CEN), cross-sectional studies in humans are challenging to obtain brain FC prior to cocaine use. Such information is critical to reveal the relationship between individual's brain FC and the subsequent development of cocaine dependence and brain changes during abstinence. Here, we performed a longitudinal study examining functional magnetic resonance imaging (fMRI) data in male rats (n = 7), acquired before cocaine self-administration (baseline), on 1 d of abstinence following 10 d of cocaine self-administration, and again after 30 d of experimenter-imposed abstinence. Using repeated-measures analysis of variance (ANOVA) with network-based statistics (NBS), significant connectivity changes were found between anterior insular cortex (AI) of the SN, retrosplenial cortex (RSC) of the DMN, somatosensory cortex, and caudate-putamen (CPu), with AI-RSC FC showing the most robust changes between baseline and 1 d of abstinence. Additionally, the level of escalated cocaine intake is associated with AI-RSC and AI-CPu FC changes between 1 d and 30 d of abstinence; further, the subjects' AI-RSC FC prior to cocaine intake is a significant moderator for the AI-RSC changes during abstinence. These results provide novel insights into the roles of AI-RSC FC before and after cocaine intake and suggest this circuit to be a potential target to modulate large-scale network and associated behavioral changes in cocaine use disorders.

Experimenter administered Δ9-THC decreases nicotine self-administration in a rat model

BACKGROUND

The co-use of nicotine and cannabis has been steadily rising in the United States. Rodent studies suggest that delta-9-tetrahydrocannabinol (THC) could increase addictive qualities of nicotine, but whether repeated THC exposure alters self-administration of nicotine has not been tested. We hypothesized that THC would increase the reinforcing effects of nicotine and alter nicotine intake.

METHODS

Adult male and female Sprague-Dawley rats were treated with THC (0, 3, 30 mg/kg) daily for 14 days prior to and during training for intravenous self-administration of nicotine. Rats were allowed to self-administer nicotine for several weeks, then tested for sensitivity to nicotine dose through multiple determinations of a nicotine dose-effect curve with or without THC pretreatment. A separate set of rats were trained on fixed ratio responding for sucrose and assessed for THC effects on behavior.

RESULTS

Post-session THC decreased nicotine self-administration in male and female rats throughout acquisition and maintenance and increased the latency to stable rates of nicotine intake during acquisition. Post-session THC shifted nicotine dose-effect curves downward, and pre-session THC suppressed responding at higher nicotine doses. Unlike nicotine, responding for sucrose was not affected by post-session THC. Pre-session THC decreased responding for sucrose, particularly for THC-naïve rats.

CONCLUSIONS

Repeated post-session THC decreased nicotine-taking behaviors but did not alter sucrose responding. Thus, post-session THC may alter sensitivity to nicotine. Pre-session THC treatment decreased lever pressing in both sucrose and nicotine studies, indicating this effect was nonspecific. These studies show that THC modulates patterns of nicotine intake in rat models.

Nondrug reinforcers contingent on alternative behavior or abstinence increase resistance to extinction and reinstatement of ethanol-maintained behavior

The effects of delivering nondrug alternative reinforcement on resistance to extinction and reinstatement of rats' ethanol-maintained lever pressing were evaluated in two experiments. In both, rats self-administered ethanol by lever pressing in a two-component multiple schedule during baseline. In the Rich component, alternative food reinforcement was made available for performing an alternative response (Experiment 1) or according to a differential-reinforcement-of-other-behavior schedule for lever pressing (Experiment 2). In the Lean component, only ethanol was available. Moreover, the frequency of alternative reinforcement was manipulated across conditions in Experiment 1. Following baseline, lever pressing was extinguished in both components by suspending ethanol reinforcement, and alternative food reinforcers were discontinued. Finally, to test for reinstatement, ethanol reinforcers were delivered independently of lever pressing in both components. In both experiments, proportion-of-baseline response rates were higher during extinction and reinstatement testing in the Rich component than in the Lean component (although differentiation was not observed at the lowest frequency of alternative reinforcement in Experiment 1). Thus, alternative nondrug reinforcers increased resistance to extinction and reinstatement of rats' ethanol-maintained lever pressing, even when those reinforcers were delivered contingently on an alternative response or on abstinence from lever pressing.

The influence of reinforcement schedule on experience-dependent changes in motivation

The progressive ratio procedure is used across fields to assess motivation for different reinforcers, define the effects of experimental interventions on motivation, and determine experience-dependent changes in motivation. However, less is known about how operant training schedules affect performance on this widely utilized task. Here we designed an experiment to examine the effect of variable ratio versus fixed ratio training schedules of reinforcement on progressive ratio performance while holding other performance variables constant between groups. We found a robust increase in maximum ratio completed between the pretest and posttraining test highlighting a robust training effect on progressive ratio performance. However, it did not matter if the training was under a fixed or variable ratio schedule. Additionally, we show that neither individual rates during training nor extinction responding correlated with maximum ratio achieved during the sessions. Finally, we show that rates during the training sessions do correlate with extinction performance, suggesting that these variables measure a different aspect of performance that does not predict motivation.

The gold-standard in preclinical abuse liability testing: It's all relative

All new molecular entities (NMEs) with targeted or indirect effects on the central nervous system (CNS) must be evaluated for their abuse liability as a part of their nonclinical development plan. Inherently key in the drug control review is the term "relative abuse liability". The basis for determination of drug control is critically dependent on the nonclinical assessment of the reinforcing attributes of the NME in animals (rat is the regulatory preferred species) in a standard operant conditioning paradigm. Pharmaceutical representatives without a background in behavioral analysis or operant conditioning models must weigh through conceptually-intriguing language and constructs that accurately convey and communicate the relative potential for abuse to drug regulatory experts in the field. Effective statutory language in the preclinical assessment of relative abuse liabilities for schedule control status reviews must be 1) specific; 2) concise; 3) familiar to the regulators; 4) unambiguous; 5) constructive; and 6) formalized with respect to both international and national drug control policies. In this review we attempt to define and highlight the importance of the statutory language used to report self-administration study results to both parties engaged in NDA approval process.

Quantitative models of persistence and relapse from the perspective of behavioral momentum theory: Fits and misfits

We review quantitative accounts of behavioral momentum theory (BMT), its application to clinical treatment, and its extension to post-intervention relapse of target behavior. We suggest that its extension can account for relapse using reinstatement and renewal models, but that its application to resurgence is flawed both conceptually and in its failure to account for recent data. We propose that the enhanced persistence of target behavior engendered by alternative reinforcers is limited to their concurrent availability within a distinctive stimulus context. However, a failure to find effects of stimulus-correlated reinforcer rates in a Pavlovian-to-Instrumental Transfer (PIT) paradigm challenges even a straightforward Pavlovian account of alternative reinforcer effects. BMT has been valuable in understanding basic research findings and in guiding clinical applications and accounting for their data, but alternatives are needed that can account more effectively for resurgence while encompassing basic data on resistance to change as well as other forms of relapse.

Early social isolation increases persistence of alcohol-seeking behavior in alcohol-related contexts

Social conditions during rearing are well known to affect adult alcohol consumption, but few experiments have explored the effects of social conditions on behaviors that are related to alcohol dependence, such as the persistence of alcohol seeking. This study compared the effects of isolation (ISO) and interaction (INT) rearing on the persistence of alcohol-seeking behavior. Rats were trained to lever press for a solution of 10% alcohol diluted in water. They were then exposed to a two-component multiple schedule of reinforcement (baseline). Responses in one component were reinforced by a higher rate of alcohol delivery (rich component, variable interval 15 s) and responses in the other component were reinforced by a lower rate of delivery (lean component, variable interval 45 s). The persistence of lever pressing in the presence of each stimulus was then assessed during extinction. The results from baseline showed that response rates in rats in both groups were higher in the rich component than in the lean component, but ISO rats responded significantly more than INT rats in both components. The persistence of responding during extinction in ISO rats in both components was also higher than that in INT rats. The results show that effects of ISO are not restricted to alcohol consumption, but also affect persistence of alcohol-seeking behavior, which may reflect differences in the value of drug-related stimuli.

Resurgence of sucrose and cocaine seeking in free-feeding rats

Resurgence is relapse of an extinguished operant response following the removal of alternative reinforcement. In animal models of resurgence to date, rats have been food deprived and food is used as the source of alternative reinforcement. Thus, when the alternative reinforcer is removed, the only remaining source of food during experimental sessions is no longer available. Acute food deprivation is known to produce reinstatement of drug seeking, thus such deprivation has been suggested a potential mechanism of resurgence. The present experiments examined whether resurgence of sucrose and cocaine seeking could be obtained with rats that were not food deprived. Free-feeding rats were trained to press a lever for either sucrose (Experiment 1) or cocaine infusions (Experiment 2). Next, lever pressing was extinguished and an alternative response (nose poking) was reinforced with sucrose. When nose poking was also placed on extinction, resurgence of both sucrose and cocaine seeking was observed. Thus, resurgence of both sucrose and cocaine seeking can be obtained in rats that are not food restricted and it appears unlikely that an acute hunger state is responsible for resurgence. In addition, the present procedures for studying resurgence in the absence of interpretive complexities introduced by the use of food-deprivation may prove useful for further investigations of the neurobiological mechanisms of resurgence.

Reinforcer magnitude and resistance to disruption of forgetting functions and response rates

The present experiment investigated the effects of reinforcer magnitude on resistance to disruption of remembering and response rates. Pigeons were exposed to a variable-interval (VI), delayed-matching-to-sample (DMTS) procedure with two components (rich and lean, distinguished by differing discriminative stimuli and hopper presentation duration). Completion of a VI 20 s schedule resulted in DMTS trials. In a DMTS trial, a choice of one of two comparison stimuli resulted in food if the choice matched the color of the previously presented sample stimulus. Separable aspects of the forgetting functions (initial discrimination and rate of forgetting) were examined by determining accuracy across a range of delays. Response rates and accuracy were higher in the rich relative to the lean component during baseline, and were more persistent during disruptors (extinction and prefeeding). During DMTS trials, extinction decreased initial discrimination more in the lean than the rich component, but had no systematic effect on rate of forgetting. During prefeeding, the rate of forgetting increased more in the lean than the rich component, but initial discrimination was not systematically affected. These results show persistence of response rates and remembering are positively related to reinforcer magnitude. The type of disruptor also influences the way in which remembering is disrupted.

Perhaps More Consideration of Pavlovian-Operant Interaction May Improve the Clinical Efficacy of Behaviorally Based Drug Treatment Programs

Drug abuse remains costly. Drug-related cues can evoke cue-reactivity and craving, contributing to relapse. The Pavlovian extinction-based cue-exposure therapy (CET) has not been very successful in treating drug abuse. A functional operant analysis of complex rituals involved in CET is outlined and reinterpreted as an operant heterogeneous chain maintained by observing responses, conditioned reinforcers, and discriminative stimuli. It is further noted that operant functions are not predicated on Pavlovian processes but can be influenced by them in contributing to relapse; several empirical studies from the animal and human literature highlight this view. Cue-reactivity evoked by Pavlovian processes is conceptualized as an operant establishing/motivating operation. CET may be more effective in incorporating an operant-based approach that takes into account the complexity of Pavlovian-operant interaction. Extinction of the operant chain coupled with the shaping of alternative behaviors is proposed as an integrated therapy. It is proposed that operant-based drug abuse treatments (contingency management, voucher programs, and the therapeutic work environment) might consider incorporating cue-reactivity, as establishing/motivating operations, to increase long-term success-a hybrid approach based on Pavlovian-operant interaction.

Concurrent-chains schedules as a method to study choice between alcohol-associated conditioned reinforcers

An extensive body of research using concurrent-chains schedules of reinforcement has shown that choice for one of two differentially valued food-associated stimuli is dependent upon the overall temporal context in which those stimuli are embedded. The present experiments examined whether the concurrent chains procedure was useful for the study of behavior maintained by alcohol and alcohol-associated stimuli. In Experiment 1, rats responded on concurrent-chains schedules with equal variable-interval (VI) 10-s schedules in the initial links. Across conditions, fixed-interval schedules in the terminal links were varied to yield 1∶1, 9∶1, and 1∶9 ratios of alcohol delivery. Initial-link response rates reflected changes in terminal-link schedules, with greater relative responding in the rich terminal link. In Experiment 2, terminal-link schedules remained constant with a 9∶1 ratio of alcohol delivery rates while the length of two equal duration initial-link schedules was varied. Preference for the rich terminal link was less extreme when initial links were longer (i.e., the initial-link effect), as has been previously reported with food reinforcers. This result suggests that the conditioned reinforcing value of an alcohol-associated stimulus depends on the temporal context in which it is embedded. The concurrent-chains procedure and quantitative models of concurrent chains performance may provide a useful framework within which to study how contextual variables modulate preference for drug-associated conditioned reinforcers.

BOLD responses in reward regions to hypothetical and imaginary monetary rewards

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies.

Locomotor activity in a novel environment predicts both responding for a visual stimulus and self-administration of a low dose of methamphetamine in rats

There is evidence that visual stimuli used to signal drug delivery in self-administration procedures have primary reinforcing properties, and that drugs of abuse enhance the reinforcing properties of such stimuli. Here, we explored the relationships between locomotor activity, responding for a visual stimulus, and self-administration of methamphetamine (METH). Rats were classified as high or low responders based on activity levels in a novel locomotor chamber and were subsequently tested for responding to produce a visual stimulus followed by self-administration of a low dose of METH (0.025 mg/kg/infusion) paired with the visual stimulus. High responder rats responded more for the visual stimulus than low responder rats indicating that the visual stimulus was reinforcing and that operant responding for a visual stimulus has commonalities with locomotor activity in a novel environment. Similarly, high responder rats responded more for METH paired with a visual stimulus than low responder rats. Because of the reinforcing properties of the visual stimulus, it was not possible to determine if the rats were responding to produce the visual stimulus, METH or the combination. We speculate that responding to produce sensory reinforcers may be a measure of sensation seeking. These results indicate that visual stimuli have unconditioned reinforcing effects which may have a significant role in acquisition of drug self-administration, a role that is not yet well understood.

Extinction, relapse, and behavioral momentum

Previous experiments on behavioral momentum have shown that relative resistance to extinction of operant behavior in the presence of a discriminative stimulus depends upon the baseline rate or magnitude of reinforcement associated with that stimulus (i.e., the Pavlovian stimulus-reinforcer relation). Recently, we have shown that relapse of operant behavior in reinstatement, resurgence, and context renewal preparations also is a function of baseline stimulus-reinforcer relations. In this paper we present new data examining the role of baseline stimulus-reinforcer relations on resistance to extinction and relapse using a variety of baseline training conditions and relapse operations. Furthermore, we evaluate the adequacy of a behavioral momentum based model in accounting for the results. The model suggests that relapse occurs as a result of a decrease in the disruptive impact of extinction precipitated by a change in circumstances associated with extinction, and that the degree of relapse is a function of the pre-extinction baseline Pavlovian stimulus-reinforcer relation. Across experiments, relative resistance to extinction and relapse were greater in the presence of stimuli associated with more favorable conditions of reinforcement and were positively related to one another. In addition, the model did a good job in accounting for these effects. Thus, behavioral momentum theory may provide a useful quantitative approach for characterizing how differential reinforcement conditions contribute to relapse of operant behavior.