Acquisition of responding with a remifentanil-associated conditioned reinforcer in the rat

Effects of food restriction on the conditioned reinforcing properties of an opioid-associated stimulus

Food restriction promotes drug self-administration; however, the effects of food restriction on the conditioned reinforcing properties of drug-associated stimuli are less clear. We tested the extent to which food restriction modified the conditioned reinforcing properties of a remifentanil-associated stimulus following conditioning with 3.2 or 1.0 μg/kg/infusion of remifentanil. First, we provided restricted (20 g/day standard chow) or ad libitum access to standard chow to rats. Second, within each feeding condition, we exposed rats to 20 intravenous infusions of remifentanil and 20 stimulus presentations that were delivered response independently each day for 5 days. For the experimental group (paired Pavlovian), the remifentanil infusions and stimulus presentations were delivered concurrently. The control group (random control) received the same number of infusions and stimulus presentations, but were not paired. For 28 sessions, we tested the extent to which the stimulus functioned as a conditioned reinforcer by allowing rats to freely respond for presentations of the remifentanil-associated stimulus. Following conditioning with 3.2 μg/kg/infusion of remifentanil, we found that rats that in the Paired Pavlovian group responded for the remifentanil-associated stimulus significantly more than rats in the Random control group, regardless of feeding condition. Following conditioning with 1.0 μg/kg/infusion of remifentanil, the remifentanil-associated stimulus was not associated with conditioned reinforcing properties, regardless of feeding condition. These findings confirm previous research demonstrating that a remifentanil-associated stimulus takes on conditioned reinforcing properties in a dose-dependent manner.

Effects of dose on acquisition and persistence of a new response for a remifentanil-associated stimulus

Previous research demonstrated that a remifentanil-associated stimulus facilitated the acquisition of a previously unlearned response; however, it is unclear how long a remifentanil-associated stimulus maintains conditioned reinforcing properties under conditions of daily testing. To address this gap, we exposed adult male rats to response-independent stimulus presentations and deliveries of remifentanil (1.0, 3.2, or 10.0 μg/kg/infusion). Rats either received the stimulus presentations and remifentanil deliveries together (Paired Pavlovian conditioning) or according to separate clocks (Random control group). In the sessions following Pavlovian conditioning, we allowed rats to emit nose-poke responses for the presentation of the stimulus alone and measured the extent to which the stimulus facilitated and maintained a previously unlearned response. We tested responding for the stimulus presentations across 28 daily sessions to assess the Pavlovian extinction (degradation of the drug-stimulus association) of the conditioned reinforcing properties of the remifentanil-associated stimulus. We observed the highest and most persistent levels of responding in rats with a Paired Pavlovian conditioning history at 3.2 and 10.0 μg/kg/infusion. In addition, we included analyses of the variability in responding for each group, which revealed individual differences in the susceptibility of the remifentanil-associated stimulus acting as a conditioned reinforcer. These findings demonstrate that a remifentanil-associated stimulus has the ability to sustain drug-seeking behavior and underscores the importance of Pavlovian conditioning in promoting drug abuse.

Cues Associated with Alternative Reinforcement During Extinction Can Attenuate Resurgence of an Extinguished Instrumental Response

In resurgence, a target behavior (R1) is acquired in an initial phase and extinguished in a second phase while an R2 behavior is reinforced. When R2 is extinguished, R1 behavior can return or resurge. Two experiments tested the effectiveness of a potential retrieval cue associated with extinction in attenuating resurgence. Experiment 1 established that a 2-s cue paired with outcome delivery in Phase 2 can attenuate resurgence when presented during testing. This effect depended on the cue being associated with the outcome, and it occurred if the cue was delivered contingently or noncontingently on responding during testing. Pairing the cue with reinforcement might be necessary to maintain attention to it during Phase 2. Experiment 2 demonstrated that the cue must be experienced in sessions that also include R1 extinction and that it does not reduce resurgence through a conditioned reinforcement mechanism. The results suggest that previously neutral stimuli can attenuate resurgence if they are first paired with alternative reinforcement and presented in sessions in which R1 is extinguished. They build on existing literature that suggests enhancing generalization between extinction and testing reduces resurgence. The results may have implications for reducing relapse following interventions in humans such as contingency management (CM), in which participants can earn vouchers contingent upon drug abstinence. A cue associated with CM might help reduce this relapse.

Effects of sex and remifentanil dose on rats' acquisition of responding for a remifentanil-conditioned reinforcer

Opioid-conditioned reinforcement is thought to exacerbate opioid abuse and dependence. Sex/gender can influence opioid abuse behaviors, but the effects of sex/gender on opioid-conditioned reinforcement, specifically, are unclear. In this study, we compared new-response acquisition with opioid-conditioned reinforcement in male and female rats. First, separate groups received response-independent remifentanil injections (0.0-32.0 μg/kg, intravenous) and presentations of a light-noise stimulus. In the experimental groups, injections and stimulus presentations always co-occurred [paired Pavlovian conditioning (PAV)]; in the control groups, the two occurred independently of each other (random PAV). Next, in the instrumental acquisition (ACQ) sessions, two novel nose-poke manipulanda were introduced. All animals (regardless of sex, dose, and PAV type) could respond in the active nose-poke, which produced the stimulus alone, or in the inactive nose-poke. Both males and females dose-dependently acquired nose-poke responding (active>inactive) after paired PAV, but not after random PAV. Therefore, the stimulus was a conditioned reinforcer. We identified three sex differences. First, only females acquired responding after paired PAV with 32.0 μg/kg remifentanil. Second, using a progressive ratio schedule for ACQ, both sexes acquired responding, but females made significantly more active responses. Third, when a single session of PAV was conducted, only males acquired responding. Thus, rats' sex interacts with pharmacological and environmental factors to determine opioid-conditioned reinforcement.

A Bibliographic Tribute to Jack Michael

"In the late 1950's, Jack Michael, a bright but irritating young psychology instructor, moved from the Universities of Kansas to Houston to Arizona State. Along the way he befriended two nontraditional students, protected them through their Ph.D. programs, and turned them loose on the world: Teodoro Ayllon…and Montrose Wolf…" (Risley, 2001, p. 267). So begins Risley's chapter on the origins of applied behavior analysis. For almost 50 years, Jack Michael provided a model for us to "talk like Skinner" and to analyze behavior as Skinner would. For this, he has been widely respected and revered. The purpose of this bibliography is to explain to new and familiar readers alike Jack's contributions to the field of behavior analysis in areas of his primary focus: (a) behavioral function taxonomy, (b) motivation, (c) reinforcement, (d) response topographies, (e) multiple control, (f) duplic and codic verbal behavior, and (g) teaching. Throughout, we weave his role in the field's history and his leadership in its expansion, as these have been additional areas of significant contributions. Above all, we wish to highlight Jack's work, in bibliographic and narrative form, in a way that expresses a heartfelt tribute on behalf of his students and others whom he influenced to learn about psychology as a natural science and to think and talk like Skinner.

Individual variation in the motivational and neurobiological effects of an opioid cue

A discrete cue associated with intravenous injections of cocaine acquires greater control over motivated behavior in some rats ('sign-trackers', STs) than others ('goal-trackers', GTs). It is not known, however, if such variation generalizes to cues associated with other drugs. We asked, therefore, whether a discrete cue (a light) associated with the intravenous administration of an opioid drug (the short-acting mu receptor agonist, remifentanil) acquires incentive motivational properties differently in STs and GTs, as indicated by tests of Pavlovian conditioned approach and conditioned reinforcement. Consistent with studies using cocaine, STs approached a classically conditioned opioid cue more readily than GTs, and in a test of conditioned reinforcement worked more avidly to get it. Interestingly, STs and GTs did not differ in the acquisition of a conditioned orienting response. In addition, the performance of conditioned approach behavior, but not conditioned orientation, was attenuated by pretreatment with the dopamine receptor antagonist, flupenthixol, into the core of the nucleus accumbens. Lastly, food and opioid cues engaged similar amygdalo-striatal-thalamic circuitry to a much greater extent in STs than GTs, as indicated by Fos expression. Taken together, these data demonstrate that, similar to food and cocaine cues: (1) a discrete opioid cue attains greater incentive motivational value in STs than GTs; (2) the attribution of incentive motivational properties to an opioid cue is dopamine dependent; and (3) an opioid cue engages the so-called 'motive circuit' only if it is imbued with incentive salience.

Effects of pramipexole on the acquisition of responding with opioid-conditioned reinforcement in the rat

RATIONALE

Dopamine D3 receptor-preferring ligands may be able to modify the conditioned reinforcing effects of drug-associated stimuli. In evaluating the effects of these compounds, it is important to clarify the extent to which responding depends on (1) conditioned reinforcement vs. other behavioral mechanisms and (2) dopamine D3 vs. D2 receptor activity.

OBJECTIVES

To use behaviorally stringent new-response acquisition procedures to characterize the effects of the D3-preferring agonist, pramipexole, on the conditioned reinforcing effects of a stimulus paired with the opioid agonist, remifentanil.

METHODS

First, in Pavlovian conditioning (PAV) sessions, rats received response-independent IV injections of remifentanil and presentations of a light-noise stimulus. In separate groups, injections and stimuli either always co-occurred ("paired PAV") or occurred with no consistent relationship ("random PAV" control). Next, in instrumental acquisition (ACQ) sessions, all animals could respond in two nose-poke manipulanda: an active nose-poke, which produced the stimulus alone, or an inactive nose-poke. Pramipexole was injected SC prior to ACQ sessions with or without pretreatments of the D3-preferring antagonist, SB-277011A, or the D2-preferring antagonist, L-741,626.

RESULTS

After paired PAV, but not random PAV, rats acquired nose-poke responding during ACQ (i.e., active > inactive). Pramipexole dose-dependently increased active responding without changing inactive responding. Pramipexole-induced increases in responding were blocked by pretreatment with L-741,626, but not SB-277011A.

CONCLUSIONS

Pramipexole specifically enhanced remifentanil-conditioned reinforcement: active responding was selectively increased only after the stimulus was paired with remifentanil. Although pramipexole is D3-preferring, the antagonist effects obtained presently suggest an important role for the D2 receptor in opioid-conditioned reinforcement.

Effects of the NOP agonist SCH221510 on producing and attenuating reinforcing effects as measured by drug self-administration in rats

Nociceptin/orphanin FQ peptide (NOP) receptor agonists attenuate morphine-induced conditioned place preference in rodents. However, it is not known whether NOP agonists have reinforcing properties or can inhibit mu opioid receptor (MOP)-mediated reinforcement as measured by drug self-administration in rodents. Further understanding the behavioral effects of NOP agonists could suggest them as having potential in attenuating reinforcing effects of opioids. In the first part of the study, reinforcing properties of selective NOP agonist SCH221510 were determined and compared with the full MOP agonist remifentanil under fixed-ratio 5 (FR5) and progressive-ratio (PR) schedules of drug self-administration. In the second part, effects of systemic and intracisternal pretreatment of SCH221510 were determined and compared with MOP antagonist naltrexone in attenuating reinforcing effects of remifentanil and a non-drug reinforcer (sucrose pellets). Remifentanil self-administration (0.3-10 µg/kg/infusion) generated a biphasic dose-response curve, characteristic of drugs with reinforcing properties. SCH221510 (3-300 µg/kg/infusion) self-administration resulted in flat dose-response curves and early break-points under the PR, indicative of drugs lacking reinforcing value. Intracisternally, but not systemically, administered SCH221510 (0.3-3 µg) attenuated remifentanil self-administration, comparable with systemic naltrexone (0.03-0.3 mg/kg). SCH221510 (1-3 µg), unlike naltrexone (0.03-1 mg/kg), attenuated responding for sucrose pellets. Both effects of SCH221510 were reversed by the NOP antagonist J-113397 (0.3-3 µg). These results suggest that SCH221510 does not function as a reinforcer in rats, and that it can attenuate the reinforcing value of MOP agonists; therefore, the potential utility of NOP agonists for the treatment of drug addiction warrants further evaluation.

Cue-evoked cocaine "craving": role of dopamine in the accumbens core

Drug-associated cues can acquire powerful motivational control over the behavior of addicts, and can contribute to relapse via multiple, dissociable mechanisms. Most preclinical models of relapse focus on only one of these mechanisms: the ability of drug cues to reinforce drug-seeking actions following a period of extinction training. However, in addicts, drug cues typically do not follow seeking actions; they precede them. They often produce relapse by evoking a conditioned motivational state ("wanting" or "craving") that instigates and/or invigorates drug-seeking behavior. Here we used a conflict-based relapse model to ask whether individual variation in the propensity to attribute incentive salience to reward cues predicts variation in the ability of a cocaine cue to produce conditioned motivation (craving) for cocaine. Following self-administration training, responding was curtailed by requiring rats to cross an electrified floor to take cocaine. The subsequent response-independent presentation of a cocaine-associated cue was sufficient to reinstate drug-seeking behavior, despite the continued presence of the adverse consequence. Importantly, there were large individual differences in the motivational properties of the cocaine cue, which were predicted by variation in the propensity to attribute incentive salience to a food cue. Finally, a dopamine antagonist injected into the nucleus accumbens core attenuated, and amphetamine facilitated, cue-evoked cocaine seeking, implicating dopamine signaling in cocaine cue-evoked craving. These data provide a promising preclinical approach for studying sources of individual variation in susceptibility to relapse due to conditioned craving and implicate mesolimbic dopamine in this process.