Conditioned approach behavior of SHR and SD rats during Pavlovian conditioning

Individual differences in reward-related learning are relevant to many behavioral disorders. Sensory cues that predict reward can become incentive stimuli that adaptively support behavior, or alternatively, cause maladaptive behaviors. The spontaneously hypertensive rat (SHR) expresses a genetically determined elevated sensitivity to delay of reward, and has been extensively studied as a behavioral model for attention deficit hyperactivity disorder (ADHD). We investigated reward-related learning in the SHR, comparing them to Sprague-Dawley (SD) rats as a reference strain. A standard Pavlovian conditioned approach task was used, in which a lever cue was followed by reward. Lever presses could occur while the lever was extended, but had no effect on reward delivery. The behavior of both the SHRs and the SD rats showed that they learnt that the lever cue predicted reward. However, the pattern of behavior differed between the strains. During lever cue presentation, SD rats pressed the lever more often and made fewer magazine entries than SHRs. When lever contacts that did not result in lever presses were analyzed, there was no significant difference between SHRs and SDs. These results suggest that the SHRs attributed less incentive value to the conditioned stimulus than the SD rats. During the presentation of the conditioned cue, cue directed responses are called sign tracking responses, whereas responses directed towards the food magazine are called goal tracking responses. Analysis of behavior using a standard Pavlovian conditioned approach index to quantify sign and goal tracking tendencies showed that both strains had a tendency towards goal tracking in this task. However, the SHRs showed a significantly greater goal tracking tendency than the SD rats. Taken together, these findings suggest that attribution of incentive value to reward predicting cues is attenuated in SHRs, which might explain their elevated sensitivity to delay of reward.

Investigating discriminative stimulus modulation of opioid seeking after conflict-induced abstinence in sign- and goal-tracking rats

RATIONALE

Discriminative stimuli (DS) are cues that predict reward availability. DS are resistant to extinction and motivate drug seeking even after long periods of abstinence. Previous studies have demonstrated that sign-tracking (ST) and goal-tracking (GT) differences in Pavlovian approach predict distinct cue-modulated vulnerabilities to cocaine reinstatement. GT rats show heightened reinstatement to contextual and DS, while ST rats show heightened reinstatement to discrete stimuli. Here we examine whether DS modulate reinstatement after electric barrier-induced abstinence and whether tracking-related relapse vulnerabilities generalize to opioid relapse.

OBJECTIVES

We examine whether DS-modulated reinstatement to fentanyl seeking persists in the presence of reduced adverse consequences after electric barrier-induced abstinence. We also examine whether tracking differences predict the magnitude of DS-modulated reinstatement of fentanyl seeking after electric barrier-induced abstinence.

METHODS

We used Pavlovian lever autoshaping (PLA) training to determine sign-, goal-, and intermediate tracking groups in male and female Sprague Dawley rats. We then trained rats in a DS model of intermittent fentanyl self-administration, and extinguished drug seeking by imposing an electric barrier of increasing intensity. We then measured the level of DS-modulated reinstatement in the presence of a reduced electric barrier intensity.

RESULTS

We report that DS strongly modulate fentanyl seeking after electric barrier-induced abstinence. DS-modulation of fentanyl acquisition, electric barrier-induced abstinence, and reinstatement was similar for sign- and goal-tracking groups.

CONCLUSIONS

Discriminative stimuli powerfully motivate opioid seeking, despite continued aversive consequences. Pavlovian approach differences do not predict the level of DS-modulated reinstatement to fentanyl seeking after conflict-induced abstinence.

Stopping at nothing: Two-year-olds differentiate between interrupted and abandoned goals

Previous research has established that goal tracking emerges early in the first year of life and rapidly becomes increasingly sophisticated. However, it has not yet been shown whether young children continue to update their representations of others' goals over time. The current study investigated this by probing young children's (24- to 30-month-olds; N = 24) ability to differentiate between goal-directed actions that have been halted because the goal was interrupted and those that have been halted because the goal was abandoned. To test whether children are sensitive to this distinction, we manipulated the experimenter's reason for not completing a goal-directed action; his initial goal was either interrupted by an obstacle or abandoned in favor of an alternative. We measured whether children's helping behavior was sensitive to the experimenter's reason for not completing his goal-directed action by recording whether children completed the experimenter's initial goal or the alternative goal. The results showed that children helped to complete the experimenter's initial goal significantly more often after this goal had been interrupted than after it had been abandoned. These results support the hypothesis that children continue to update their representations of others' goals over time by 2 years of age and specifically that they differentiate between abandoned and interrupted goals.

Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats

Individuals trained under partial reinforcement (PR) typically show a greater resistance to extinction than individuals exposed to continuous reinforcement (CR). This phenomenon is referred to as the PR extinction effect (PREE) and is interpreted as a consequence of uncertainty-induced frustration counterconditioning. In this study, we assessed the effects of PR and CR in acquisition and extinction in two strains of rats, the inbred Roman high- and low-avoidance (RHA and RLA, respectively) rats. These two strains mainly differ in the expression of anxiety, the RLA rats showing more anxiety-related behaviors (hence, more sensitive to frustration) than the RHA rats. At a neurobiological level, mild stress is known to elevate corticosterone in RLA rats and dopamine in RHA rats. We tested four groups of rats (RHA/CR, RHA/PR, RLA/CR, and RLA/PR) in two successive acquisition-extinction phases to try to consolidate the behavioral effects. Animals received training in a Pavlovian autoshaping procedure with retractable levers as the conditioned stimulus, food pellets as the unconditioned stimulus, and lever presses as the conditioned response. In Phase 1, we observed a PREE in lever pressing in both strains, but this effect was larger and longer lasting in RHA/PR than in RLA/PR rats. In Phase 2, reacquisition was fast and the PREE persisted in both strains, although the two PR groups no longer differed in lever pressing. The results are discussed in terms of frustration theory and of uncertainty-induced sensitization of dopaminergic neurons.

Sex differences in nicotine-enhanced Pavlovian conditioned approach in rats

Background

Nicotine exposure enhances Pavlovian conditioned approach (PCA), or the learned approach to reward-predictive cues. While females show elevated approach to conditioned stimuli compared to males, potentially indicating heightened addiction vulnerability, it is unknown how sex may interact with nicotine to influence approach behavior. Additionally, brain-derived neurotrophic factor (BDNF) levels can be altered significantly after repeated nicotine exposure, suggesting a potential mechanism contributing to nicotine-induced behavioral phenotypes. The present study investigated the role of sex on nicotine-induced changes to stimulus-response behavior and associated BDNF protein levels.

Methods

Male and female rats were exposed to nicotine (0.4 mg/kg, subcutaneously) or saline 15 min prior to each PCA session. PCA training consisted of 29 sessions of 15 trials, in which a 30-s cue presentation ended concurrently with a sucrose reward (20% w/v in water, 100 μL), and a 120-s variable intertrial interval occurred between trials. Approach behavior to the cue and reward receptacle was recorded. Preference toward the reward receptacle indicated a goal-tracking phenotype, and preference toward the cue indicated a sign-tracking phenotype, demonstrating that the cue had gained incentive salience. Twenty-four hours after the last PCA session, brain tissue was collected and BDNF levels were measured in the basolateral amygdala, orbitofrontal cortex, and nucleus accumbens using Western blot analysis.

Results

Nicotine exposure enhanced both sign- and goal-tracking conditioned approach, and females showed elevated sign-tracking compared to males. There were no sex-by-drug interactions on conditioned approach. Day-to-day variability in conditioned approach was similar between sexes. In contrast to prior studies, neither repeated exposure to nicotine nor sex significantly affected BDNF expression.

Conclusions

Drug-naïve females exhibited heightened sign-tracking compared to males, and nicotine enhanced conditioned approach similarly in males and females. Further, non-significant changes to BDNF expression in brain regions highly associated with PCA indicate that BDNF is unlikely to drive nicotine-enhanced conditioned behavior.

Sign- and goal-tracking rats show differences in various executive functions: Authors

Sign tracking (ST) is a complex Pavlovian trait that is known to impact instrumental behaviour. Recent work suggests that this trait also correlates with altered top-down executive control relative to goal tracking (GT) rats. This raises the question as to the extent to which both phenotypes differ in executive functions. Moreover, it is unclear which cognitive processes might cause potential differences between ST and GT rats. We therefore compared the behaviour of ST and GT rats in several assays, such as outcome devaluation, attentional set shifting and reversal learning, conditional responding, as well as delayed alternation to measure different aspects of executive functioning. Goal-directed behaviour per se was not different between ST and GT rats in the outcome devaluation task. ST rats performed slightly better than GT rats in one condition of the set shifting task (place->cue shift) and the delayed alternation task, but did not perform as well in the conditional responding task. Thus, differential behavioural performance between ST and GT rats was dependent on the specific task context. Further, we found evidence that the differences in executive functions are likely related to increased incentive salience attribution and impulsive action in ST rats.

Orbitofrontal participation in sign- and goal-tracking conditioned responses: Effects of nicotine

Pavlovian conditioned stimuli can acquire incentive motivational properties, and this phenomenon can be measured in animals using Pavlovian conditioned approach behavior. Drugs of abuse can influence the expression of this behavior, and nicotine in particular exhibits incentive amplifying effects. Both conditioned approach behavior and drug abuse rely on overlapping corticolimbic circuitry. We hypothesize that the orbitofrontal cortex (OFC) regulates conditioned approach, and that one site of nicotine action is in the OFC where it reduces cortical output. To test this, we repeatedly exposed rats to 0.4 mg/kg nicotine (s.c.) during training and then pharmacologically inactivated the lateral OFC or performed in vivo electrophysiological recordings of lateral OFC neurons in the presence or absence of nicotine. In Experiment 1, animals were trained in a Pavlovian conditioning paradigm and behavior was evaluated after inactivation of the OFC by microinfusion of the GABA agonists baclofen and muscimol. In Experiment 2, we monitored phasic firing of OFC neurons during Pavlovian conditioning sessions. Nicotine reliably enhanced conditioned responding to the conditioned cue, and inactivation of the OFC reduced conditioned responding, especially the sign-tracking response. OFC neurons exhibited phasic excitations to cue presentation and during goal tracking, and nicotine acutely blunted this phasic neuronal firing. When nicotine was withheld, both conditioned responding and phasic firing in the OFC returned to the level of controls. These results suggest that the OFC is recruited for the expression of conditioned responses, and that nicotine acutely influences this behavior by reducing phasic firing in the OFC.

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself.

Chronic corticosterone treatment enhances extinction-induced depression in aged rats

Withdrawal and avoidance behavior are common symptoms of depression and can appear as a consequence of absence of reward, i.e. extinction-induced depression (EID). This is particularly relevant for the aged organism subjected to pronounced loss of former rewards. Avoidance of the former site of reward and increased withdrawal into a distant compartment accompany extinction of food-rewarded behavior in rodent models. During extinction, behavioral markers for re-learning dissociate from indicators of extinction-induced depression. Here we examined the effect of a chronic treatment with corticosterone (CORT), a well-known inducer of depression-related behavior, on EID in adult and aged rats. Adult (3-4months) and aged (18months) male rats were treated with CORT via drinking water for 3weeks prior to extinction of a cued food-reward task. CORT treatment increased the distance from the site of reward and decreased goal tracking behavior during extinction, especially in the aged rats. Plasma hormone levels measured before and after restraint stress showed a decline in basal ACTH- and CORT-levels after chronic CORT treatment in aged animals. The treatment significantly impaired the HPA-axis activation after acute stress in both, adult and aged animals, alike. Altogether, these findings show an enhancement of EID after chronic CORT treatment in the aged organism, which may be mediated by an impaired HPA-axis sensitivity. These findings may have special relevance for the investigation of human geriatric depression.

Dopamine antagonism does not impair learning of Pavlovian conditioned approach to manipulable or non-manipulable cues but biases responding towards goal tracking

Dopamine's (DA) role in reward-processing is currently discussed as either providing a teaching signal to guide learning or mediating the transfer of incentive salience (i.e. motivational aspects) from unconditioned stimuli (US) to conditioned stimuli (CS). We used a Pavlovian conditioned approach (PCA) procedure to further investigate DAs contribution to these processes. Experiment 1 assessed the acquisition of PCA to a manipulable lever cue for 7days under DA-blockade with Flupenthixol (FLU; 225μg/kg) or Saline (SAL) treatment, followed by 6-days off-drug testing. FLU decreased the number of conditioned responses (CR) during the treatment phase, but cessation of treatment resulted in an immediate increase in CR to levels comparable to SAL controls; notably, CR in FLU-treated rats were restricted to goal tracking behaviour. During continued off-drug testing, rats from the FLU group developed sign tracking with a similar temporal pattern as controls. In experiment 2, acquisition of PCA to a non-manipulable auditory cue was investigated. FLU reduced the number of CR during treatment, and removing DA antagonism resulted in a similar rapid increase of CR as seen in experiment 1. These data complement other reports by demonstrating that, independently from the physical properties of the CS, DA is not required for learning predictive aspects of a CS-US relationship but for the development of behaviour (namely sign tracking) which is based on the motivational aspects of a CS-US relationship.

Role of prefrontal 5-HT in the strain-dependent variation in sign-tracking behavior of C57BL/6 and DBA/2 mice

RATIONALE

The expression of sign-tracking (ST) phenotype over goal-tracking (GT) phenotype has been associated to different aspects of impulsive behavior, and depletions of brain serotonin (5-HT) have been shown to selectively increase impulsive action as well as ST.

OBJECTIVES

The present study aimed at testing the relationship between reduced brain 5-HT availability and expression of ST phenotype in a genetic model of individual variation in brain 5-HT functionality. Inbred DBA/2J (DBA) mice are homozygous for the allelic variant of the TPH-2 gene causing lower brain 5-HT function in comparison with C57BL/6J (C57) inbred mice.

MATERIALS

Young adult (10 weeks) and adult (14 weeks) C57 and DBA mice were trained in a Pavlovian conditioned approach (PCA) paradigm. Lever-directed (ST) and magazine-directed (GT) responses were measured in 12 daily conditioning sessions. In a second experiment, effect of the medial prefrontal cortex (mPFC) 5-HT depletion by the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT) was assessed on acquisition of ST phenotype in adult C57 mice, according to their higher 5-HT functionality compared to DBA mice.

RESULTS

Young adult mice of both strains developed ST phenotype, but only adult DBA mice developed ST phenotype. 5-HT depletion in the mPFC of adult C57 mice completely changed their phenotype, as shown by their increased ST.

CONCLUSIONS

These findings indicate that ST phenotype can be the expression of a transitory late developmental stage and that genetic factors determine persistence of this phenotype in adulthood. These findings also support a role of 5-HT transmission in PFC in constraining development of ST phenotype.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Effects of ethanol exposure during adolescence or in adulthood on Pavlovian conditioned approach in Sprague-Dawley rats

Human studies have shown that adolescents who repeatedly use alcohol are more likely to be dependent on alcohol and are more likely to suffer from psychological problems later in life. There has been limited research examining how ethanol exposure in adolescence might contribute to later abuse or addiction in adulthood. The present experiment examined effects of intermittent ethanol exposure during adolescence on sign-tracking behavior in adulthood, indexed by a Pavlovian conditioned approach (PCA) task wherein an 8s lever presentation served as a cue predicting subsequent delivery of a flavored food pellet. Although no response was required for food delivery, after multiple pairings, 1 of 2 different responses often emerged during the lever presentation: goal tracking (head entries into the food trough) or sign tracking (engagement with the lever when presented). Sign tracking is thought to reflect the attribution of incentive salience to reward-paired cues and has been previously correlated with addiction-like behaviors. Following the last PCA session, blood samples were collected for analysis of post-session corticosterone levels. Sixty-two rats (n = 10-12/group) were pseudo-randomly assigned to 1 of 2 intragastric (i.g.) exposure groups (water or 4 g/kg ethanol) or a non-manipulated (NM) control group. Animals were intubated with ethanol or water every other session from postnatal session (PND) 28-48 or PND 70-90. Rats were then tested in adulthood (PND 71-79 or PND 113-122) on the PCA task. Animals exposed chronically to ethanol during adolescence exhibited significantly higher levels of sign-tracking behavior in adulthood than NM and water-treated animals, and showed higher corticosterone than NM control animals. These effects were not seen after comparable ethanol exposure in adulthood. These results suggest that adolescent alcohol exposure has long-term consequences on the expression of potential addiction-relevant behaviors in adulthood.

The incentive amplifying effects of nicotine are reduced by selective and non-selective dopamine antagonists in rats

Nicotine is a psychomotor stimulant with 'reinforcement enhancing' effects--the actions of nicotine in the brain increase responding for non-nicotine rewards. We hypothesized that this latter effect of nicotine depends on increased incentive properties of anticipatory cues; consistent with this hypothesis, multiple laboratories have reported that nicotine increases sign tracking, i.e. approach to a conditioned stimulus (CS), in Pavlovian conditioned-approach tasks. Incentive motivation and sign tracking are mediated by mesolimbic dopamine (DA) transmission and nicotine facilitates mesolimbic DA release. Therefore, we hypothesized that the incentive-promoting effects of nicotine would be impaired by DA antagonists. To test this hypothesis, separate groups of rats were injected with nicotine (0.4mg/kg base) or saline prior to Pavlovian conditioning sessions in which a CS (30s illumination of a light or presentation of a lever) was immediately followed by a sweet reward delivered in an adjacent location. Both saline and nicotine pretreated rats exhibited similar levels of conditioned approach to the reward location (goal tracking), but nicotine pretreatment significantly increased approach to the CS (sign tracking), regardless of type (lever or light). The DAD1 antagonist SCH-23390 and the DAD2/3 antagonist eticlopride reduced conditioned approach in all rats, but specifically reduced goal tracking in the saline pretreated rats and sign tracking in the nicotine pretreated rats. The non-selective DA antagonist flupenthixol reduced sign-tracking in nicotine rats at all doses tested; however, only the highest dose of flupenthixol reduced goal tracking in both nicotine and saline groups. The reductions in conditioned approach behavior, especially those by SCH-23390, were dissociated from simple motor suppressant effects of the antagonists. These experiments are the first to investigate the effects of dopaminergic drugs on the facilitation of sign-tracking engendered by nicotine and they implicate dopaminergic systems both in conditioned approach as well as the incentive-promoting effects of nicotine.

The attribution of incentive salience to an appetitive conditioned cue is not affected by knockout of the serotonin transporter in rats

Understanding the neurobiological basis underlying individual differences in conditioned stimulus (CS) sensitivity is pertinent, given that excessive conditioned responses to CSs is a key feature of anxiety-related disorders and drug addiction. We have previously shown that behaviour of serotonin transporter knockout (5-HTT(-/-)) rats-mimicking the common 5-HTT promoter polymorphism in humans-is strongly driven by Pavlovian CSs. To investigate whether the knockout rats attribute greater incentive salience to CSs, we tested the 5-HTT(-/-) rats and their wild-type counterparts in the sucrose-reinforced sign-versus goal-tracking task. We also assessed whether motivational properties of the unconditioned stimulus (sucrose pellet) are involved in the individual differences under investigation, by testing the animals in a sucrose-reinforced progressive ratio schedule of reinforcement. We found no genotype differences in sign-versus goal-tracking behavior, despite that progressive ratio responding was increased in 5-HTT(-/-) rats. In conclusion, the high CS sensitivity in 5-HTT(-/-) rats cannot be explained by enhanced incentive salience attribution to the CS as measured by the sign- versus goal-tracking paradigm. Rather, 5-HTT(-/-) rats may be more sensitive to the motivational properties of the unconditioned stimulus.