Environmental manipulations alter age differences in attribution of incentive salience to reward-paired cues

Propensity for risky choices despite lower cue reactivity in adolescent rats

Adolescence is a time of heightened risk-taking across species. Salient audiovisual cues associated with rewards are a common feature of gambling environments and have been connected to increased risky decision-making. We have previously shown that, in adult male rats, sign tracking - a behavioral measure of cue reactivity - predicts an individual's propensity for suboptimal risky choices in a rodent gambling task (rGT) with win-paired cues. However, adolescents perform less sign tracking than adult animals, suggesting that they are less cue-reactive than adults in some circumstances. Therefore, we investigated the performance of adolescent male rats on the rGT with win cues and examined its relationship with their sign-tracking behavior. We found that adolescents make more risky choices and fewer optimal choices on the rGT compared with adults, evidence of the validity of the rGT as a model of adolescent gambling behavior. We also confirmed that adolescents perform less sign tracking than adults, and we found that, unlike in adults, adolescents' sign tracking was unrelated to their risk-taking in the rGT. This implies that adolescent risk-taking is less likely than that of adults to be driven by reward-related cues. Finally, we found that adults trained on the rGT as adolescents retained an adolescent-like propensity toward risky choices, suggesting that early exposure to a gambling environment may have a long-lasting impact on risk-taking behavior.

Effects of predictive and incentive value manipulation on sign- and goal-tracking behavior

When a neutral stimulus is repeatedly paired with an appetitive reward, two different types of conditioned approach responses may develop: a sign-tracking response directed toward the neutral cue, or a goal-tracking response directed toward the location of impending reward delivery. Sign-tracking responses have been postulated to result from attribution of incentive value to conditioned cues, while goal-tracking reflects the assignment of only predictive value to the cue. We therefore hypothesized that sign-tracking rats would be more sensitive to manipulations of incentive value, while goal-tracking rats would be more responsive to changes in the predictive value of the cue. We tested sign- and goal-tracking before and after devaluation of a food reward using lithium chloride, and tested whether either response could be learned under negative contingency conditions that precluded any serendipitous reinforcement of the behavior that might support instrumental learning. We also tested the effects of blocking the predictive value of a cue using simultaneous presentation of a pre-conditioned cue. We found that sign-tracking was sensitive to outcome devaluation, while goal-tracking was not. We also confirmed that both responses are Pavlovian because they can be learned under negative contingency conditions. Goal-tracking was almost completely blocked by a pre-conditioned cue, while sign-tracking was much less sensitive to such interference. These results indicate that sign- and goal-tracking may follow different rules of reinforcement learning and suggest a need to revise current models of associative learning to account for these differences.

Age-related changes in the organization of spontaneously occurring behaviors

Age-related changes in spatial and temporal processing have been documented across a range of species. Rodent studies typically investigate differences in performance between adult and senescent animals; however, progressive loss of neurons in the hippocampus and cortex has been observed to occur as early as after adolescence. Therefore, the current study evaluated the effects of age in three- and ten-month-old female rats on the organization of movement in open field and food protection behaviors, two tasks that have previously dissociated hippocampal and cortical pathology. Age-related differences were observed in general measures of locomotion, spatial orientation, and attentional processing. The results of the current study are consistent with age-related changes in the processing of spatial information and motivation that occur earlier in life than previously anticipated. These observations establish a foundation for future studies evaluating interventions that influence these age-related differences in performance.

Sign Tracking in an Enriched Environment: A Potential Ecologically Relevant Animal Model of Adaptive Behavior Change

When an object conditioned stimulus (CS) is paired with a food unconditioned stimulus (US), anticipatory goal-directed action directed at the US location (goal tracking) is accompanied by behavior directed at the object CS (sign tracking). Sign-tracking behavior appears to be compulsive and habit-like and predicts increased vulnerability to the addictive potential of drugs in animal models. A large body of the literature also suggests that environmental enrichment protects against the development of addiction-prone phenotypes. Thus, we investigated whether compulsive-like sign tracking develops in environmentally enriched rats trained directly in their enriched home environment. We demonstrate that adolescent enriched-housed male Sprague-Dawley rats readily sign track a 5% ethanol bottle CS in their home environment and at a rate higher than adolescent standard-housed rats. We also show that enriched adolescent rats sign track less than enriched adult-trained rats and that acute isolation stress affects sign- and goal-tracking performance of adolescents and adults differently. Sign tracking increased more in the adult than the adolescent rats. Whereas the younger rats showed a decrease in goal tacking after the final stressor manipulation, the adults showed increased goal tracking. Our results are consistent with recent studies, which suggest that although sign tracking performance is compulsive-like, it is not as inflexible and habit-like as previously assumed. Testing in an enriched home environment with object CSs having greater affordance than "neutral" lever CSs may provide greater ecological relevance for investigating the development and expression of adaptive and compulsive-like behaviors in translational research.

Effects of dopamine receptor antagonism and amphetamine-induced psychomotor sensitization on sign- and goal-tracking after extended training

The dopamine system is important for incentive salience attribution, where motivational value is assigned to conditioned cues that predict appetitive reinforcers. However, the role of dopamine in this process may change with extended training. We tested the effects of dopamine D1-like and D2-like receptor antagonism on the expression of sign-tracking and goal-tracking conditioned responses following extended Pavlovian conditioned approach (PCA) training. We also tested if amphetamine-induced psychomotor sensitization accelerates the enhanced acquisition of sign-tracking that is observed with extended training. In experiment 1, 24 male Long-Evans rats received 20 PCA sessions in which one lever (CS+, 10 s) predicted 0.2 ml sucrose (10 %, w/v) delivery and the other lever (CS-) did not. SCH-23390 (D1-like antagonist) or eticlopride (D2-like antagonist) were administered before non-reinforced behavioural tests at doses of 0, 0.01, and 0.1 mg/kg (s.c.). In experiment 2, rats received vehicle or 2 mg/kg amphetamine (i.p.) for 7 days (n = 12/group). Ten days later, they received 16 PCA training sessions. Both doses of SCH-23390 reduced sign- and goal-tracking, but also reduced locomotor behaviour. A low dose of eticlopride (0.01 mg/kg) selectively reduced goal-tracking, without affecting sign-tracking or locomotor behaviour. Amphetamine produced psychomotor sensitization, and this did not affect the acquisition of sign- or goal-tracking. Following extended PCA training, dopamine D2-like receptor activity is required for the expression of goal-tracking but not sign-tracking. Psychomotor sensitization to amphetamine did not impact incentive salience attribution; however, more selective manipulations of the dopamine system may be needed.

Assessing the Role of Corticothalamic and Thalamo-Accumbens Projections in the Augmentation of Heroin Seeking in Chronically Food-Restricted Rats

Drug addiction is a chronic disorder characterized by compulsive drug seeking, and involves repetitive cycles of compulsive drug use, abstinence, and relapse. In both human and animal models of addiction, chronic food restriction increases rates of relapse. Our laboratory has reported a robust increase in drug seeking following a period of withdrawal in chronically food-restricted rats compared with sated controls. Recently, we reported that activation of the paraventricular nucleus of the thalamus (PVT) abolished heroin seeking in chronically food-restricted rats. However, the precise inputs and outputs of the PVT that mediate this effect remain elusive. The goal of the current study was to determine the role of corticothalamic and thalamo-accumbens projections in the augmentation of heroin seeking induced by chronic food restriction. Male Long-Evans rats were trained to self-administer heroin for 10 d. Next, rats were removed from the self-administration chambers and were subjected to a 14 d withdrawal period while sated (unlimited access to food) or mildly food-restricted (FDR). On day 14, rats were returned to the self-administration context for a 3 h heroin-seeking test under extinction conditions during which corticothalamic and thalamo-accumbens neural activity was altered using chemogenetics. Surprisingly, chemogenetic activation or inhibition of corticothalamic projections did not alter heroin-seeking behavior. Chemogenetic activation of thalamo-accumbens shell, but not core, projectors attenuated heroin seeking in FDR rats. The results indicate an important role for the PVT to nucleus accumbens shell projections in the augmentation of heroin seeking induced by chronic food restriction.SIGNIFICANCE STATEMENT Relapse to heroin use is one of the major obstacles in the treatment of opiate addiction. Triggers for relapse are modulated by environmental challenges such as caloric restriction. Elucidating the brain mechanisms that underlie relapse is critical for evidence-based treatment development. Here we demonstrate a critical role for the input from the paraventricular thalamus (PVT), a hub for cortical, sensory, and limbic information, to the nucleus accumbens shell (an area known to be important for reward and motivation) in the augmentation of heroin seeking in food-restricted rats. Our findings highlight a previously unknown role for the PVT in heroin seeking following a period of abstinence.

Reward-predictive cues elicit excessive reward seeking in adolescent rats

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.

Adolescents exhibit reduced Pavlovian biases on instrumental learning

Multiple learning systems allow individuals to flexibly respond to opportunities and challenges present in the environment. An evolutionarily conserved "Pavlovian" learning mechanism couples valence and action, promoting a tendency to approach cues associated with reward and to inhibit action in the face of anticipated punishment. Although this default response system may be adaptive, these hard-wired reactions can hinder the ability to learn flexible "instrumental" actions in pursuit of a goal. Such constraints on behavioral flexibility have been studied extensively in adults. However, the extent to which these valence-specific response tendencies bias instrumental learning across development remains poorly characterized. Here, we show that while Pavlovian response biases constrain flexible action learning in children and adults, these biases are attenuated in adolescents. This adolescent-specific reduction in Pavlovian bias may promote unbiased exploration of approach and avoidance responses, facilitating the discovery of rewarding behavior in the many novel contexts that adolescents encounter.

Dose-dependent effects of alcohol injections on omission-contingency learning have an inverted-U pattern

Previous examinations of the long-term effects of alcohol exposure on omission-contingency learning have produced mixed results across different age or sex groups, with evidence for faster learning or no effect. However, none of these experiments made comparisons using the same exposure-dose across the age/sex groups. Here, we exposed rats to 6 weeks of alcohol injections (3 days/week, 1.75 or 3.5 g/kg/24-h, i.p. broken up into 2 injections/day) in adolescent/early adult males or females (PND27-66) or adult males (PND62-101). We then tested the rats in autoshaping and omission-contingency tasks. In contrast to our hypotheses, the low 1.75-g/kg/24-h dose led to slower omission learning and the higher 3.5-g/kg/24-h dose had no effect. There were no age- or sex-differences in omission learning. Additionally, during autoshaping training, rats exposed in adolescence/early adulthood had a faster shift to sign-tracking in their sign-tracking/goal-tracking ratios than rats exposed in adulthood, with no consistent effect of alcohol exposure or sex-differences. Our results suggest complex effects of alcohol on the neural substrates of omission-contingency learning at different doses, which will require future investigation.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

The role of the paraventricular nucleus of the thalamus in the augmentation of heroin seeking induced by chronic food restriction

Drug addiction is a chronic disorder that is characterized by compulsive drug seeking and involves cycling between periods of compulsive drug use, abstinence, and relapse. In both human addicts and animal models of addiction, chronic food restriction has been shown to increase rates of relapse. Previously, our laboratory has demonstrated a robust increase in drug seeking following a period of withdrawal in chronically food-restricted rats compared with sated rats. To date, the neural mechanisms that mediate the effect of chronic food restriction on drug seeking have not been elucidated. However, the paraventricular nucleus of the thalamus (PVT) appears to be a promising target to investigate. The objective of the current study was to examine the role of the PVT in the augmentation of heroin seeking induced by chronic food restriction. Male Long-Evans rats were trained to self-administer heroin for 10 days. Rats were then removed from the training chambers and experienced a 14-day withdrawal period with either unrestricted (sated) or mildly restricted (FDR) access to food. On day 14, rats underwent a 1-hour heroin-seeking test under extinction conditions, during which neural activity in the PVT was either inhibited or increased using pharmacological or chemogenetic approaches. Unexpectedly, inhibition of the PVT did not alter heroin seeking in food-restricted or sated rats, while enhancing neural activity in the PVT-attenuated heroin seeking in food-restricted rats. These results indicate that PVT activity can modulate heroin seeking induced by chronic food restriction.

Increased Goal Tracking in Adolescent Rats Is Goal-Directed and Not Habit-Like

When a cue is paired with reward in a different location, some animals will approach the site of reward during the cue, a behavior called goal tracking, while other animals will approach and interact with the cue itself: a behavior called sign tracking. Sign tracking is thought to reflect a tendency to transfer incentive salience from the reward to the cue. Adolescence is a time of heightened sensitivity to rewards, including environmental cues that have been associated with rewards, which may account for increased impulsivity and vulnerability to drug abuse. Surprisingly, however, studies have shown that adolescents are actually less likely to interact with the cue (i.e., sign track) than adult animals. We reasoned that adolescents might show decreased sign tracking, accompanied by increased apparent goal tracking, because they tend to attribute incentive salience to a more reward-proximal "cue": the food magazine. On the other hand, adolescence is also a time of enhanced exploratory behavior, novelty-seeking, and behavioral flexibility. Therefore, adolescents might truly express more goal-directed reward-seeking and less inflexible habit-like approach to a reward-associated cue. Using a reward devaluation procedure to distinguish between these two hypotheses, we found that adolescents indeed exhibit more goal tracking, and less sign tracking, than a comparable group of adults. Moreover, adolescents' goal tracking behavior is highly sensitive to reward devaluation and therefore goal-directed and not habit-like.

Adolescent but not adult Sprague-Dawley rats display goal-directed responding after reward devaluation

Alcohol drinking is typically initiated in adolescence, with use sometimes escalating to problematic levels. Escalation of drinking is often associated with a shift in drinking motives, with goal-directed initial use later transitioning to more habitual behavior. This study assessed whether adolescents are more sensitive than adults to habit formation when indexed via insensitivity to reward devaluation in an operant task for food reward. Adolescent and adult Sprague-Dawley rats were trained on either a random ratio (RR) or random interval (RI) schedule before undergoing devaluation. Adolescent animals on both schedules increased the number of lever presses across all training days. In contrast, adults in the RR group increased the number of lever presses across days whereas RI adults remained relatively stable. In response to pellet devaluation, only adolescents exhibited reduced responding, suggestive of goal-directed behavior, whereas no age differences were evident following control (home cage chow) devaluation. Contrary to our hypothesis, adolescents (but not adults) displayed goal-directed responding indexed via sensitivity to reward devaluation. These findings suggest that adolescents are not necessarily more likely to develop habits than adults, and hence other factors may contribute to the greater propensity of adolescents to engage in and escalate alcohol use.

Voluntary elevated ethanol consumption in adolescent Sprague-Dawley rats: Procedural contributors and age-specificity

Alcohol consumption is typically initiated during adolescence, with the incidence of binge drinking (production of blood ethanol concentrations [BECs] > 80 mg/dL) peaking during this stage of development. Studies in outbred rats investigating the consequences of adolescent ethanol exposure have typically employed intragastric, vapor, or intraperitoneal administration to attain BECs in this range. While these procedures have yielded valuable data regarding the consequences of adolescent exposure, they are varyingly stressful, administer the full dose at once, and/or bypass digestion. Consequently, we have worked to develop a model of voluntary elevated ethanol consumption in outbred adolescent Sprague-Dawley males and females, building on our previous work (see Hosová & Spear, 2017). This model utilizes daily 30-min access to 10% ethanol (v/v) in chocolate Boost® from postnatal day (P)28-41. Experiment 1 compared intake levels between (1a) animals given either ball-bearing or open-ended sipper tube tips for solution access, (1b) animals separated from their cage mate by wire mesh or isolated to a separate cage during solution access, (1c) animals given solution access with or without simultaneous access to banana-flavored sugar pellets, and (1d) animals that were either moderately food-restricted or fed ad libitum. Experiment 2 compared intake levels between animals given daily solution access and animals given access only on a "Monday-Wednesday-Friday" intermittent schedule. Experiment 3 compared adolescent and adult (P70-83) consumption using the finalized procedure as based on the results of Experiments 1 and 2. As in our previous work, consumptions well within the binge range were produced on some days, with high-consumption days typically followed by several days of lower consumption before increasing again. Sipper tube type (1a) and simultaneous pellet access (1c) did not affect consumption, while intake was significantly higher in non-isolated (1b), food-restricted (1d), daily-access (2), and adolescent (3) animals. However, although ethanol intake was higher in food-restricted animals, the resulting BECs were equivalent or higher in non-restricted animals, likely due to a hepatoprotective effect of moderate food restriction. Post-consumption intoxication ratings correlated with BECs and were notably higher in adults than adolescents, despite the lower voluntary consumption levels of adults, confirming prior reports of the attenuated sensitivity of adolescents to ethanol intoxication relative to adults. The final model utilized ball-bearing sipper tube tips to provide daily access to 10% ethanol in chocolate Boost® to free-feeding adolescent animals separated from their cage mate by wire mesh, with no food provided during solution access. This easy-to-implement model is effective in producing elevated voluntary ethanol consumption in adolescent, but not adult, Sprague-Dawley rats.

Offspring of male rats exposed to binge alcohol exhibit heightened ethanol intake at infancy and alterations in T-maze performance

Alcohol use is associated with a variety of negative consequences, including heightened likelihood of cognitive impairment, proclivity to alcohol use disorders (AUD), and alterations in the drinker's offspring. Children and rodents exposed to alcohol during pregnancy, or those whose fathers consumed alcohol prior to mating, often exhibit neurodevelopmental, physiological, and behavioral deficits. The present study assessed cognitive function and alcohol intake in male and female rats that were offspring of alcohol-exposed fathers. Adult male rats were exposed to alcohol or vehicle (0.0 or 2.0 g/kg, respectively; twice daily for 2 days followed by a rest day, for a total of eight alcohol or vehicle exposure days), or were left untreated and then mated with non-manipulated females. The offspring were assessed for alcohol intake, via intraoral infusion, followed by cognitive assessment via an alternating T-maze task. The results indicated that paternal ethanol exposure, prior to breeding, resulted in offspring that consumed significantly more ethanol than vehicle or untreated controls. Furthermore, the offspring of alcohol-exposed fathers exhibited a significant failure to initiate and complete the T-maze performance tests. Although, when they did engage in the tests they performed at the level of controls (i.e., 80% correct). The present results add to a growing body of literature suggesting that paternal pre-conception alcohol exposure can have deleterious effects on the offspring.

Ethanol Exposure History and Alcoholic Reward Differentially Alter Dopamine Release in the Nucleus Accumbens to a Reward-Predictive Cue

BACKGROUND

Conditioned stimuli (CS) that predict reward delivery acquire the ability to induce phasic dopamine release in the nucleus accumbens (NAc). This dopamine release may facilitate conditioned approach behavior, which often manifests as approach to the site of reward delivery (called "goal-tracking") or to the CS itself (called "sign-tracking"). Previous research has linked sign-tracking in particular to impulsivity and drug self-administration, and addictive drugs may promote the expression of sign-tracking. Ethanol (EtOH) acutely promotes phasic release of dopamine in the accumbens, but it is unknown whether an alcoholic reward alters dopamine release to a CS. We hypothesized that Pavlovian conditioning with an alcoholic reward would increase dopamine release triggered by the CS and subsequent sign-tracking behavior. Moreover, we predicted that chronic intermittent EtOH (CIE) exposure would promote sign-tracking while acute administration of naltrexone (NTX) would reduce it.

METHODS

Rats received 14 doses of EtOH (3 to 5 g/kg, intragastric) or water followed by 6 days of Pavlovian conditioning training. Rewards were a chocolate solution with or without 10% (w/v) alcohol. We used fast-scan cyclic voltammetry to measure phasic dopamine release in the NAc core in response to the CS and the rewards. We also determined the effect of NTX (1 mg/kg, subcutaneous) on conditioned approach.

RESULTS

Both CIE and alcoholic reward, individually but not together, associated with greater dopamine to the CS than control conditions. However, this increase in dopamine release was not linked to greater sign-tracking, as both CIE and alcoholic reward shifted conditioned approach from sign-tracking behavior to goal-tracking behavior. However, they both also increased sensitivity to NTX, which reduced goal-tracking behavior.

CONCLUSIONS

While a history of EtOH exposure or alcoholic reward enhanced dopamine release to a CS, they did not promote sign-tracking under the current conditions. These findings are consistent with the interpretation that EtOH can stimulate conditioned approach, but indicate that the conditioned response may manifest as goal-tracking.

Adolescent food restriction in rats alters prefrontal cortex microglia in an experience-dependent manner

Microglia are resident immune cells of the brain that can regulate neural communication and excitability. Any environmental influence on microglial activity has the potential to alter subsequent neural physiology and behavior. Within the prefrontal cortex, several types of stressors have been shown to increase microglial expression of activation markers such as ionized calcium-binding adapter molecule-1 (Iba-1), which suggests altered microglial activity. Recent reports in rodents suggest that exposure to forms of early-life stress such as maternal separation can alter microglial responsivity to subsequent challenges. Several learning paradigms used in rodents require food restriction to provoke motivational states that facilitate approach behaviors. Here, we tested whether food restriction (increasing from 13 g/day-23 g/day in males and 10 g/day-20 g/day in females, which reduced body weight to 72-84% free-fed weight) in adolescent rats is a sufficient challenge to affect microglial Iba-1 expression, and whether previous exposure to postnatal maternal separation influenced microglial outcomes. We measured prefrontal cortex Iba-1 expression and microglial morphology after 20 days of ad libitum or restricted food availability in males and females with or without exposure to maternal separation. Food-restricted animals displayed higher levels of Iba-1 in the prefrontal cortex, with hyper-ramified microglial morphology in maternally separated males and control females, compared to those that were free-fed. Together, our data provide evidence that food restriction paradigms may have unintended effects in some behavioral protocols.

Increased sign-tracking behavior in adolescent rats

An autoshaping procedure was used to test the notion that conditioned stimuli (CSs) gain greater incentive salience during adolescence than young adulthood under conditions of social isolation rearing and food restriction. Rats were single-housed and placed on food restriction during 10 daily training sessions in which a lever (CS⁺ ) was presented then followed immediately by a food unconditioned stimulus (US). A second lever (CS^- ) was presented on intermixed trials and was not reinforced. Despite the fact that food delivery was not contingent on the rats' behavior, all rats exhibited behaviors directed towards the lever (i.e., sign-tracking). In the adolescent group, the rate of lever pressing and the percentage of trials with a lever press were higher than in young adults. Initially, group differences were observed when rats were retrained when the adolescents had reached young adulthood. These findings support the hypothesis that cues that come to predict reward become imbued with excessive motivational value in adolescents, perhaps contributing to the hyper-responsiveness to reward-related stimuli typically observed during this period of development.

Long-lasting contribution of dopamine in the nucleus accumbens core, but not dorsal lateral striatum, to sign-tracking

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

Methyl donor supplementation alters cognitive performance and motivation in female offspring from high-fat diet-fed dams

During gestation, fetal nutrition is entirely dependent on maternal diet. Maternal consumption of excess fat during pregnancy has been linked to an increased risk of neurologic disorders in offspring, including attention deficit/hyperactivity disorder, autism, and schizophrenia. In a mouse model, high-fat diet (HFD)-fed offspring have cognitive and executive function deficits as well as whole-genome DNA and promoter-specific hypomethylation in multiple brain regions. Dietary methyl donor supplementation during pregnancy or adulthood has been used to alter DNA methylation and behavior. Given that extensive brain development occurs during early postnatal life-particularly within the prefrontal cortex (PFC), a brain region critical for executive function-we examined whether early life methyl donor supplementation (e.g., during adolescence) could ameliorate executive function deficits observed in offspring that were exposed to maternal HFD. By using operant testing, progressive ratio, and the PFC-dependent 5-choice serial reaction timed task (5-CSRTT), we determined that F1 female offspring (B6D2F1/J) from HFD-fed dams have decreased motivation (decreased progressive ratio breakpoint) and require a longer stimulus length to complete the 5-CSRTT task successfully, whereas early life methyl donor supplementation increased motivation and shortened the minimum stimulus length required for a correct response in the 5-CSRTT. Of interest, we found that expression of 2 chemokines, CCL2 and CXCL10, correlated with the median stimulus length in the 5-CSRTT. Furthermore, we found that acute adult supplementation of methyl donors increased motivation in HFD-fed offspring and those who previously received supplementation with methyl donors. These data point to early life as a sensitive time during which dietary methyl donor supplementation can alter PFC-dependent cognitive behaviors.-McKee, S. E., Grissom, N. M., Herdt, C. T., Reyes, T. M. Methyl donor supplementation alters cognitive performance and motivation in female offspring from high-fat diet-fed dams.

Voluntary Binge Consumption of Ethanol in a Sweetened, Chocolate-Flavored Solution by Male and Female Adolescent Sprague Dawley Rats

BACKGROUND

The still maturing adolescent brain may be particularly vulnerable to lasting consequences of ethanol (EtOH) exposure. Yet, human adolescents are the age group most likely to engage in binge drinking (a pattern of drinking leading to blood EtOH concentrations (BECs) of 80 mg/dl or greater). Most studies to date assessing the long-term effects of adolescent EtOH exposure in outbred rodent populations have either used experimenter-administered EtOH to produce BECs in the binge range or assessed voluntary intake of EtOH at well below binge levels. Beginning with a modified schedule-induced polydipsia (SIP) procedure, this study examined the suitability of several approaches to induce voluntary binge-like consumption during adolescence in an outbred rat strain.

METHODS

Adolescent male and female Sprague Dawley rats were food deprived to 85% projected free-feeding weights beginning on postnatal day (P) 24 and were given 30 minutes of access to 10% EtOH in chocolate Boost^® or Boost^® alone daily from P28 to P41 (followed later by their daily allocation of food). Animals were tested within operant chambers (Exp. 1a, 1b and Exp. 2) or home and novel cages (Exp. 3). Animals received either scheduled delivery of banana pellets to examine SIP (Exp. 1a,b) or massed pellet presentation (Exp. 2 and Exp. 3). Blood samples were collected via the lateral tail vein on P33 and P41.

RESULTS

Intakes produced BECs frequently in the binge range (>80 mg/dl) and modeled binge-like consumption patterns, with high consumption days typically followed by 1 to 2 days of lower consumption; this variability was less evident with Boost^® alone. Consumption was not schedule induced and was generally high across all studies, although consumption in males appeared to be particularly pronounced when animals were tested in the presence of their cage mate.

CONCLUSIONS

Binge-like patterns of EtOH consumption were produced using these procedures in adolescent Sprague Dawley rats of both sexes and may prove to be a useful model for work examining the short- and long-term consequences of high levels of voluntary EtOH intake in adolescence.

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse.

Pavlovian Conditioned Approach Training in Rats

Cues that are contingently paired with unconditioned, rewarding stimuli can acquire rewarding properties themselves through a process known as the attribution of incentive salience, or the transformation of neutral stimuli into attractive, "wanted' stimuli capable of motivating behavior. Pavlovian conditioned approach (PCA) develops after the response-independent presentation of a conditioned stimulus (CS; e.g., a lever) that predicts the delivery of an unconditioned stimulus (US; e.g., a food pellet) and can be used to measure incentive salience. During training, three patterns of conditioned responses (CRs) can develop: sign-tracking behavior (CS-directed CR), goal-tracking behavior (US-directed CR), and an intermediate response (both CRs). Sign-trackers attribute incentive salience to reward-related cues and are more vulnerable to cue-induced reinstatement of drug-seeking as well as other addiction-related behaviors, making PCA a potentially valuable procedure for studying addiction vulnerability. Here, we describe materials and methods used to elicit PCA behavior from rats as well as analyze and interpret PCA behavior in individual experiments.

Adolescent Alcohol Exposure Amplifies the Incentive Value of Reward-Predictive Cues Through Potentiation of Phasic Dopamine Signaling

Adolescent alcohol use remains a major public health concern due in part to well-established findings implicating the age of onset in alcohol use in the development of alcohol use disorders and persistent decision-making deficits in adults. We have previously demonstrated that moderate adolescent alcohol consumption in rats promotes suboptimal decision making and an associated perturbation in mesolimbic dopamine transmission in adulthood. Dopamine-dependent incentive learning processes are an integral component of value-based decision making and a fundamental element to many theoretical accounts of addiction. Thus we tested the hypothesis that adolescent alcohol use selectively alters incentive learning processes through perturbation of mesolimbic dopamine systems. To assess incentive learning, behavioral and neurochemical measurements were made during the acquisition, maintenance, extinction, and reacquisition of a Pavlovian conditioned approach procedure in adult rats with a history of adolescent alcohol consumption. We show that moderate adolescent alcohol consumption potentiates stimulus-evoked phasic dopamine transmission, measured in vivo by fast-scan cyclic voltammetry, in adulthood and biases individuals toward a dopamine-dependent incentive learning strategy. Moreover, we demonstrate that animals exposed to alcohol in adolescence are more sensitive to an unexpected variation in reward outcomes. This pattern of phasic dopamine signaling and the associated bias in learning may provide a mechanism for the well-documented vulnerability of individuals with early-life alcohol use for alcohol use disorders in adulthood.

Sex and strain influence attribution of incentive salience to reward cues in mice

The propensity to attribute incentive salience to reward cues, measured by Pavlovian sign-tracking, is strongly associated with addiction-related traits including cocaine self-administration, impulsivity, novelty reactivity, and novelty preference. Despite its critical role in addiction, the genetic underpinnings of incentive salience attribution and its relationship to drug addiction are unknown. Mouse genetics can be a powerful means to discover genetic mechanisms underlying this relationship. However, feasibility of genetic dissection of sign-tracking in mice is unknown as only a single study limited to male C57BL/6J mice has rigorously examined this behavior, and limited sign-tracking was observed. Highly diverse mouse populations such as the Collaborative Cross (CC) and Diversity Outbred population (DO) possess a greater range of behavioral and genetic variation than conventional laboratory strains. In the present study, we evaluated sign-tracking and the related phenotype goal-tracking in mice of both sexes from five inbred CC and DO founder strains. Male CAST/EiJ mice exhibited robust sign-tracking; male NOD, male C57BL/6J, and female A/J mice also exhibited significant sign-tracking. Male and female mice from all strains exhibited significant goal-tracking, and significant strain and sex differences were observed. Sign-tracking in males was genetically correlated with exploration of a novel environment, and heritability of sign-tracking and goal-tracking ranged from .32 to .41. These data highlight the importance of considering genetic diversity when evaluating the occurrence of specific behavioral traits in the laboratory mouse and demonstrate that the CC and DO mouse populations can be used to discover mechanisms underlying genetic relationships among sign-tracking and addiction-related behaviors.

Adolescent rats are resistant to forming ethanol seeking habits

•

Adult rats develop ethanol-seeking habits more rapidly than adolescents.

•

Adolescents appear resistant to the habit promoting effects of ethanol.

•

Adolescent rats self-administer more ethanol than adults.

•

Adolescent onset ethanol self-administration results in greater self-administration in adulthood.

Early age of onset alcohol drinking is significantly more likely to lead to alcohol use disorders (AUDs) than alcohol drinking that begins after the age of 18. Unfortunately, the majority of people in the United States begin drinking in adolescence. Therefore, it is important to understand how early alcohol drinking leads to increased risk for AUDs so that better treatments and prevention strategies can be developed. Adolescents perceive greater rewarding properties of alcohol, and adolescents may be more likely to form alcohol-seeking habits that promote continued use throughout the lifetime. Therefore, we compared the development of alcohol seeking habits in adolescent and adult male, Sprague-Dawley rats. Rats were trained to lever press to receive 10% ethanol + 0.1% saccharin on a schedule that promotes habit formation. Rats were tested using a contingency degradation procedure at different points in training. Adult rats formed ethanol-seeking habits with only moderate training, while adolescents remained goal-directed even with extended training. Nevertheless, adolescents consumed more ethanol than adults throughout the experiment and continued to consume more ethanol than adults when they reached adulthood. Therefore, early onset alcohol use may promote AUD formation through establishment of high levels of drinking that becomes habitual in adulthood.

Reward components of feeding behavior are preserved during mouse aging

Eating behavior depends on associations between the sensory and energetic properties of foods. Healthful balance of these factors is a challenge for industrialized societies that have an abundance of food, food choices and food-related cues. Here, we were interested in whether appetitive conditioning changes as a function of age. Operant and pavlovian conditioning experiments (rewarding stimulus was a palatable food) in male mice (aged 3, 6, and 15 months) showed that implicit (non-declarative) memory remains intact during aging. Two other essential components of eating behavior, motivation and hedonic preference for rewarding foods, were also found not to be altered in aging mice. Specifically, hedonic responding by satiated mice to isocaloric foods of differing sensory properties (sucrose, milk) was similar in all age groups; importantly, however, this paradigm disclosed that older animals adjust their energy intake according to energetic need. Based on the assumption that the mechanisms that control feeding are conserved across species, it would appear that overeating and obesity in humans reflects a mismatch between ancient physiological mechanisms and today's cue-laden environment. The implication of the present results showing that aging does not impair the ability to learn stimulus-food associations is that the risk of overeating in response to food cues is maintained through to old age.