Age and sex differences in behavioral flexibility, sensitivity to reward value, and risky decision-making

Fractionating impulsivity and reward-related phenotypes in adolescent mice

Adolescence is a developmental period characterized by changes in the brain and behavior, including heightened reward seeking, increased impulsivity, and elevated risk-taking behavior. It is also a sensitive period for the development of a number of behavioral and psychiatric disorders associated with pathological phenotypes of reward processing and impulsivity. Landmark human studies are charting the development of impulsivity and other reward-related phenotypes to identify the facets and timecourse of the adolescent phenotype. Collecting similar data from mice is important to enable molecular, cellular, and circuit-level interrogation of adolescent maturation of reward, motivation, and impulsive behavior. These complex phenotypes have traditionally been difficult to assay in adolescent mice. Here, using a combination of approaches including homecage testing, we tested a number of facets of reward seeking, impulsivity, motivation, and incentive salience attribution during adolescent development. We found that adolescent mice show increased reward seeking, impulsive action, and motivation. Interestingly, we found no effect of adolescence on impulsive choice, sign-tracking, reward-learning, or conditioned reinforcement. Overall, our studies set the stage for approaches to study multi-faceted phenotypes related to impulsivity and other reward-related behaviors in adolescent mice to examine the developmental trajectories of brain and behavior.

The scheduling of adolescence with Netrin-1 and UNC5C

Dopamine axons are the only axons known to grow during adolescence. Here, using rodent models, we examined how two proteins, Netrin-1 and its receptor, UNC5C, guide dopamine axons toward the prefrontal cortex and shape behaviour. We demonstrate in mice (Mus musculus) that dopamine axons reach the cortex through a transient gradient of Netrin-1-expressing cells - disrupting this gradient reroutes axons away from their target. Using a seasonal model (Siberian hamsters; Phodopus sungorus) we find that mesocortical dopamine development can be regulated by a natural environmental cue (daylength) in a sexually dimorphic manner - delayed in males, but advanced in females. The timings of dopamine axon growth and UNC5C expression are always phase-locked. Adolescence is an ill-defined, transitional period; we pinpoint neurodevelopmental markers underlying this period.

Sex-Specific Mechanisms Underlie Long-Term Potentiation at Hippocampus→Medium Spiny Neuron Synapses in the Medial Shell of the Nucleus Accumbens

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp→NAc synapses is rewarding, and mice can establish learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigated sex differences in the mechanisms underlying Hipp→NAc LTP using whole-cell electrophysiology and pharmacology. We observed similarities in basal synaptic strength between males and females and found that LTP occurs postsynaptically with similar magnitudes in both sexes. However, key sex differences emerged as LTP in males required NMDA receptors (NMDAR), whereas LTP in females utilized an NMDAR-independent mechanism involving L-type voltage-gated Ca2+ channels (VGCCs) and estrogen receptor α (ERα). We also uncovered sex-similar features as LTP in both sexes depended on CaMKII activity and occurred independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

Short-Term Memory Capacity Predicts Willingness to Expend Cognitive Effort for Reward

We must often decide whether the effort required for a task is worth the reward. Past rodent work suggests that willingness to deploy cognitive effort can be driven by individual differences in perceived reward value, depression, or chronic stress. However, many factors driving cognitive effort deployment-such as short-term memory ability-cannot easily be captured in rodents. Furthermore, we do not fully understand how individual differences in short-term memory ability, depression, chronic stress, and reward anticipation impact cognitive effort deployment for reward. Here, we examined whether these factors predict cognitive effort deployment for higher reward in an online visual short-term memory task. Undergraduate participants were grouped into high and low effort groups (n HighEffort = 348, n LowEffort = 81; n Female = 332, n Male = 92, M Age = 20.37, Range Age = 16-42) based on decisions in this task. After completing a monetary incentive task to measure reward anticipation, participants completed short-term memory task trials where they could choose to encode either fewer (low effort/reward) or more (high effort/reward) squares before reporting whether or not the color of a target square matched the square previously in that location. We found that only greater short-term memory ability predicted whether participants chose a much higher proportion of high versus low effort trials. Drift diffusion modeling showed that high effort group participants were more biased than low effort group participants toward selecting high effort trials. Our findings highlight the role of individual differences in cognitive effort ability in explaining cognitive effort deployment choices.

Methamphetamine increases risky choice in rats, but only when magnitude and probability of reinforcement are manipulated within a session

Risky choice is associated with maladaptive behaviors, particularly substance use disorders. Current animal models of risky choice are often confounded by other constructs like behavioral flexibility and suboptimal choice. The purpose of the current experiment was to determine if the psychostimulant methamphetamine, a drug whose popularity has increased in recent years, increases risky choice in an equivalent expected value (EEV) task. In the EEV task, rats are given a choice between two reinforcer alternatives that differ in magnitude and probability of delivery, but have equivalent expected value. Forty-eight Sprague Dawley rats were tested in three versions of the EEV task. In the first version of the EEV task, both reinforcer magnitude and probability were adjusted across blocks of trials for both alternatives. In the second and the third versions of the EEV task, reinforcer magnitude was held constant across each block of trials (either 1 vs. 2 pellets or 4 vs. 5 pellets). We found that male rats preferred the "riskier" option, except when reinforcer magnitudes were held constant at 4 and 5 pellets across each block of trials. Methamphetamine (0.5 mg/kg) increased preference for the risky option in both males and females, but only when both reinforcer magnitude and probability were manipulated across blocks of trials for each alternative. The current results demonstrate that both magnitude of reinforcement and probability of reinforcement interact to influence risky choice. Overall, this study provides additional support for using reinforcers with expected value to measure risky choice.

The scheduling of adolescence with Netrin-1 and UNC5C

Dopamine axons are the only axons known to grow during adolescence. Here, using rodent models, we examined how two proteins, Netrin-1 and its receptor, UNC5C, guide dopamine axons towards the prefrontal cortex and shape behaviour. We demonstrate in mice ( Mus musculus ) that dopamine axons reach the cortex through a transient gradient of Netrin-1 expressing cells - disrupting this gradient reroutes axons away from their target. Using a seasonal model (Siberian hamsters; Phodopus sungorus ) we find that mesocortical dopamine development can be regulated by a natural environmental cue (daylength) in a sexually dimorphic manner - delayed in males, but advanced in females. The timings of dopamine axon growth and UNC5C expression are always phase-locked. Adolescence is an ill-defined, transitional period; we pinpoint neurodevelopmental markers underlying this period.

Sex-specific mechanisms underlie long-term potentiation at hippocampus-nucleus accumbens synapses

Sex differences have complicated our understanding of the neurobiological basis of many behaviors that are key for survival. As such, continued elucidation of the similarities and differences between sexes is necessary in order to gain insight into brain function and vulnerability. The connection between the hippocampus (Hipp) and nucleus accumbens (NAc) is a crucial site where modulation of neuronal activity mediates reward-related behavior. Our previous work demonstrated that long-term potentiation (LTP) of Hipp-NAc synapses is rewarding, and that mice can make learned associations between LTP of these synapses and the contextual environment in which LTP occurred. Here, we investigate sex differences in the mechanisms underlying Hipp-NAc LTP using whole-cell electrophysiology and pharmacology. We found that males and females display similar magnitudes of Hipp-NAc LTP which occurs postsynaptically. However, LTP in females requires L-type voltage-gated Ca 2+ channels (VGCC) for postsynaptic Ca 2+ influx, while males rely on NMDA receptors (NMDAR). Additionally, females require estrogen receptor α (ERα) activity for LTP while males do not. These differential mechanisms converge as LTP in both sexes depends on CAMKII activity and occurs independently of dopamine-1 receptor (D1R) activation. Our results have elucidated sex-specific molecular mechanisms for LTP in an integral excitatory pathway that mediates reward-related behaviors, emphasizing the importance of considering sex as a variable in mechanistic studies. Continued characterization of sex-specific mechanisms underlying plasticity will offer novel insight into the neurophysiological basis of behavior, with significant implications for understanding how diverse processes mediate behavior and contribute to vulnerability to developing psychiatric disorders.

SIGNIFICANCE STATEMENT

Strengthening of Hipp-NAc synapses drives reward-related behaviors. Male and female mice have similar magnitudes of long-term potentiation (LTP) and both sexes have a predicted postsynaptic locus of plasticity. Despite these similarities, we illustrate here that sex-specific molecular mechanisms are used to elicit LTP. Given the bidirectional relationship between Hipp-NAc synaptic strength in mediating reward-related behaviors, the use of distinct molecular mechanisms may explain sex differences observed in stress susceptibility or response to rewarding stimuli. Discovery and characterization of convergent sex differences provides mechanistic insight into the sex-specific function of Hipp-NAc circuitry and has widespread implications for circuits mediating learning and reward-related behavior.

Propensity for risky choices despite lower cue reactivity in adolescent rats

Adolescence is a time of heightened risk-taking across species. Salient audiovisual cues associated with rewards are a common feature of gambling environments and have been connected to increased risky decision-making. We have previously shown that, in adult male rats, sign tracking - a behavioral measure of cue reactivity - predicts an individual's propensity for suboptimal risky choices in a rodent gambling task (rGT) with win-paired cues. However, adolescents perform less sign tracking than adult animals, suggesting that they are less cue-reactive than adults in some circumstances. Therefore, we investigated the performance of adolescent male rats on the rGT with win cues and examined its relationship with their sign-tracking behavior. We found that adolescents make more risky choices and fewer optimal choices on the rGT compared with adults, evidence of the validity of the rGT as a model of adolescent gambling behavior. We also confirmed that adolescents perform less sign tracking than adults, and we found that, unlike in adults, adolescents' sign tracking was unrelated to their risk-taking in the rGT. This implies that adolescent risk-taking is less likely than that of adults to be driven by reward-related cues. Finally, we found that adults trained on the rGT as adolescents retained an adolescent-like propensity toward risky choices, suggesting that early exposure to a gambling environment may have a long-lasting impact on risk-taking behavior.

Paternal morphine exposure in rats reduces social play in adolescent male progeny without affecting drug-taking behavior in juvenile males or female offspring

The ongoing opioid addiction crisis necessitates the identification of novel risk factors to improve prevention and treatment of opioid use disorder. Parental opioid exposure has recently emerged as a potential regulator of offspring vulnerability to opioid misuse, in addition to heritable genetic liability. An understudied aspect of this "missing heritability" is the developmental presentation of these cross-generational phenotypes. This is an especially relevant question in the context of inherited addiction-related phenotypes, given the prominent role of developmental processes in the etiology of psychiatric disorders. Paternal morphine self-administration was previously shown to alter the sensitivity to the reinforcing and antinociceptive properties of opioids in the next generation. Here, phenotyping was expanded to include the adolescent period, with a focus on endophenotypes related to opioid use disorders and pain. Paternal morphine exposure did not alter heroin or cocaine self-administration in male and female juvenile progeny. Further, baseline sensory reflexes related to pain were unaltered in morphine-sired adolescent rats of either sex. However, morphine-sired adolescent males exhibited a reduction in social play behavior. Our findings suggest that, in morphine-sired male offspring, paternal opioid exposure does not affect opioid intake during adolescence, suggesting that this phenotype does not emerge until later in life. Altered social behaviors in male morphine-sired adolescents indicate that the changes in drug-taking behavior in adults sired by morphine-exposed sires may be due to more complex factors not yet fully assessed.

Reward maximization assessed using a sequential patch depletion task in a large sample of heterogeneous stock rats

Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. Males and females did not significantly differ on traditional measures of DD (e.g. delay gradient; AUC). When examining measures of patch utilization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. Consistent with this, there was some evidence that females deviated from reward maximization more than males. However, when controlling for body weight, females had a higher normalized rate of reinforcement than males. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.

Cognitive Flexibility in Mice: Effects of Puberty and Role of NMDA Receptor Subunits

Cognitive flexibility refers to the ability to adapt flexibly to changing circumstances. In laboratory mice, we investigated whether cognitive flexibility is higher in pubertal mice than in adult mice, and whether this difference is related to the expression of distinct NMDA receptor subunits. Using the attentional set shifting task as a measure of cognitive flexibility, we found that cognitive flexibility was increased during puberty. This difference was more pronounced in female pubertal mice. Further, the GluN2A subunit of the NMDA receptor was more expressed during puberty than after puberty. Pharmacological blockade of GluN2A reduced the cognitive flexibility of pubertal mice to adult levels. In adult mice, the expression of GluN2A, GluN2B, and GluN2C in the orbitofrontal cortex correlated positively with performance in the attentional set shifting task, whereas in pubertal mice this was only the case for GluN2C. In conclusion, the present study confirms the observation in humans that cognitive flexibility is higher during puberty than in adulthood. Future studies should investigate whether NMDA receptor subunit-specific agonists are able to rescue deficient cognitive flexibility, and whether they have the potential to be used in human diseases with deficits in cognitive flexibility.

Reward Maximization Assessed Using a Sequential Patch Depletion Task in a Large Sample of Heterogeneous Stock Rats

Choice behavior requires animals to evaluate both short- and long-term advantages and disadvantages of all potential alternatives. Impulsive choice is traditionally measured in laboratory tasks by utilizing delay discounting (DD), a paradigm that offers a choice between a smaller immediate reward, or a larger more delayed reward. This study tested a large sample of Heterogeneous Stock (HS) male (n = 896) and female (n = 898) rats, part of a larger genetic study, to investigate whether measures of reward maximization overlapped with traditional models of delay discounting via the patch depletion model using a Sequential Patch Depletion procedure. In this task, rats were offered a concurrent choice between two water "patches" and could elect to "stay" in the current patch or "leave" for an alternative patch. Staying in the current patch resulted in decreasing subsequent reward magnitudes, whereas the choice to leave a patch was followed by a delay and a resetting to the maximum reward magnitude. Based on the delay in a given session, different visit durations were necessary to obtain the maximum number of rewards. Visit duration may be analogous to an indifference point in traditional DD tasks. While differences in traditional DD measures (e.g., delay gradient) have been detected between males and females, these effects were small and inconsistent. However, when examining measures of reward maximization, females made fewer patch changes at all delays and spent more time in the patch before leaving for the alternative patch compared to males. This pattern of choice resulted in males having a higher rate of reinforcement than females. Consistent with this, there was some evidence that females deviated from the optimal more, leading to less reward. Measures of reward maximization were only weakly associated with traditional DD measures and may represent distinctive underlying processes. Taken together, females performance differed from males with regard to reward maximization that were not observed utilizing traditional measures of DD, suggesting that the patch depletion model was more sensitive to modest sex differences when compared to traditional DD measures in a large sample of HS rats.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Factors modulating the incubation of drug and non-drug craving and their clinical implications

It was suggested in 1986 that cue-induced cocaine craving increases progressively during early abstinence and remains high during extended periods of time. Clinical evidence now supports this hypothesis and that this increase is not specific to cocaine but rather generalize across several drugs of abuse. Investigators have identified an analogous incubation phenomenon in rodents, in which time-dependent increases in cue-induced drug seeking are observed after abstinence from intravenous drug or palatable food self-administration. Incubation of craving is susceptible to variation in magnitude as a function of biological and/or the environmental circumstances surrounding the individual. During the last decade, the neurobiological correlates of the modulatory role of biological (sex, age, genetic factors) and environmental factors (environmental enrichment and physical exercise, sleep architecture, acute and chronic stress, abstinence reinforcement procedures) on incubation of drug craving has been investigated. In this review, we summarized the behavioral procedures adopted, the key underlying neurobiological correlates and clinical implications of these studies.

Acute vagus nerve stimulation enhances reversal learning in rats

Cognitive flexibility is a prefrontal cortex-dependent neurocognitive process that enables behavioral adaptation in response to changes in environmental contingencies. Electrical vagus nerve stimulation (VNS) enhances several forms of learning and neuroplasticity, but its effects on cognitive flexibility have not been evaluated. In the current study, a within-subjects design was used to assess the effects of VNS on performance in a novel visual discrimination reversal learning task conducted in touchscreen operant chambers. The task design enabled simultaneous assessment of acute VNS both on reversal learning and on recall of a well-learned discrimination problem. Acute VNS delivered in conjunction with stimuli presentation during reversal learning reliably enhanced learning of new reward contingencies. Enhancement was not observed, however, if VNS was delivered during the session but was not coincident with presentation of to-be-learned stimuli. In addition, whereas VNS delivered at 30 HZ enhanced performance, the same enhancement was not observed using 10 or 50 Hz. Together, these data show that acute VNS facilitates reversal learning and indicate that the timing and frequency of the VNS are critical for these enhancing effects. In separate rats, administration of the norepinephrine reuptake inhibitor atomoxetine also enhanced reversal learning in the same task, consistent with a noradrenergic mechanism through which VNS enhances cognitive flexibility.

Incubation of Oxycodone Craving Following Adult-Onset and Adolescent-Onset Oxycodone Self-Administration in Male Rats

Relapse is a major obstacle to curb the ongoing epidemic of prescription opioid abuse. We and others previously demonstrated that oxycodone seeking in adult rats progressively increases after abstinence from oxycodone self-administration (incubation of oxycodone craving). In humans, the onset of oxycodone use in adolescents may increase individuals' vulnerability to later opioid addiction. However, little is known about incubation of oxycodone craving after adolescent-onset oxycodone self-administration in rats. In the first study, we trained single-housed adolescent (postnatal day 35 at start) and adult (postnatal day 77 at start) male Sprague-Dawley rats to self-administer oxycodone (0.1 mg/kg/infusion, 6 h/day for 10 days) and then tested oxycodone relapse on both abstinence day 1 and day 15. Given that social experience is critical for neurobehavioral development in adolescents, we performed the second study using group-housed adolescent and adult rats. In both studies, we observed no age differences in oxycodone self-administration and incubated oxycodone seeking on abstinence day 15. However, on abstinence day 1, we observed decreased oxycodone seeking in adolescents compared with adults. This pattern of data led to elevated incubation slopes in adolescent rats compared with adult rats. Finally, group-housed rats exhibited attenuated oxycodone seeking compared with single-housed rats on abstinence day 15, but not on day 1. Taken together, these data suggest that adolescents may be resistant to oxycodone relapse during early abstinence, but this resistance dissipates quickly during the transition between adolescent and young adulthood. In addition, group-housing plays a protective role against incubated oxycodone craving.

Risk-Based Decision Making: A Systematic Scoping Review of Animal Models and a Pilot Study on the Effects of Sleep Deprivation in Rats

Animals, including humans, frequently make decisions involving risk or uncertainty. Different strategies in these decisions can be advantageous depending the circumstances. Short sleep duration seems to be associated with more risky decisions in humans. Animal models for risk-based decision making can increase mechanistic understanding, but very little data is available concerning the effects of sleep. We combined primary- and meta-research to explore the relationship between sleep and risk-based decision making in animals. Our first objective was to create an overview of the available animal models for risky decision making. We performed a systematic scoping review. Our searches in Pubmed and Psychinfo retrieved 712 references, of which 235 were included. Animal models for risk-based decision making have been described for rodents, non-human primates, birds, pigs and honey-bees. We discuss task designs and model validity. Our second objective was to apply this knowledge and perform a pilot study on the effect of sleep deprivation. We trained and tested male Wistar rats on a probability discounting task; a “safe” lever always resulted in 1 reward, a “risky” lever resulted in 4 or no rewards. Rats adapted their preferences to variations in reward probabilities (p < 0.001), but 12 h of sleep deprivation during the light phase did not clearly alter risk preference (p = 0.21).

The effects of age, sex, and handling on behavioral parameters in the multivariate concentric square field™ test

The multivariate concentric square field™ (MCSF) is a complex and ethologically relevant apparatus that is designed to measure several behavioral parameters within the same test session including risk-taking, risk-assessment, shelter-seeking (anxiety relieving), exploration, and general activity. While several studies have behaviorally and pharmacologically validated the use of the MCSF in adults, far fewer have used adolescents. Given the well-established link between adolescence and risk-taking, it is important to validate use of the MCSF in adolescence. The present study compared the effects of age, sex, and handling on behavioral categories in the MCSF. In addition, principal component analyses were used to compare the underlying behavioral components in adolescent and adult Sprague-Dawley rats. Results revealed that handling increased risk-taking and reduced shelter-seeking. Females were more exploratory than males, but no compelling age differences in risk-taking or risk-assessment were found. Principal component analyses revealed six major principal components for both adolescents and adults with the first and second components consisting mainly of center/center circle, risk-assessment, and shelter-seeking variables in adolescence, and general activity and center/center circle variables in adults. These results confirm age differences in the underlying behavioral components in the MCSF.

Sex and age differences in locomotor and anxiety-like behaviors in rats: From adolescence to adulthood

Risk-taking behaviors are a primary contributor to elevated adolescent injury and mortality. Locomotor and anxiety-like behaviors in rodents have been used to examine risk-taking. Here, we examined risk-taking behavior (i.e., changes in locomotor and anxiety-like behaviors) from early to late adolescence and adulthood in male and female rats in the open-field (OF) apparatus and the light-dark (LD) test. We also examined whether these behaviors are affected by an early adolescent immune stressor, lipopolysaccharide (LPS). Long-Evans male and female rats were injected with LPS (200 μg/kg) or vehicle control in early adolescence (postnatal day [PND] 30 and 32). Anxiety-like behavior and locomotor activity were measured in early (PND 38-40), late adolescence (PND 50), and adulthood (PND 88 and 98) in the OF and in early adolescence (PND 42) and adulthood (PND 90) in the LD test. Early and late adolescent rats displayed significantly greater locomotor and anxiety-like behaviors than adult rats in the OF and LD test. Sex differences were also found, with adolescent and adult females displaying greater locomotor and anxiety-like behaviors than male rats in the OF and LD tests. LPS administered two times in early adolescence did not have a significant impact on either locomotor or anxiety-like behaviors suggesting minimal impact of the immune stressor.

Reward-predictive cues elicit excessive reward seeking in adolescent rats

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.

AMPed-up adolescents: The role of age in the abuse of amphetamines and its consequences on cognition and prefrontal cortex development

Adolescent use of amphetamine and its closely related, methylated version methamphetamine, is alarmingly high in those who use drugs for nonmedical purposes. This raises serious concerns about the potential for this drug use to have a long-lasting, detrimental impact on the normal development of the brain and behavior that is ongoing during adolescence. In this review, we explore recent findings from both human and laboratory animal studies that investigate the consequences of amphetamine and methamphetamine exposure during this stage of life. We highlight studies that assess sex differences in adolescence, as well as those that are designed specifically to address the potential unique effects of adolescent exposure by including groups at other life stages (typically young adulthood). We consider epidemiological studies on age and sex as vulnerability factors for developing problems with the use of amphetamines, as well as human and animal laboratory studies that tap into age differences in use, its short-term effects on behavior, and the long-lasting consequences of this exposure on cognition. We also focus on studies of drug effects in the prefrontal cortex, which is known to be critically important for cognition and is among the later maturing brain regions. Finally, we discuss important issues that should be addressed in future studies so that the field can further our understanding of the mechanisms underlying adolescent use of amphetamines and its outcomes on the developing brain and behavior.

Sex chromosome complement affects multiple aspects of reversal-learning task performance in mice

Determining the mechanisms by which the sex-chromosome complement (SCC) affects learning, attention, and impulsivity has implications for observed sex differences in prevalence, severity, and prognosis of psychiatric/neurodevelopmental disorders and syndromes associated with sex-chromosome aneuploidy. Here, Four Core Genotypes (FCG) mice were evaluated in order to assess the separable and/or interacting effects of gonads (testes vs. ovaries) and their secretions and/or SCC (XX vs. XY) acting via non-gonadal mechanisms on behavior. We tested FCG mice on a reversal-learning task that enables the quantification of aspects of learning, attention and impulsivity. Across testing phases (involving the initial acquisition of a spatial discrimination and subsequent reversal learning), overall error rate was larger in XY compared with XX mice. Although XX and XY groups did not differ in the total number of trials required in order to reach a preset performance criterion, analyses of reversal error types showed more perseverative errors in XY than XX mice, with no difference in regressive errors. Additionally, prepotent-response latencies during the reversal phase were shorter in XY males, as compared with both XX gonadal males and females of either SCC, and failures to sustain the observing response were more frequent in XY mice than XX mice during the acquisition phase. These results indicate that SCC affects the characteristic pattern of response selection during acquisition and reversal performance without affecting the overall learning rate. More broadly, these results show direct effects of the SCC on cognitive processes that are relevant to psychiatric/neurodevelopmental disorders and syndromes associated with sex-chromosome aneuploidies.

Extended access self-administration of methamphetamine is associated with age- and sex-dependent differences in drug taking behavior and recognition memory in rats

Individuals who begin drug use during early adolescence experience more adverse consequences compared to those initiating later, especially if they are female. The mechanisms for these age and gender differences remain obscure, but studies in rodents suggest that psychostimulants may disrupt the normal ontogeny of dopamine and glutamate systems in the prefrontal cortex (PFC). Here, we studied Sprague-Dawley rats of both sexes who began methamphetamine (METH, i.v.) self-administration in adolescence (postnatal [P] day 41) or adulthood (P91). Rats received seven daily 2-h self-administration sessions with METH or saccharin as the reinforcer, followed by 14 daily long access (LgA; 6 h) sessions. After 7 and 14 days of abstinence, novel object (NOR) or object-in-place (OiP) recognition was assessed. PFC and nucleus accumbens were collected 7 days after the final cognitive test and NMDA receptor subunits and dopamine D1 receptor expression was measured. We found that during LgA sessions, adolescent-onset rats escalated METH intake more rapidly than adult-onset rats, with adolescent-onset females earning the most infusions. Adolescent-onset rats with a history of METH self-administration exhibited modest deficits in OiP compared to their adult-onset counterparts, but there was no sex difference and self-administration groups did not differ from naïve control rats. All rats displayed intact novel object recognition memory. We found no group differences in D1 and NMDA receptor expression, suggesting no long-lasting alteration of ontogenetic expression profiles. Our findings suggest that adolescent-onset drug use is more likely to lead to compulsive-like patterns of drug-taking and modest dysfunction in PFC-dependent cognition.

Reward Responsiveness in the Adolescent Brain Cognitive Development (ABCD) Study: African Americans' Diminished Returns of Parental Education

(1) Background: Reward responsiveness (RR) is a risk factor for high-risk behaviors such as aggressive behaviors and early sexual initiation, which are all reported to be higher in African American and low socioeconomic status adolescents. At the same time, parental education is one of the main drivers of reward responsiveness among adolescents. It is still unknown if some of this racial and economic gap is attributed to weaker effects of parental education for African Americans, a pattern also called minorities' diminished returns (MDRs). (2) Aim: We compared non-Hispanic White and African American adolescents for the effects of parent education on adolescents RR, a psychological and cognitive construct that is closely associated with high-risk behaviors such as the use of drugs, alcohol, and tobacco. (3) Methods: This was a cross-sectional analysis that included 7072 adolescents from the adolescent brain cognitive development (ABCD) study. The independent variable was parent education. The main outcome as adolescents' RR measured by the behavioral inhibition system (BIS) and behavioral activation system (BAS) measure. (4) Results: In the overall sample, high parent education was associated with lower levels of RR. In the overall sample, we found a statistically significant interaction between race and parent education on adolescents' RR. The observed statistical interaction term suggested that high parent education is associated with a weaker effect on RR for African American than non-Hispanic White adolescents. In race-stratified models, high parent education was only associated with lower RR for non-Hispanic White but not African American adolescents. (5) Conclusion: Parent education reduces RR for non-Hispanic White but not African American adolescents. To minimize the racial gap in brain development and risk-taking behaviors, we need to address societal barriers that diminish the returns of parent education and resources in African American families. We need public and social policies that target structural and societal barriers, such as the unequal distribution of opportunities and resources. To meet such an aim, we need to reduce the negative effects of social stratification, segregation, racism, and discrimination in the daily lives of African American parents and families. Through an approach like this, African American families and parents can effectively mobilize their resources and utilize their human capital to secure the best possible tangible outcomes for their adolescents.

Increased Goal Tracking in Adolescent Rats Is Goal-Directed and Not Habit-Like

When a cue is paired with reward in a different location, some animals will approach the site of reward during the cue, a behavior called goal tracking, while other animals will approach and interact with the cue itself: a behavior called sign tracking. Sign tracking is thought to reflect a tendency to transfer incentive salience from the reward to the cue. Adolescence is a time of heightened sensitivity to rewards, including environmental cues that have been associated with rewards, which may account for increased impulsivity and vulnerability to drug abuse. Surprisingly, however, studies have shown that adolescents are actually less likely to interact with the cue (i.e., sign track) than adult animals. We reasoned that adolescents might show decreased sign tracking, accompanied by increased apparent goal tracking, because they tend to attribute incentive salience to a more reward-proximal "cue": the food magazine. On the other hand, adolescence is also a time of enhanced exploratory behavior, novelty-seeking, and behavioral flexibility. Therefore, adolescents might truly express more goal-directed reward-seeking and less inflexible habit-like approach to a reward-associated cue. Using a reward devaluation procedure to distinguish between these two hypotheses, we found that adolescents indeed exhibit more goal tracking, and less sign tracking, than a comparable group of adults. Moreover, adolescents' goal tracking behavior is highly sensitive to reward devaluation and therefore goal-directed and not habit-like.

The Abused Inhalant Toluene Impairs Medial Prefrontal Cortex Activity and Risk/Reward Decision-Making during a Probabilistic Discounting Task

Inhalant (e.g., toluene) misuse is linked to behavioral and cognitive deficits in humans, yet preclinical studies of the effect of inhalants on higher-order cognition are limited. We addressed this gap in the literature by examining the effect of toluene vapor exposure on risk/reward decision-making in male and female Sprague-Dawley rats using a probabilistic discounting task. In this task, rodents chose a risky/large reward or a safe/small reward, with the odds of risky reinforcement descending or ascending throughout the test session. We observed a dose-dependent, sex-independent deficit in behavioral flexibility during probabilistic discounting caused by acute toluene exposure. Rats exposed to toluene vapor during adolescence and tested as adults performed comparably to air-treated controls and were susceptible to the effects of an acute toluene challenge. These behavioral flexibility deficits observed suggests dysfunctional medial prefrontal cortex (mPFC) activity. To address this hypothesis, we virally expressed the genetically encoded calcium sensor GCaMP6f in glutamatergic mPFC neurons and monitored calcium transients in real-time using in vivo fiber photometry. mPFC activity peaked before either lever press during free-choice trials in toluene- and air-treated animals. During forced-choice trials, GCaMP6f transients shifted from pre-risky to pre-safe choice, an effect mitigated by acute toluene exposure. mPFC activity decreased during rewarded trials, with larger decreases following risky/large wins compared with safe/small wins. Toluene-treated animals also had decreased mPFC activity during rewarded trials, but there was no distinction between risky/large wins and safe/small wins. These results provide physiological evidence for mPFC-dependent behavioral deficits caused by toluene.SIGNIFICANCE STATEMENT Inhalants (e.g., toluene) are an understudied class of drugs of abuse that cause devastating behavioral and cognitive deficits in humans. Understanding the neurobiological interactions of toluene vapor using animal models is important for developing effective treatment strategies for inhalant addicts. Here we find that toluene vapor reduces behavioral flexibility in rodents making risk/reward-based decisions. The medial prefrontal cortex (mPFC) drives behavioral flexibility during this type of decision-making and we show that toluene reduces the ability of mPFC neurons to track optimal choices as reward probabilities change. Toluene also reduces these neurons' ability to distinguish between small and large rewards. A combination of these factors likely leads to the impaired performance in probabilistic discounting following acute toluene exposure.

Adolescent but not adult Sprague-Dawley rats display goal-directed responding after reward devaluation

Alcohol drinking is typically initiated in adolescence, with use sometimes escalating to problematic levels. Escalation of drinking is often associated with a shift in drinking motives, with goal-directed initial use later transitioning to more habitual behavior. This study assessed whether adolescents are more sensitive than adults to habit formation when indexed via insensitivity to reward devaluation in an operant task for food reward. Adolescent and adult Sprague-Dawley rats were trained on either a random ratio (RR) or random interval (RI) schedule before undergoing devaluation. Adolescent animals on both schedules increased the number of lever presses across all training days. In contrast, adults in the RR group increased the number of lever presses across days whereas RI adults remained relatively stable. In response to pellet devaluation, only adolescents exhibited reduced responding, suggestive of goal-directed behavior, whereas no age differences were evident following control (home cage chow) devaluation. Contrary to our hypothesis, adolescents (but not adults) displayed goal-directed responding indexed via sensitivity to reward devaluation. These findings suggest that adolescents are not necessarily more likely to develop habits than adults, and hence other factors may contribute to the greater propensity of adolescents to engage in and escalate alcohol use.

Impaired behavioural flexibility related to white matter microgliosis in the TgAPP21 rat model of Alzheimer disease

Executive dysfunction and white matter inflammation continue to be relatively understudied in rodent models of Alzheimer's disease (AD). Behavioural inflexibility is an important component of executive dysfunction that can be further categorized as perseverative or regressive, which respectively specify whether maladaptive persistence occurs early or late during a behavioural change. Previous studies of the TgAPP21 rat model of AD (expressing pathogenic hAPP) suggested a potentially spontaneous increase of regressive behavioral inflexibility. In this study, 7-8-month-old male TgAPP21 rats were tested for behavioral flexibility, learning, and memory using an operant conditioning chamber and the Morris Water Maze (MWM). TgAPP21 rats demonstrated a regressive behavioral inflexibility during set shifting in an operant conditioning chamber (regressive errors η² = 0.32 and number of errors after criterion η² = 0.33). Regressive behavior was also demonstrated in the MWM probe test, wherein TgAPP21 rats significantly increased their swim time in the target quadrant during the last third of the probe test (43% vs 33% in the first 2 thirds of the probe test or the Wt rats' 29%-32%); this behavioral phenotype has not been previously described in the MWM. TgAPP21 demonstrated further impairment of behavioural inflexibility as they committed a greater number of reversal errors in the operant conditioning chamber (η² = 0.30). Diffuse microglia activation was increased in the white matter tracts of TgAPP21 (corpus callosum, cingulum, and internal capsule; η² = 0.59-0.62), which was found to correlate with the number of reversal errors in the operant conditioning chamber (R² = 0.42). As TgAPP21 rats do not spontaneously develop amyloid plaques but have been shown in previous studies to be vulnerable to the development of plaques, these rats demonstrate an important onset of cognitive change and inflammation in the pre-plaque phase of AD. TgAPP21 rats are also an instrumental model for studying the role and mechanism of white matter microglial activation in executive functioning. This is pertinent to clinical research of prodromal AD which has suggested that white matter inflammation may underlie impairment of executive functions such as behavioral flexibility.

Sex differences in adolescent ethanol drinking to behavioral intoxication

Rodent models have been especially useful for investigating adolescent ethanol exposure. However, there is a paucity of studies examining sex differences in behavioral intoxication from adolescent ethanol drinking. Here, we used an ethanol drinking model to investigate if adolescent rats of both sexes readily drink ethanol to measurable behavioral intoxication, indicated by increased impulsive action and motor incoordination. Beginning on postnatal day (P) 28, male and female Long-Evans rats were given 30-min access to a solution of sucrose (20%) or sweetened ethanol (20% sucrose +15% ethanol) every other day until P60 and once after 2 weeks of forced abstinence (on P75). On alternate (nondrinking) days, rats were reinforced with a food pellet for making a cued nosepoke response. Beginning on P56, rats were tested in this task after drinking sessions to assess ethanol-induced changes in impulsive action, defined as premature responding prior to cue presentation. Motor coordination was assessed before and after drinking sessions using an incline plane test. Adolescent male and female rats readily consumed ethanol to behavioral intoxication, measured as reduced motor coordination. Following forced abstinence, females displayed greater ethanol-induced impulsive action. These studies provide evidence for sex differences in behavioral intoxication following adolescent ethanol drinking.

Age- and sex-dependent effects of methamphetamine on cognitive flexibility and 5-HT2C receptor localization in the orbitofrontal cortex of Sprague-Dawley rats

Adolescents and females experience worse outcomes of drug use compared to adults and males. This could result from age- and sex-specific consequences of drug exposure on brain function and cognitive behavior. In the current study, we examined whether a history of intravenous methamphetamine (METH) self-administration impacted cognitive flexibility and 5-HT_2CR localization in the orbitofrontal cortex (OFC) in an age- and sex-dependent manner. Strategy shifting was assessed in male and female Sprague-Dawley rats that had self-administered METH (0.08 mg/kg/inf) or received non-contingent infusions of saline during periadolescence or young adulthood. After all rats reached adulthood, they were tested in an operant strategy shifting task and their brains were subsequently analyzed using immunofluorescence to quantify co-localization of 5-HT_2C receptors with parvalbumin interneurons in the OFC. We found that adolescent-onset females were the only group impaired during discrimination and reversal learning, but they did not exhibit changes in localization of 5-HT_2C receptors. In contrast, adult-onset males exhibited a significant increase in co-localization of 5-HT_2C receptors within parvalbumin interneurons in the left hemisphere of the OFC. These studies reveal that age and sex differences in drug-induced deficits in reversal learning and 5-HT_2CR co-localization with parvalbumin interneurons are dissociable and can manifest independently. In addition, these data highlight the potential for certain treatment approaches to be more suitable in some populations compared to others, such as alleviating drug-induced cognitive deficits as a focus for treatment in adolescent females.