Chronic cocaine exposure in adolescence: Effects on spatial discrimination reversal, delay discounting, and performance on fixed-ratio schedules in mice

Relationship between two forms of impulsivity in mice at baseline and under acute and sub-chronic atomoxetine treatment

RATIONALE

Impulsivity is a symptom of various mental disorders, including attention deficit hyperactivity disorder (ADHD), bipolar disorder, and addiction. Impulsivity is not a unitary construct, but is present in different forms, yet only a few rodent studies have explored the relationship between these forms within individual subjects.

OBJECTIVES

In this study, we compared behaviors representing two impulsivity forms, delay discounting (choice impulsivity) and premature responding (waiting impulsivity), within the same mice.

METHODS

C57BL/6J male mice were concurrently trained and tested in the delay discounting task and the rodent continuous performance test in a counterbalanced design. The effects of the ADHD medication atomoxetine were tested in both tasks, after both acute (0.3-5.0 mg/kg) and sub-chronic (0.3 mg/kg twice daily for seven days) administration.

RESULTS

There was no correlation between the two impulsivity forms at baseline. Acute atomoxetine treatment (1, 3, and 5 mg/kg) significantly reduced premature responding. Furthermore, sub-chronic treatment with 0.3 mg/kg of atomoxetine caused a stable decrease in premature responding. Atomoxetine had no significant effect on delay discounting after acute or sub-chronic administration, although the acute administration of 1 mg/kg showed a trend towards increasing delay discounting.

CONCLUSIONS

The present results support that delay discounting and premature responding represent two different forms of impulsivity that show dissimilar responses to atomoxetine treatment. The consistency with findings in humans lends support to the translatability of the results in mice.

Theory of reinforcement schedules

The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the "contingencies of reinforcement." Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.

Reward prediction error in learning-related behaviors

Learning is a complex process, during which our opinions and decisions are easily changed due to unexpected information. But the neural mechanism underlying revision and correction during the learning process remains unclear. For decades, prediction error has been regarded as the core of changes to perception in learning, even driving the learning progress. In this article, we reviewed the concept of reward prediction error, and the encoding mechanism of dopaminergic neurons and the related neural circuities. We also discussed the relationship between reward prediction error and learning-related behaviors, including reversal learning. We then demonstrated the evidence of reward prediction error signals in several neurological diseases, including Parkinson's disease and addiction. These observations may help to better understand the regulatory mechanism of reward prediction error in learning-related behaviors.

Cognitive Flexibility in Mice: Effects of Puberty and Role of NMDA Receptor Subunits

Cognitive flexibility refers to the ability to adapt flexibly to changing circumstances. In laboratory mice, we investigated whether cognitive flexibility is higher in pubertal mice than in adult mice, and whether this difference is related to the expression of distinct NMDA receptor subunits. Using the attentional set shifting task as a measure of cognitive flexibility, we found that cognitive flexibility was increased during puberty. This difference was more pronounced in female pubertal mice. Further, the GluN2A subunit of the NMDA receptor was more expressed during puberty than after puberty. Pharmacological blockade of GluN2A reduced the cognitive flexibility of pubertal mice to adult levels. In adult mice, the expression of GluN2A, GluN2B, and GluN2C in the orbitofrontal cortex correlated positively with performance in the attentional set shifting task, whereas in pubertal mice this was only the case for GluN2C. In conclusion, the present study confirms the observation in humans that cognitive flexibility is higher during puberty than in adulthood. Future studies should investigate whether NMDA receptor subunit-specific agonists are able to rescue deficient cognitive flexibility, and whether they have the potential to be used in human diseases with deficits in cognitive flexibility.

Impacts of Neonatal Methylmercury on Behavioral Flexibility and Learning in Spatial Discrimination Reversal and Visual Signal Detection Tasks

Early postnatal development in rodents is sensitive to neurotoxic effects of the environmental contaminant, methylmercury. While juvenile and adolescent exposure also produce long-term impairments in behavior, the outcome of neonatal exposure is less understood. Neural development during the neonatal period in rodents is akin to that seen in humans during the third trimester of pregnancy but methylmercury exposure occurring during the neonatal period has not been modeled, partly because breast milk is a poor source of bioavailable methylmercury. To examine this developmental period, male Long-Evans rats were exposed to 0, 80, or 350µg/kg/day methylmercuric chloride from postnatal days 1 to 10, the rodent neonatal period. As adults, behavioral flexibility, attention, memory, and expression of the dopamine transporter in these rats was assessed. Rats exhibited changes in behavioral flexibility assessed in a spatial discrimination reversal procedure. Those rats exposed to the highest dose of methylmercury displayed subtly altered patterns of perseveration compared to control animals. During acquisition of the attention/memory procedure, rats exposed to this dose also had slower acquisition, and achieved lower overall accuracy during training, compared to controls despite neither attention nor memory being affected once the task was acquired. Finally, dopamine transporter expression in the striatum, prefrontal cortex, and hippocampus was unchanged in these adult rats. The results of this study replicate the trend of findings seen with exposure during gestation or during adolescence.

HIV Tat and cocaine interactively alter genome-wide DNA methylation and gene expression and exacerbate learning and memory impairments

Cocaine use is a major comorbidity of HIV-associated neurocognitive disorder (HAND). In this study, we show that cocaine exposure worsens the learning and memory of doxycycline-inducible and brain-specific HIV Tat transgenic mice (iTat) and results in 14,838 hypermethylated CpG-related differentially methylated regions (DMRs) and 15,800 hypomethylated CpG-related DMRs, which are linked to 52 down- and 127 upregulated genes, respectively, in the hippocampus of iTat mice. These genes are mostly enriched at the neuronal function-, cell morphology-, and synapse formation-related extracellular matrix (ECM) receptor-ligand interaction pathway and mostly impacted in microglia. The accompanying neuropathological changes include swollen dendritic spines, increased synaptophysin expression, and diminished glial activation. We also find that sex (female) and age additively worsen the behavioral and pathological changes. These findings together indicate that chronic cocaine and long-term Tat expression interactively contribute to HAND, likely involving changes of DNA methylation and ECM receptor-ligand interactions.

Adolescence as a sensitive period for neurotoxicity: Lifespan developmental effects of methylmercury

Neurotoxicity resulting from the environmental contaminant, methylmercury (MeHg), is a source of concern for many human populations that rely heavily on the consumption of fish and rice as stable ingredients in the diet. The developmental period of exposure is important both to the qualitative effects of MeHg and to the dose required to produce those effects. MeHg exposure during the sensitive prenatal period causes deleterious and long-lasting changes in neurodevelopment at particularly low doses. The effects include a wide host of cognitive and behavioral outcomes expressed in adulthood and sometimes not until aging. However, neurotoxic outcomes of methylmercury when exposure occurs during adolescence are only recently revealing impacts on human populations and animal models. This review examines the current body of work and showcases the sensitivity of adolescence, a period that straddles early development and adulthood, to methylmercury neurotoxicity and the implications such toxicity has in our understanding of methylmercury's effects in human populations and animal models.

The effects of cocaine exposure in adolescence: Behavioural effects and neuroplastic mechanisms in experimental models

Drug addiction is a devastating disorder with a huge economic and social burden for modern society. Although an individual may slip into drug abuse throughout his/her life, adolescents are at higher risk, but, so far, only a few studies have attempted to elucidate the underlying cellular and molecular bases of such vulnerability. Indeed, preclinical evidence indicates that psychostimulants and adolescence interact and contribute to promoting a dysfunctional brain. In this review, we have focused our attention primarily on changes in neuroplasticity brought about by cocaine, taking into account that there is much less evidence from exposure to cocaine in adolescence, compared with that from adults. This review clearly shows that exposure to cocaine during adolescence, acute or chronic, as well as contingent or non‐contingent, confers a vulnerable endophenotype, primarily, by causing changes in neuroplasticity. Given the close relationship between drug abuse and psychiatric disorders, we also discuss the translational implications providing an interpretative framework for clinical studies involving addictive as well as affective or psychotic behaviours.

Neurobehavioral changes arising from early life dopamine signaling perturbations

Dopamine (DA) signaling is critical to the modulation of multiple brain functions including locomotion, reinforcement, attention and cognition. The literature provides strong evidence that altered DA availability and actions can impact normal neurodevelopment, with both early and enduring consequences on anatomy, physiology and behavior. An appreciation for the developmental contributions of DA signaling to brain development is needed to guide efforts to preclude and remedy neurobehavioral disorders, such as attention-deficit/hyperactivity disorder, addiction, bipolar disorder, schizophrenia and autism spectrum disorder, each of which exhibits links to DA via genetic, cellular and/or pharmacological findings. In this review, we highlight research pursued in preclinical models that use genetic and pharmacological approaches to manipulate DA signaling at sensitive developmental stages, leading to changes at molecular, circuit and/or behavioral levels. We discuss how these alterations can be aligned with traits displayed by neuropsychiatric diseases. Lastly, we review human studies that evaluate contributions of developmental perturbations of DA systems to increased risk for neuropsychiatric disorders.

Adolescent drug exposure: A review of evidence for the development of persistent changes in brain function

Over the past decade, many studies have indicated that adolescence is a critical period of brain development and maturation. The refinement and maturation of the central nervous system over this prolonged period, however, makes the adolescent brain highly susceptible to perturbations from acute and chronic drug exposure. Here we review the preclinical literature addressing the long-term consequences of adolescent exposure to common recreational drugs and drugs-of-abuse. These studies on adolescent exposure to alcohol, nicotine, opioids, cannabinoids and psychostimulant drugs, such as cocaine and amphetamine, reveal a variety of long-lasting behavioral and neurobiological consequences. These agents can affect development of the prefrontal cortex and mesolimbic dopamine pathways and modify the reward systems, socio-emotional processing and cognition. Other consequences include disruption in working memory, anxiety disorders and an increased risk of subsequent drug abuse in adult life. Although preventive and control policies are a valuable approach to reduce the detrimental effects of drugs-of-abuse on the adolescent brain, a more profound understanding of their neurobiological impact can lead to improved strategies for the treatment and attenuation of the detrimental neuropsychiatric sequelae.

d-Amphetamine and methylmercury exposure during adolescence alters sensitivity to monoamine uptake inhibitors in adult mice

Gestational exposure to methylmercury (MeHg), an environmental neurotoxicant, and adolescent administration of d-amphetamine (d-AMP) disrupt dopamine neurotransmission and alter voluntary behavior in adult rodents. We determined the impact of adolescent exposure to MeHg and d-AMP on monoamine neurotransmission in mice by assessing sensitivity to acute d-AMP, desipramine, and clomipramine, drugs that target dopamine, norepinephrine, and serotonin reuptake, respectively. Male C57Bl/6n mice were given 0 (control) or 3 ppm MeHg via drinking water from postnatal day 21 to 60 (murine adolescence). Within each group, mice were given once-daily injections of d-AMP or saline (i.p.) from postnatal day 28 to 42. This exposure regimen produced four treatment groups (n = 10-12/group): control, d-AMP, MeHg, and d-AMP + MeHg. As adults, the mice lever pressed under fixed-ratio schedules of reinforcement (FR 1, 5, 15, 30, 60, and 120). Acute i.p. injections of d-AMP (.3-1.7 mg/kg), desipramine (5.6-30 mg/kg), and clomipramine (5.6-30 mg/kg) were administered in adulthood after a stable behavioral baseline was established. Adolescent MeHg exposure increased saturation rate and minimum response time, an effect that was mitigated by chronic administration of d-AMP in adolescence. In unexposed mice, the three monoamine reuptake inhibitors had separable behavioral effects. Adolescent d-AMP increased sensitivity to acute d-AMP, desipramine, and clomipramine. Adolescent MeHg exposure alone did not alter drug sensitivity. Combined adolescent d-AMP + MeHg exposure enhanced sensitivity to acute d-AMP's and desipramine's effects on minimum response time. Adolescence is a vulnerable developmental period during which exposure to chemicals can have lasting effects on monoamine function and behavior.

Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making

Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.

Adolescent methylmercury exposure: Behavioral mechanisms and effects of sodium butyrate in mice

Methylmercury (MeHg), an environmental neurotoxicant primarily found in fish, produces neurobehavioral impairment when exposure occurs during gestation. Whether other developmental periods, such as adolescence, display enhanced vulnerability to the behavioral effects of MeHg exposure is only beginning to be explored. Further, little is known about the effects of repeated administration of lysine deacetylase inhibitors, such as sodium butyrate (NaB), on operant behavior. In Experiment 1, male C57BL6/n mice were exposed to 0, 0.3, and 3.0 ppm MeHg (n = 12 each) via drinking water from postnatal days 21 to 60 (murine adolescence). As adults, mice were trained to lever press under an ascending series of fixed-ratio schedules of milk reinforcement selected to enable the analysis of three important parameters of operant behavior using the framework provided by Mathematical Principles of Reinforcement. Adolescent MeHg exposure dose-dependently increased saturation rate, a measure of the retroactive reach of a reinforcer, and decreased minimum response time relative to controls. In Experiment 2, the behavioral effects of repeated NaB administration both alone and following adolescent MeHg exposure were examined. Male C57BL6/n mice were given either 0 or 3.0 ppm MeHg during adolescence and, before behavioral testing, two weeks of once daily i.p. injections of saline or 0.6 g/kg NaB (n = 12 in each cell). Adolescent MeHg exposure again increased saturation rate but did not significantly alter minimum response time. NaB also increased saturation rate in both MeHg exposure groups. These data suggest that the behavioral mechanisms of adolescent MeHg exposure and NaB may be related to the impact of reinforcement on prior responses. Specifically, MeHg and NaB concentrated the effects of reinforcers onto the most recent responses.

Cocaine impairs serial-feature negative learning and blood-brain barrier integrity

Previous research has shown that diets high in fat and sugar [a.k.a., Western diets (WD)] can impair performance of rats on hippocampal-dependent learning and memory problems, an effect that is accompanied by selective increases in hippocampal blood brain barrier (BBB) permeability. Based on these types of findings, it has been proposed that overeating of a WD (and its resulting obesity) may be, in part, a consequence of impairments in these anatomical substrates and cognitive processes. Given that drug use (and addiction) represents another behavioral excess, the present experiments assessed if similar outcomes might occur with drug exposure by evaluating the effects of cocaine administration on hippocampal-dependent memory and on the integrity of the BBB. Experiment 1 of the present series of studies found that systemic cocaine administration in rats also appears to have disruptive effects on the same hippocampal-dependent learning and memory mechanism that has been proposed to underlie the inhibition of food intake. Experiment 2 demonstrated that the same regimen of cocaine exposure that produced disruptions in learning and memory in Experiment 1 also produced increased BBB permeability in the hippocampus, but not in the striatum. Although the predominant focus of previous research investigating the etiologies of substance use and abuse has been on the brain circuits that underlie the motivational properties of drugs, the current investigation implicates the possible involvement of hippocampal memory systems in such behaviors. It is important to note that these positions are not mutually exclusive and that neuroadaptations in these two circuits might occur in parallel that generate dysregulated drug use in a manner similar to that of excessive eating.

Effects of adolescent exposure to methylmercury and d-amphetamine on reversal learning and an extradimensional shift in male mice

Adolescence is associated with the continued maturation of dopamine neurotransmission and is implicated in the etiology of many psychiatric illnesses. Adolescent exposure to neurotoxicants that distort dopamine neurotransmission, such as methylmercury (MeHg), may modify the effects of chronic d-amphetamine (d-AMP) administration on reversal learning and attentional-set shifting. Male C57Bl/6n mice were randomly assigned to two MeHg-exposure groups (0 ppm and 3 ppm) and two d-AMP-exposure groups (saline and 1 mg/kg/day), producing four treatment groups (n = 10-12/group): control, MeHg, d-AMP, and MeHg + d-AMP. MeHg exposure (via drinking water) spanned postnatal days 21-59 (the murine adolescent period), and once daily intraperitoneal injections of d-AMP or saline spanned postnatal days 28-42. As adults, mice were trained on a spatial-discrimination-reversal (SDR) task in which the spatial location of a lever press predicted reinforcement. Following 2 SDRs, a visual-discrimination task (extradimensional shift) was instated in which the presence of a stimulus light above a lever predicted reinforcement. Responding was modeled using a logistic function, which estimated the rate (slope) of a behavioral transition and trials required to complete half a transition (half-max). MeHg, d-AMP, and MeHg + d-AMP exposure increased estimates of half-max on the second reversal. MeHg exposure increased half-max and decreased the slope term following the extradimensional shift, but these effects did not occur following MeHg + d-AMP exposure. MeHg + d-AMP exposure produced more perseverative errors and omissions following a reversal. Adolescent exposure to MeHg can modify the behavioral effects of chronic d-AMP administration. (PsycINFO Database Record

Adolescent methylmercury exposure affects choice and delay discounting in mice

The developing fetus is vulnerable to low-level exposure to methylmercury (MeHg), an environmental neurotoxicant, but the consequences of exposure during the adolescent period remain virtually unknown. The current experiments were designed to assess the effects of low-level MeHg exposure during adolescence on delay discounting, preference for small, immediate reinforcers over large, delayed ones, using a mouse model. Thirty-six male C57BL/6n mice were exposed to 0, 0.3, or 3.0ppm mercury (as MeHg) via drinking water from postnatal day 21 through 59, encompassing the murine adolescent period. As adults, mice lever pressed for a 0.01-cc droplet of milk solution delivered immediately or four 0.01-cc droplets delivered after a delay. Delays ranged from 1.26 to 70.79s, and all were presented within a session. A model based on the Generalized Matching Law indicated that sensitivity to reinforcer magnitude was lower for MeHg-exposed mice relative to controls, indicating that responding in MeHg-exposed mice was relatively indifferent to the larger reinforcer. Sensitivity to reinforcer delay was reduced (delay discounting was decreased) in the 0.3-ppm group, but not in the 3.0-ppm group, compared to controls. Adolescence is a developmental period during which the brain and behavior may be vulnerable to MeHg exposure. As with gestational MeHg exposure, the effects are reflected in the impact of reinforcing stimuli.